-- Logs begin at Thu 2022-05-19 18:37:42 UTC, end at Thu 2022-05-19 21:08:09 UTC. -- May 19 19:41:14.216476 dv-cinder-841302-4-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 19:41:14.224328 dv-cinder-841302-4-smb devstack@keystone.service[92077]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 19:41:14.226297 dv-cinder-841302-4-smb devstack@keystone.service[92077]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 19:41:14 2022] *** May 19 19:41:14.226297 dv-cinder-841302-4-smb devstack@keystone.service[92077]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 19:41:14.226297 dv-cinder-841302-4-smb devstack@keystone.service[92077]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 19:41:14.226297 dv-cinder-841302-4-smb devstack@keystone.service[92077]: nodename: dv-cinder-841302-4-smb May 19 19:41:14.226297 dv-cinder-841302-4-smb devstack@keystone.service[92077]: machine: x86_64 May 19 19:41:14.226297 dv-cinder-841302-4-smb devstack@keystone.service[92077]: clock source: unix May 19 19:41:14.226297 dv-cinder-841302-4-smb devstack@keystone.service[92077]: pcre jit disabled May 19 19:41:14.226297 dv-cinder-841302-4-smb devstack@keystone.service[92077]: detected number of CPU cores: 4 May 19 19:41:14.226863 dv-cinder-841302-4-smb devstack@keystone.service[92077]: current working directory: / May 19 19:41:14.226863 dv-cinder-841302-4-smb devstack@keystone.service[92077]: detected binary path: /usr/bin/uwsgi-core May 19 19:41:14.226863 dv-cinder-841302-4-smb devstack@keystone.service[92077]: your processes number limit is 47680 May 19 19:41:14.226863 dv-cinder-841302-4-smb devstack@keystone.service[92077]: your memory page size is 4096 bytes May 19 19:41:14.226863 dv-cinder-841302-4-smb devstack@keystone.service[92077]: detected max file descriptor number: 2048 May 19 19:41:14.226863 dv-cinder-841302-4-smb devstack@keystone.service[92077]: lock engine: pthread robust mutexes May 19 19:41:14.226863 dv-cinder-841302-4-smb devstack@keystone.service[92077]: thunder lock: enabled May 19 19:41:14.227762 dv-cinder-841302-4-smb devstack@keystone.service[92077]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 19:41:14.227873 dv-cinder-841302-4-smb devstack@keystone.service[92077]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 19:41:14.272053 dv-cinder-841302-4-smb devstack@keystone.service[92077]: Python main interpreter initialized at 0x564b8d4979c0 May 19 19:41:14.272053 dv-cinder-841302-4-smb devstack@keystone.service[92077]: python threads support enabled May 19 19:41:14.272053 dv-cinder-841302-4-smb devstack@keystone.service[92077]: your server socket listen backlog is limited to 100 connections May 19 19:41:14.272053 dv-cinder-841302-4-smb devstack@keystone.service[92077]: your mercy for graceful operations on workers is 90 seconds May 19 19:41:14.272584 dv-cinder-841302-4-smb devstack@keystone.service[92077]: mapped 403077 bytes (393 KB) for 2 cores May 19 19:41:14.272584 dv-cinder-841302-4-smb devstack@keystone.service[92077]: *** Operational MODE: preforking *** May 19 19:41:14.272754 dv-cinder-841302-4-smb devstack@keystone.service[92077]: *** uWSGI is running in multiple interpreter mode *** May 19 19:41:14.272754 dv-cinder-841302-4-smb devstack@keystone.service[92077]: spawned uWSGI master process (pid: 92077) May 19 19:41:14.272971 dv-cinder-841302-4-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 19:41:14.275077 dv-cinder-841302-4-smb devstack@keystone.service[92077]: spawned uWSGI worker 1 (pid: 92088, cores: 1) May 19 19:41:14.275077 dv-cinder-841302-4-smb devstack@keystone.service[92077]: spawned uWSGI worker 2 (pid: 92089, cores: 1) May 19 19:41:14.275077 dv-cinder-841302-4-smb devstack@keystone.service[92077]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 19:41:19.991550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:41:19.991550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: from cryptography.utils import int_from_bytes May 19 19:41:19.992328 dv-cinder-841302-4-smb devstack@keystone.service[92088]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:41:19.992328 dv-cinder-841302-4-smb devstack@keystone.service[92088]: from cryptography.utils import int_from_bytes May 19 19:41:19.992453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:41:19.992453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: from cryptography.utils import int_from_bytes May 19 19:41:19.992864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:41:19.992864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: from cryptography.utils import int_from_bytes May 19 19:41:20.042122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 19:41:20.042295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 19:41:20.042481 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] command line args: [] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 19:41:20.042577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 19:41:20.042767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 19:41:20.042867 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 19:41:20.042942 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ================================================================================ {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 19:41:20.043021 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] command line args: [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 19:41:20.043173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] admin_token = **** {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.043253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 19:41:20.043383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ================================================================================ {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 19:41:20.043467 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] config_dir = [] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.043583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.043673 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] admin_token = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.043746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] config_source = [] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.043871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] config_dir = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.043951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] debug = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.044058 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.044147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.044348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] config_source = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.044412 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] debug = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.044469 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.044604 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.044743 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.044858 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.044961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.045063 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.045165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.045266 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.045380 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] list_limit = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.045483 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.045579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] log_config_append = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.045680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.045779 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.045887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] log_dir = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.045996 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_config_append = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.046099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] log_file = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.046210 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.046307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.046408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_dir = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.046408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_file = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.046598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.046696 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.046813 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.046899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.046978 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.047105 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.047190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.047268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.047387 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.047470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.047543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.047670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.047746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.047862 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.047938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.048058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.048139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.048262 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.048336 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.048452 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.048527 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.048695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.048783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.048923 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.049027 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.049171 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.049252 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.049442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.049685 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.049769 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.049892 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] publish_errors = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.050079 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.050195 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.050310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.050393 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] publish_errors = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.050485 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.050596 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.050759 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.050848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.050991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.051089 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.051237 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] standard_threads = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.051312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.051438 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.051517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.051677 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.051760 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] standard_threads = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.051843 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.051916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.052011 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] use_journal = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.052208 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.052305 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] use_json = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.052384 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.052464 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] use_stderr = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.052536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] use_journal = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.052612 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] use_syslog = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.052683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] use_json = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.052754 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.052829 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] use_stderr = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.052953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.053033 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] use_syslog = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.053181 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:41:20.053259 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.053436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.053523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.053672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.053757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.053917 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.053998 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.054149 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.054227 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.054396 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.054480 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.054645 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.054726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.054894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.054981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.055130 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.055214 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.055376 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.055459 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.055608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.055686 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.055849 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.055928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.056081 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.056159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.056325 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.056411 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.056559 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.056639 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.056786 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.056863 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.057030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.057115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.057268 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.057353 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.057506 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.057583 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.057738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.057824 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.057987 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.058065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.058220 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.058296 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.058475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.058835 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.059010 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.059101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.059238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.059316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.059465 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.059550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.059693 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.059771 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.059924 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.060002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.060161 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.060250 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.060397 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.060475 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.060621 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.060698 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.060849 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.060935 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.061090 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.061168 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.061323 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.061399 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.061552 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.061636 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.061795 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.061903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.062026 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.062133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.062260 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.062374 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.062504 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.062632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.062738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.062846 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.062964 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.063054 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.063158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.063237 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.063385 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.063462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.063613 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.063702 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.063847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.063934 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.064070 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.064157 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.064302 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.064432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.064510 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.064635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.064744 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.065394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.065516 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.065592 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.065718 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.065794 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.065943 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.066027 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.066175 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.066266 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.066407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.066487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.066711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.066808 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.066884 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.067004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.067090 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.067164 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.067321 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.067403 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.067561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.067650 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.067789 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.067867 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.068022 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.068102 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.068247 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.068334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.068482 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.068561 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.068715 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.068868 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.068943 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.069067 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.069193 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.069277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.069379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.069458 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.069641 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.069718 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.069874 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.069951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.070120 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.070200 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.070361 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.070438 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.070592 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.070697 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.070854 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.070933 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.071086 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.071166 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.071318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.071444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.071551 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.071629 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.071782 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.071867 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.072018 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.072108 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.072246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.072324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.072477 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.072562 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.072706 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.072800 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.072938 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.073015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.073166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.073244 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.073399 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.073485 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.073633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.073711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.073869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.073946 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.074101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.074189 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.074338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.074417 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.074570 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.074669 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.074826 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.074918 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.075057 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.075135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.075282 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.075360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.075508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.075595 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.075735 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.075846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.075964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.076081 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.076194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.076310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.076428 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.076548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.076657 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.076782 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.076895 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.077027 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.077112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.077259 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.077375 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.077512 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.077612 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.077769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.077975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.078054 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.078221 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] auth.external = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.078298 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.078451 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.078538 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.078711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.external = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.078792 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.078946 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.079060 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.079202 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] auth.password = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.079282 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.079430 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] auth.token = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.079517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.079665 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.079744 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.password = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.079944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.080034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.token = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.080137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.080225 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.080367 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.080445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.081173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.081265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.081409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.081498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.081634 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.081721 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.081865 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] credential.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.081945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.082107 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.082198 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.082342 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.082421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.082584 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.082694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.082842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.082999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.083076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.083206 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.083288 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.083361 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.083546 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.083634 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.083779 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.083857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.084014 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.084101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.084263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.084344 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.084512 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.084589 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.084767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.084846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.085024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.085102 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.085261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.085340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.085511 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.085590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.085741 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] federation.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.085821 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.085974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.086058 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.086213 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.086292 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.086449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.086528 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.086697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.086788 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.086942 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.087023 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.087174 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.087253 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.087419 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.087497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.087650 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.087728 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.087901 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.087982 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.088133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.088214 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.088370 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.088447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.088601 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.088680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.088844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.088922 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.089078 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.089157 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.089306 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.089384 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.089536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.089614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.089776 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.089855 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.090003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.090083 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.090235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.090314 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.090462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.090540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.090720 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.090804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.090953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.091030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.091180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.091259 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.091408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.091490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.091639 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.091718 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.091869 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.091947 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.092108 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.092188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.092354 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.092432 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.092593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.092671 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.092849 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.092929 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.093076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.093154 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.093307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.093394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.093533 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.093613 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.093763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.093841 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.093988 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.094074 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.094218 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.094297 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.094451 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.094530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.094708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.094802 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.094948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.095028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.095172 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.095250 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.095415 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.095503 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.095644 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.095728 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.095873 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.095951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.096151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.096245 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.096396 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.096475 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.096618 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.096696 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.096850 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.096936 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.097076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.097155 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.097308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.097387 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.097539 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.097630 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.097775 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.097853 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.098003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.098081 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.098235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.098323 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.098469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.098547 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.098728 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.098809 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.098954 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.099051 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.099180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.099259 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.099423 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.099503 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.099650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.099737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.099884 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.099962 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.100114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.100193 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.100349 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.100436 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.100576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.100655 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.100807 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.100881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.101036 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.101128 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.101272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.101351 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.101515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.101596 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.101755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.101843 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.101994 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.102075 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.102223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.102302 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.102447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.102535 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.102702 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.102783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.102933 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.103012 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.103162 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.103253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.103387 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.103466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.103622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.103700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.103853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.103940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.104090 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.104168 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.104329 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.104407 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.104569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.104658 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.104793 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.104872 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.105031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.105110 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.105258 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.105412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.105488 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.105559 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.105700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.105781 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.105928 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.106016 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.106167 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.106245 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.106397 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.106475 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.106641 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.106736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.106894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.106974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.107119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.107198 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.107359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.107438 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.107590 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.107668 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.107820 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.107899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.108053 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.108132 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.108288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.108367 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.108521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.108598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.108750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.108830 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.108981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.109060 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.109211 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.109289 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] resource.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.109448 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.109539 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.109687 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.109773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.109917 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.109995 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.110162 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.110242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.110393 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.110471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.110655 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.110737 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.110898 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.110979 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.111129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.111208 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.111363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.111442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.111593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] role.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.111673 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.111859 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.111937 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] role.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.112083 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.112161 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] role.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.112362 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.112445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] role.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.112591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.112670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.112839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.112916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.113083 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.113164 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.113325 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.113404 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.113565 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.113644 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.113806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.113887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.114048 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.114126 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.114275 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.114354 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.114516 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.114596 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.114769 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.114849 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.115014 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.115092 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.115256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.115328 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.115501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.115642 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.115747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.115874 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.116119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.116198 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.116362 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.116436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.116604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.116690 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.116848 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.116927 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.117077 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.117156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.117325 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.117413 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.117557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.117635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.117792 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.117869 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.118018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.118106 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.118246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.118326 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.118473 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.118552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.118730 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.118825 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.118965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.119044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.119206 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.119284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.119438 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.119531 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.119670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.119749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.119896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.119974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.120127 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] token.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.120215 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.120363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.120443 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.120596 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.120673 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.120824 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.120910 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.121070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.121149 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.121305 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.121384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.121533 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.121619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.121770 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.121848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.122007 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.122085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.122248 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.122331 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.122476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.122544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.122730 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.122811 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.122961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.123053 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.123202 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.123280 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.123432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.123510 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.123653 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.123739 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.123890 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.123969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.124128 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.124205 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.124370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.124457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.connection = **** {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.124647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.124735 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.124889 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.124969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.connection = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.125119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.125203 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.125344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.125432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.125572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.125659 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.125802 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.125881 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.126031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.126119 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.126260 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.126339 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.126492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.126569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.126744 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.126838 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.126983 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.127063 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.127211 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.127290 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.127963 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.128053 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.128193 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.128272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.128433 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.128512 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.128659 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.128747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.128895 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.128974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.129122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.129200 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.129272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 19:41:20.129352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.129579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:41:20.129747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 19:41:20.158725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.158953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.159174 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.160497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.160731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.160958 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.169050 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.169623 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.198452 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.198691 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.198785 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.198956 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.252100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.258773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.304091 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.304326 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.305437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.305672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.370436 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.370687 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.370913 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.370998 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.371132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.371235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.371349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.371431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.371562 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.371643 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.371807 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.372017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.395717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.395825 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.395992 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.396103 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.396181 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.396256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.396386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.396470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.396603 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.396693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.396811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.396892 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.397017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.397099 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.408301 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.408400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.421438 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.421659 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.421872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.422083 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.422296 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.422502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.422737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92089) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.423499 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.423736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.423955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.424171 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.424411 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.424622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.424834 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:41:20.439783 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.440014 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:41:20.440097 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.440296 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:41:20.440377 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.440525 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:41:20.440632 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.440786 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.440867 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:41:20.441039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.441120 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.441291 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.441373 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.441542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.441621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.441808 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.452837 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.453114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.453380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.453657 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.454159 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.454433 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.454723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.455002 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.462315 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.463581 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.465616 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.465896 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.466175 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.466564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.466840 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.466925 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.467113 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.467197 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.467381 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.467463 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.467654 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.467759 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.467924 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.468035 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.468194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.468275 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.468461 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.468551 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.468800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.469066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.469335 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.469602 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.495736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.496323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.497379 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.497658 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.497918 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.498192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.503113 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.503344 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.503452 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.503628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.503719 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.503980 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.511011 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.511292 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.511380 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.511608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.515916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.516186 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.516270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.516471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.516563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.516745 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.516919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.517000 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.517074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.517276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.517360 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.517541 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.517624 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.517807 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.517891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.518621 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.537718 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.538009 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.542556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.542777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.543076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.546198 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.546493 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.547628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.551286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.551510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.551593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.555131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.556554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.559299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.559598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.559884 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.560174 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.560401 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.560485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.560723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.564177 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.564474 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.564751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.565625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.565898 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.566179 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.580165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.581075 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.581354 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.581618 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.585665 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.586039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.586310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.586571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.589547 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.591303 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.591580 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.594425 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.594643 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.594932 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.595219 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.595501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.595777 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.596168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.596436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.599463 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.599740 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.600016 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.600311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.600580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.609162 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.609438 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.609717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.609997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.610279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.610552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.610857 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.613805 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.614081 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.614365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.614660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.614937 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.615212 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.615482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.629364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.632642 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.633922 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.635975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.637164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.637596 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.639272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.639563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.639845 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.640427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.642000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.644278 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.644561 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.644834 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.647829 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.649449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.652154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.652726 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.653016 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.653301 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.653572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.653745 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.656966 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.657251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.657529 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.657807 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.663043 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.663359 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.663643 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.666934 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.667216 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.667492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.671536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.671816 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.672096 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.672377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.672648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.672931 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.673205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.673469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.673735 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.674007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.674316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.674578 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.674879 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.675146 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.675505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92089) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:41:20.675777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.676050 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.676328 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.676601 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.676879 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.677154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.677422 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.677691 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.677952 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.678214 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.678479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.678766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.679026 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92089) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:41:20.715087 dv-cinder-841302-4-smb devstack@keystone.service[92088]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b8d4979c0 pid: 92088 (default app) May 19 19:41:20.718373 dv-cinder-841302-4-smb devstack@keystone.service[92089]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b8d4979c0 pid: 92089 (default app) May 19 19:41:20.718465 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee79319-9766-4263-9c50-7debf13a0504 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:20.718756 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee79319-9766-4263-9c50-7debf13a0504 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:20.719041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee79319-9766-4263-9c50-7debf13a0504 None None] PATH_INFO: `/v3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:20.723283 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1/1] 10.222.0.89 () {50 vars in 791 bytes} [Thu May 19 19:41:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:29.442272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68eba1-6db5-4fb8-ba0f-b87282361676 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:29.442936 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68eba1-6db5-4fb8-ba0f-b87282361676 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:29.442936 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68eba1-6db5-4fb8-ba0f-b87282361676 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:29.447287 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 1/2] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:29.452393 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90739-0cd2-4abb-bb59-cd4c3c259ae4 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:29.452813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90739-0cd2-4abb-bb59-cd4c3c259ae4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:29.452942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90739-0cd2-4abb-bb59-cd4c3c259ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:29.520828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: INFO dbcounter [None req-3bb90739-0cd2-4abb-bb59-cd4c3c259ae4 None None] Registered counter for database keystone May 19 19:41:29.542345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb90739-0cd2-4abb-bb59-cd4c3c259ae4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 19:41:29.548678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writer thread running {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 19:41:29.723957 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG passlib.handlers.bcrypt [None req-3bb90739-0cd2-4abb-bb59-cd4c3c259ae4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92088) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 19:41:29.724382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG passlib.handlers.bcrypt [None req-3bb90739-0cd2-4abb-bb59-cd4c3c259ae4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92088) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 19:41:29.779123 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3bb90739-0cd2-4abb-bb59-cd4c3c259ae4 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:29.780732 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3bb90739-0cd2-4abb-bb59-cd4c3c259ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:29.902728 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 2/3] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 19:41:30.083014 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68eba1-6db5-4fb8-ba0f-b87282361676 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:30.151506 dv-cinder-841302-4-smb devstack@keystone.service[92089]: INFO dbcounter [None req-6a68eba1-6db5-4fb8-ba0f-b87282361676 None None] Registered counter for database keystone May 19 19:41:30.171661 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG oslo_db.sqlalchemy.engines [None req-6a68eba1-6db5-4fb8-ba0f-b87282361676 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 19:41:30.177994 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writer thread running {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 19:41:30.297616 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68eba1-6db5-4fb8-ba0f-b87282361676 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:30.301962 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd45ed-1f0c-4266-ad40-769a09049e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbf08f613684bc5800cd2a653ac6ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:30.302647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd45ed-1f0c-4266-ad40-769a09049e6d admin admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:30.302941 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd45ed-1f0c-4266-ad40-769a09049e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:30.303223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd45ed-1f0c-4266-ad40-769a09049e6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:30.311622 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd45ed-1f0c-4266-ad40-769a09049e6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:30.364014 dv-cinder-841302-4-smb devstack@keystone.service[92089]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9bbd45ed-1f0c-4266-ad40-769a09049e6d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 19:41:30.364383 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd45ed-1f0c-4266-ad40-769a09049e6d admin admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:30.374838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 2/4] 10.222.0.89 () {58 vars in 1324 bytes} [Thu May 19 19:41:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 19:41:30.381185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90739-0cd2-4abb-bb59-cd4c3c259ae4 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:30.396124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90739-0cd2-4abb-bb59-cd4c3c259ae4 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:30.400626 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55944413-7db2-41a0-8236-60dba3d65d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbf08f613684bc5800cd2a653ac6ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:30.401715 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944413-7db2-41a0-8236-60dba3d65d78 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:30.402006 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944413-7db2-41a0-8236-60dba3d65d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:30.402293 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944413-7db2-41a0-8236-60dba3d65d78 admin admin] PATH_INFO: `/v3/projects/8cbf08f613684bc5800cd2a653ac6ae3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:30.403907 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55944413-7db2-41a0-8236-60dba3d65d78 admin admin] RBAC: Authorizing `identity:get_project(project_id=8cbf08f613684bc5800cd2a653ac6ae3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:30.561363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: WARNING keystone.common.rbac_enforcer.enforcer [None req-55944413-7db2-41a0-8236-60dba3d65d78 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 19:41:30.561984 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55944413-7db2-41a0-8236-60dba3d65d78 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:30.566905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 3/5] 10.222.0.89 () {56 vars in 1207 bytes} [Thu May 19 19:41:30 2022] GET /identity/v3/projects/8cbf08f613684bc5800cd2a653ac6ae3 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:32.740695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7071c6-6b43-487e-a42e-de598aa9eab7 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:32.741232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7071c6-6b43-487e-a42e-de598aa9eab7 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:32.741232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7071c6-6b43-487e-a42e-de598aa9eab7 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:32.745390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 3/6] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:32.750945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee656a6-2b34-45c7-b3fc-792d91b27687 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:32.751367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee656a6-2b34-45c7-b3fc-792d91b27687 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:32.751508 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee656a6-2b34-45c7-b3fc-792d91b27687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:32.770112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-4ee656a6-2b34-45c7-b3fc-792d91b27687 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:32.771669 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4ee656a6-2b34-45c7-b3fc-792d91b27687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:32.779546 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 4/7] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 19:41:32.802295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7071c6-6b43-487e-a42e-de598aa9eab7 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:32.814852 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7071c6-6b43-487e-a42e-de598aa9eab7 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:32.819076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59e8d0-2b91-4efe-98a2-f9e4574e520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbf08f613684bc5800cd2a653ac6ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:32.819701 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e8d0-2b91-4efe-98a2-f9e4574e520f admin admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:32.819986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e8d0-2b91-4efe-98a2-f9e4574e520f admin admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:32.820265 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e8d0-2b91-4efe-98a2-f9e4574e520f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:32.827965 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59e8d0-2b91-4efe-98a2-f9e4574e520f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:32.829727 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59e8d0-2b91-4efe-98a2-f9e4574e520f admin admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:32.838400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 4/8] 10.222.0.89 () {58 vars in 1324 bytes} [Thu May 19 19:41:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 19:41:32.843634 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee656a6-2b34-45c7-b3fc-792d91b27687 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:32.853065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee656a6-2b34-45c7-b3fc-792d91b27687 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:32.857555 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51ee6-6a82-484e-acaa-07233b79d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbf08f613684bc5800cd2a653ac6ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:32.858406 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51ee6-6a82-484e-acaa-07233b79d4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:32.858728 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51ee6-6a82-484e-acaa-07233b79d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:32.859009 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51ee6-6a82-484e-acaa-07233b79d4b7 admin admin] PATH_INFO: `/v3/users/64713eb0c74847f6b1357f2125edd3b1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:32.860411 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e51ee6-6a82-484e-acaa-07233b79d4b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=64713eb0c74847f6b1357f2125edd3b1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:32.862814 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e51ee6-6a82-484e-acaa-07233b79d4b7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:32.864371 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 5/9] 10.222.0.89 () {56 vars in 1198 bytes} [Thu May 19 19:41:32 2022] GET /identity/v3/users/64713eb0c74847f6b1357f2125edd3b1 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:35.107087 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0d3f-5bed-4438-8fd0-14a2560b848d None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:35.107604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0d3f-5bed-4438-8fd0-14a2560b848d None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:35.107686 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0d3f-5bed-4438-8fd0-14a2560b848d None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:35.109010 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 5/10] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:35.114840 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c59d0b-3f61-446a-9c70-be8c39394e58 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:35.115271 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c59d0b-3f61-446a-9c70-be8c39394e58 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:35.115403 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c59d0b-3f61-446a-9c70-be8c39394e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:35.131839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-99c59d0b-3f61-446a-9c70-be8c39394e58 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:35.132987 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-99c59d0b-3f61-446a-9c70-be8c39394e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:35.166724 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6fc2f-a651-410d-b3ca-355d1b54d82b None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:35.167098 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6fc2f-a651-410d-b3ca-355d1b54d82b None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:35.167444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6fc2f-a651-410d-b3ca-355d1b54d82b None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:35.168863 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 6/11] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:41:35.174316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472c37b-dc95-44e0-ab12-36f849bc1fdf None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:35.174693 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472c37b-dc95-44e0-ab12-36f849bc1fdf None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:35.175043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472c37b-dc95-44e0-ab12-36f849bc1fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:35.213415 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 6/12] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:41:35.214204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG passlib.handlers.bcrypt [None req-2472c37b-dc95-44e0-ab12-36f849bc1fdf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92089) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 19:41:35.214671 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG passlib.handlers.bcrypt [None req-2472c37b-dc95-44e0-ab12-36f849bc1fdf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92089) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 19:41:35.236446 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c59d0b-3f61-446a-9c70-be8c39394e58 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:35.259466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:35.261100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-2472c37b-dc95-44e0-ab12-36f849bc1fdf None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:35.262749 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-2472c37b-dc95-44e0-ab12-36f849bc1fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:35.339780 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c59d0b-3f61-446a-9c70-be8c39394e58 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:35.364757 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 7/13] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:41:35.373334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4d5fc-b55f-47ec-9ab7-34c74b47948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:35.374124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d5fc-b55f-47ec-9ab7-34c74b47948b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:35.374405 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d5fc-b55f-47ec-9ab7-34c74b47948b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:35.374705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d5fc-b55f-47ec-9ab7-34c74b47948b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:35.385966 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4d5fc-b55f-47ec-9ab7-34c74b47948b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:35.386751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472c37b-dc95-44e0-ab12-36f849bc1fdf None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-47d4d5fc-b55f-47ec-9ab7-34c74b47948b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:35.397792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:35.398765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:41:35.399615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 7/14] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:41:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:41:35.404696 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4d5fc-b55f-47ec-9ab7-34c74b47948b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:35.485041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:35.489851 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472c37b-dc95-44e0-ab12-36f849bc1fdf None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:35.492214 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:35.503510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4d5fc-b55f-47ec-9ab7-34c74b47948b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:35.528074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939573b-f3a4-40d2-8e86-4614b9a348d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:35.528965 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939573b-f3a4-40d2-8e86-4614b9a348d2 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:35.529248 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939573b-f3a4-40d2-8e86-4614b9a348d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:35.529528 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939573b-f3a4-40d2-8e86-4614b9a348d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:35.539534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efd6a5-e275-4774-bbaa-63b92dfaaeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:35.540199 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efd6a5-e275-4774-bbaa-63b92dfaaeed None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:35.540484 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efd6a5-e275-4774-bbaa-63b92dfaaeed None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:35.540761 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efd6a5-e275-4774-bbaa-63b92dfaaeed None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:35.541523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efd6a5-e275-4774-bbaa-63b92dfaaeed None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:35.541831 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efd6a5-e275-4774-bbaa-63b92dfaaeed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:35.543287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efd6a5-e275-4774-bbaa-63b92dfaaeed None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:35.554759 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 8/15] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:41:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:41:35.560549 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efd6a5-e275-4774-bbaa-63b92dfaaeed None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:35.598170 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939573b-f3a4-40d2-8e86-4614b9a348d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:35.599731 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939573b-f3a4-40d2-8e86-4614b9a348d2 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:35.657354 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efd6a5-e275-4774-bbaa-63b92dfaaeed None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:35.691427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533c4d0-ec29-4196-ad6d-7d97266cbe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:35.692304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533c4d0-ec29-4196-ad6d-7d97266cbe8c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:35.692592 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533c4d0-ec29-4196-ad6d-7d97266cbe8c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:35.692872 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533c4d0-ec29-4196-ad6d-7d97266cbe8c None admin] PATH_INFO: `/v3/users/64713eb0c74847f6b1357f2125edd3b1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:35.694098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533c4d0-ec29-4196-ad6d-7d97266cbe8c None admin] RBAC: Authorizing `identity:get_user(user_id=64713eb0c74847f6b1357f2125edd3b1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:35.695602 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533c4d0-ec29-4196-ad6d-7d97266cbe8c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:35.697250 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 9/16] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:35 2022] GET /identity/v3/users/64713eb0c74847f6b1357f2125edd3b1 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:41:35.697820 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 8/17] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:41:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:41:35.702524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533c4d0-ec29-4196-ad6d-7d97266cbe8c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:35.703070 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939573b-f3a4-40d2-8e86-4614b9a348d2 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:35.706535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:35.717566 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:35.799948 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939573b-f3a4-40d2-8e86-4614b9a348d2 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:35.800326 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533c4d0-ec29-4196-ad6d-7d97266cbe8c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:35.833865 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b5ef0-8b21-4f6b-8526-38ccc3a6224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:35.834442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe8bbd-8edd-4fce-ae53-34366c972fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:35.834698 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b5ef0-8b21-4f6b-8526-38ccc3a6224f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:35.834980 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b5ef0-8b21-4f6b-8526-38ccc3a6224f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:35.835252 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b5ef0-8b21-4f6b-8526-38ccc3a6224f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:35.835338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe8bbd-8edd-4fce-ae53-34366c972fd0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:35.835541 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe8bbd-8edd-4fce-ae53-34366c972fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:35.835820 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe8bbd-8edd-4fce-ae53-34366c972fd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:35.837015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe8bbd-8edd-4fce-ae53-34366c972fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:35.838500 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe8bbd-8edd-4fce-ae53-34366c972fd0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:35.840293 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 10/18] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:41:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:35.845645 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe8bbd-8edd-4fce-ae53-34366c972fd0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:35.854779 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b5ef0-8b21-4f6b-8526-38ccc3a6224f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:35.856245 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b5ef0-8b21-4f6b-8526-38ccc3a6224f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-921b5ef0-8b21-4f6b-8526-38ccc3a6224f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:41:35.877056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:35.878153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:35.879168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:41:35.879168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:41:35.879168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:41:35.879168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:41:35.879168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 9/19] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:41:35.884024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b5ef0-8b21-4f6b-8526-38ccc3a6224f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:35.925674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:35.941588 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:35.944219 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe8bbd-8edd-4fce-ae53-34366c972fd0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:35.981335 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf0f65-8753-46e6-be40-f21327e8301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:35.982015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf0f65-8753-46e6-be40-f21327e8301a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:35.982299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf0f65-8753-46e6-be40-f21327e8301a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:35.982574 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf0f65-8753-46e6-be40-f21327e8301a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:35.983460 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf0f65-8753-46e6-be40-f21327e8301a None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.domain.id=default, user.id=64713eb0c74847f6b1357f2125edd3b1) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:35.983771 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf0f65-8753-46e6-be40-f21327e8301a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:35.985279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf0f65-8753-46e6-be40-f21327e8301a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:35.993511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 11/20] 10.222.0.89 () {56 vars in 1322 bytes} [Thu May 19 19:41:35 2022] GET /identity/v3/role_assignments?user.id=64713eb0c74847f6b1357f2125edd3b1&scope.domain.id=default&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:41:36.098504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b5ef0-8b21-4f6b-8526-38ccc3a6224f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:36.134498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0a298-c8c2-46ba-bb31-335bbbf99aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:36.135202 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0a298-c8c2-46ba-bb31-335bbbf99aa8 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:36.135471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0a298-c8c2-46ba-bb31-335bbbf99aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:36.135748 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0a298-c8c2-46ba-bb31-335bbbf99aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:36.136489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0a298-c8c2-46ba-bb31-335bbbf99aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:36.136794 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0a298-c8c2-46ba-bb31-335bbbf99aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:36.138195 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0a298-c8c2-46ba-bb31-335bbbf99aa8 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:36.156643 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 10/21] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:41:38.484967 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c3e7e-5c9f-4453-873b-5c105f85add5 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:38.485484 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c3e7e-5c9f-4453-873b-5c105f85add5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:38.485557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c3e7e-5c9f-4453-873b-5c105f85add5 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:38.487443 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 12/22] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:38.493012 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afce940-c97f-48ad-a2d0-c4dcb224c408 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:38.493948 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afce940-c97f-48ad-a2d0-c4dcb224c408 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:38.494416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afce940-c97f-48ad-a2d0-c4dcb224c408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:38.512855 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-4afce940-c97f-48ad-a2d0-c4dcb224c408 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:38.514378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-4afce940-c97f-48ad-a2d0-c4dcb224c408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:38.599904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 11/23] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:38.635941 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c3e7e-5c9f-4453-873b-5c105f85add5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:38.730168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6c06-5807-473f-9406-74e42338544d None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:38.730836 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6c06-5807-473f-9406-74e42338544d None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:38.731327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6c06-5807-473f-9406-74e42338544d None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:38.733150 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 12/24] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:38.737956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdc196-7a46-4ecd-805d-3b467b824559 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:38.738451 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdc196-7a46-4ecd-805d-3b467b824559 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:38.738948 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdc196-7a46-4ecd-805d-3b467b824559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:38.756208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-adcdc196-7a46-4ecd-805d-3b467b824559 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:38.757689 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-adcdc196-7a46-4ecd-805d-3b467b824559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:38.788093 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c3e7e-5c9f-4453-873b-5c105f85add5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:38.852735 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:38.854520 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb27ab-247f-4845-a84e-dc2163228015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:38.855365 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb27ab-247f-4845-a84e-dc2163228015 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:38.855651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb27ab-247f-4845-a84e-dc2163228015 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:38.855932 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb27ab-247f-4845-a84e-dc2163228015 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:38.883562 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb27ab-247f-4845-a84e-dc2163228015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-22fb27ab-247f-4845-a84e-dc2163228015 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:38.891469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:38.893084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:41:38.893856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 13/25] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:41:38.900883 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb27ab-247f-4845-a84e-dc2163228015 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:38.909815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:38.917315 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 13/26] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:38.957144 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdc196-7a46-4ecd-805d-3b467b824559 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:39.060591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb27ab-247f-4845-a84e-dc2163228015 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:39.107819 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdc196-7a46-4ecd-805d-3b467b824559 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:39.148651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95a29e-b309-455c-b05b-b0a01d412a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:39.149327 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a29e-b309-455c-b05b-b0a01d412a63 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:39.149614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a29e-b309-455c-b05b-b0a01d412a63 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:39.149896 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a29e-b309-455c-b05b-b0a01d412a63 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:39.150693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95a29e-b309-455c-b05b-b0a01d412a63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:39.151253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95a29e-b309-455c-b05b-b0a01d412a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:39.152867 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95a29e-b309-455c-b05b-b0a01d412a63 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:39.158367 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a0c2-18fb-411d-b02d-e198e5b89177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:39.159242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a0c2-18fb-411d-b02d-e198e5b89177 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:39.159678 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a0c2-18fb-411d-b02d-e198e5b89177 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:39.160086 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a0c2-18fb-411d-b02d-e198e5b89177 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:39.160973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98a0c2-18fb-411d-b02d-e198e5b89177 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:39.162358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 14/27] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:41:39.162900 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98a0c2-18fb-411d-b02d-e198e5b89177 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:39.164109 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cf4af-79da-4093-971d-a4e02612aa82 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:39.168901 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cf4af-79da-4093-971d-a4e02612aa82 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:39.169791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cf4af-79da-4093-971d-a4e02612aa82 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:39.171358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 15/28] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:39.175041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cf4af-79da-4093-971d-a4e02612aa82 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:39.262990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:39.317990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cf4af-79da-4093-971d-a4e02612aa82 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:39.398139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddf438-803b-4723-8602-daf8ed8f9796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:39.399071 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf438-803b-4723-8602-daf8ed8f9796 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:39.399364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf438-803b-4723-8602-daf8ed8f9796 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:39.399649 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf438-803b-4723-8602-daf8ed8f9796 None admin] PATH_INFO: `/v3/users/64713eb0c74847f6b1357f2125edd3b1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:39.400970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddf438-803b-4723-8602-daf8ed8f9796 None admin] RBAC: Authorizing `identity:get_user(user_id=64713eb0c74847f6b1357f2125edd3b1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:39.402476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddf438-803b-4723-8602-daf8ed8f9796 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:39.404233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 16/29] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:39 2022] GET /identity/v3/users/64713eb0c74847f6b1357f2125edd3b1 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:39.405551 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9228-6cd9-4196-ab9c-555a8dc51b3e None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:39.405847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9228-6cd9-4196-ab9c-555a8dc51b3e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:39.406129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9228-6cd9-4196-ab9c-555a8dc51b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:39.425310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-348c9228-6cd9-4196-ab9c-555a8dc51b3e None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:39.426887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-348c9228-6cd9-4196-ab9c-555a8dc51b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:39.468344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 14/30] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 19:41:38 2022] POST /identity/v3/roles => generated 219 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:41:39.469737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a0c2-18fb-411d-b02d-e198e5b89177 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:39.501220 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 17/31] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:39.538379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:39.543188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c9228-6cd9-4196-ab9c-555a8dc51b3e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:39.644976 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:39.681927 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c9228-6cd9-4196-ab9c-555a8dc51b3e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:39.690836 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a0c2-18fb-411d-b02d-e198e5b89177 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:39.720479 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401d39b-da0a-4565-b5c8-19d8b53d1793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:39.721696 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401d39b-da0a-4565-b5c8-19d8b53d1793 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:39.722195 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401d39b-da0a-4565-b5c8-19d8b53d1793 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:39.722704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401d39b-da0a-4565-b5c8-19d8b53d1793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:39.735330 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401d39b-da0a-4565-b5c8-19d8b53d1793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:39.737714 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401d39b-da0a-4565-b5c8-19d8b53d1793 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0401d39b-da0a-4565-b5c8-19d8b53d1793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:41:39.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:39.764377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:39.765199 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:41:39.765199 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:41:39.765199 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:41:39.765199 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:41:39.768368 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 18/32] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:41:39.771828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b10a9-502f-4b91-8bb9-c4addd3076fb None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:39.773764 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b10a9-502f-4b91-8bb9-c4addd3076fb None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:39.774270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b10a9-502f-4b91-8bb9-c4addd3076fb None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:39.776806 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 19/33] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:39.778752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b10a9-502f-4b91-8bb9-c4addd3076fb None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:39.789742 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676d8aa-a01d-4034-ad00-7a063279ac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:39.790987 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676d8aa-a01d-4034-ad00-7a063279ac26 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:39.791477 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676d8aa-a01d-4034-ad00-7a063279ac26 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:39.791956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676d8aa-a01d-4034-ad00-7a063279ac26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:39.794308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676d8aa-a01d-4034-ad00-7a063279ac26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:39.796152 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676d8aa-a01d-4034-ad00-7a063279ac26 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:39.799340 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 15/34] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:41:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:39.800900 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eb5b2-6175-4405-baa7-34e9acaa846c None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:39.801395 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eb5b2-6175-4405-baa7-34e9acaa846c None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:39.801875 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eb5b2-6175-4405-baa7-34e9acaa846c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:39.824896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-b69eb5b2-6175-4405-baa7-34e9acaa846c None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:39.827242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-b69eb5b2-6175-4405-baa7-34e9acaa846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:39.920694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 16/35] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:39.921868 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eb5b2-6175-4405-baa7-34e9acaa846c None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:39.922581 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b10a9-502f-4b91-8bb9-c4addd3076fb None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:39.950110 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:39.960610 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:39.978489 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a03755-d243-4d48-aeae-5e77c2300484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:39.980689 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a03755-d243-4d48-aeae-5e77c2300484 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:39.981188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a03755-d243-4d48-aeae-5e77c2300484 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:39.981674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a03755-d243-4d48-aeae-5e77c2300484 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:39.982716 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a03755-d243-4d48-aeae-5e77c2300484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:39.983241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a03755-d243-4d48-aeae-5e77c2300484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:39.984843 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a03755-d243-4d48-aeae-5e77c2300484 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:40.008686 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 20/36] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:40.009957 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a03755-d243-4d48-aeae-5e77c2300484 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:40.051578 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eb5b2-6175-4405-baa7-34e9acaa846c None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:40.092307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8e4e-c749-4318-b728-e10932d8178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:40.093655 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8e4e-c749-4318-b728-e10932d8178f None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:40.094128 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8e4e-c749-4318-b728-e10932d8178f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:40.094554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8e4e-c749-4318-b728-e10932d8178f None admin] PATH_INFO: `/v3/domains/default/users/64713eb0c74847f6b1357f2125edd3b1/roles/4f7e6c1b02094f72ae978c3558b530a9` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:40.097846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da8e4e-c749-4318-b728-e10932d8178f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=64713eb0c74847f6b1357f2125edd3b1, role_id=4f7e6c1b02094f72ae978c3558b530a9)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:40.099550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da8e4e-c749-4318-b728-e10932d8178f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:40.138106 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a03755-d243-4d48-aeae-5e77c2300484 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:40.175522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7a75c-613c-45c4-8c10-a8addfe438b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:40.176238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7a75c-613c-45c4-8c10-a8addfe438b7 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:40.176521 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7a75c-613c-45c4-8c10-a8addfe438b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:40.176797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7a75c-613c-45c4-8c10-a8addfe438b7 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:40.177596 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7a75c-613c-45c4-8c10-a8addfe438b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:40.179136 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7a75c-613c-45c4-8c10-a8addfe438b7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:40.206461 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 17/37] 10.222.0.89 () {58 vars in 1361 bytes} [Thu May 19 19:41:39 2022] PUT /identity/v3/domains/default/users/64713eb0c74847f6b1357f2125edd3b1/roles/4f7e6c1b02094f72ae978c3558b530a9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:41:40.206461 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8e4e-c749-4318-b728-e10932d8178f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:40.317941 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:40.326083 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8e4e-c749-4318-b728-e10932d8178f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:40.370912 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc2237-a6f6-4f45-bee7-e12c43d28448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:40.371896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2237-a6f6-4f45-bee7-e12c43d28448 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:40.372714 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2237-a6f6-4f45-bee7-e12c43d28448 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:40.373448 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2237-a6f6-4f45-bee7-e12c43d28448 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:40.374846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc2237-a6f6-4f45-bee7-e12c43d28448 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:40.376531 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc2237-a6f6-4f45-bee7-e12c43d28448 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:40.405133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 21/38] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 19:41:40 2022] POST /identity/v3/roles => generated 225 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:41:40.407045 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d811-1ad0-482b-9a38-b0cdfd0b0c9f None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:40.407437 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d811-1ad0-482b-9a38-b0cdfd0b0c9f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:40.408299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d811-1ad0-482b-9a38-b0cdfd0b0c9f None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:40.409887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 22/39] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:40.415968 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5a6e5-3336-4db5-bfc7-b67214784b96 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:40.416285 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5a6e5-3336-4db5-bfc7-b67214784b96 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:40.416641 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5a6e5-3336-4db5-bfc7-b67214784b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:40.438483 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-62a5a6e5-3336-4db5-bfc7-b67214784b96 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:40.440155 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-62a5a6e5-3336-4db5-bfc7-b67214784b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:40.485877 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:40.511257 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 18/40] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:41:40 2022] POST /identity/v3/projects => generated 301 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:41:40.535050 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 23/41] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:41:40.559376 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc2237-a6f6-4f45-bee7-e12c43d28448 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:40.582085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2b24-b8c4-49fd-84ee-183654bf7ae5 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:40.583028 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2b24-b8c4-49fd-84ee-183654bf7ae5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:40.583642 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2b24-b8c4-49fd-84ee-183654bf7ae5 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:40.586898 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 24/42] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:41:40.593505 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb345e-3bc7-46a4-b57a-23110e8d4941 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:40.594035 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb345e-3bc7-46a4-b57a-23110e8d4941 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:40.594764 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb345e-3bc7-46a4-b57a-23110e8d4941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:40.621875 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-eddb345e-3bc7-46a4-b57a-23110e8d4941 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:40.623511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-eddb345e-3bc7-46a4-b57a-23110e8d4941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:40.700106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc2237-a6f6-4f45-bee7-e12c43d28448 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:40.718345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 25/43] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:41:40.742888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb345e-3bc7-46a4-b57a-23110e8d4941 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:40.754834 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e9015-f30d-4d34-8422-54b07f2611b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:40.755749 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e9015-f30d-4d34-8422-54b07f2611b9 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:40.755928 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e9015-f30d-4d34-8422-54b07f2611b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:40.756195 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e9015-f30d-4d34-8422-54b07f2611b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:40.758006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e9015-f30d-4d34-8422-54b07f2611b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:40.759586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e9015-f30d-4d34-8422-54b07f2611b9 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:40.761446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 19/44] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:41:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:40.767878 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e9015-f30d-4d34-8422-54b07f2611b9 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:40.787526 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:40.867418 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:40.874066 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb345e-3bc7-46a4-b57a-23110e8d4941 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:40.884776 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e9015-f30d-4d34-8422-54b07f2611b9 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:40.912752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8a16-1d85-41ce-aadc-9ef7fc822b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:40.913417 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8a16-1d85-41ce-aadc-9ef7fc822b9b None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:40.913704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8a16-1d85-41ce-aadc-9ef7fc822b9b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:40.913981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8a16-1d85-41ce-aadc-9ef7fc822b9b None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:40.914768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb8a16-1d85-41ce-aadc-9ef7fc822b9b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:40.916288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb8a16-1d85-41ce-aadc-9ef7fc822b9b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:40.920643 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddc080-07be-4c9d-9612-38bc32ca626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:40.921307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddc080-07be-4c9d-9612-38bc32ca626a None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:40.921598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddc080-07be-4c9d-9612-38bc32ca626a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:40.921881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddc080-07be-4c9d-9612-38bc32ca626a None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:40.922618 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddc080-07be-4c9d-9612-38bc32ca626a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:40.924187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddc080-07be-4c9d-9612-38bc32ca626a None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:40.972518 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 26/45] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 19:41:40 2022] POST /identity/v3/roles => generated 223 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:41:40.997816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 20/46] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:41:40 2022] POST /identity/v3/projects => generated 312 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:41:42.564410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfbec5-ccd8-49b2-891b-38b9eb11158f None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:42.564897 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfbec5-ccd8-49b2-891b-38b9eb11158f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:42.564897 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfbec5-ccd8-49b2-891b-38b9eb11158f None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:42.566278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 27/47] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:42.572049 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e138b-fa09-4f0c-819d-c9c86f16730d None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:42.572479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e138b-fa09-4f0c-819d-c9c86f16730d None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:42.572624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e138b-fa09-4f0c-819d-c9c86f16730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:42.589082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-1e4e138b-fa09-4f0c-819d-c9c86f16730d None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:42.590263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-1e4e138b-fa09-4f0c-819d-c9c86f16730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:42.648586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:42.655928 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 21/48] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:42.679662 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfbec5-ccd8-49b2-891b-38b9eb11158f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:42.783442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfbec5-ccd8-49b2-891b-38b9eb11158f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:42.817020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f5106-b499-4f55-b8a3-19b0d29f335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:42.817741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f5106-b499-4f55-b8a3-19b0d29f335b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:42.818034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f5106-b499-4f55-b8a3-19b0d29f335b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:42.818318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f5106-b499-4f55-b8a3-19b0d29f335b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:42.830416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f5106-b499-4f55-b8a3-19b0d29f335b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-292f5106-b499-4f55-b8a3-19b0d29f335b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:42.838072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:42.838974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:41:42.839745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 28/49] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:41:42.845760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e138b-fa09-4f0c-819d-c9c86f16730d None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:42.943438 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e138b-fa09-4f0c-819d-c9c86f16730d None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:42.977106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7462d4-a1ee-49fe-8644-356320408c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:42.977770 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7462d4-a1ee-49fe-8644-356320408c4d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:42.978061 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7462d4-a1ee-49fe-8644-356320408c4d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:42.978343 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7462d4-a1ee-49fe-8644-356320408c4d None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:42.979136 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7462d4-a1ee-49fe-8644-356320408c4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:42.979452 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7462d4-a1ee-49fe-8644-356320408c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:42.980837 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7462d4-a1ee-49fe-8644-356320408c4d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:42.992163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 22/50] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:41:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:42.997732 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f5106-b499-4f55-b8a3-19b0d29f335b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:43.016034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:43.102902 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f5106-b499-4f55-b8a3-19b0d29f335b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:43.136623 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733bec9-e105-4611-994f-80e529706853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:43.137607 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733bec9-e105-4611-994f-80e529706853 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:43.137895 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733bec9-e105-4611-994f-80e529706853 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:43.138173 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733bec9-e105-4611-994f-80e529706853 None admin] PATH_INFO: `/v3/users/64713eb0c74847f6b1357f2125edd3b1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:43.139451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733bec9-e105-4611-994f-80e529706853 None admin] RBAC: Authorizing `identity:get_user(user_id=64713eb0c74847f6b1357f2125edd3b1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:43.141433 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733bec9-e105-4611-994f-80e529706853 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:43.143690 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 29/51] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:42 2022] GET /identity/v3/users/64713eb0c74847f6b1357f2125edd3b1 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:41:43.149217 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7462d4-a1ee-49fe-8644-356320408c4d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:43.208565 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:43.249905 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7462d4-a1ee-49fe-8644-356320408c4d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:43.260915 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c02d-03f1-47f5-a861-3af352e11be7 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:43.261212 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c02d-03f1-47f5-a861-3af352e11be7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:43.261495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c02d-03f1-47f5-a861-3af352e11be7 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:43.262912 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 30/52] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:41:43.267862 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab0c02-08a5-4829-9a5a-893d0c1d2ff0 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:43.268147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab0c02-08a5-4829-9a5a-893d0c1d2ff0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:43.268426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab0c02-08a5-4829-9a5a-893d0c1d2ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:43.283801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea666e2-7338-4909-bee3-c4dbdecaea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:43.284598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea666e2-7338-4909-bee3-c4dbdecaea6b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:43.284885 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea666e2-7338-4909-bee3-c4dbdecaea6b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:43.285167 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea666e2-7338-4909-bee3-c4dbdecaea6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:43.285498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-56ab0c02-08a5-4829-9a5a-893d0c1d2ff0 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:43.286731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-56ab0c02-08a5-4829-9a5a-893d0c1d2ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:43.286998 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea666e2-7338-4909-bee3-c4dbdecaea6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:43.288460 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea666e2-7338-4909-bee3-c4dbdecaea6b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:43.290122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 23/53] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:41:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:43.295584 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea666e2-7338-4909-bee3-c4dbdecaea6b None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:43.353300 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 31/54] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:41:43.376723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab0c02-08a5-4829-9a5a-893d0c1d2ff0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:43.390684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:43.393756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea666e2-7338-4909-bee3-c4dbdecaea6b None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:43.419031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:43.427781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe0516-37a3-4bf6-9e8d-b6c97c17086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:43.428445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe0516-37a3-4bf6-9e8d-b6c97c17086e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:43.428733 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe0516-37a3-4bf6-9e8d-b6c97c17086e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:43.429015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe0516-37a3-4bf6-9e8d-b6c97c17086e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:43.429942 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe0516-37a3-4bf6-9e8d-b6c97c17086e None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.domain.id=default, user.id=64713eb0c74847f6b1357f2125edd3b1) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:43.430259 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe0516-37a3-4bf6-9e8d-b6c97c17086e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:43.431753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe0516-37a3-4bf6-9e8d-b6c97c17086e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:43.440500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 24/55] 10.222.0.89 () {56 vars in 1322 bytes} [Thu May 19 19:41:43 2022] GET /identity/v3/role_assignments?user.id=64713eb0c74847f6b1357f2125edd3b1&scope.domain.id=default&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:41:43.478991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab0c02-08a5-4829-9a5a-893d0c1d2ff0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:43.518139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab53aa-4f37-40b6-a9ba-3ad9fce23f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:43.518993 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab53aa-4f37-40b6-a9ba-3ad9fce23f4e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:43.519288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab53aa-4f37-40b6-a9ba-3ad9fce23f4e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:43.519569 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab53aa-4f37-40b6-a9ba-3ad9fce23f4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:43.520833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab53aa-4f37-40b6-a9ba-3ad9fce23f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:43.522348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab53aa-4f37-40b6-a9ba-3ad9fce23f4e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:43.524077 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 32/56] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:41:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:41:43.529800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe0516-37a3-4bf6-9e8d-b6c97c17086e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:43.636453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe0516-37a3-4bf6-9e8d-b6c97c17086e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:43.676793 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e1187-2528-4f57-8db7-74ec53909077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:43.677451 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1187-2528-4f57-8db7-74ec53909077 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:43.677741 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1187-2528-4f57-8db7-74ec53909077 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:43.678023 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1187-2528-4f57-8db7-74ec53909077 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:43.678843 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e1187-2528-4f57-8db7-74ec53909077 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:43.680298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e1187-2528-4f57-8db7-74ec53909077 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:43.778130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 25/57] 10.222.0.89 () {60 vars in 1140 bytes} [Thu May 19 19:41:43 2022] POST /identity/v3/projects => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:41:45.976864 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0aa20-f1c1-4b20-93e9-4eaeb7e4e8bf None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:45.977375 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0aa20-f1c1-4b20-93e9-4eaeb7e4e8bf None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:45.977483 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0aa20-f1c1-4b20-93e9-4eaeb7e4e8bf None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:45.978841 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 33/58] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:45.984085 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7e74-015b-42d5-a892-3f30a75eed5f None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:45.984480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7e74-015b-42d5-a892-3f30a75eed5f None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:45.984653 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7e74-015b-42d5-a892-3f30a75eed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:46.002221 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-632b7e74-015b-42d5-a892-3f30a75eed5f None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:46.003438 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-632b7e74-015b-42d5-a892-3f30a75eed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:46.037506 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:46.068297 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 26/59] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:46.092234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0aa20-f1c1-4b20-93e9-4eaeb7e4e8bf None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:46.182867 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:46.200941 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0aa20-f1c1-4b20-93e9-4eaeb7e4e8bf None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:46.233735 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fa3c0-22d3-4510-99af-8df15c956ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:46.234458 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fa3c0-22d3-4510-99af-8df15c956ffd None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:46.234777 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fa3c0-22d3-4510-99af-8df15c956ffd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:46.235067 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fa3c0-22d3-4510-99af-8df15c956ffd None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:46.236862 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fa3c0-22d3-4510-99af-8df15c956ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:46.238359 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fa3c0-22d3-4510-99af-8df15c956ffd None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:46.239988 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 34/60] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:41:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:46.245561 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b7e74-015b-42d5-a892-3f30a75eed5f None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:46.341706 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b7e74-015b-42d5-a892-3f30a75eed5f None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:46.375045 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bc12f-9ddf-4c98-b718-378ebfe10c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:46.375732 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bc12f-9ddf-4c98-b718-378ebfe10c73 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:46.376048 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bc12f-9ddf-4c98-b718-378ebfe10c73 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:46.376331 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bc12f-9ddf-4c98-b718-378ebfe10c73 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:46.377044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bc12f-9ddf-4c98-b718-378ebfe10c73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:46.378491 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bc12f-9ddf-4c98-b718-378ebfe10c73 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:46.462917 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 27/61] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:41:46 2022] POST /identity/v3/users => generated 275 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:41:49.785232 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc0dad-e072-4b08-8144-7480a302d393 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:49.786262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc0dad-e072-4b08-8144-7480a302d393 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:49.786781 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc0dad-e072-4b08-8144-7480a302d393 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:49.788663 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 35/62] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:49.793899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd418d4-0449-4317-a03a-9b9c191b1ea2 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:49.794759 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd418d4-0449-4317-a03a-9b9c191b1ea2 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:49.795232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd418d4-0449-4317-a03a-9b9c191b1ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:49.820521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-efd418d4-0449-4317-a03a-9b9c191b1ea2 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:49.822197 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-efd418d4-0449-4317-a03a-9b9c191b1ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:49.851852 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:49.915440 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 28/63] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:49.927774 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6844-54da-4aa4-bb1f-9227701041b3 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:49.928366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6844-54da-4aa4-bb1f-9227701041b3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:49.928836 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6844-54da-4aa4-bb1f-9227701041b3 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:49.930396 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 36/64] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:49.936287 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d136-de4f-4b43-b5d2-4407bcc1e8e1 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:49.936802 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d136-de4f-4b43-b5d2-4407bcc1e8e1 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:49.937305 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d136-de4f-4b43-b5d2-4407bcc1e8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:49.955956 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6844-54da-4aa4-bb1f-9227701041b3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:49.957588 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-e288d136-de4f-4b43-b5d2-4407bcc1e8e1 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:49.959195 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-e288d136-de4f-4b43-b5d2-4407bcc1e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:50.096385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6844-54da-4aa4-bb1f-9227701041b3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:50.104291 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 29/65] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:50.150171 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ab6b4-f646-410b-a051-4faa3a27ed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:50.151064 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ab6b4-f646-410b-a051-4faa3a27ed18 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.151355 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ab6b4-f646-410b-a051-4faa3a27ed18 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.151632 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ab6b4-f646-410b-a051-4faa3a27ed18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.164462 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288d136-de4f-4b43-b5d2-4407bcc1e8e1 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:50.168292 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ab6b4-f646-410b-a051-4faa3a27ed18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-685ab6b4-f646-410b-a051-4faa3a27ed18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:50.176890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:50.177755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:41:50.178550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 37/66] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:41:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:41:50.190312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ab6b4-f646-410b-a051-4faa3a27ed18 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:50.205128 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:50.312738 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ab6b4-f646-410b-a051-4faa3a27ed18 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:50.321344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:50.337327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288d136-de4f-4b43-b5d2-4407bcc1e8e1 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:50.440908 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfe4a4-98dd-425c-8af0-221549d7a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:50.440908 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfe4a4-98dd-425c-8af0-221549d7a3ac None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.440908 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfe4a4-98dd-425c-8af0-221549d7a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.440908 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfe4a4-98dd-425c-8af0-221549d7a3ac None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.441275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfe4a4-98dd-425c-8af0-221549d7a3ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:50.441275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfe4a4-98dd-425c-8af0-221549d7a3ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:50.441275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfe4a4-98dd-425c-8af0-221549d7a3ac None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:50.441275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 38/67] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:41:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:41:50.441275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e87d-b5c3-4bde-890e-f74ed72d2712 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.441275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e87d-b5c3-4bde-890e-f74ed72d2712 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.441603 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e87d-b5c3-4bde-890e-f74ed72d2712 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.441603 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 39/68] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:50.441603 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4362ec-cf1a-4f93-a223-647872d86a2b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.441603 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4362ec-cf1a-4f93-a223-647872d86a2b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.441603 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4362ec-cf1a-4f93-a223-647872d86a2b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.441950 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04337d09-29a3-47b8-b48a-681318de975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:50.441950 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04337d09-29a3-47b8-b48a-681318de975f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.441950 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04337d09-29a3-47b8-b48a-681318de975f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.441950 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04337d09-29a3-47b8-b48a-681318de975f None admin] PATH_INFO: `/v3/roles/member` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.442190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 40/69] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:50.442190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4362ec-cf1a-4f93-a223-647872d86a2b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04337d09-29a3-47b8-b48a-681318de975f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-04337d09-29a3-47b8-b48a-681318de975f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:50.442303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:50.443076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:41:50.444106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 30/70] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:41:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:41:50.445030 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0732fa-baf8-4ea5-8e67-baa99682d782 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.445030 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0732fa-baf8-4ea5-8e67-baa99682d782 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.445030 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0732fa-baf8-4ea5-8e67-baa99682d782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.445030 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-bb0732fa-baf8-4ea5-8e67-baa99682d782 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:50.445030 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-bb0732fa-baf8-4ea5-8e67-baa99682d782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:50.465319 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:50.494678 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 31/71] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:50.494948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4362ec-cf1a-4f93-a223-647872d86a2b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:50.497177 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79e73-b0d5-4858-a3a2-299677486325 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.497619 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79e73-b0d5-4858-a3a2-299677486325 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.497908 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79e73-b0d5-4858-a3a2-299677486325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.514232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-45e79e73-b0d5-4858-a3a2-299677486325 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:50.516623 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-45e79e73-b0d5-4858-a3a2-299677486325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:50.529635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6627c-1152-42db-938c-89a332ccc40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:50.530519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6627c-1152-42db-938c-89a332ccc40b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.530925 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6627c-1152-42db-938c-89a332ccc40b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.531213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6627c-1152-42db-938c-89a332ccc40b None admin] PATH_INFO: `/v3/users/21eb078de33942d0b8933741472428d0` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.544855 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6627c-1152-42db-938c-89a332ccc40b None admin] RBAC: Authorizing `identity:get_user(user_id=21eb078de33942d0b8933741472428d0)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:50.546336 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6627c-1152-42db-938c-89a332ccc40b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:50.548822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 41/72] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:50 2022] GET /identity/v3/users/21eb078de33942d0b8933741472428d0 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:50.549586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6627c-1152-42db-938c-89a332ccc40b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:50.587409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 32/73] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:50.588737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeca0a-c162-4f79-8b49-effd489197f6 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.589034 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeca0a-c162-4f79-8b49-effd489197f6 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.589321 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeca0a-c162-4f79-8b49-effd489197f6 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.590801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 33/74] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:50.595834 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeca0a-c162-4f79-8b49-effd489197f6 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:50.606780 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:50.655452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6627c-1152-42db-938c-89a332ccc40b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:50.684294 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:50.690348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a26a6f-88da-4617-be6a-8671f0e34eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:50.691143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a26a6f-88da-4617-be6a-8671f0e34eb0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.691369 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a26a6f-88da-4617-be6a-8671f0e34eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.691646 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a26a6f-88da-4617-be6a-8671f0e34eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.692395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a26a6f-88da-4617-be6a-8671f0e34eb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:50.692701 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a26a6f-88da-4617-be6a-8671f0e34eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:50.694110 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a26a6f-88da-4617-be6a-8671f0e34eb0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:50.702049 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 42/75] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:41:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:50.702947 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a26a6f-88da-4617-be6a-8671f0e34eb0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:50.704040 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeca0a-c162-4f79-8b49-effd489197f6 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:50.738980 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0581ef9-53e9-45b0-a7cf-a48b4639d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:50.739763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0581ef9-53e9-45b0-a7cf-a48b4639d263 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.740046 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0581ef9-53e9-45b0-a7cf-a48b4639d263 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.740321 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0581ef9-53e9-45b0-a7cf-a48b4639d263 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.751004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0581ef9-53e9-45b0-a7cf-a48b4639d263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-d0581ef9-53e9-45b0-a7cf-a48b4639d263 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:50.758695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:50.759753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:41:50.760573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 34/76] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:41:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:41:50.761594 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece1bba-6d34-4ba3-851c-8880bef4ecaf None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.761774 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece1bba-6d34-4ba3-851c-8880bef4ecaf None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.762057 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece1bba-6d34-4ba3-851c-8880bef4ecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.778699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-6ece1bba-6d34-4ba3-851c-8880bef4ecaf None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:50.779910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-6ece1bba-6d34-4ba3-851c-8880bef4ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:50.806500 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a26a6f-88da-4617-be6a-8671f0e34eb0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:50.839270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a952-7e88-4bb5-9998-debdf4446f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:50.839917 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a952-7e88-4bb5-9998-debdf4446f9a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.840204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a952-7e88-4bb5-9998-debdf4446f9a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.840489 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a952-7e88-4bb5-9998-debdf4446f9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.840760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:50.846805 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 35/77] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:50.847412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece1bba-6d34-4ba3-851c-8880bef4ecaf None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:50.899290 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:50.908999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800a952-7e88-4bb5-9998-debdf4446f9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:50.910505 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800a952-7e88-4bb5-9998-debdf4446f9a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:50.948217 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece1bba-6d34-4ba3-851c-8880bef4ecaf None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:50.983286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4505d4-b1c5-4b72-bf9c-d8109c9e9650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:50.984070 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4505d4-b1c5-4b72-bf9c-d8109c9e9650 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:50.984355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4505d4-b1c5-4b72-bf9c-d8109c9e9650 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:50.984637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4505d4-b1c5-4b72-bf9c-d8109c9e9650 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:50.994824 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4505d4-b1c5-4b72-bf9c-d8109c9e9650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-db4505d4-b1c5-4b72-bf9c-d8109c9e9650 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:51.002457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:51.003359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:41:51.004133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 36/78] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:41:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:41:51.005838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4505d4-b1c5-4b72-bf9c-d8109c9e9650 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.009322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 43/79] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:41:51.010357 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a952-7e88-4bb5-9998-debdf4446f9a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.065113 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:51.101535 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:51.107873 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4505d4-b1c5-4b72-bf9c-d8109c9e9650 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:51.109829 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a952-7e88-4bb5-9998-debdf4446f9a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:51.147167 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6eec-9447-4356-854a-7c86a7c69ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:51.148041 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6eec-9447-4356-854a-7c86a7c69ce1 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:51.148332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6eec-9447-4356-854a-7c86a7c69ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:51.148611 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6eec-9447-4356-854a-7c86a7c69ce1 None admin] PATH_INFO: `/v3/users/21eb078de33942d0b8933741472428d0` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:51.149845 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc6eec-9447-4356-854a-7c86a7c69ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=21eb078de33942d0b8933741472428d0)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:51.151359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc6eec-9447-4356-854a-7c86a7c69ce1 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:51.152962 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4460e-9772-4988-85b8-5207135e44f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:51.153070 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 37/80] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:51 2022] GET /identity/v3/users/21eb078de33942d0b8933741472428d0 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:51.153700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4460e-9772-4988-85b8-5207135e44f7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:51.153878 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6eec-9447-4356-854a-7c86a7c69ce1 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.154089 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4460e-9772-4988-85b8-5207135e44f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:51.154269 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4460e-9772-4988-85b8-5207135e44f7 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:51.155083 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4460e-9772-4988-85b8-5207135e44f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:51.155401 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4460e-9772-4988-85b8-5207135e44f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:51.156797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4460e-9772-4988-85b8-5207135e44f7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:51.165697 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 44/81] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:41:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:51.166520 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4460e-9772-4988-85b8-5207135e44f7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.255941 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6eec-9447-4356-854a-7c86a7c69ce1 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:51.265933 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4460e-9772-4988-85b8-5207135e44f7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:51.283801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:51.291918 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af9d79-0206-40c3-b787-79ddbba8fe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:51.292713 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af9d79-0206-40c3-b787-79ddbba8fe26 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:51.293002 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af9d79-0206-40c3-b787-79ddbba8fe26 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:51.293276 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af9d79-0206-40c3-b787-79ddbba8fe26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:51.294456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af9d79-0206-40c3-b787-79ddbba8fe26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:51.296040 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af9d79-0206-40c3-b787-79ddbba8fe26 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:51.297676 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 38/82] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:41:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:51.298434 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af9d79-0206-40c3-b787-79ddbba8fe26 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.305014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca7058-822e-4108-983a-7ec8baa887c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:51.305689 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7058-822e-4108-983a-7ec8baa887c7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:51.305975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7058-822e-4108-983a-7ec8baa887c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:51.306254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7058-822e-4108-983a-7ec8baa887c7 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:51.307044 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca7058-822e-4108-983a-7ec8baa887c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:51.307357 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca7058-822e-4108-983a-7ec8baa887c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:51.309009 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca7058-822e-4108-983a-7ec8baa887c7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:51.317772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 45/83] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:41:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:51.318638 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca7058-822e-4108-983a-7ec8baa887c7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.337294 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:51.402851 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af9d79-0206-40c3-b787-79ddbba8fe26 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:51.416574 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca7058-822e-4108-983a-7ec8baa887c7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:51.435597 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1038b-84bb-4ff6-a1db-b10bf8d45e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:51.436441 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1038b-84bb-4ff6-a1db-b10bf8d45e80 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:51.436722 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1038b-84bb-4ff6-a1db-b10bf8d45e80 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:51.437003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1038b-84bb-4ff6-a1db-b10bf8d45e80 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:51.438717 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1038b-84bb-4ff6-a1db-b10bf8d45e80 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:51.440158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1038b-84bb-4ff6-a1db-b10bf8d45e80 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:51.441850 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 39/84] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:41:51 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:51.442623 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1038b-84bb-4ff6-a1db-b10bf8d45e80 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.456799 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f3402-2e8b-47db-bad9-1f13b8f782cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:51.457461 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f3402-2e8b-47db-bad9-1f13b8f782cf None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:51.457750 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f3402-2e8b-47db-bad9-1f13b8f782cf None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:51.458047 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f3402-2e8b-47db-bad9-1f13b8f782cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:51.508105 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:51.527948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f3402-2e8b-47db-bad9-1f13b8f782cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:51.529507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f3402-2e8b-47db-bad9-1f13b8f782cf None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:51.546928 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1038b-84bb-4ff6-a1db-b10bf8d45e80 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:51.548162 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:51.582806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a910f-036a-4d18-9c7d-c4df51c0d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:51.583674 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a910f-036a-4d18-9c7d-c4df51c0d333 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:51.583963 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a910f-036a-4d18-9c7d-c4df51c0d333 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:51.584242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a910f-036a-4d18-9c7d-c4df51c0d333 None admin] PATH_INFO: `/v3/users/21eb078de33942d0b8933741472428d0` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:51.585453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a910f-036a-4d18-9c7d-c4df51c0d333 None admin] RBAC: Authorizing `identity:get_user(user_id=21eb078de33942d0b8933741472428d0)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:51.586939 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a910f-036a-4d18-9c7d-c4df51c0d333 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:51.588580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 40/85] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:51 2022] GET /identity/v3/users/21eb078de33942d0b8933741472428d0 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:51.589320 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a910f-036a-4d18-9c7d-c4df51c0d333 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.629840 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 46/86] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:41:51.630722 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f3402-2e8b-47db-bad9-1f13b8f782cf None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.690305 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a910f-036a-4d18-9c7d-c4df51c0d333 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:51.717599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:51.723862 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b7af4-d4c4-4d06-9084-4bb0f2f1337f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:51.724527 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7af4-d4c4-4d06-9084-4bb0f2f1337f None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:51.724817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7af4-d4c4-4d06-9084-4bb0f2f1337f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:51.725100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7af4-d4c4-4d06-9084-4bb0f2f1337f None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:51.725815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b7af4-d4c4-4d06-9084-4bb0f2f1337f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:51.727294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b7af4-d4c4-4d06-9084-4bb0f2f1337f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:51.728492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f3402-2e8b-47db-bad9-1f13b8f782cf None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:51.744977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:51.762322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b40c3-55f6-4a38-b0f0-58ce84de3db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:51.763164 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b40c3-55f6-4a38-b0f0-58ce84de3db8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:51.763447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b40c3-55f6-4a38-b0f0-58ce84de3db8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:51.763721 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b40c3-55f6-4a38-b0f0-58ce84de3db8 None admin] PATH_INFO: `/v3/users/64713eb0c74847f6b1357f2125edd3b1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:51.764939 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b40c3-55f6-4a38-b0f0-58ce84de3db8 None admin] RBAC: Authorizing `identity:get_user(user_id=64713eb0c74847f6b1357f2125edd3b1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:51.766507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b40c3-55f6-4a38-b0f0-58ce84de3db8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:51.768144 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 47/87] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:51 2022] GET /identity/v3/users/64713eb0c74847f6b1357f2125edd3b1 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:51.768893 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b40c3-55f6-4a38-b0f0-58ce84de3db8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.801398 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 41/88] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:41:51 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:41:51.802459 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b7af4-d4c4-4d06-9084-4bb0f2f1337f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.888752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b40c3-55f6-4a38-b0f0-58ce84de3db8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:51.928761 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b7af4-d4c4-4d06-9084-4bb0f2f1337f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:51.930745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81ccd1-dcc8-473e-bdd2-60eb43dbb0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:51.931441 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ccd1-dcc8-473e-bdd2-60eb43dbb0a6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:51.931731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ccd1-dcc8-473e-bdd2-60eb43dbb0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:51.932013 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ccd1-dcc8-473e-bdd2-60eb43dbb0a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:51.932876 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81ccd1-dcc8-473e-bdd2-60eb43dbb0a6 None admin] RBAC: Adding query filter params (role.id=963eb8fa7a2943569e51dc5310a46baa, scope.project.id=11f8474be7594f1f9370c395b04ee7d2, user.id=21eb078de33942d0b8933741472428d0) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:51.933460 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81ccd1-dcc8-473e-bdd2-60eb43dbb0a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:51.934997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81ccd1-dcc8-473e-bdd2-60eb43dbb0a6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:51.942882 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 48/89] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:41:51 2022] GET /identity/v3/role_assignments?user.id=21eb078de33942d0b8933741472428d0&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=963eb8fa7a2943569e51dc5310a46baa => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:51.943555 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81ccd1-dcc8-473e-bdd2-60eb43dbb0a6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:51.987581 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a5a9d-3d64-4c22-9f9d-0056ac6d5ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:51.988613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a5a9d-3d64-4c22-9f9d-0056ac6d5ba5 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:51.989099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a5a9d-3d64-4c22-9f9d-0056ac6d5ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:51.989571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a5a9d-3d64-4c22-9f9d-0056ac6d5ba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:52.004761 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:52.065086 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:52.079147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81ccd1-dcc8-473e-bdd2-60eb43dbb0a6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:52.084007 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a5a9d-3d64-4c22-9f9d-0056ac6d5ba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:52.085875 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a5a9d-3d64-4c22-9f9d-0056ac6d5ba5 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:52.140735 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b047b-d103-4998-b1c6-48a01074289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:52.141948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b047b-d103-4998-b1c6-48a01074289f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:52.142826 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b047b-d103-4998-b1c6-48a01074289f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:52.143305 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b047b-d103-4998-b1c6-48a01074289f None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:52.145704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b047b-d103-4998-b1c6-48a01074289f None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:52.147572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b047b-d103-4998-b1c6-48a01074289f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:52.149921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 49/90] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:41:51 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:52.150892 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b047b-d103-4998-b1c6-48a01074289f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:52.213462 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 42/91] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:41:52.214327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a5a9d-3d64-4c22-9f9d-0056ac6d5ba5 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:52.287942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b047b-d103-4998-b1c6-48a01074289f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:52.309719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:52.336055 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c27d80-8769-4994-b0e8-b3869221064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:52.336367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c27d80-8769-4994-b0e8-b3869221064e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:52.336900 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c27d80-8769-4994-b0e8-b3869221064e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:52.337187 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c27d80-8769-4994-b0e8-b3869221064e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:52.351187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a5a9d-3d64-4c22-9f9d-0056ac6d5ba5 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:52.355711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:52.393025 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce186f-8ab7-4930-b3da-385a76bfe630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:52.394488 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce186f-8ab7-4930-b3da-385a76bfe630 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:52.401521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce186f-8ab7-4930-b3da-385a76bfe630 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:52.401633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce186f-8ab7-4930-b3da-385a76bfe630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:52.402425 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce186f-8ab7-4930-b3da-385a76bfe630 None admin] RBAC: Adding query filter params (role.id=08c3f41d763c4a50ae3acacf391942aa, scope.project.id=11f8474be7594f1f9370c395b04ee7d2, user.id=21eb078de33942d0b8933741472428d0) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:52.404149 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce186f-8ab7-4930-b3da-385a76bfe630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:52.405553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce186f-8ab7-4930-b3da-385a76bfe630 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:52.418048 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 43/92] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:41:52 2022] GET /identity/v3/role_assignments?user.id=21eb078de33942d0b8933741472428d0&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:52.421481 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce186f-8ab7-4930-b3da-385a76bfe630 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:52.446982 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c27d80-8769-4994-b0e8-b3869221064e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:52.446982 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c27d80-8769-4994-b0e8-b3869221064e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:52.560482 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 50/93] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:41:52.567326 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c27d80-8769-4994-b0e8-b3869221064e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:52.595033 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:52.649399 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce186f-8ab7-4930-b3da-385a76bfe630 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:52.703044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f3c9e-dc43-46fb-b5bf-8dd6c7b6d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:52.703961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f3c9e-dc43-46fb-b5bf-8dd6c7b6d315 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:52.704384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f3c9e-dc43-46fb-b5bf-8dd6c7b6d315 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:52.704837 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f3c9e-dc43-46fb-b5bf-8dd6c7b6d315 None admin] PATH_INFO: `/v3/projects/6cb0bc77dc17445d931d713649448dca` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:52.706253 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f3c9e-dc43-46fb-b5bf-8dd6c7b6d315 None admin] RBAC: Authorizing `identity:get_project(project_id=6cb0bc77dc17445d931d713649448dca)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:52.707985 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f3c9e-dc43-46fb-b5bf-8dd6c7b6d315 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:52.710015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 44/94] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:41:52 2022] GET /identity/v3/projects/6cb0bc77dc17445d931d713649448dca => generated 312 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:52.727327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f3c9e-dc43-46fb-b5bf-8dd6c7b6d315 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:52.763497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c27d80-8769-4994-b0e8-b3869221064e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:52.774358 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:52.835365 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd109ac-9205-4c91-b191-0cc5ba6f84e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:52.836236 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd109ac-9205-4c91-b191-0cc5ba6f84e2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:52.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd109ac-9205-4c91-b191-0cc5ba6f84e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:52.836806 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd109ac-9205-4c91-b191-0cc5ba6f84e2 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:52.838975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd109ac-9205-4c91-b191-0cc5ba6f84e2 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:52.840443 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd109ac-9205-4c91-b191-0cc5ba6f84e2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:52.842391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 51/95] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:41:52 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:52.849197 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd109ac-9205-4c91-b191-0cc5ba6f84e2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:52.936226 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f3c9e-dc43-46fb-b5bf-8dd6c7b6d315 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:52.983386 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a0d5b-4f82-4d45-993f-94f5a8fc384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:52.984201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a0d5b-4f82-4d45-993f-94f5a8fc384f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:52.984631 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a0d5b-4f82-4d45-993f-94f5a8fc384f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:52.984972 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a0d5b-4f82-4d45-993f-94f5a8fc384f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:52.986453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a0d5b-4f82-4d45-993f-94f5a8fc384f None admin] RBAC: Adding query filter params (role.id=08c3f41d763c4a50ae3acacf391942aa, scope.project.id=6cb0bc77dc17445d931d713649448dca, user.id=21eb078de33942d0b8933741472428d0) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:52.986807 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a0d5b-4f82-4d45-993f-94f5a8fc384f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:52.988577 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a0d5b-4f82-4d45-993f-94f5a8fc384f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:52.995372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 45/96] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:41:52 2022] GET /identity/v3/role_assignments?user.id=21eb078de33942d0b8933741472428d0&scope.project.id=6cb0bc77dc17445d931d713649448dca&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:53.019835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:53.052428 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd109ac-9205-4c91-b191-0cc5ba6f84e2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:53.124530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23746272-77b5-4537-ac5f-ca3970cb7dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:53.126127 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23746272-77b5-4537-ac5f-ca3970cb7dca None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:53.126635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23746272-77b5-4537-ac5f-ca3970cb7dca None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:53.127115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23746272-77b5-4537-ac5f-ca3970cb7dca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:53.128211 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23746272-77b5-4537-ac5f-ca3970cb7dca None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=11f8474be7594f1f9370c395b04ee7d2, user.id=64713eb0c74847f6b1357f2125edd3b1) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:53.128743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23746272-77b5-4537-ac5f-ca3970cb7dca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:53.130578 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23746272-77b5-4537-ac5f-ca3970cb7dca None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:53.143954 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 52/97] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:41:52 2022] GET /identity/v3/role_assignments?user.id=64713eb0c74847f6b1357f2125edd3b1&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:54.841733 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf74cd-07c6-4f63-b16a-bb0463062633 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:54.842804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf74cd-07c6-4f63-b16a-bb0463062633 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:54.843304 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf74cd-07c6-4f63-b16a-bb0463062633 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:54.845446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 46/98] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:54.850985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543a063-65b5-48bc-97dd-7271f976c651 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:54.851952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543a063-65b5-48bc-97dd-7271f976c651 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:54.852472 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543a063-65b5-48bc-97dd-7271f976c651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:54.870132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3543a063-65b5-48bc-97dd-7271f976c651 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:54.871668 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3543a063-65b5-48bc-97dd-7271f976c651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:54.955089 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 53/99] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:41:54.979122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf74cd-07c6-4f63-b16a-bb0463062633 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:54.981880 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927d58-1327-4088-aa64-753804b00739 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:54.982570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927d58-1327-4088-aa64-753804b00739 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:54.983087 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927d58-1327-4088-aa64-753804b00739 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:54.984763 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 54/100] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:54.990526 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db5b2-9997-4a37-9cd8-63bb1fc6f5a8 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:54.991122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db5b2-9997-4a37-9cd8-63bb1fc6f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:54.991636 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db5b2-9997-4a37-9cd8-63bb1fc6f5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:55.019607 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-788db5b2-9997-4a37-9cd8-63bb1fc6f5a8 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:55.020851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-788db5b2-9997-4a37-9cd8-63bb1fc6f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:55.114370 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:55.131023 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 55/101] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:55.140271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf74cd-07c6-4f63-b16a-bb0463062633 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:55.170042 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788db5b2-9997-4a37-9cd8-63bb1fc6f5a8 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:55.175377 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0095191-4223-46ec-9121-150f6c7cda2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:55.176250 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0095191-4223-46ec-9121-150f6c7cda2d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:55.176532 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0095191-4223-46ec-9121-150f6c7cda2d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:55.179023 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0095191-4223-46ec-9121-150f6c7cda2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:55.189385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:55.203834 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0095191-4223-46ec-9121-150f6c7cda2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-c0095191-4223-46ec-9121-150f6c7cda2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:55.218489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:55.222047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:41:55.223520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 47/102] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:41:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:41:55.230865 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0095191-4223-46ec-9121-150f6c7cda2d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:55.411540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0095191-4223-46ec-9121-150f6c7cda2d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:55.418670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788db5b2-9997-4a37-9cd8-63bb1fc6f5a8 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:55.471630 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e30cf-5a33-44fe-8dc5-0b5db8f0e8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:55.472440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e30cf-5a33-44fe-8dc5-0b5db8f0e8e5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:55.472731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e30cf-5a33-44fe-8dc5-0b5db8f0e8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:55.473013 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e30cf-5a33-44fe-8dc5-0b5db8f0e8e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:55.474311 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e30cf-5a33-44fe-8dc5-0b5db8f0e8e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:55.475814 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e30cf-5a33-44fe-8dc5-0b5db8f0e8e5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:55.478544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 56/103] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:41:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:41:55.486779 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b0fe9-db52-48f2-b17b-770eca9af7ea None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:55.487074 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b0fe9-db52-48f2-b17b-770eca9af7ea None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:55.487358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b0fe9-db52-48f2-b17b-770eca9af7ea None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:55.488638 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 57/104] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:55.493843 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b0fe9-db52-48f2-b17b-770eca9af7ea None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:55.495684 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe52a27-cec1-4672-9cf5-ed2db1a4e141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:55.496357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe52a27-cec1-4672-9cf5-ed2db1a4e141 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:55.496645 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe52a27-cec1-4672-9cf5-ed2db1a4e141 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:55.496931 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe52a27-cec1-4672-9cf5-ed2db1a4e141 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:55.497727 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe52a27-cec1-4672-9cf5-ed2db1a4e141 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:55.498012 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe52a27-cec1-4672-9cf5-ed2db1a4e141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:55.500933 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe52a27-cec1-4672-9cf5-ed2db1a4e141 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:55.510625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 48/105] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:41:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:41:55.511883 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0038-8e01-4320-ae82-180a1694045f None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:55.512181 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0038-8e01-4320-ae82-180a1694045f None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:55.512465 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0038-8e01-4320-ae82-180a1694045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:55.529924 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:55.548923 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-a2fc0038-8e01-4320-ae82-180a1694045f None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:55.551174 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-a2fc0038-8e01-4320-ae82-180a1694045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:55.649394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:55.692156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 49/106] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:55.693887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc0038-8e01-4320-ae82-180a1694045f None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:55.699217 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b0fe9-db52-48f2-b17b-770eca9af7ea None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:55.807246 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec26d53-b6e1-4eb5-a277-ecd105632a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:55.807918 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec26d53-b6e1-4eb5-a277-ecd105632a9b None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:55.808472 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec26d53-b6e1-4eb5-a277-ecd105632a9b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:55.808755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec26d53-b6e1-4eb5-a277-ecd105632a9b None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:55.809471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec26d53-b6e1-4eb5-a277-ecd105632a9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:55.810975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec26d53-b6e1-4eb5-a277-ecd105632a9b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:55.876237 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc0038-8e01-4320-ae82-180a1694045f None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:55.894730 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 58/107] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:41:55 2022] POST /identity/v3/projects => generated 302 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:41:55.895656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec26d53-b6e1-4eb5-a277-ecd105632a9b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:55.918497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c4912-c479-460f-9551-7286ae057ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:55.919872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4912-c479-460f-9551-7286ae057ca8 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:55.920413 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4912-c479-460f-9551-7286ae057ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:55.920910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4912-c479-460f-9551-7286ae057ca8 None admin] PATH_INFO: `/v3/users/1540c67d88174bf18031cf5b2e3d8791` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:55.923796 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:55.956715 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c4912-c479-460f-9551-7286ae057ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=1540c67d88174bf18031cf5b2e3d8791)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:55.958129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c4912-c479-460f-9551-7286ae057ca8 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:55.960549 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 50/108] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:55 2022] GET /identity/v3/users/1540c67d88174bf18031cf5b2e3d8791 => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:55.961774 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae385aa-9c59-49eb-bdd9-2fafebd3906a None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:55.962027 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae385aa-9c59-49eb-bdd9-2fafebd3906a None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:55.962309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae385aa-9c59-49eb-bdd9-2fafebd3906a None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:55.972242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 51/109] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:55.972242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae385aa-9c59-49eb-bdd9-2fafebd3906a None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:56.021434 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec26d53-b6e1-4eb5-a277-ecd105632a9b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:56.055474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:56.061187 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aa31b-bf30-423b-9def-f15819b8076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:56.062329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aa31b-bf30-423b-9def-f15819b8076c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.063458 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aa31b-bf30-423b-9def-f15819b8076c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.063980 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aa31b-bf30-423b-9def-f15819b8076c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.087516 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aa31b-bf30-423b-9def-f15819b8076c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-794aa31b-bf30-423b-9def-f15819b8076c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:56.104833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:56.105850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:41:56.106679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:41:56.112621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 59/110] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:41:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:41:56.115679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4174d-8fee-4924-91be-5e5af3e6432e None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.118358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4174d-8fee-4924-91be-5e5af3e6432e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.119972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4174d-8fee-4924-91be-5e5af3e6432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.154388 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-74b4174d-8fee-4924-91be-5e5af3e6432e None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:56.156199 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-74b4174d-8fee-4924-91be-5e5af3e6432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:56.226692 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae385aa-9c59-49eb-bdd9-2fafebd3906a None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:56.250976 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 60/111] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:56.250976 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4174d-8fee-4924-91be-5e5af3e6432e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:56.280762 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ac43b-e285-4e48-ac30-7e0ffd6801e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:56.281834 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ac43b-e285-4e48-ac30-7e0ffd6801e4 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.282378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ac43b-e285-4e48-ac30-7e0ffd6801e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.282884 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ac43b-e285-4e48-ac30-7e0ffd6801e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.357521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:56.364266 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4174d-8fee-4924-91be-5e5af3e6432e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:56.371688 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ac43b-e285-4e48-ac30-7e0ffd6801e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:56.377563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ac43b-e285-4e48-ac30-7e0ffd6801e4 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:56.390973 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:56.414864 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c17b1-7e4c-4528-9741-fe33549533da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:56.416393 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c17b1-7e4c-4528-9741-fe33549533da None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.416855 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c17b1-7e4c-4528-9741-fe33549533da None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.417287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c17b1-7e4c-4528-9741-fe33549533da None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.418678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c17b1-7e4c-4528-9741-fe33549533da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:56.419155 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c17b1-7e4c-4528-9741-fe33549533da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:56.421408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c17b1-7e4c-4528-9741-fe33549533da None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:56.434400 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 61/112] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:41:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:56.436190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c17b1-7e4c-4528-9741-fe33549533da None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:56.492548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 52/113] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:41:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:41:56.494547 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca8fa8-e536-468f-9e37-bd4683653dd3 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.495026 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca8fa8-e536-468f-9e37-bd4683653dd3 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.495799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca8fa8-e536-468f-9e37-bd4683653dd3 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.497962 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 53/114] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:56.499173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca8fa8-e536-468f-9e37-bd4683653dd3 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:56.553454 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c17b1-7e4c-4528-9741-fe33549533da None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:56.590916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015a3ce-ce9b-444b-b374-b7e7f2beaa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:56.591719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a3ce-ce9b-444b-b374-b7e7f2beaa52 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.592011 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a3ce-ce9b-444b-b374-b7e7f2beaa52 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.592288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a3ce-ce9b-444b-b374-b7e7f2beaa52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.604501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015a3ce-ce9b-444b-b374-b7e7f2beaa52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-8015a3ce-ce9b-444b-b374-b7e7f2beaa52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:56.613556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:56.614473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:41:56.616262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 62/115] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:41:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:41:56.620360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015a3ce-ce9b-444b-b374-b7e7f2beaa52 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:56.631355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:56.640631 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca8fa8-e536-468f-9e37-bd4683653dd3 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:56.667244 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:56.679312 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271a7ee-0e08-4c8a-996e-e4eb20930c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:56.680246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a7ee-0e08-4c8a-996e-e4eb20930c00 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.680536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a7ee-0e08-4c8a-996e-e4eb20930c00 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.680814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a7ee-0e08-4c8a-996e-e4eb20930c00 None admin] PATH_INFO: `/v3/users/21eb078de33942d0b8933741472428d0` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.683260 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271a7ee-0e08-4c8a-996e-e4eb20930c00 None admin] RBAC: Authorizing `identity:get_user(user_id=21eb078de33942d0b8933741472428d0)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:56.684712 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271a7ee-0e08-4c8a-996e-e4eb20930c00 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:56.686490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 54/116] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:56 2022] GET /identity/v3/users/21eb078de33942d0b8933741472428d0 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:56.691881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ea71-47c7-420d-aabb-ca28a4bb6c12 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.696586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ea71-47c7-420d-aabb-ca28a4bb6c12 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.696586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ea71-47c7-420d-aabb-ca28a4bb6c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.709970 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-3f09ea71-47c7-420d-aabb-ca28a4bb6c12 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:56.711208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-3f09ea71-47c7-420d-aabb-ca28a4bb6c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:56.744164 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015a3ce-ce9b-444b-b374-b7e7f2beaa52 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:56.778344 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd74d67-ea8b-43ea-956c-d5e7eaee576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:56.779243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd74d67-ea8b-43ea-956c-d5e7eaee576f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.779538 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd74d67-ea8b-43ea-956c-d5e7eaee576f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.779822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd74d67-ea8b-43ea-956c-d5e7eaee576f None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.781028 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd74d67-ea8b-43ea-956c-d5e7eaee576f None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:56.783054 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd74d67-ea8b-43ea-956c-d5e7eaee576f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:56.784070 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 55/117] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:56.789557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 63/118] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:41:56 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:56.789557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd74d67-ea8b-43ea-956c-d5e7eaee576f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:56.793384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcc9d7-1bfd-451c-82b6-3aed2713e945 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.793678 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcc9d7-1bfd-451c-82b6-3aed2713e945 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.793954 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcc9d7-1bfd-451c-82b6-3aed2713e945 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.799326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 56/119] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:56.799326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcc9d7-1bfd-451c-82b6-3aed2713e945 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:56.896863 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:56.909916 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcc9d7-1bfd-451c-82b6-3aed2713e945 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:56.911799 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd74d67-ea8b-43ea-956c-d5e7eaee576f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:56.924041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:56.948281 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4437afe-489b-4f4e-b173-24009ce7513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:56.949158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4437afe-489b-4f4e-b173-24009ce7513b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.949447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4437afe-489b-4f4e-b173-24009ce7513b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.949733 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4437afe-489b-4f4e-b173-24009ce7513b None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.950329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35870048-9bad-4be0-be7e-439fe44d0af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:56.950965 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4437afe-489b-4f4e-b173-24009ce7513b None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:56.951260 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35870048-9bad-4be0-be7e-439fe44d0af4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.951815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35870048-9bad-4be0-be7e-439fe44d0af4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.952202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35870048-9bad-4be0-be7e-439fe44d0af4 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.952436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4437afe-489b-4f4e-b173-24009ce7513b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:56.953211 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35870048-9bad-4be0-be7e-439fe44d0af4 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:56.954480 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35870048-9bad-4be0-be7e-439fe44d0af4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:56.954785 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 57/120] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:41:56 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:56.955567 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4437afe-489b-4f4e-b173-24009ce7513b None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:56.961363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35870048-9bad-4be0-be7e-439fe44d0af4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:56.973687 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 64/121] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:41:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:56.979287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97d832-1b7d-407a-88f6-22da16dd8646 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:56.979583 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97d832-1b7d-407a-88f6-22da16dd8646 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:56.979870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97d832-1b7d-407a-88f6-22da16dd8646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:56.996196 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-4c97d832-1b7d-407a-88f6-22da16dd8646 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:56.997314 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4c97d832-1b7d-407a-88f6-22da16dd8646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:57.062861 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4437afe-489b-4f4e-b173-24009ce7513b None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:57.074642 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 65/122] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:57.074642 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97d832-1b7d-407a-88f6-22da16dd8646 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:57.108243 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bf594-6cd5-4c1e-b90f-79db06c11a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:57.109669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf594-6cd5-4c1e-b90f-79db06c11a54 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:57.109963 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf594-6cd5-4c1e-b90f-79db06c11a54 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:57.110243 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf594-6cd5-4c1e-b90f-79db06c11a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:57.111119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bf594-6cd5-4c1e-b90f-79db06c11a54 None admin] RBAC: Adding query filter params (role.id=e0ec7191f86c4ea48d96bca7efa2bae7, scope.project.id=11f8474be7594f1f9370c395b04ee7d2, user.id=1540c67d88174bf18031cf5b2e3d8791) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:57.111437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bf594-6cd5-4c1e-b90f-79db06c11a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:57.112958 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bf594-6cd5-4c1e-b90f-79db06c11a54 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:57.120377 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 58/123] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:41:56 2022] GET /identity/v3/role_assignments?user.id=1540c67d88174bf18031cf5b2e3d8791&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=e0ec7191f86c4ea48d96bca7efa2bae7 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:57.120986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bf594-6cd5-4c1e-b90f-79db06c11a54 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:57.157555 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:57.195423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:57.200368 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97d832-1b7d-407a-88f6-22da16dd8646 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:57.249790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfdbcd-0e75-4bad-9290-4618de62f1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:57.251666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfdbcd-0e75-4bad-9290-4618de62f1ff None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:57.252256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfdbcd-0e75-4bad-9290-4618de62f1ff None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:57.252788 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfdbcd-0e75-4bad-9290-4618de62f1ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:57.264514 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bf594-6cd5-4c1e-b90f-79db06c11a54 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:57.275487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfdbcd-0e75-4bad-9290-4618de62f1ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-82bfdbcd-0e75-4bad-9290-4618de62f1ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:57.287797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:57.288694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:41:57.289451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:41:57.291831 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 66/124] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:41:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:41:57.293751 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfdbcd-0e75-4bad-9290-4618de62f1ff None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:57.315212 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6838e8-d339-4d74-a5d1-c9deead0aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:57.316718 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6838e8-d339-4d74-a5d1-c9deead0aad1 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:57.317620 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6838e8-d339-4d74-a5d1-c9deead0aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:57.317620 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6838e8-d339-4d74-a5d1-c9deead0aad1 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2/users/21eb078de33942d0b8933741472428d0/roles/963eb8fa7a2943569e51dc5310a46baa` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:57.320187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6838e8-d339-4d74-a5d1-c9deead0aad1 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f8474be7594f1f9370c395b04ee7d2, user_id=21eb078de33942d0b8933741472428d0, role_id=963eb8fa7a2943569e51dc5310a46baa)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:57.322034 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6838e8-d339-4d74-a5d1-c9deead0aad1 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:57.386707 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 59/125] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:41:57 2022] PUT /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2/users/21eb078de33942d0b8933741472428d0/roles/963eb8fa7a2943569e51dc5310a46baa => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:41:57.387857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6838e8-d339-4d74-a5d1-c9deead0aad1 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:57.437663 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfdbcd-0e75-4bad-9290-4618de62f1ff None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:57.524031 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f02e4-0210-4fa8-b38b-485e95b9e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:57.525209 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f02e4-0210-4fa8-b38b-485e95b9e628 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:57.525628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f02e4-0210-4fa8-b38b-485e95b9e628 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:57.526118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f02e4-0210-4fa8-b38b-485e95b9e628 None admin] PATH_INFO: `/v3/users/21eb078de33942d0b8933741472428d0` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:57.527563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f02e4-0210-4fa8-b38b-485e95b9e628 None admin] RBAC: Authorizing `identity:get_user(user_id=21eb078de33942d0b8933741472428d0)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:57.529528 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:57.530577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f02e4-0210-4fa8-b38b-485e95b9e628 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:57.538630 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 67/126] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:57 2022] GET /identity/v3/users/21eb078de33942d0b8933741472428d0 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:57.539855 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f02e4-0210-4fa8-b38b-485e95b9e628 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:57.550047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6838e8-d339-4d74-a5d1-c9deead0aad1 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:57.594661 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209acd5-8015-46b9-92d2-e7fdf85d6f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:57.596055 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209acd5-8015-46b9-92d2-e7fdf85d6f2e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:57.596358 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209acd5-8015-46b9-92d2-e7fdf85d6f2e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:57.596643 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209acd5-8015-46b9-92d2-e7fdf85d6f2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:57.608182 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:57.610274 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209acd5-8015-46b9-92d2-e7fdf85d6f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-7209acd5-8015-46b9-92d2-e7fdf85d6f2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:41:57.623301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:41:57.624279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:41:57.625058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 60/127] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:41:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:41:57.626256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209acd5-8015-46b9-92d2-e7fdf85d6f2e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:57.728679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f02e4-0210-4fa8-b38b-485e95b9e628 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:57.761716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209acd5-8015-46b9-92d2-e7fdf85d6f2e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:57.771385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74480-1b53-4576-ba54-75ff19458082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:57.772357 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74480-1b53-4576-ba54-75ff19458082 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:57.772959 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74480-1b53-4576-ba54-75ff19458082 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:57.773324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74480-1b53-4576-ba54-75ff19458082 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:57.774210 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb74480-1b53-4576-ba54-75ff19458082 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:57.774533 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb74480-1b53-4576-ba54-75ff19458082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:57.776187 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb74480-1b53-4576-ba54-75ff19458082 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:57.785919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 68/128] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:41:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:57.786682 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74480-1b53-4576-ba54-75ff19458082 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:57.811515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e514a5b-5afb-40bc-b838-3505edbb6947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:57.813871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514a5b-5afb-40bc-b838-3505edbb6947 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:57.814668 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514a5b-5afb-40bc-b838-3505edbb6947 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:57.815129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514a5b-5afb-40bc-b838-3505edbb6947 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:57.817800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e514a5b-5afb-40bc-b838-3505edbb6947 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:57.820192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e514a5b-5afb-40bc-b838-3505edbb6947 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:57.823374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 61/129] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:41:57 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:57.824625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e514a5b-5afb-40bc-b838-3505edbb6947 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:57.843187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:57.937512 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:57.948645 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74480-1b53-4576-ba54-75ff19458082 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:57.982510 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e514a5b-5afb-40bc-b838-3505edbb6947 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:57.997621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed511d-d9f7-48e3-8543-76400b9fcf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:57.998845 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed511d-d9f7-48e3-8543-76400b9fcf37 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:57.999136 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed511d-d9f7-48e3-8543-76400b9fcf37 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:58.000423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed511d-d9f7-48e3-8543-76400b9fcf37 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:58.001194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed511d-d9f7-48e3-8543-76400b9fcf37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:41:58.001510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed511d-d9f7-48e3-8543-76400b9fcf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:58.002957 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed511d-d9f7-48e3-8543-76400b9fcf37 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:58.019921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 69/130] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:41:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:58.020748 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed511d-d9f7-48e3-8543-76400b9fcf37 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:58.041989 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767927f-afdc-4f87-9dee-e636944be3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:58.042817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767927f-afdc-4f87-9dee-e636944be3d7 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:58.043102 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767927f-afdc-4f87-9dee-e636944be3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:58.043379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767927f-afdc-4f87-9dee-e636944be3d7 None admin] PATH_INFO: `/v3/users/21eb078de33942d0b8933741472428d0` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:58.044605 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767927f-afdc-4f87-9dee-e636944be3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=21eb078de33942d0b8933741472428d0)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:58.046086 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767927f-afdc-4f87-9dee-e636944be3d7 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:58.048130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 62/131] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:57 2022] GET /identity/v3/users/21eb078de33942d0b8933741472428d0 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:58.048896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767927f-afdc-4f87-9dee-e636944be3d7 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:58.147000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:58.158852 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767927f-afdc-4f87-9dee-e636944be3d7 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:58.204108 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df42341-31e7-4940-bcae-7fffc96b3595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:58.205491 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df42341-31e7-4940-bcae-7fffc96b3595 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:58.205784 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df42341-31e7-4940-bcae-7fffc96b3595 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:58.206067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df42341-31e7-4940-bcae-7fffc96b3595 None admin] PATH_INFO: `/v3/users/64713eb0c74847f6b1357f2125edd3b1` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:58.207224 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed511d-d9f7-48e3-8543-76400b9fcf37 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:58.207333 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df42341-31e7-4940-bcae-7fffc96b3595 None admin] RBAC: Authorizing `identity:get_user(user_id=64713eb0c74847f6b1357f2125edd3b1)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:58.208945 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df42341-31e7-4940-bcae-7fffc96b3595 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:58.210913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 63/132] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:41:58 2022] GET /identity/v3/users/64713eb0c74847f6b1357f2125edd3b1 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:58.211523 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df42341-31e7-4940-bcae-7fffc96b3595 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:58.244199 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef9cc2-d769-46c8-865f-f58575280beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:58.245435 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef9cc2-d769-46c8-865f-f58575280beb None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:58.246024 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef9cc2-d769-46c8-865f-f58575280beb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:58.246316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef9cc2-d769-46c8-865f-f58575280beb None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2/users/21eb078de33942d0b8933741472428d0/roles/08c3f41d763c4a50ae3acacf391942aa` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:58.249285 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef9cc2-d769-46c8-865f-f58575280beb None admin] RBAC: Authorizing `identity:create_grant(project_id=11f8474be7594f1f9370c395b04ee7d2, user_id=21eb078de33942d0b8933741472428d0, role_id=08c3f41d763c4a50ae3acacf391942aa)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:58.250889 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef9cc2-d769-46c8-865f-f58575280beb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:58.334739 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df42341-31e7-4940-bcae-7fffc96b3595 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:58.354367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 70/133] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:41:58 2022] PUT /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2/users/21eb078de33942d0b8933741472428d0/roles/08c3f41d763c4a50ae3acacf391942aa => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:41:58.360442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef9cc2-d769-46c8-865f-f58575280beb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:58.389307 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:58.397272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c37d-c518-4419-852c-b216ac00fd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:58.398153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c37d-c518-4419-852c-b216ac00fd70 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:58.398447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c37d-c518-4419-852c-b216ac00fd70 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:58.398761 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c37d-c518-4419-852c-b216ac00fd70 None admin] PATH_INFO: `/v3/projects/6cb0bc77dc17445d931d713649448dca` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:58.401021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c37d-c518-4419-852c-b216ac00fd70 None admin] RBAC: Authorizing `identity:get_project(project_id=6cb0bc77dc17445d931d713649448dca)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:58.402772 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c37d-c518-4419-852c-b216ac00fd70 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:58.411878 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 64/134] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:41:58 2022] GET /identity/v3/projects/6cb0bc77dc17445d931d713649448dca => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:58.416810 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c37d-c518-4419-852c-b216ac00fd70 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:58.438712 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:58.532536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c37d-c518-4419-852c-b216ac00fd70 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:58.571908 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416647d-b24a-41db-b43f-5fe7c4c3ea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:58.572927 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416647d-b24a-41db-b43f-5fe7c4c3ea08 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:58.573289 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416647d-b24a-41db-b43f-5fe7c4c3ea08 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:58.573640 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416647d-b24a-41db-b43f-5fe7c4c3ea08 None admin] PATH_INFO: `/v3/projects/6cb0bc77dc17445d931d713649448dca/users/21eb078de33942d0b8933741472428d0/roles/08c3f41d763c4a50ae3acacf391942aa` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:58.575940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416647d-b24a-41db-b43f-5fe7c4c3ea08 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cb0bc77dc17445d931d713649448dca, user_id=21eb078de33942d0b8933741472428d0, role_id=08c3f41d763c4a50ae3acacf391942aa)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:58.577522 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416647d-b24a-41db-b43f-5fe7c4c3ea08 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:58.601539 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef9cc2-d769-46c8-865f-f58575280beb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:58.642596 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef20ebd-b39d-4734-9293-3497c5545986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:58.643942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef20ebd-b39d-4734-9293-3497c5545986 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:58.644431 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef20ebd-b39d-4734-9293-3497c5545986 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:58.644964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef20ebd-b39d-4734-9293-3497c5545986 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:58.646452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef20ebd-b39d-4734-9293-3497c5545986 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:58.647703 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 65/135] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:41:58 2022] PUT /identity/v3/projects/6cb0bc77dc17445d931d713649448dca/users/21eb078de33942d0b8933741472428d0/roles/08c3f41d763c4a50ae3acacf391942aa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:41:58.648465 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef20ebd-b39d-4734-9293-3497c5545986 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:58.649083 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ac471-e7b2-4524-b231-4af165c8c3f5 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:58.649398 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ac471-e7b2-4524-b231-4af165c8c3f5 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:58.649750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ac471-e7b2-4524-b231-4af165c8c3f5 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:58.654640 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 66/136] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:41:58.655352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 71/137] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:41:58 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:58.659660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5473642-01c2-48bd-b8d4-77ee025bd311 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:58.659955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5473642-01c2-48bd-b8d4-77ee025bd311 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:58.660244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5473642-01c2-48bd-b8d4-77ee025bd311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:58.662036 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef20ebd-b39d-4734-9293-3497c5545986 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:58.712529 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-c5473642-01c2-48bd-b8d4-77ee025bd311 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:41:58.713802 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-c5473642-01c2-48bd-b8d4-77ee025bd311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:41:58.835106 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:58.862560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 67/138] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:41:58.874928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef20ebd-b39d-4734-9293-3497c5545986 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:58.899858 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5473642-01c2-48bd-b8d4-77ee025bd311 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:58.915001 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:58.950018 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c225c-06b3-464e-aa20-99df731f4052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:58.950974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c225c-06b3-464e-aa20-99df731f4052 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:58.951264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c225c-06b3-464e-aa20-99df731f4052 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:58.951547 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c225c-06b3-464e-aa20-99df731f4052 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2/users/64713eb0c74847f6b1357f2125edd3b1/roles/4f7e6c1b02094f72ae978c3558b530a9` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:58.957865 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c225c-06b3-464e-aa20-99df731f4052 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f8474be7594f1f9370c395b04ee7d2, user_id=64713eb0c74847f6b1357f2125edd3b1, role_id=4f7e6c1b02094f72ae978c3558b530a9)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:58.960097 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c225c-06b3-464e-aa20-99df731f4052 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:59.045468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 72/139] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:41:58 2022] PUT /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2/users/64713eb0c74847f6b1357f2125edd3b1/roles/4f7e6c1b02094f72ae978c3558b530a9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:41:59.073764 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5473642-01c2-48bd-b8d4-77ee025bd311 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:59.114252 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250b64d-d73d-43bd-8886-8f5925c644d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:59.115054 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b64d-d73d-43bd-8886-8f5925c644d2 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:59.115348 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b64d-d73d-43bd-8886-8f5925c644d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:59.115633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b64d-d73d-43bd-8886-8f5925c644d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:59.116906 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250b64d-d73d-43bd-8886-8f5925c644d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:59.118487 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250b64d-d73d-43bd-8886-8f5925c644d2 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:59.120635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 68/140] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:41:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:41:59.126635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c225c-06b3-464e-aa20-99df731f4052 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:41:59.260676 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c225c-06b3-464e-aa20-99df731f4052 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:41:59.300227 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b96861-cbb9-4006-887d-440fe827f90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:41:59.300919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96861-cbb9-4006-887d-440fe827f90e None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:41:59.301261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96861-cbb9-4006-887d-440fe827f90e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:41:59.301546 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96861-cbb9-4006-887d-440fe827f90e None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:41:59.302278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b96861-cbb9-4006-887d-440fe827f90e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:41:59.303813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b96861-cbb9-4006-887d-440fe827f90e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:41:59.321285 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:41:59.458167 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 73/141] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:41:59 2022] POST /identity/v3/users => generated 283 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:42:00.173119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa29bfd-86c6-4758-b265-261ef2cf5bf9 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:00.173668 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa29bfd-86c6-4758-b265-261ef2cf5bf9 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:00.173668 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa29bfd-86c6-4758-b265-261ef2cf5bf9 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:00.175358 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 69/142] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:00.189593 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea180f5-5e08-4fe4-8467-65f91dd10302 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:00.190231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea180f5-5e08-4fe4-8467-65f91dd10302 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:00.190231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea180f5-5e08-4fe4-8467-65f91dd10302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:00.215844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0ea180f5-5e08-4fe4-8467-65f91dd10302 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:00.217175 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0ea180f5-5e08-4fe4-8467-65f91dd10302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:00.307035 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 74/143] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:00.339412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa29bfd-86c6-4758-b265-261ef2cf5bf9 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:00.428246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:00.431065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a533-d252-4e5e-8443-24655ef79472 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:00.431601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a533-d252-4e5e-8443-24655ef79472 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:00.432074 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a533-d252-4e5e-8443-24655ef79472 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:00.434216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 75/144] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:00.447028 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715d43-1b88-45b1-9180-0331f25b64da None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:00.447571 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715d43-1b88-45b1-9180-0331f25b64da None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:00.448024 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715d43-1b88-45b1-9180-0331f25b64da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:00.461775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa29bfd-86c6-4758-b265-261ef2cf5bf9 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:00.474773 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0d715d43-1b88-45b1-9180-0331f25b64da None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:00.476246 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0d715d43-1b88-45b1-9180-0331f25b64da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:00.501041 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdec8c-e862-40c4-9dc3-f4c1c445c51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:00.501850 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdec8c-e862-40c4-9dc3-f4c1c445c51a None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:00.502139 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdec8c-e862-40c4-9dc3-f4c1c445c51a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:00.502419 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdec8c-e862-40c4-9dc3-f4c1c445c51a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:00.513470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdec8c-e862-40c4-9dc3-f4c1c445c51a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-18fdec8c-e862-40c4-9dc3-f4c1c445c51a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:00.526364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:00.527492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:00.528471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:00.532047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 70/145] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:00.537555 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdec8c-e862-40c4-9dc3-f4c1c445c51a None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:00.606965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 76/146] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:00.677740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d715d43-1b88-45b1-9180-0331f25b64da None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:00.705453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdec8c-e862-40c4-9dc3-f4c1c445c51a None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:00.765638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:00.777443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c861c9-c84b-4894-9ee0-e62d0bfc187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:00.785986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c861c9-c84b-4894-9ee0-e62d0bfc187e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:00.785986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c861c9-c84b-4894-9ee0-e62d0bfc187e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:00.785986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c861c9-c84b-4894-9ee0-e62d0bfc187e None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:00.785986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c861c9-c84b-4894-9ee0-e62d0bfc187e None admin] RBAC: Adding query filter params (name=reader) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:00.785986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c861c9-c84b-4894-9ee0-e62d0bfc187e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:00.785986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c861c9-c84b-4894-9ee0-e62d0bfc187e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:00.787549 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:00.800396 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 71/147] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:00.816246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c861c9-c84b-4894-9ee0-e62d0bfc187e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:00.853990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d715d43-1b88-45b1-9180-0331f25b64da None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:00.913696 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b83882-3b9b-4863-b46e-fcd80c3c91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:00.914545 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83882-3b9b-4863-b46e-fcd80c3c91d5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:00.914849 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83882-3b9b-4863-b46e-fcd80c3c91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:00.915122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83882-3b9b-4863-b46e-fcd80c3c91d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:00.931838 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b83882-3b9b-4863-b46e-fcd80c3c91d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-d5b83882-3b9b-4863-b46e-fcd80c3c91d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:00.952633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:00.954194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:00.955100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 77/148] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:42:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:00.960353 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b83882-3b9b-4863-b46e-fcd80c3c91d5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:01.008354 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c861c9-c84b-4894-9ee0-e62d0bfc187e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:01.058198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a5c2c-4c61-4c26-8e82-53dbb5799e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:01.059497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a5c2c-4c61-4c26-8e82-53dbb5799e29 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:01.060060 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a5c2c-4c61-4c26-8e82-53dbb5799e29 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:01.060537 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a5c2c-4c61-4c26-8e82-53dbb5799e29 None admin] PATH_INFO: `/v3/users/1540c67d88174bf18031cf5b2e3d8791` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:01.063526 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a5c2c-4c61-4c26-8e82-53dbb5799e29 None admin] RBAC: Authorizing `identity:get_user(user_id=1540c67d88174bf18031cf5b2e3d8791)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:01.065919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a5c2c-4c61-4c26-8e82-53dbb5799e29 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:01.070106 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 72/149] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:00 2022] GET /identity/v3/users/1540c67d88174bf18031cf5b2e3d8791 => generated 289 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:01.074577 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a5c2c-4c61-4c26-8e82-53dbb5799e29 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:01.124888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b83882-3b9b-4863-b46e-fcd80c3c91d5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:01.170298 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:01.190939 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28769a3-3e94-448f-b228-d170eddc48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:01.191682 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28769a3-3e94-448f-b228-d170eddc48e0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:01.191898 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28769a3-3e94-448f-b228-d170eddc48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:01.192180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28769a3-3e94-448f-b228-d170eddc48e0 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:01.192949 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28769a3-3e94-448f-b228-d170eddc48e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:01.193280 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28769a3-3e94-448f-b228-d170eddc48e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:01.194741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28769a3-3e94-448f-b228-d170eddc48e0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:01.197749 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:01.217876 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 78/150] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:01.224312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28769a3-3e94-448f-b228-d170eddc48e0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:01.246956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a5c2c-4c61-4c26-8e82-53dbb5799e29 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:01.303467 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19539c00-7ff3-42e2-9767-9d4df0811c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:01.304340 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539c00-7ff3-42e2-9767-9d4df0811c22 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:01.304623 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539c00-7ff3-42e2-9767-9d4df0811c22 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:01.304897 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19539c00-7ff3-42e2-9767-9d4df0811c22 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:01.307838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19539c00-7ff3-42e2-9767-9d4df0811c22 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:01.311331 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19539c00-7ff3-42e2-9767-9d4df0811c22 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:01.315956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 73/151] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:01 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:01.321616 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19539c00-7ff3-42e2-9767-9d4df0811c22 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:01.380076 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28769a3-3e94-448f-b228-d170eddc48e0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:01.419988 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec317fc0-e03f-4530-b00e-4ce8bf6481d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:01.420861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec317fc0-e03f-4530-b00e-4ce8bf6481d0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:01.421139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec317fc0-e03f-4530-b00e-4ce8bf6481d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:01.421411 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec317fc0-e03f-4530-b00e-4ce8bf6481d0 None admin] PATH_INFO: `/v3/users/21eb078de33942d0b8933741472428d0` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:01.423853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec317fc0-e03f-4530-b00e-4ce8bf6481d0 None admin] RBAC: Authorizing `identity:get_user(user_id=21eb078de33942d0b8933741472428d0)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:01.425331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec317fc0-e03f-4530-b00e-4ce8bf6481d0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:01.429534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 79/152] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:01 2022] GET /identity/v3/users/21eb078de33942d0b8933741472428d0 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:01.435121 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec317fc0-e03f-4530-b00e-4ce8bf6481d0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:01.489705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:01.491659 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19539c00-7ff3-42e2-9767-9d4df0811c22 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:01.542975 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:01.556559 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec317fc0-e03f-4530-b00e-4ce8bf6481d0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:01.559300 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149620c-9169-48c6-95f7-4c112b93d926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:01.560212 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149620c-9169-48c6-95f7-4c112b93d926 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:01.560500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149620c-9169-48c6-95f7-4c112b93d926 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:01.560778 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149620c-9169-48c6-95f7-4c112b93d926 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2/users/1540c67d88174bf18031cf5b2e3d8791/roles/e0ec7191f86c4ea48d96bca7efa2bae7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:01.563479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149620c-9169-48c6-95f7-4c112b93d926 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f8474be7594f1f9370c395b04ee7d2, user_id=1540c67d88174bf18031cf5b2e3d8791, role_id=e0ec7191f86c4ea48d96bca7efa2bae7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:01.564953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149620c-9169-48c6-95f7-4c112b93d926 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:01.608057 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720a451-a726-41ad-ad29-fc6210f1fac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:01.608746 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720a451-a726-41ad-ad29-fc6210f1fac5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:01.609028 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720a451-a726-41ad-ad29-fc6210f1fac5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:01.609307 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720a451-a726-41ad-ad29-fc6210f1fac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:01.664180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 74/153] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:42:01 2022] PUT /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2/users/1540c67d88174bf18031cf5b2e3d8791/roles/e0ec7191f86c4ea48d96bca7efa2bae7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:42:01.700763 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720a451-a726-41ad-ad29-fc6210f1fac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:01.702366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720a451-a726-41ad-ad29-fc6210f1fac5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:01.762267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:01.801010 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f07fe-7840-431b-aab5-c1bccdfdd929 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:01.801374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f07fe-7840-431b-aab5-c1bccdfdd929 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:01.801569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f07fe-7840-431b-aab5-c1bccdfdd929 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:01.804095 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 75/154] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:01.808590 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe723f-5885-4b68-b530-b1f71480eee9 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:01.808882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe723f-5885-4b68-b530-b1f71480eee9 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:01.809165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe723f-5885-4b68-b530-b1f71480eee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:01.831665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 80/155] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:42:01.837465 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720a451-a726-41ad-ad29-fc6210f1fac5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:01.855076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-77fe723f-5885-4b68-b530-b1f71480eee9 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:01.856299 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-77fe723f-5885-4b68-b530-b1f71480eee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:01.977083 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720a451-a726-41ad-ad29-fc6210f1fac5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:02.012198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 76/156] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:02.027942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7b75-646f-48b0-b65f-179312d36c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:02.028784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7b75-646f-48b0-b65f-179312d36c70 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:02.029075 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7b75-646f-48b0-b65f-179312d36c70 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:02.029351 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7b75-646f-48b0-b65f-179312d36c70 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:02.030578 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a7b75-646f-48b0-b65f-179312d36c70 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:02.032686 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a7b75-646f-48b0-b65f-179312d36c70 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:02.034639 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 81/157] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:01 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:02.040549 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe723f-5885-4b68-b530-b1f71480eee9 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:02.068476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7b75-646f-48b0-b65f-179312d36c70 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:02.093627 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:02.252560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe723f-5885-4b68-b530-b1f71480eee9 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:02.253824 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7b75-646f-48b0-b65f-179312d36c70 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:02.298633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:02.329813 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e5ecf-cd25-4d22-9fc0-b5a0a4cdc469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:02.330842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5ecf-cd25-4d22-9fc0-b5a0a4cdc469 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:02.331362 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5ecf-cd25-4d22-9fc0-b5a0a4cdc469 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:02.331829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5ecf-cd25-4d22-9fc0-b5a0a4cdc469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:02.332981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e5ecf-cd25-4d22-9fc0-b5a0a4cdc469 None admin] RBAC: Adding query filter params (role.id=963eb8fa7a2943569e51dc5310a46baa, scope.project.id=11f8474be7594f1f9370c395b04ee7d2, user.id=21eb078de33942d0b8933741472428d0) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:02.333456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e5ecf-cd25-4d22-9fc0-b5a0a4cdc469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:02.335092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e5ecf-cd25-4d22-9fc0-b5a0a4cdc469 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:02.344450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f35e0-0e90-4b92-b806-af63373305cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:02.345272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f35e0-0e90-4b92-b806-af63373305cb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:02.345557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f35e0-0e90-4b92-b806-af63373305cb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:02.345831 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f35e0-0e90-4b92-b806-af63373305cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:02.347457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 77/158] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:02 2022] GET /identity/v3/role_assignments?user.id=21eb078de33942d0b8933741472428d0&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=963eb8fa7a2943569e51dc5310a46baa => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:02.368487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f35e0-0e90-4b92-b806-af63373305cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0e6f35e0-0e90-4b92-b806-af63373305cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:02.384851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:02.385784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:02.386678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 82/159] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:02.392772 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e5ecf-cd25-4d22-9fc0-b5a0a4cdc469 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:02.558714 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e5ecf-cd25-4d22-9fc0-b5a0a4cdc469 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:02.600272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5ac5-3129-4e91-bd58-711e102d4846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:02.601202 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5ac5-3129-4e91-bd58-711e102d4846 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:02.601659 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5ac5-3129-4e91-bd58-711e102d4846 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:02.602081 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5ac5-3129-4e91-bd58-711e102d4846 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:02.603141 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5ac5-3129-4e91-bd58-711e102d4846 None admin] RBAC: Adding query filter params (name=member) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:02.603613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5ac5-3129-4e91-bd58-711e102d4846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:02.605290 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5ac5-3129-4e91-bd58-711e102d4846 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:02.619563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 78/160] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:02.625807 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f35e0-0e90-4b92-b806-af63373305cb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:02.768301 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:02.802771 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f35e0-0e90-4b92-b806-af63373305cb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:02.843107 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ecc91-e953-467b-a2b6-b7262b4db2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:02.843966 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ecc91-e953-467b-a2b6-b7262b4db2c6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:02.844248 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ecc91-e953-467b-a2b6-b7262b4db2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:02.844525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ecc91-e953-467b-a2b6-b7262b4db2c6 None admin] PATH_INFO: `/v3/users/21eb078de33942d0b8933741472428d0` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:02.851604 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ecc91-e953-467b-a2b6-b7262b4db2c6 None admin] RBAC: Authorizing `identity:get_user(user_id=21eb078de33942d0b8933741472428d0)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:02.853145 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ecc91-e953-467b-a2b6-b7262b4db2c6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:02.854980 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 83/161] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:02 2022] GET /identity/v3/users/21eb078de33942d0b8933741472428d0 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:02.860737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5ac5-3129-4e91-bd58-711e102d4846 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:02.915399 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:02.976465 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5ac5-3129-4e91-bd58-711e102d4846 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:03.016225 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a78ae-c50d-43c0-9fc6-828d9bb6ca83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:03.016969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a78ae-c50d-43c0-9fc6-828d9bb6ca83 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:03.017252 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a78ae-c50d-43c0-9fc6-828d9bb6ca83 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:03.017528 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a78ae-c50d-43c0-9fc6-828d9bb6ca83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:03.118258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a78ae-c50d-43c0-9fc6-828d9bb6ca83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:03.119766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a78ae-c50d-43c0-9fc6-828d9bb6ca83 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:03.164779 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0a65b-1dbe-41d4-a6ef-11dcab422131 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:03.165108 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0a65b-1dbe-41d4-a6ef-11dcab422131 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:03.165335 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0a65b-1dbe-41d4-a6ef-11dcab422131 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:03.166724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 84/162] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:03.179902 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7020225-b09e-4361-9e4e-77ac628f0636 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:03.180236 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7020225-b09e-4361-9e4e-77ac628f0636 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:03.180445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7020225-b09e-4361-9e4e-77ac628f0636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:03.197280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:03.207480 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c7020225-b09e-4361-9e4e-77ac628f0636 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:03.213119 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c7020225-b09e-4361-9e4e-77ac628f0636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:03.309467 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 79/163] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:03.314968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac132a-7b32-409a-91d6-11a195b5d680 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:03.315281 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac132a-7b32-409a-91d6-11a195b5d680 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:03.315665 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac132a-7b32-409a-91d6-11a195b5d680 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:03.317208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 80/164] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:03.318875 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac132a-7b32-409a-91d6-11a195b5d680 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:03.356553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 85/165] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:03.357861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c6b6-82d9-4d70-87b6-93ca0668189c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:03.358146 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c6b6-82d9-4d70-87b6-93ca0668189c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:03.358418 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c6b6-82d9-4d70-87b6-93ca0668189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:03.392390 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-86a6c6b6-82d9-4d70-87b6-93ca0668189c None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:03.393502 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-86a6c6b6-82d9-4d70-87b6-93ca0668189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:03.436417 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac132a-7b32-409a-91d6-11a195b5d680 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:03.473806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a6542-38fe-4fe3-9852-9e6c03b4460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:03.474694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a6542-38fe-4fe3-9852-9e6c03b4460c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:03.475085 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a6542-38fe-4fe3-9852-9e6c03b4460c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:03.475364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a6542-38fe-4fe3-9852-9e6c03b4460c None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:03.476674 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a6542-38fe-4fe3-9852-9e6c03b4460c None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:03.478232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a6542-38fe-4fe3-9852-9e6c03b4460c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:03.480073 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 81/166] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:03 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:03.480930 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a6542-38fe-4fe3-9852-9e6c03b4460c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:03.497100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 86/167] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:03.497793 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c6b6-82d9-4d70-87b6-93ca0668189c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:03.500669 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:03.503500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:03.594809 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a6542-38fe-4fe3-9852-9e6c03b4460c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:03.635539 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a57cd-3c41-49ad-86ab-2089fe1f6ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:03.636338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a57cd-3c41-49ad-86ab-2089fe1f6ef0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:03.636622 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a57cd-3c41-49ad-86ab-2089fe1f6ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:03.636898 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a57cd-3c41-49ad-86ab-2089fe1f6ef0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:03.648824 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a57cd-3c41-49ad-86ab-2089fe1f6ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:03.657141 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c6b6-82d9-4d70-87b6-93ca0668189c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-368a57cd-3c41-49ad-86ab-2089fe1f6ef0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:03.657308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:03.658309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:03.659129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 82/168] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:42:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:03.659954 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a57cd-3c41-49ad-86ab-2089fe1f6ef0 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:03.702434 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe987e-d82c-4924-aca8-2181ff513c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:03.703184 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe987e-d82c-4924-aca8-2181ff513c20 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:03.703475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe987e-d82c-4924-aca8-2181ff513c20 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:03.703750 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe987e-d82c-4924-aca8-2181ff513c20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:03.704610 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe987e-d82c-4924-aca8-2181ff513c20 None admin] RBAC: Adding query filter params (role.id=08c3f41d763c4a50ae3acacf391942aa, scope.project.id=11f8474be7594f1f9370c395b04ee7d2, user.id=21eb078de33942d0b8933741472428d0) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:03.704921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe987e-d82c-4924-aca8-2181ff513c20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:03.706394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe987e-d82c-4924-aca8-2181ff513c20 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:03.719429 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 87/169] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:03 2022] GET /identity/v3/role_assignments?user.id=21eb078de33942d0b8933741472428d0&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:03.720272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe987e-d82c-4924-aca8-2181ff513c20 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:03.821530 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:03.880316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a57cd-3c41-49ad-86ab-2089fe1f6ef0 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:03.895962 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:03.960525 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f667df-c2c0-43df-8c94-6f237d40abe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:03.961258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f667df-c2c0-43df-8c94-6f237d40abe2 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:03.961543 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f667df-c2c0-43df-8c94-6f237d40abe2 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:03.961819 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f667df-c2c0-43df-8c94-6f237d40abe2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:03.974826 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe987e-d82c-4924-aca8-2181ff513c20 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:03.986785 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f667df-c2c0-43df-8c94-6f237d40abe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-42f667df-c2c0-43df-8c94-6f237d40abe2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:03.994752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:03.995773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:03.996580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 83/170] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:04.002389 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f667df-c2c0-43df-8c94-6f237d40abe2 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:04.056538 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab23b06-3ea9-455d-a2da-44b264a4899c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:04.057222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23b06-3ea9-455d-a2da-44b264a4899c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:04.057507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23b06-3ea9-455d-a2da-44b264a4899c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:04.057786 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23b06-3ea9-455d-a2da-44b264a4899c None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:04.058831 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab23b06-3ea9-455d-a2da-44b264a4899c None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:04.059146 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab23b06-3ea9-455d-a2da-44b264a4899c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:04.060552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab23b06-3ea9-455d-a2da-44b264a4899c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:04.081732 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 88/171] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:04.087585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab23b06-3ea9-455d-a2da-44b264a4899c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:04.154426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f667df-c2c0-43df-8c94-6f237d40abe2 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:04.201500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e76e3-4b54-4e60-94a0-4e553ba4a283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:04.203146 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e76e3-4b54-4e60-94a0-4e553ba4a283 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:04.203573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e76e3-4b54-4e60-94a0-4e553ba4a283 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:04.203970 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e76e3-4b54-4e60-94a0-4e553ba4a283 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:04.204857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e76e3-4b54-4e60-94a0-4e553ba4a283 None admin] RBAC: Adding query filter params (name=member) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:04.205289 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e76e3-4b54-4e60-94a0-4e553ba4a283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:04.206854 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e76e3-4b54-4e60-94a0-4e553ba4a283 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:04.208867 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:04.227670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 84/172] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:04.227670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e76e3-4b54-4e60-94a0-4e553ba4a283 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:04.325467 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab23b06-3ea9-455d-a2da-44b264a4899c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:04.354197 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:04.368775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e76e3-4b54-4e60-94a0-4e553ba4a283 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:04.371045 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09cb49-6c16-476f-b4e6-f695470e4942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:04.371951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09cb49-6c16-476f-b4e6-f695470e4942 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:04.372239 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09cb49-6c16-476f-b4e6-f695470e4942 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:04.374054 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09cb49-6c16-476f-b4e6-f695470e4942 None admin] PATH_INFO: `/v3/users/64713eb0c74847f6b1357f2125edd3b1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:04.374054 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09cb49-6c16-476f-b4e6-f695470e4942 None admin] RBAC: Authorizing `identity:get_user(user_id=64713eb0c74847f6b1357f2125edd3b1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:04.375326 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09cb49-6c16-476f-b4e6-f695470e4942 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:04.377289 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 89/173] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:04 2022] GET /identity/v3/users/64713eb0c74847f6b1357f2125edd3b1 => generated 247 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:04.382541 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09cb49-6c16-476f-b4e6-f695470e4942 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:04.417829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f67b8-ea28-4315-a43b-b82d20c220c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:04.418739 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f67b8-ea28-4315-a43b-b82d20c220c3 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:04.419020 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f67b8-ea28-4315-a43b-b82d20c220c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:04.419291 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f67b8-ea28-4315-a43b-b82d20c220c3 None admin] PATH_INFO: `/v3/users/21eb078de33942d0b8933741472428d0` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:04.420539 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f67b8-ea28-4315-a43b-b82d20c220c3 None admin] RBAC: Authorizing `identity:get_user(user_id=21eb078de33942d0b8933741472428d0)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:04.422690 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f67b8-ea28-4315-a43b-b82d20c220c3 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:04.424588 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 85/174] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:04 2022] GET /identity/v3/users/21eb078de33942d0b8933741472428d0 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:04.430071 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f67b8-ea28-4315-a43b-b82d20c220c3 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:04.547620 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09cb49-6c16-476f-b4e6-f695470e4942 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:04.584154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:04.602262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da524c-4dc8-40a5-afa7-d28f36fdb397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:04.604929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da524c-4dc8-40a5-afa7-d28f36fdb397 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:04.604929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da524c-4dc8-40a5-afa7-d28f36fdb397 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:04.604929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da524c-4dc8-40a5-afa7-d28f36fdb397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:04.690628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f67b8-ea28-4315-a43b-b82d20c220c3 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:04.707915 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:04.720481 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da524c-4dc8-40a5-afa7-d28f36fdb397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:04.725063 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da524c-4dc8-40a5-afa7-d28f36fdb397 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:04.756949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727aa70-6369-47b3-bcaf-c04e1f1ff774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:04.757607 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727aa70-6369-47b3-bcaf-c04e1f1ff774 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:04.757894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727aa70-6369-47b3-bcaf-c04e1f1ff774 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:04.758170 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727aa70-6369-47b3-bcaf-c04e1f1ff774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:04.884853 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727aa70-6369-47b3-bcaf-c04e1f1ff774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:04.886343 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727aa70-6369-47b3-bcaf-c04e1f1ff774 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:04.908926 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 90/175] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:42:04.910620 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc3192-74b4-4df8-8465-685719a7a445 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:04.910914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc3192-74b4-4df8-8465-685719a7a445 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:04.911195 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc3192-74b4-4df8-8465-685719a7a445 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:04.916564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 91/176] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:04.917445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc3192-74b4-4df8-8465-685719a7a445 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:05.016780 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:05.097424 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 86/177] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:42:05.098772 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9c64b-c3c7-4766-9570-4e6a13529cb2 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.099066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9c64b-c3c7-4766-9570-4e6a13529cb2 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.099346 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9c64b-c3c7-4766-9570-4e6a13529cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.116223 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:05.126082 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc3192-74b4-4df8-8465-685719a7a445 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:05.129918 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-f0b9c64b-c3c7-4766-9570-4e6a13529cb2 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:05.131339 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-f0b9c64b-c3c7-4766-9570-4e6a13529cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:05.170802 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508ecab-859c-4ab8-8a53-1943353ca675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:05.172368 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ecab-859c-4ab8-8a53-1943353ca675 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.172660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ecab-859c-4ab8-8a53-1943353ca675 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.172941 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ecab-859c-4ab8-8a53-1943353ca675 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.175165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508ecab-859c-4ab8-8a53-1943353ca675 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:05.176658 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508ecab-859c-4ab8-8a53-1943353ca675 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:05.178384 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 92/178] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:04 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:05.179213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508ecab-859c-4ab8-8a53-1943353ca675 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:05.209788 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 87/179] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:05.211587 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c4f2e-b7eb-4fea-9060-87b13ec4ec86 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.212096 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c4f2e-b7eb-4fea-9060-87b13ec4ec86 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.212571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c4f2e-b7eb-4fea-9060-87b13ec4ec86 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.218249 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 88/180] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:05.219275 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c4f2e-b7eb-4fea-9060-87b13ec4ec86 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:05.303006 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508ecab-859c-4ab8-8a53-1943353ca675 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:05.328984 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:05.337538 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c4f2e-b7eb-4fea-9060-87b13ec4ec86 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:05.344074 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6945fd-1541-4eca-8a6c-d30cc9c84ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:05.344937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6945fd-1541-4eca-8a6c-d30cc9c84ad1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.345458 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6945fd-1541-4eca-8a6c-d30cc9c84ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.345458 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6945fd-1541-4eca-8a6c-d30cc9c84ad1 None admin] PATH_INFO: `/v3/projects/6cb0bc77dc17445d931d713649448dca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.346677 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6945fd-1541-4eca-8a6c-d30cc9c84ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=6cb0bc77dc17445d931d713649448dca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:05.348242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6945fd-1541-4eca-8a6c-d30cc9c84ad1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:05.355101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 93/181] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:05 2022] GET /identity/v3/projects/6cb0bc77dc17445d931d713649448dca => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:05.355101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233124a-db62-4abc-95fd-939493f3b515 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.355101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233124a-db62-4abc-95fd-939493f3b515 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.355101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233124a-db62-4abc-95fd-939493f3b515 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.355101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 94/182] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:05.355101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3975aa-f05a-4de1-9c86-70965d0e0936 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.355526 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3975aa-f05a-4de1-9c86-70965d0e0936 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.355526 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3975aa-f05a-4de1-9c86-70965d0e0936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.374007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-6f3975aa-f05a-4de1-9c86-70965d0e0936 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:05.375780 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6f3975aa-f05a-4de1-9c86-70965d0e0936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:05.382078 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddde51-c0f0-429b-b2a5-a14bb946aa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:05.382769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddde51-c0f0-429b-b2a5-a14bb946aa7c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.383058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddde51-c0f0-429b-b2a5-a14bb946aa7c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.383767 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddde51-c0f0-429b-b2a5-a14bb946aa7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.384623 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddde51-c0f0-429b-b2a5-a14bb946aa7c None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=11f8474be7594f1f9370c395b04ee7d2, user.id=64713eb0c74847f6b1357f2125edd3b1) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:05.384943 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddde51-c0f0-429b-b2a5-a14bb946aa7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:05.387114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddde51-c0f0-429b-b2a5-a14bb946aa7c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:05.393436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 89/183] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:05 2022] GET /identity/v3/role_assignments?user.id=64713eb0c74847f6b1357f2125edd3b1&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:05.394545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddde51-c0f0-429b-b2a5-a14bb946aa7c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:05.409481 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:05.459669 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 95/184] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:05.467862 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3975aa-f05a-4de1-9c86-70965d0e0936 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:05.530269 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddde51-c0f0-429b-b2a5-a14bb946aa7c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:05.568734 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73353adc-d4c9-4c76-9e00-58226b088089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:05.569532 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73353adc-d4c9-4c76-9e00-58226b088089 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.569812 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73353adc-d4c9-4c76-9e00-58226b088089 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.570086 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73353adc-d4c9-4c76-9e00-58226b088089 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.581982 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73353adc-d4c9-4c76-9e00-58226b088089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:05.588256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3975aa-f05a-4de1-9c86-70965d0e0936 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-73353adc-d4c9-4c76-9e00-58226b088089 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:05.589683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:05.590637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 90/185] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:05.596882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072c132-a421-409d-83a2-851ca80862f3 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.597683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072c132-a421-409d-83a2-851ca80862f3 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.597683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072c132-a421-409d-83a2-851ca80862f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.612363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-5072c132-a421-409d-83a2-851ca80862f3 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:05.613557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-5072c132-a421-409d-83a2-851ca80862f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:05.628592 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:05.634093 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898781c9-4247-4f70-83ad-92ec914922ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:05.634807 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898781c9-4247-4f70-83ad-92ec914922ca None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.635097 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898781c9-4247-4f70-83ad-92ec914922ca None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.635374 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898781c9-4247-4f70-83ad-92ec914922ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.636236 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898781c9-4247-4f70-83ad-92ec914922ca None admin] RBAC: Adding query filter params (role.id=08c3f41d763c4a50ae3acacf391942aa, scope.project.id=6cb0bc77dc17445d931d713649448dca, user.id=21eb078de33942d0b8933741472428d0) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:05.636759 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898781c9-4247-4f70-83ad-92ec914922ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:05.638292 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898781c9-4247-4f70-83ad-92ec914922ca None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:05.645461 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 96/186] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:05 2022] GET /identity/v3/role_assignments?user.id=21eb078de33942d0b8933741472428d0&scope.project.id=6cb0bc77dc17445d931d713649448dca&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:05.646863 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6629cc-a137-4216-98b5-9cfa73da81c8 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.646863 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6629cc-a137-4216-98b5-9cfa73da81c8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.647156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6629cc-a137-4216-98b5-9cfa73da81c8 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.652606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 97/187] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:05.653460 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6629cc-a137-4216-98b5-9cfa73da81c8 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:05.684626 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:05.699701 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 91/188] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:05.703660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072c132-a421-409d-83a2-851ca80862f3 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:05.780887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6629cc-a137-4216-98b5-9cfa73da81c8 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:05.818446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072c132-a421-409d-83a2-851ca80862f3 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:05.825187 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605f464-3b52-426e-a9b6-a1a86b65a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:05.825741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f464-3b52-426e-a9b6-a1a86b65a6eb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.826559 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f464-3b52-426e-a9b6-a1a86b65a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.826935 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f464-3b52-426e-a9b6-a1a86b65a6eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.828664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605f464-3b52-426e-a9b6-a1a86b65a6eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:05.830284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605f464-3b52-426e-a9b6-a1a86b65a6eb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:05.832007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 98/189] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:05.833170 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59065920-104e-48c4-9e78-382851b2ea99 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.833457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59065920-104e-48c4-9e78-382851b2ea99 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.833736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59065920-104e-48c4-9e78-382851b2ea99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.856932 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-59065920-104e-48c4-9e78-382851b2ea99 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:05.858126 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-59065920-104e-48c4-9e78-382851b2ea99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:05.863521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138fd47-6603-433e-90d7-238e009dbf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:05.864189 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138fd47-6603-433e-90d7-238e009dbf13 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:05.864470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138fd47-6603-433e-90d7-238e009dbf13 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:05.864742 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138fd47-6603-433e-90d7-238e009dbf13 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:05.865498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138fd47-6603-433e-90d7-238e009dbf13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:05.865806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138fd47-6603-433e-90d7-238e009dbf13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:05.868098 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138fd47-6603-433e-90d7-238e009dbf13 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:05.878074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 92/190] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:05.879172 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138fd47-6603-433e-90d7-238e009dbf13 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:05.893408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:05.936384 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 99/191] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:05.937209 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59065920-104e-48c4-9e78-382851b2ea99 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:05.971738 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:05.987975 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138fd47-6603-433e-90d7-238e009dbf13 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:06.020631 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd632b-7593-4d55-8104-82b46fdbd849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:06.021430 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd632b-7593-4d55-8104-82b46fdbd849 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:06.021713 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd632b-7593-4d55-8104-82b46fdbd849 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:06.021996 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd632b-7593-4d55-8104-82b46fdbd849 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:06.032841 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd632b-7593-4d55-8104-82b46fdbd849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-18fd632b-7593-4d55-8104-82b46fdbd849 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:06.040887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:06.041775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:06.042572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 93/192] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:42:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:06.043264 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd632b-7593-4d55-8104-82b46fdbd849 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:06.050090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59065920-104e-48c4-9e78-382851b2ea99 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:06.084134 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce6a8a-2f87-47e1-8648-2bf4bdf4702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:06.084800 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6a8a-2f87-47e1-8648-2bf4bdf4702d None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:06.085084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6a8a-2f87-47e1-8648-2bf4bdf4702d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:06.085355 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6a8a-2f87-47e1-8648-2bf4bdf4702d None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:06.086063 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce6a8a-2f87-47e1-8648-2bf4bdf4702d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:06.087595 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce6a8a-2f87-47e1-8648-2bf4bdf4702d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:06.110538 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:06.139713 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd632b-7593-4d55-8104-82b46fdbd849 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:06.172307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe78c2c-9256-4217-a362-025c2d2bc275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:06.173167 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe78c2c-9256-4217-a362-025c2d2bc275 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:06.173449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe78c2c-9256-4217-a362-025c2d2bc275 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:06.173724 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe78c2c-9256-4217-a362-025c2d2bc275 None admin] PATH_INFO: `/v3/users/2099fd095a834a1a95b05375279e0715` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:06.186990 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe78c2c-9256-4217-a362-025c2d2bc275 None admin] RBAC: Authorizing `identity:get_user(user_id=2099fd095a834a1a95b05375279e0715)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:06.188474 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe78c2c-9256-4217-a362-025c2d2bc275 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:06.190125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 94/193] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:06 2022] GET /identity/v3/users/2099fd095a834a1a95b05375279e0715 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:06.193268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe78c2c-9256-4217-a362-025c2d2bc275 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:06.226498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 100/194] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:42:05 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:42:06.226498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce6a8a-2f87-47e1-8648-2bf4bdf4702d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:06.305088 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe78c2c-9256-4217-a362-025c2d2bc275 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:06.321770 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:06.337922 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:06.346121 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7739fb5-15d2-46b1-9012-7f55332a6d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:06.346332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce6a8a-2f87-47e1-8648-2bf4bdf4702d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:06.346981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7739fb5-15d2-46b1-9012-7f55332a6d75 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:06.347395 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7739fb5-15d2-46b1-9012-7f55332a6d75 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:06.347682 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7739fb5-15d2-46b1-9012-7f55332a6d75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:06.361282 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7739fb5-15d2-46b1-9012-7f55332a6d75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-f7739fb5-15d2-46b1-9012-7f55332a6d75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:06.369705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:06.370919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:06.371871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 95/195] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:06.372644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7739fb5-15d2-46b1-9012-7f55332a6d75 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:06.389769 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1d692-0ab1-4dfc-b551-9fbb3b2851b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:06.391185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1d692-0ab1-4dfc-b551-9fbb3b2851b4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:06.391507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1d692-0ab1-4dfc-b551-9fbb3b2851b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:06.391758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1d692-0ab1-4dfc-b551-9fbb3b2851b4 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:06.392536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1d692-0ab1-4dfc-b551-9fbb3b2851b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:06.392847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1d692-0ab1-4dfc-b551-9fbb3b2851b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:06.394464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1d692-0ab1-4dfc-b551-9fbb3b2851b4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:06.404685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 101/196] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:06.405432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1d692-0ab1-4dfc-b551-9fbb3b2851b4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:06.489071 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7739fb5-15d2-46b1-9012-7f55332a6d75 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:06.535170 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1d692-0ab1-4dfc-b551-9fbb3b2851b4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:06.541167 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d65de1-2ceb-4fb6-bc9a-a2d95f4b00b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:06.541765 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d65de1-2ceb-4fb6-bc9a-a2d95f4b00b1 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:06.542051 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d65de1-2ceb-4fb6-bc9a-a2d95f4b00b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:06.542332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d65de1-2ceb-4fb6-bc9a-a2d95f4b00b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:06.575624 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72d4c3-a1ad-40df-ba0d-11e3afeb0251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:06.576299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72d4c3-a1ad-40df-ba0d-11e3afeb0251 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:06.576586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72d4c3-a1ad-40df-ba0d-11e3afeb0251 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:06.576896 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72d4c3-a1ad-40df-ba0d-11e3afeb0251 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:06.577766 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72d4c3-a1ad-40df-ba0d-11e3afeb0251 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:06.578498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72d4c3-a1ad-40df-ba0d-11e3afeb0251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:06.580155 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72d4c3-a1ad-40df-ba0d-11e3afeb0251 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:06.589293 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 102/197] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:06.590152 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72d4c3-a1ad-40df-ba0d-11e3afeb0251 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:06.594130 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:06.611686 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:06.626837 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d65de1-2ceb-4fb6-bc9a-a2d95f4b00b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:06.628825 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d65de1-2ceb-4fb6-bc9a-a2d95f4b00b1 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:06.720051 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72d4c3-a1ad-40df-ba0d-11e3afeb0251 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:06.751440 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 96/198] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:06.752700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d65de1-2ceb-4fb6-bc9a-a2d95f4b00b1 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:06.767363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b29e5-c70c-4f3f-80c0-f64b530816dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:06.768505 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b29e5-c70c-4f3f-80c0-f64b530816dd None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:06.768792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b29e5-c70c-4f3f-80c0-f64b530816dd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:06.769069 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b29e5-c70c-4f3f-80c0-f64b530816dd None admin] PATH_INFO: `/v3/users/2099fd095a834a1a95b05375279e0715` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:06.771078 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b29e5-c70c-4f3f-80c0-f64b530816dd None admin] RBAC: Authorizing `identity:get_user(user_id=2099fd095a834a1a95b05375279e0715)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:06.772830 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b29e5-c70c-4f3f-80c0-f64b530816dd None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:06.774981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 103/199] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:06 2022] GET /identity/v3/users/2099fd095a834a1a95b05375279e0715 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:06.775756 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b29e5-c70c-4f3f-80c0-f64b530816dd None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:06.856781 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:06.862079 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:06.876323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d65de1-2ceb-4fb6-bc9a-a2d95f4b00b1 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:06.890146 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b29e5-c70c-4f3f-80c0-f64b530816dd None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:06.914430 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8611a8e-8e8c-4836-8598-559a5aaf55ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:06.915325 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8611a8e-8e8c-4836-8598-559a5aaf55ff None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:06.915604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8611a8e-8e8c-4836-8598-559a5aaf55ff None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:06.915872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8611a8e-8e8c-4836-8598-559a5aaf55ff None admin] PATH_INFO: `/v3/users/1540c67d88174bf18031cf5b2e3d8791` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:06.918023 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8611a8e-8e8c-4836-8598-559a5aaf55ff None admin] RBAC: Authorizing `identity:get_user(user_id=1540c67d88174bf18031cf5b2e3d8791)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:06.919541 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8611a8e-8e8c-4836-8598-559a5aaf55ff None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:06.922137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 97/200] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:06 2022] GET /identity/v3/users/1540c67d88174bf18031cf5b2e3d8791 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:06.926957 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8611a8e-8e8c-4836-8598-559a5aaf55ff None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:06.934378 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04e728-64d9-4a5b-bc65-b8f319a8ec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:06.935539 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e728-64d9-4a5b-bc65-b8f319a8ec0c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:06.936059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e728-64d9-4a5b-bc65-b8f319a8ec0c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:06.936536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e728-64d9-4a5b-bc65-b8f319a8ec0c None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:06.938505 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04e728-64d9-4a5b-bc65-b8f319a8ec0c None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:06.940198 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04e728-64d9-4a5b-bc65-b8f319a8ec0c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:06.942474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 104/201] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:06 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:06.943460 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04e728-64d9-4a5b-bc65-b8f319a8ec0c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:07.034431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8611a8e-8e8c-4836-8598-559a5aaf55ff None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:07.051479 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04e728-64d9-4a5b-bc65-b8f319a8ec0c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:07.069851 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5551a8-3655-4aa0-9a88-33a5763ab758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:07.070497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5551a8-3655-4aa0-9a88-33a5763ab758 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:07.070831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5551a8-3655-4aa0-9a88-33a5763ab758 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:07.071336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5551a8-3655-4aa0-9a88-33a5763ab758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:07.088724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7092e01-a119-4caa-9633-3d20669889d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:07.089779 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7092e01-a119-4caa-9633-3d20669889d9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:07.090269 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7092e01-a119-4caa-9633-3d20669889d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:07.090775 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7092e01-a119-4caa-9633-3d20669889d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:07.098967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:07.104390 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:07.140595 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5551a8-3655-4aa0-9a88-33a5763ab758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:07.142312 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5551a8-3655-4aa0-9a88-33a5763ab758 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:07.165744 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7092e01-a119-4caa-9633-3d20669889d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:07.167744 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7092e01-a119-4caa-9633-3d20669889d9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:07.243111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 98/202] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:07.244061 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5551a8-3655-4aa0-9a88-33a5763ab758 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:07.274452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 105/203] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:07.275621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7092e01-a119-4caa-9633-3d20669889d9 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:07.310636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:07.331768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:07.353443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5551a8-3655-4aa0-9a88-33a5763ab758 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:07.389133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd49ee-976a-4916-94c5-2a59d9364b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:07.390341 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd49ee-976a-4916-94c5-2a59d9364b10 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:07.390722 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd49ee-976a-4916-94c5-2a59d9364b10 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:07.390947 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd49ee-976a-4916-94c5-2a59d9364b10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:07.391947 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd49ee-976a-4916-94c5-2a59d9364b10 None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=83b3fa382b104cb9832f009730a50fe7, user.id=2099fd095a834a1a95b05375279e0715) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:07.392261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd49ee-976a-4916-94c5-2a59d9364b10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:07.394305 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd49ee-976a-4916-94c5-2a59d9364b10 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:07.395651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7092e01-a119-4caa-9633-3d20669889d9 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:07.405080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 99/204] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:07 2022] GET /identity/v3/role_assignments?user.id=2099fd095a834a1a95b05375279e0715&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:07.406923 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd49ee-976a-4916-94c5-2a59d9364b10 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:07.437549 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc65ab-a3ca-48c2-93a6-dac26f97106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:07.438428 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc65ab-a3ca-48c2-93a6-dac26f97106e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:07.438735 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc65ab-a3ca-48c2-93a6-dac26f97106e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:07.439010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc65ab-a3ca-48c2-93a6-dac26f97106e None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:07.440544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc65ab-a3ca-48c2-93a6-dac26f97106e None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:07.442555 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc65ab-a3ca-48c2-93a6-dac26f97106e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:07.444346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 106/205] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:07 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:07.451238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc65ab-a3ca-48c2-93a6-dac26f97106e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:07.571418 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc65ab-a3ca-48c2-93a6-dac26f97106e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:07.582968 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:07.611085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27392dbf-4514-4da7-9be6-2f8e405b84c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:07.619709 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27392dbf-4514-4da7-9be6-2f8e405b84c2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:07.619709 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27392dbf-4514-4da7-9be6-2f8e405b84c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:07.619709 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27392dbf-4514-4da7-9be6-2f8e405b84c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:07.619709 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27392dbf-4514-4da7-9be6-2f8e405b84c2 None admin] RBAC: Adding query filter params (role.id=963eb8fa7a2943569e51dc5310a46baa, scope.project.id=83b3fa382b104cb9832f009730a50fe7, user.id=2099fd095a834a1a95b05375279e0715) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:07.619709 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27392dbf-4514-4da7-9be6-2f8e405b84c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:07.619709 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27392dbf-4514-4da7-9be6-2f8e405b84c2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:07.627555 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 107/206] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:07 2022] GET /identity/v3/role_assignments?user.id=2099fd095a834a1a95b05375279e0715&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=963eb8fa7a2943569e51dc5310a46baa => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:07.685012 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd49ee-976a-4916-94c5-2a59d9364b10 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:07.707031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:07.722267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a7b85-192b-4f3e-8265-b6c1d7e8289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:07.723247 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a7b85-192b-4f3e-8265-b6c1d7e8289f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:07.723528 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a7b85-192b-4f3e-8265-b6c1d7e8289f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:07.723805 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a7b85-192b-4f3e-8265-b6c1d7e8289f None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:07.725119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a7b85-192b-4f3e-8265-b6c1d7e8289f None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:07.726642 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a7b85-192b-4f3e-8265-b6c1d7e8289f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:07.733420 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 100/207] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:07 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:07.734938 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27392dbf-4514-4da7-9be6-2f8e405b84c2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:07.889272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27392dbf-4514-4da7-9be6-2f8e405b84c2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:07.928889 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fa55a-5cfa-41e0-947d-1994210993c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:07.929549 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa55a-5cfa-41e0-947d-1994210993c7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:07.929828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa55a-5cfa-41e0-947d-1994210993c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:07.930099 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa55a-5cfa-41e0-947d-1994210993c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:07.930966 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fa55a-5cfa-41e0-947d-1994210993c7 None admin] RBAC: Adding query filter params (role.id=e0ec7191f86c4ea48d96bca7efa2bae7, scope.project.id=11f8474be7594f1f9370c395b04ee7d2, user.id=1540c67d88174bf18031cf5b2e3d8791) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:07.931278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fa55a-5cfa-41e0-947d-1994210993c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:07.932981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fa55a-5cfa-41e0-947d-1994210993c7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:07.946799 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 108/208] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:07 2022] GET /identity/v3/role_assignments?user.id=1540c67d88174bf18031cf5b2e3d8791&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=e0ec7191f86c4ea48d96bca7efa2bae7 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:08.686320 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39884cc4-e529-40c7-a06c-9693c21625c2 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:08.686893 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39884cc4-e529-40c7-a06c-9693c21625c2 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:08.686893 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39884cc4-e529-40c7-a06c-9693c21625c2 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:08.688549 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 101/209] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:08.694013 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329d82-52bb-4a88-b275-df30a755c4da None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:08.694430 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329d82-52bb-4a88-b275-df30a755c4da None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:08.694641 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329d82-52bb-4a88-b275-df30a755c4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:08.711519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ab329d82-52bb-4a88-b275-df30a755c4da None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:08.712720 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ab329d82-52bb-4a88-b275-df30a755c4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:08.743486 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:08.768609 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e348e99-7930-40a2-a714-af8f1634c989 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:08.768899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e348e99-7930-40a2-a714-af8f1634c989 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:08.769167 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e348e99-7930-40a2-a714-af8f1634c989 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:08.770749 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 102/210] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:08.775749 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4a3d2-05db-4bea-a1ee-0b7fca6f5e75 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:08.776038 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4a3d2-05db-4bea-a1ee-0b7fca6f5e75 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:08.776311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4a3d2-05db-4bea-a1ee-0b7fca6f5e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:08.784034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 109/211] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:08.794471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-0af4a3d2-05db-4bea-a1ee-0b7fca6f5e75 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:08.795716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-0af4a3d2-05db-4bea-a1ee-0b7fca6f5e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:08.810466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab329d82-52bb-4a88-b275-df30a755c4da None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:08.877822 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 103/212] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:08.901347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4a3d2-05db-4bea-a1ee-0b7fca6f5e75 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:08.944506 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab329d82-52bb-4a88-b275-df30a755c4da None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:08.982246 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7965edd-adad-454e-932e-97cf191fd111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:08.983444 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7965edd-adad-454e-932e-97cf191fd111 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:08.983934 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7965edd-adad-454e-932e-97cf191fd111 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:08.984469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7965edd-adad-454e-932e-97cf191fd111 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:08.997407 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7965edd-adad-454e-932e-97cf191fd111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-d7965edd-adad-454e-932e-97cf191fd111 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:09.006004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:09.007008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:09.007822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:09.010650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 110/213] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:09.016824 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7965edd-adad-454e-932e-97cf191fd111 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:09.025098 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4a3d2-05db-4bea-a1ee-0b7fca6f5e75 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:09.047653 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:09.055618 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:09.068553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa13eb7-9422-409c-bfbc-2141cfc3ad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:09.069346 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13eb7-9422-409c-bfbc-2141cfc3ad47 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:09.069696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13eb7-9422-409c-bfbc-2141cfc3ad47 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:09.069906 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13eb7-9422-409c-bfbc-2141cfc3ad47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:09.071140 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa13eb7-9422-409c-bfbc-2141cfc3ad47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:09.072582 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa13eb7-9422-409c-bfbc-2141cfc3ad47 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:09.074249 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 104/214] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:09.080528 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa13eb7-9422-409c-bfbc-2141cfc3ad47 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:09.147211 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7965edd-adad-454e-932e-97cf191fd111 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:09.185002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73099f-9485-434f-8ac4-06c047394eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:09.185999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73099f-9485-434f-8ac4-06c047394eb8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:09.186485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73099f-9485-434f-8ac4-06c047394eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:09.187056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73099f-9485-434f-8ac4-06c047394eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:09.188144 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73099f-9485-434f-8ac4-06c047394eb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:09.188664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73099f-9485-434f-8ac4-06c047394eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:09.190387 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73099f-9485-434f-8ac4-06c047394eb8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:09.199540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 111/215] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:09.205449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73099f-9485-434f-8ac4-06c047394eb8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:09.211983 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa13eb7-9422-409c-bfbc-2141cfc3ad47 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:09.253122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f8608-3728-4fa4-b115-465b3e9119e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:09.253860 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8608-3728-4fa4-b115-465b3e9119e8 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:09.254511 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8608-3728-4fa4-b115-465b3e9119e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:09.254511 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8608-3728-4fa4-b115-465b3e9119e8 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:09.255287 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f8608-3728-4fa4-b115-465b3e9119e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:09.256978 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f8608-3728-4fa4-b115-465b3e9119e8 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:09.309996 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:09.322173 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73099f-9485-434f-8ac4-06c047394eb8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:09.359120 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0292c0-cbdd-42dd-8faa-43dd90b189b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:09.359987 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0292c0-cbdd-42dd-8faa-43dd90b189b7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:09.360266 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0292c0-cbdd-42dd-8faa-43dd90b189b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:09.360534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0292c0-cbdd-42dd-8faa-43dd90b189b7 None admin] PATH_INFO: `/v3/users/25cb10de8ae8408eb91a52e67d64de84` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:09.376098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0292c0-cbdd-42dd-8faa-43dd90b189b7 None admin] RBAC: Authorizing `identity:get_user(user_id=25cb10de8ae8408eb91a52e67d64de84)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:09.377850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0292c0-cbdd-42dd-8faa-43dd90b189b7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:09.378340 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 105/216] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:42:09 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:42:09.384397 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 112/217] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:09 2022] GET /identity/v3/users/25cb10de8ae8408eb91a52e67d64de84 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:09.386084 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f8608-3728-4fa4-b115-465b3e9119e8 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:09.443996 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:09.509281 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f8608-3728-4fa4-b115-465b3e9119e8 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:09.547074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134371f-7d13-4d17-9b73-9c17318bd0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:09.548038 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134371f-7d13-4d17-9b73-9c17318bd0b3 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:09.548497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134371f-7d13-4d17-9b73-9c17318bd0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:09.548971 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134371f-7d13-4d17-9b73-9c17318bd0b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:09.623938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134371f-7d13-4d17-9b73-9c17318bd0b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:09.625944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134371f-7d13-4d17-9b73-9c17318bd0b3 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:09.671145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:09.733640 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 106/218] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:09.739814 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0292c0-cbdd-42dd-8faa-43dd90b189b7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:09.868920 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0292c0-cbdd-42dd-8faa-43dd90b189b7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:09.905495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac4e7d-1eaa-4079-89a4-65145ecd5381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:09.906376 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4e7d-1eaa-4079-89a4-65145ecd5381 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:09.906684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4e7d-1eaa-4079-89a4-65145ecd5381 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:09.906964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4e7d-1eaa-4079-89a4-65145ecd5381 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:09.908178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac4e7d-1eaa-4079-89a4-65145ecd5381 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:09.909635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac4e7d-1eaa-4079-89a4-65145ecd5381 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:09.911373 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 113/219] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:09 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:09.917153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134371f-7d13-4d17-9b73-9c17318bd0b3 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:09.998009 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d122342-5965-4c2f-b1e5-ca7fe0a87544 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:09.998356 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d122342-5965-4c2f-b1e5-ca7fe0a87544 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:10.000684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d122342-5965-4c2f-b1e5-ca7fe0a87544 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:10.000684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 114/220] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:10.008209 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f1d08-fcca-4572-ab2c-3769eb4e1f66 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:10.008497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f1d08-fcca-4572-ab2c-3769eb4e1f66 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:10.008779 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f1d08-fcca-4572-ab2c-3769eb4e1f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:10.029180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-075f1d08-fcca-4572-ab2c-3769eb4e1f66 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:10.030490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-075f1d08-fcca-4572-ab2c-3769eb4e1f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:10.041327 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:10.064789 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134371f-7d13-4d17-9b73-9c17318bd0b3 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:10.124383 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fb33b-4e62-4e23-8222-394c31c8f7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:10.124999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb33b-4e62-4e23-8222-394c31c8f7d7 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:10.125284 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb33b-4e62-4e23-8222-394c31c8f7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:10.125563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb33b-4e62-4e23-8222-394c31c8f7d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:10.126412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fb33b-4e62-4e23-8222-394c31c8f7d7 None admin] RBAC: Adding query filter params (role.id=08c3f41d763c4a50ae3acacf391942aa, scope.project.id=83b3fa382b104cb9832f009730a50fe7, user.id=25cb10de8ae8408eb91a52e67d64de84) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:10.126762 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fb33b-4e62-4e23-8222-394c31c8f7d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:10.132554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fb33b-4e62-4e23-8222-394c31c8f7d7 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:10.136507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 115/221] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:10.145147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 107/222] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:09 2022] GET /identity/v3/role_assignments?user.id=25cb10de8ae8408eb91a52e67d64de84&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:10.158315 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a3bc6-5187-4485-9f8e-ab45de33cc1e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:10.158677 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a3bc6-5187-4485-9f8e-ab45de33cc1e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:10.158902 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a3bc6-5187-4485-9f8e-ab45de33cc1e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:10.160312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 116/223] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:10.166120 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf9faf-7cf1-4633-b996-d4d2402e6b98 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:10.166403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf9faf-7cf1-4633-b996-d4d2402e6b98 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:10.166721 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf9faf-7cf1-4633-b996-d4d2402e6b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:10.180738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:10.187955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-3fcf9faf-7cf1-4633-b996-d4d2402e6b98 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:10.189351 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-3fcf9faf-7cf1-4633-b996-d4d2402e6b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:10.203478 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a3bc6-5187-4485-9f8e-ab45de33cc1e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:10.342213 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 108/224] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:10.380116 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf9faf-7cf1-4633-b996-d4d2402e6b98 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:10.396678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a3bc6-5187-4485-9f8e-ab45de33cc1e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:10.463921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6f946-8962-439b-93cd-1bcf78d30cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:10.465121 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6f946-8962-439b-93cd-1bcf78d30cfc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:10.465626 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6f946-8962-439b-93cd-1bcf78d30cfc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:10.466842 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6f946-8962-439b-93cd-1bcf78d30cfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:10.488833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6f946-8962-439b-93cd-1bcf78d30cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-12b6f946-8962-439b-93cd-1bcf78d30cfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:10.497598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:10.498536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:10.499370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:10.502279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 117/225] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:10.508331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6f946-8962-439b-93cd-1bcf78d30cfc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:10.512618 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:10.579669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf9faf-7cf1-4633-b996-d4d2402e6b98 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:10.648916 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302266c-7eaa-43a7-812c-75afbcbaf067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:10.649668 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302266c-7eaa-43a7-812c-75afbcbaf067 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:10.649951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302266c-7eaa-43a7-812c-75afbcbaf067 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:10.650225 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302266c-7eaa-43a7-812c-75afbcbaf067 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:10.659889 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:10.667245 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302266c-7eaa-43a7-812c-75afbcbaf067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:10.677355 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6f946-8962-439b-93cd-1bcf78d30cfc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-e302266c-7eaa-43a7-812c-75afbcbaf067 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:10.686708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:10.687629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:10.688447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 109/226] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:42:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:10.695397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302266c-7eaa-43a7-812c-75afbcbaf067 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:10.747891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6ff0c-86b8-4564-b3be-747857f031bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:10.748561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ff0c-86b8-4564-b3be-747857f031bc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:10.748848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ff0c-86b8-4564-b3be-747857f031bc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:10.749123 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ff0c-86b8-4564-b3be-747857f031bc None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:10.749913 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6ff0c-86b8-4564-b3be-747857f031bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:10.750221 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6ff0c-86b8-4564-b3be-747857f031bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:10.751734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6ff0c-86b8-4564-b3be-747857f031bc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:10.771328 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 118/227] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:10.789939 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6ff0c-86b8-4564-b3be-747857f031bc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:10.827220 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302266c-7eaa-43a7-812c-75afbcbaf067 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:10.870937 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d774213-79c1-48bf-8441-9efe33116dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:10.871606 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d774213-79c1-48bf-8441-9efe33116dac None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:10.871888 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d774213-79c1-48bf-8441-9efe33116dac None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:10.872162 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d774213-79c1-48bf-8441-9efe33116dac None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:10.872919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d774213-79c1-48bf-8441-9efe33116dac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:10.873226 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d774213-79c1-48bf-8441-9efe33116dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:10.875230 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d774213-79c1-48bf-8441-9efe33116dac None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:10.884466 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 110/228] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:10.891951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d774213-79c1-48bf-8441-9efe33116dac None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:10.913850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:10.966547 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:10.981687 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6ff0c-86b8-4564-b3be-747857f031bc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:11.022101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d774213-79c1-48bf-8441-9efe33116dac None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:11.060116 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72cbc5-a803-4e2a-8321-23fafba02986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:11.061074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3844b7e-eeef-47d8-b16c-056d0137d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:11.062733 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72cbc5-a803-4e2a-8321-23fafba02986 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:11.063803 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3844b7e-eeef-47d8-b16c-056d0137d50c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:11.064303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3844b7e-eeef-47d8-b16c-056d0137d50c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:11.064775 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72cbc5-a803-4e2a-8321-23fafba02986 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:11.065241 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3844b7e-eeef-47d8-b16c-056d0137d50c None admin] PATH_INFO: `/v3/users/2099fd095a834a1a95b05375279e0715` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:11.065707 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72cbc5-a803-4e2a-8321-23fafba02986 None admin] PATH_INFO: `/v3/users/2099fd095a834a1a95b05375279e0715` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:11.067760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3844b7e-eeef-47d8-b16c-056d0137d50c None admin] RBAC: Authorizing `identity:get_user(user_id=2099fd095a834a1a95b05375279e0715)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:11.068653 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72cbc5-a803-4e2a-8321-23fafba02986 None admin] RBAC: Authorizing `identity:get_user(user_id=2099fd095a834a1a95b05375279e0715)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:11.070304 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3844b7e-eeef-47d8-b16c-056d0137d50c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:11.071995 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72cbc5-a803-4e2a-8321-23fafba02986 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:11.073985 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 111/229] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:10 2022] GET /identity/v3/users/2099fd095a834a1a95b05375279e0715 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:11.075908 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 119/230] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:10 2022] GET /identity/v3/users/2099fd095a834a1a95b05375279e0715 => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:11.081862 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3844b7e-eeef-47d8-b16c-056d0137d50c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:11.083116 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72cbc5-a803-4e2a-8321-23fafba02986 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:11.223553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3844b7e-eeef-47d8-b16c-056d0137d50c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:11.251373 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:11.265158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66841fc-c5e5-4bd0-a308-aa375f5b6f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:11.266292 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66841fc-c5e5-4bd0-a308-aa375f5b6f26 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:11.266804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66841fc-c5e5-4bd0-a308-aa375f5b6f26 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:11.267279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66841fc-c5e5-4bd0-a308-aa375f5b6f26 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:11.269900 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66841fc-c5e5-4bd0-a308-aa375f5b6f26 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:11.271731 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66841fc-c5e5-4bd0-a308-aa375f5b6f26 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:11.275747 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 112/231] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:11 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:11.283681 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66841fc-c5e5-4bd0-a308-aa375f5b6f26 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:11.299111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72cbc5-a803-4e2a-8321-23fafba02986 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:11.372996 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972571d-f22c-4512-a9cd-90c7f9269686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:11.373860 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972571d-f22c-4512-a9cd-90c7f9269686 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:11.374146 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972571d-f22c-4512-a9cd-90c7f9269686 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:11.374423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972571d-f22c-4512-a9cd-90c7f9269686 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:11.376945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972571d-f22c-4512-a9cd-90c7f9269686 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:11.378411 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972571d-f22c-4512-a9cd-90c7f9269686 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:11.382854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 120/232] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:11 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:11.391478 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972571d-f22c-4512-a9cd-90c7f9269686 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:11.396213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:11.464812 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66841fc-c5e5-4bd0-a308-aa375f5b6f26 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:11.496254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972571d-f22c-4512-a9cd-90c7f9269686 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:11.530651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadd1f2-0834-4dfa-8003-a11631ef3666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:11.532091 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd1f2-0834-4dfa-8003-a11631ef3666 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:11.532373 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd1f2-0834-4dfa-8003-a11631ef3666 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:11.532649 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd1f2-0834-4dfa-8003-a11631ef3666 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7/users/2099fd095a834a1a95b05375279e0715/roles/4f7e6c1b02094f72ae978c3558b530a9` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:11.534686 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadd1f2-0834-4dfa-8003-a11631ef3666 None admin] RBAC: Authorizing `identity:create_grant(project_id=83b3fa382b104cb9832f009730a50fe7, user_id=2099fd095a834a1a95b05375279e0715, role_id=4f7e6c1b02094f72ae978c3558b530a9)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:11.536162 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadd1f2-0834-4dfa-8003-a11631ef3666 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:11.552199 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78eaa6-564c-4fc1-9cb8-c5c1d6fd0151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:11.553121 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78eaa6-564c-4fc1-9cb8-c5c1d6fd0151 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:11.553491 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78eaa6-564c-4fc1-9cb8-c5c1d6fd0151 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:11.553794 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78eaa6-564c-4fc1-9cb8-c5c1d6fd0151 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7/users/2099fd095a834a1a95b05375279e0715/roles/963eb8fa7a2943569e51dc5310a46baa` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:11.556341 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78eaa6-564c-4fc1-9cb8-c5c1d6fd0151 None admin] RBAC: Authorizing `identity:create_grant(project_id=83b3fa382b104cb9832f009730a50fe7, user_id=2099fd095a834a1a95b05375279e0715, role_id=963eb8fa7a2943569e51dc5310a46baa)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:11.558118 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78eaa6-564c-4fc1-9cb8-c5c1d6fd0151 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:11.631067 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 121/233] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:42:11 2022] PUT /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7/users/2099fd095a834a1a95b05375279e0715/roles/4f7e6c1b02094f72ae978c3558b530a9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:42:11.658504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 113/234] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:42:11 2022] PUT /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7/users/2099fd095a834a1a95b05375279e0715/roles/963eb8fa7a2943569e51dc5310a46baa => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:42:12.120723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76a3f-bbbb-4b72-adf2-ed3039f6ddf9 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:12.121254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76a3f-bbbb-4b72-adf2-ed3039f6ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:12.121332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76a3f-bbbb-4b72-adf2-ed3039f6ddf9 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:12.123007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 122/235] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:12.129399 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17930950-852d-4672-aeb5-d8c60b8948e3 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:12.129888 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17930950-852d-4672-aeb5-d8c60b8948e3 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:12.129989 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17930950-852d-4672-aeb5-d8c60b8948e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:12.148796 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-17930950-852d-4672-aeb5-d8c60b8948e3 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:12.149998 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-17930950-852d-4672-aeb5-d8c60b8948e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:12.203542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:12.221752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 114/236] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:12.246929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76a3f-bbbb-4b72-adf2-ed3039f6ddf9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:12.316497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:12.376070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76a3f-bbbb-4b72-adf2-ed3039f6ddf9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:12.423361 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be040a8-a37d-492b-b89d-ccd0bb141731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:12.424252 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be040a8-a37d-492b-b89d-ccd0bb141731 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:12.424529 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be040a8-a37d-492b-b89d-ccd0bb141731 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:12.424782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be040a8-a37d-492b-b89d-ccd0bb141731 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:12.426040 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be040a8-a37d-492b-b89d-ccd0bb141731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:12.427627 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be040a8-a37d-492b-b89d-ccd0bb141731 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:12.429301 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 123/237] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:12.435233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17930950-852d-4672-aeb5-d8c60b8948e3 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:12.473375 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40c86-94cf-42ef-a567-f97e160ea3f9 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:12.473905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40c86-94cf-42ef-a567-f97e160ea3f9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:12.474497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40c86-94cf-42ef-a567-f97e160ea3f9 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:12.476155 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 124/238] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:12.482007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2246-18ad-42fc-b037-72eb00fd0435 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:12.482806 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2246-18ad-42fc-b037-72eb00fd0435 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:12.483289 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2246-18ad-42fc-b037-72eb00fd0435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:12.517356 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-593b2246-18ad-42fc-b037-72eb00fd0435 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:12.518917 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-593b2246-18ad-42fc-b037-72eb00fd0435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:12.554283 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17930950-852d-4672-aeb5-d8c60b8948e3 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:12.599143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 125/239] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:12.604306 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1718d4-7b2e-4d26-8e84-f74e75e011d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:12.605297 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1718d4-7b2e-4d26-8e84-f74e75e011d3 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:12.605730 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1718d4-7b2e-4d26-8e84-f74e75e011d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:12.606210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1718d4-7b2e-4d26-8e84-f74e75e011d3 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:12.607178 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1718d4-7b2e-4d26-8e84-f74e75e011d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:12.609485 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1718d4-7b2e-4d26-8e84-f74e75e011d3 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:12.635783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2246-18ad-42fc-b037-72eb00fd0435 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:12.703171 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 115/240] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:42:12 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:42:12.715012 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:12.755075 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2246-18ad-42fc-b037-72eb00fd0435 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:12.793680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cfcb1-895c-4db6-8d73-a20c09a1c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:12.794785 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfcb1-895c-4db6-8d73-a20c09a1c68a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:12.795212 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfcb1-895c-4db6-8d73-a20c09a1c68a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:12.795631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfcb1-895c-4db6-8d73-a20c09a1c68a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:12.808613 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cfcb1-895c-4db6-8d73-a20c09a1c68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-d73cfcb1-895c-4db6-8d73-a20c09a1c68a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:12.818135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:12.819318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:12.820304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:12.821546 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2fe58-5b6b-44fe-afc3-08982f13c917 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:12.821839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2fe58-5b6b-44fe-afc3-08982f13c917 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:12.822118 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2fe58-5b6b-44fe-afc3-08982f13c917 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:12.823334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 126/241] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:12.826699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 116/242] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:12.830264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73896d9e-78d7-4f07-9594-0f1b8b7a4c0f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:12.830559 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73896d9e-78d7-4f07-9594-0f1b8b7a4c0f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:12.830886 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73896d9e-78d7-4f07-9594-0f1b8b7a4c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:12.832300 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2fe58-5b6b-44fe-afc3-08982f13c917 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:12.849770 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-73896d9e-78d7-4f07-9594-0f1b8b7a4c0f None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:12.851150 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-73896d9e-78d7-4f07-9594-0f1b8b7a4c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:12.931111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 127/243] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:12.968117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73896d9e-78d7-4f07-9594-0f1b8b7a4c0f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:12.971019 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:13.048121 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:13.055333 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2fe58-5b6b-44fe-afc3-08982f13c917 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:13.101500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c081f3-f725-4d56-b474-5ab0e3e30837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:13.102188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c081f3-f725-4d56-b474-5ab0e3e30837 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:13.102476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c081f3-f725-4d56-b474-5ab0e3e30837 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:13.103855 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c081f3-f725-4d56-b474-5ab0e3e30837 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:13.104629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c081f3-f725-4d56-b474-5ab0e3e30837 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:13.104944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c081f3-f725-4d56-b474-5ab0e3e30837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:13.106332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c081f3-f725-4d56-b474-5ab0e3e30837 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:13.119109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 117/244] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:13.125837 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c081f3-f725-4d56-b474-5ab0e3e30837 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:13.127368 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73896d9e-78d7-4f07-9594-0f1b8b7a4c0f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:13.176295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ec3c9-310e-4833-96fb-4c4491ab8db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:13.177126 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ec3c9-310e-4833-96fb-4c4491ab8db5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:13.177410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ec3c9-310e-4833-96fb-4c4491ab8db5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:13.177689 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ec3c9-310e-4833-96fb-4c4491ab8db5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:13.198908 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ec3c9-310e-4833-96fb-4c4491ab8db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a90ec3c9-310e-4833-96fb-4c4491ab8db5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:13.207815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:13.208699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:13.209921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 128/245] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:13.214839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ec3c9-310e-4833-96fb-4c4491ab8db5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:13.260634 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c081f3-f725-4d56-b474-5ab0e3e30837 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:13.263324 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:13.314926 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868327-5475-446f-acce-4323d1e2b756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:13.315999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868327-5475-446f-acce-4323d1e2b756 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:13.316393 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868327-5475-446f-acce-4323d1e2b756 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:13.316772 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868327-5475-446f-acce-4323d1e2b756 None admin] PATH_INFO: `/v3/users/3d2743ec40414e4782a31f7ffbdb5bb6` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:13.341040 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be868327-5475-446f-acce-4323d1e2b756 None admin] RBAC: Authorizing `identity:get_user(user_id=3d2743ec40414e4782a31f7ffbdb5bb6)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:13.343061 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be868327-5475-446f-acce-4323d1e2b756 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:13.346469 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 118/246] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:13 2022] GET /identity/v3/users/3d2743ec40414e4782a31f7ffbdb5bb6 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:13.352616 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868327-5475-446f-acce-4323d1e2b756 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:13.373694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ec3c9-310e-4833-96fb-4c4491ab8db5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:13.390265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:13.428996 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044564f5-3099-4da2-aae4-c550f6cb6b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:13.430062 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044564f5-3099-4da2-aae4-c550f6cb6b41 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:13.431055 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044564f5-3099-4da2-aae4-c550f6cb6b41 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:13.431966 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044564f5-3099-4da2-aae4-c550f6cb6b41 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:13.433546 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044564f5-3099-4da2-aae4-c550f6cb6b41 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:13.434367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044564f5-3099-4da2-aae4-c550f6cb6b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:13.437038 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044564f5-3099-4da2-aae4-c550f6cb6b41 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:13.449446 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 129/247] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:13.455331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044564f5-3099-4da2-aae4-c550f6cb6b41 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:13.508121 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868327-5475-446f-acce-4323d1e2b756 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:13.555205 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbde78b-699c-4b00-8fbb-97af35c9a24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:13.556228 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbde78b-699c-4b00-8fbb-97af35c9a24b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:13.556719 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbde78b-699c-4b00-8fbb-97af35c9a24b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:13.557246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbde78b-699c-4b00-8fbb-97af35c9a24b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:13.593014 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:13.600325 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044564f5-3099-4da2-aae4-c550f6cb6b41 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:13.644225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd9e87-0ec9-4d74-9532-1a4029369a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:13.645616 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd9e87-0ec9-4d74-9532-1a4029369a5d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:13.646131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd9e87-0ec9-4d74-9532-1a4029369a5d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:13.646586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd9e87-0ec9-4d74-9532-1a4029369a5d None admin] PATH_INFO: `/v3/users/25cb10de8ae8408eb91a52e67d64de84` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:13.648103 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd9e87-0ec9-4d74-9532-1a4029369a5d None admin] RBAC: Authorizing `identity:get_user(user_id=25cb10de8ae8408eb91a52e67d64de84)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:13.649848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd9e87-0ec9-4d74-9532-1a4029369a5d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:13.652016 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 130/248] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:13 2022] GET /identity/v3/users/25cb10de8ae8408eb91a52e67d64de84 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:13.658684 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbde78b-699c-4b00-8fbb-97af35c9a24b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:13.658865 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbde78b-699c-4b00-8fbb-97af35c9a24b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:13.660201 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd9e87-0ec9-4d74-9532-1a4029369a5d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:13.753983 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:13.837986 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd9e87-0ec9-4d74-9532-1a4029369a5d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:13.866122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 119/249] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:13.871552 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbde78b-699c-4b00-8fbb-97af35c9a24b None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:13.884361 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f869a9-ea6c-417e-a19d-b925e3225383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:13.885571 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f869a9-ea6c-417e-a19d-b925e3225383 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:13.886077 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f869a9-ea6c-417e-a19d-b925e3225383 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:13.886547 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f869a9-ea6c-417e-a19d-b925e3225383 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:13.887990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f869a9-ea6c-417e-a19d-b925e3225383 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:13.889957 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f869a9-ea6c-417e-a19d-b925e3225383 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:13.894374 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 131/250] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:13 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:13.901781 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f869a9-ea6c-417e-a19d-b925e3225383 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:13.987935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:14.058482 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f869a9-ea6c-417e-a19d-b925e3225383 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:14.063999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbde78b-699c-4b00-8fbb-97af35c9a24b None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:14.072263 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:14.110965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53d765-2e74-4f89-9c41-01eaad0851a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:14.115325 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53d765-2e74-4f89-9c41-01eaad0851a2 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:14.115614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53d765-2e74-4f89-9c41-01eaad0851a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:14.115894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53d765-2e74-4f89-9c41-01eaad0851a2 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7/users/25cb10de8ae8408eb91a52e67d64de84/roles/08c3f41d763c4a50ae3acacf391942aa` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:14.123744 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53d765-2e74-4f89-9c41-01eaad0851a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=83b3fa382b104cb9832f009730a50fe7, user_id=25cb10de8ae8408eb91a52e67d64de84, role_id=08c3f41d763c4a50ae3acacf391942aa)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:14.125717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53d765-2e74-4f89-9c41-01eaad0851a2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:14.134691 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36734149-aa52-405b-9ed3-bf8b1b6ba5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:14.135641 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36734149-aa52-405b-9ed3-bf8b1b6ba5c0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:14.135919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36734149-aa52-405b-9ed3-bf8b1b6ba5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:14.136188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36734149-aa52-405b-9ed3-bf8b1b6ba5c0 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:14.137478 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36734149-aa52-405b-9ed3-bf8b1b6ba5c0 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:14.141895 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36734149-aa52-405b-9ed3-bf8b1b6ba5c0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:14.143891 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 120/251] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:13 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:14.151805 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36734149-aa52-405b-9ed3-bf8b1b6ba5c0 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:14.211088 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 132/252] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:42:13 2022] PUT /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7/users/25cb10de8ae8408eb91a52e67d64de84/roles/08c3f41d763c4a50ae3acacf391942aa => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:42:14.306760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36734149-aa52-405b-9ed3-bf8b1b6ba5c0 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:14.346415 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:14.362688 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4800636-b3e8-4774-933e-7453b6250209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:14.363364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800636-b3e8-4774-933e-7453b6250209 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:14.366096 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800636-b3e8-4774-933e-7453b6250209 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:14.366096 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800636-b3e8-4774-933e-7453b6250209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:14.366096 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4800636-b3e8-4774-933e-7453b6250209 None admin] RBAC: Adding query filter params (role.id=e0ec7191f86c4ea48d96bca7efa2bae7, scope.project.id=83b3fa382b104cb9832f009730a50fe7, user.id=3d2743ec40414e4782a31f7ffbdb5bb6) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:14.366096 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4800636-b3e8-4774-933e-7453b6250209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:14.366594 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4800636-b3e8-4774-933e-7453b6250209 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:14.373257 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 121/253] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:14 2022] GET /identity/v3/role_assignments?user.id=3d2743ec40414e4782a31f7ffbdb5bb6&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=e0ec7191f86c4ea48d96bca7efa2bae7 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:14.485437 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca53a3-445d-4772-849a-a61b71771f09 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:14.486064 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca53a3-445d-4772-849a-a61b71771f09 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:14.486527 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca53a3-445d-4772-849a-a61b71771f09 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:14.488392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 133/254] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:14.495094 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5174-6bf5-4540-b773-d9f87d84282a None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:14.495531 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5174-6bf5-4540-b773-d9f87d84282a None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:14.495914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5174-6bf5-4540-b773-d9f87d84282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:14.519103 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-1d6d5174-6bf5-4540-b773-d9f87d84282a None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:14.520383 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-1d6d5174-6bf5-4540-b773-d9f87d84282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:14.613643 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 122/255] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:14.637753 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca53a3-445d-4772-849a-a61b71771f09 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:14.754813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca53a3-445d-4772-849a-a61b71771f09 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:14.791015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4b4e5-8e5e-439a-b382-a7de3676d8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:14.791810 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4b4e5-8e5e-439a-b382-a7de3676d8fd None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:14.792093 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4b4e5-8e5e-439a-b382-a7de3676d8fd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:14.792370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4b4e5-8e5e-439a-b382-a7de3676d8fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:14.803786 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4b4e5-8e5e-439a-b382-a7de3676d8fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a5e4b4e5-8e5e-439a-b382-a7de3676d8fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:14.812041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:14.812951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:14.813767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:14.814389 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 134/256] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:14.819658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d5174-6bf5-4540-b773-d9f87d84282a None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:14.927608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d5174-6bf5-4540-b773-d9f87d84282a None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:14.938065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688d274-07f7-4bfb-b728-e1d29540f6fd None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:14.938351 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688d274-07f7-4bfb-b728-e1d29540f6fd None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:14.938651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688d274-07f7-4bfb-b728-e1d29540f6fd None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:14.940703 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 135/257] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:14.946480 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ecdd2-0aa0-47a0-951f-6f5e846bd510 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:14.946800 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ecdd2-0aa0-47a0-951f-6f5e846bd510 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:14.947084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ecdd2-0aa0-47a0-951f-6f5e846bd510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:14.964375 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:14.970664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-d03ecdd2-0aa0-47a0-951f-6f5e846bd510 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:14.972480 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d03ecdd2-0aa0-47a0-951f-6f5e846bd510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:14.983017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c72442-d9e1-45a7-81de-547bffb1b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:14.983737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c72442-d9e1-45a7-81de-547bffb1b4ce None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:14.984331 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c72442-d9e1-45a7-81de-547bffb1b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:14.990187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c72442-d9e1-45a7-81de-547bffb1b4ce None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:14.990187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c72442-d9e1-45a7-81de-547bffb1b4ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:14.990187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c72442-d9e1-45a7-81de-547bffb1b4ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:14.990187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c72442-d9e1-45a7-81de-547bffb1b4ce None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:15.004917 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:15.005092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 123/258] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:15.006032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c72442-d9e1-45a7-81de-547bffb1b4ce None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:15.057507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 136/259] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:15.085806 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ecdd2-0aa0-47a0-951f-6f5e846bd510 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:15.196929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ecdd2-0aa0-47a0-951f-6f5e846bd510 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:15.237358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce550f-bf28-4b3d-bdb2-6d7a65574728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:15.239076 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce550f-bf28-4b3d-bdb2-6d7a65574728 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:15.239913 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce550f-bf28-4b3d-bdb2-6d7a65574728 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:15.240393 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce550f-bf28-4b3d-bdb2-6d7a65574728 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:15.251840 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce550f-bf28-4b3d-bdb2-6d7a65574728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-79ce550f-bf28-4b3d-bdb2-6d7a65574728 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:15.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:15.262002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:15.262853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:15.265967 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 137/260] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:42:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:15.271613 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce550f-bf28-4b3d-bdb2-6d7a65574728 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:15.303048 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c72442-d9e1-45a7-81de-547bffb1b4ce None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:15.322352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:15.380613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0333073-0f8c-4f81-a6ac-57a7f8a04168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:15.381550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0333073-0f8c-4f81-a6ac-57a7f8a04168 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:15.381837 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0333073-0f8c-4f81-a6ac-57a7f8a04168 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:15.382117 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0333073-0f8c-4f81-a6ac-57a7f8a04168 None admin] PATH_INFO: `/v3/users/2099fd095a834a1a95b05375279e0715` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:15.384384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0333073-0f8c-4f81-a6ac-57a7f8a04168 None admin] RBAC: Authorizing `identity:get_user(user_id=2099fd095a834a1a95b05375279e0715)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:15.385840 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0333073-0f8c-4f81-a6ac-57a7f8a04168 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:15.387756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 124/261] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:15 2022] GET /identity/v3/users/2099fd095a834a1a95b05375279e0715 => generated 283 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:15.415357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0333073-0f8c-4f81-a6ac-57a7f8a04168 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:15.480439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:15.520861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce550f-bf28-4b3d-bdb2-6d7a65574728 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:15.529883 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0333073-0f8c-4f81-a6ac-57a7f8a04168 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:15.567550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed5b6a-8d59-4d63-9646-71d26aa13db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:15.568465 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed5b6a-8d59-4d63-9646-71d26aa13db8 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:15.568757 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed5b6a-8d59-4d63-9646-71d26aa13db8 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:15.569039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed5b6a-8d59-4d63-9646-71d26aa13db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:15.643045 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeea553-eec0-404e-9170-6d92d80a7fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:15.643735 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeea553-eec0-404e-9170-6d92d80a7fe8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:15.644076 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeea553-eec0-404e-9170-6d92d80a7fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:15.644361 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeea553-eec0-404e-9170-6d92d80a7fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:15.644991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed5b6a-8d59-4d63-9646-71d26aa13db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:15.645164 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeea553-eec0-404e-9170-6d92d80a7fe8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:15.645439 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeea553-eec0-404e-9170-6d92d80a7fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:15.646476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed5b6a-8d59-4d63-9646-71d26aa13db8 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:15.646875 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeea553-eec0-404e-9170-6d92d80a7fe8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:15.660324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 138/262] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:15.666434 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeea553-eec0-404e-9170-6d92d80a7fe8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:15.711335 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:15.764170 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 125/263] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:15.771050 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed5b6a-8d59-4d63-9646-71d26aa13db8 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:15.823698 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:15.845052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeea553-eec0-404e-9170-6d92d80a7fe8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:15.907382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f39076-674d-4762-ab08-ea3f1c521492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:15.908285 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f39076-674d-4762-ab08-ea3f1c521492 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:15.908572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f39076-674d-4762-ab08-ea3f1c521492 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:15.908851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f39076-674d-4762-ab08-ea3f1c521492 None admin] PATH_INFO: `/v3/users/2099fd095a834a1a95b05375279e0715` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:15.910329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f39076-674d-4762-ab08-ea3f1c521492 None admin] RBAC: Authorizing `identity:get_user(user_id=2099fd095a834a1a95b05375279e0715)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:15.912071 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f39076-674d-4762-ab08-ea3f1c521492 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:15.913723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 139/264] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:15 2022] GET /identity/v3/users/2099fd095a834a1a95b05375279e0715 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:15.919832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f39076-674d-4762-ab08-ea3f1c521492 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:15.953114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed5b6a-8d59-4d63-9646-71d26aa13db8 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:16.015751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ed899-20f1-4fa5-b324-deca8ba43a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:16.016544 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ed899-20f1-4fa5-b324-deca8ba43a29 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:16.016831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ed899-20f1-4fa5-b324-deca8ba43a29 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:16.023039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ed899-20f1-4fa5-b324-deca8ba43a29 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:16.024408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ed899-20f1-4fa5-b324-deca8ba43a29 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:16.025964 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ed899-20f1-4fa5-b324-deca8ba43a29 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:16.027807 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 126/265] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:15 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:16.047667 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ed899-20f1-4fa5-b324-deca8ba43a29 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:16.075402 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f39076-674d-4762-ab08-ea3f1c521492 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:16.078825 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:16.136459 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25852d-f71e-4e2c-9145-47c7122dad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:16.137501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25852d-f71e-4e2c-9145-47c7122dad7a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:16.137975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25852d-f71e-4e2c-9145-47c7122dad7a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:16.138447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25852d-f71e-4e2c-9145-47c7122dad7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:16.187321 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:16.207547 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ed899-20f1-4fa5-b324-deca8ba43a29 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:16.261416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c311e9-d2dd-4b5e-9db1-a1b41afb3d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:16.262076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c311e9-d2dd-4b5e-9db1-a1b41afb3d3b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:16.262363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c311e9-d2dd-4b5e-9db1-a1b41afb3d3b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:16.266742 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c311e9-d2dd-4b5e-9db1-a1b41afb3d3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:16.267594 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c311e9-d2dd-4b5e-9db1-a1b41afb3d3b None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=83b3fa382b104cb9832f009730a50fe7, user.id=2099fd095a834a1a95b05375279e0715) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:16.267924 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c311e9-d2dd-4b5e-9db1-a1b41afb3d3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:16.269382 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c311e9-d2dd-4b5e-9db1-a1b41afb3d3b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:16.275457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 127/266] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:16 2022] GET /identity/v3/role_assignments?user.id=2099fd095a834a1a95b05375279e0715&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:16.277294 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25852d-f71e-4e2c-9145-47c7122dad7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:16.278855 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25852d-f71e-4e2c-9145-47c7122dad7a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:16.433215 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 140/267] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:16.439161 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c311e9-d2dd-4b5e-9db1-a1b41afb3d3b None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:16.570246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:16.587301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c311e9-d2dd-4b5e-9db1-a1b41afb3d3b None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:16.599101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95ab39-b7e4-4aae-bfa3-ed86d55af7db None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:16.599400 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95ab39-b7e4-4aae-bfa3-ed86d55af7db None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:16.599684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95ab39-b7e4-4aae-bfa3-ed86d55af7db None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:16.601295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 141/268] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:16.607963 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe6320-26d7-426b-b9e1-578dfbf4fd5c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:16.608257 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe6320-26d7-426b-b9e1-578dfbf4fd5c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:16.608540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe6320-26d7-426b-b9e1-578dfbf4fd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:16.633144 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7213ee-01e3-4a16-acf9-b07237be3ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:16.634115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7213ee-01e3-4a16-acf9-b07237be3ade None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:16.634395 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7213ee-01e3-4a16-acf9-b07237be3ade None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:16.634729 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7213ee-01e3-4a16-acf9-b07237be3ade None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:16.635925 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7213ee-01e3-4a16-acf9-b07237be3ade None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:16.637385 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7213ee-01e3-4a16-acf9-b07237be3ade None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:16.639126 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 128/269] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:16 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:16.645608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7213ee-01e3-4a16-acf9-b07237be3ade None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:16.650067 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-82fe6320-26d7-426b-b9e1-578dfbf4fd5c None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:16.658741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-82fe6320-26d7-426b-b9e1-578dfbf4fd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:16.722130 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:16.769268 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 142/270] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:16.818080 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe6320-26d7-426b-b9e1-578dfbf4fd5c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:16.834631 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7213ee-01e3-4a16-acf9-b07237be3ade None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:16.953618 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8c6bc-bf76-432e-9bce-fc1dbb8e349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:16.954290 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8c6bc-bf76-432e-9bce-fc1dbb8e349e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:16.954575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8c6bc-bf76-432e-9bce-fc1dbb8e349e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:16.954882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8c6bc-bf76-432e-9bce-fc1dbb8e349e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:16.955733 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8c6bc-bf76-432e-9bce-fc1dbb8e349e None admin] RBAC: Adding query filter params (role.id=963eb8fa7a2943569e51dc5310a46baa, scope.project.id=83b3fa382b104cb9832f009730a50fe7, user.id=2099fd095a834a1a95b05375279e0715) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:16.956058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8c6bc-bf76-432e-9bce-fc1dbb8e349e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:16.957501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8c6bc-bf76-432e-9bce-fc1dbb8e349e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:16.994331 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 129/271] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:16 2022] GET /identity/v3/role_assignments?user.id=2099fd095a834a1a95b05375279e0715&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=963eb8fa7a2943569e51dc5310a46baa => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:16.995264 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2666f2-cd6e-4cd8-96ef-f04344e20411 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:16.995556 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2666f2-cd6e-4cd8-96ef-f04344e20411 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:16.995836 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2666f2-cd6e-4cd8-96ef-f04344e20411 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:16.997255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 130/272] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:17.032224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff00d-e1c9-48c6-8904-7131832e7976 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:17.032531 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff00d-e1c9-48c6-8904-7131832e7976 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:17.032795 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff00d-e1c9-48c6-8904-7131832e7976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:17.041843 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe6320-26d7-426b-b9e1-578dfbf4fd5c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:17.078951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-9dbff00d-e1c9-48c6-8904-7131832e7976 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:17.080702 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-9dbff00d-e1c9-48c6-8904-7131832e7976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:17.126992 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:17.150570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcaca2-6b39-4cec-a30a-3aaf0e64fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:17.152346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaca2-6b39-4cec-a30a-3aaf0e64fce6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:17.155101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaca2-6b39-4cec-a30a-3aaf0e64fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:17.156569 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaca2-6b39-4cec-a30a-3aaf0e64fce6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:17.201718 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcaca2-6b39-4cec-a30a-3aaf0e64fce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b4bcaca2-6b39-4cec-a30a-3aaf0e64fce6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:17.213542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:17.214519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:17.215358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:17.222366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 143/273] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:17.228275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcaca2-6b39-4cec-a30a-3aaf0e64fce6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:17.298472 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 131/274] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:17.313863 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:17.334488 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbff00d-e1c9-48c6-8904-7131832e7976 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:17.399079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcaca2-6b39-4cec-a30a-3aaf0e64fce6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:17.445974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a55041-b358-4a61-983b-63673ce6d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:17.446959 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55041-b358-4a61-983b-63673ce6d357 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:17.447422 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55041-b358-4a61-983b-63673ce6d357 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:17.447856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55041-b358-4a61-983b-63673ce6d357 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:17.448758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a55041-b358-4a61-983b-63673ce6d357 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:17.449207 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a55041-b358-4a61-983b-63673ce6d357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:17.450787 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a55041-b358-4a61-983b-63673ce6d357 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:17.460884 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 144/275] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:17.466221 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a55041-b358-4a61-983b-63673ce6d357 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:17.478019 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbff00d-e1c9-48c6-8904-7131832e7976 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:17.526880 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83e89b-f138-4106-817c-8506dc49763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:17.528043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83e89b-f138-4106-817c-8506dc49763a None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:17.528518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83e89b-f138-4106-817c-8506dc49763a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:17.529058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83e89b-f138-4106-817c-8506dc49763a None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:17.531344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83e89b-f138-4106-817c-8506dc49763a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:17.533310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83e89b-f138-4106-817c-8506dc49763a None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:17.539001 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 132/276] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:17.542048 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83e89b-f138-4106-817c-8506dc49763a None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:17.563333 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:17.587331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:17.590592 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a55041-b358-4a61-983b-63673ce6d357 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:17.629009 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f6528-10c9-496f-800f-346df2f4b5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:17.630181 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f6528-10c9-496f-800f-346df2f4b5d8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:17.630773 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f6528-10c9-496f-800f-346df2f4b5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:17.631336 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f6528-10c9-496f-800f-346df2f4b5d8 None admin] PATH_INFO: `/v3/users/0ef91f40831043afb37a9dc297202338` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:17.646960 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f6528-10c9-496f-800f-346df2f4b5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=0ef91f40831043afb37a9dc297202338)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:17.648775 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f6528-10c9-496f-800f-346df2f4b5d8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:17.651323 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 145/277] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:17 2022] GET /identity/v3/users/0ef91f40831043afb37a9dc297202338 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:17.656782 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83e89b-f138-4106-817c-8506dc49763a None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:17.657144 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f6528-10c9-496f-800f-346df2f4b5d8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:17.693272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9da38-c38d-441c-b699-f52cfa4a32ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:17.693946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9da38-c38d-441c-b699-f52cfa4a32ef None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:17.694226 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9da38-c38d-441c-b699-f52cfa4a32ef None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:17.694502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9da38-c38d-441c-b699-f52cfa4a32ef None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:17.695277 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9da38-c38d-441c-b699-f52cfa4a32ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:17.696718 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9da38-c38d-441c-b699-f52cfa4a32ef None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:17.791032 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f6528-10c9-496f-800f-346df2f4b5d8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:17.799122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 133/278] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:42:17 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:42:17.799122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0684586-22c3-4ab8-aa70-42b9f54d3493 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:17.799122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0684586-22c3-4ab8-aa70-42b9f54d3493 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:17.799122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0684586-22c3-4ab8-aa70-42b9f54d3493 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:17.799122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 134/279] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:17.799122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1049-1e45-4535-a851-743765a391cd None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:17.799122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1049-1e45-4535-a851-743765a391cd None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:17.808405 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1049-1e45-4535-a851-743765a391cd None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:17.808405 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 135/280] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:17.808405 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cfdba-5989-4e99-86ce-f313536c7b44 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:17.810804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cfdba-5989-4e99-86ce-f313536c7b44 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:17.810804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cfdba-5989-4e99-86ce-f313536c7b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:17.834638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-ef9cfdba-5989-4e99-86ce-f313536c7b44 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:17.835649 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571577a-18fb-46d9-b52d-94b26049eedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:17.835997 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-ef9cfdba-5989-4e99-86ce-f313536c7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:17.836329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571577a-18fb-46d9-b52d-94b26049eedc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:17.836614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571577a-18fb-46d9-b52d-94b26049eedc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:17.836890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571577a-18fb-46d9-b52d-94b26049eedc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:17.837739 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571577a-18fb-46d9-b52d-94b26049eedc None admin] RBAC: Adding query filter params (role.id=08c3f41d763c4a50ae3acacf391942aa, user.id=0ef91f40831043afb37a9dc297202338, scope.system=all) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:17.838055 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571577a-18fb-46d9-b52d-94b26049eedc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:17.839611 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571577a-18fb-46d9-b52d-94b26049eedc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:17.859105 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 146/281] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 19:42:17 2022] GET /identity/v3/role_assignments?user.id=0ef91f40831043afb37a9dc297202338&scope.system=all&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:17.859105 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0a35f-bcca-4d7c-970b-425293a4e017 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:17.859105 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0a35f-bcca-4d7c-970b-425293a4e017 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:17.859105 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0a35f-bcca-4d7c-970b-425293a4e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:17.880211 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-dab0a35f-bcca-4d7c-970b-425293a4e017 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:17.882837 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dab0a35f-bcca-4d7c-970b-425293a4e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:17.909181 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:17.926460 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:17.933445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 136/282] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:17.958506 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cfdba-5989-4e99-86ce-f313536c7b44 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:17.988216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 147/283] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:18.012118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0a35f-bcca-4d7c-970b-425293a4e017 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:18.099505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cfdba-5989-4e99-86ce-f313536c7b44 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:18.135328 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0a35f-bcca-4d7c-970b-425293a4e017 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:18.141869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109facbe-fe9e-4310-9587-0e0e85505447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:18.142692 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109facbe-fe9e-4310-9587-0e0e85505447 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:18.142987 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109facbe-fe9e-4310-9587-0e0e85505447 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:18.143288 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109facbe-fe9e-4310-9587-0e0e85505447 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:18.158950 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109facbe-fe9e-4310-9587-0e0e85505447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-109facbe-fe9e-4310-9587-0e0e85505447 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:18.166969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:18.167866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:18.168672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 137/284] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:18.174447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109facbe-fe9e-4310-9587-0e0e85505447 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:18.182134 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1249cb3-5e12-4cee-9971-9667ca37b825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:18.184375 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249cb3-5e12-4cee-9971-9667ca37b825 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:18.184375 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249cb3-5e12-4cee-9971-9667ca37b825 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:18.184375 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249cb3-5e12-4cee-9971-9667ca37b825 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:18.199015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1249cb3-5e12-4cee-9971-9667ca37b825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b1249cb3-5e12-4cee-9971-9667ca37b825 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:18.206833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:18.207752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:18.208567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 148/285] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:18.213815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1249cb3-5e12-4cee-9971-9667ca37b825 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:18.237597 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:18.258576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:18.302353 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109facbe-fe9e-4310-9587-0e0e85505447 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:18.335077 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1249cb3-5e12-4cee-9971-9667ca37b825 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:18.338512 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32526d5-e57c-4b6e-b3f2-cf9ff566d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:18.339247 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32526d5-e57c-4b6e-b3f2-cf9ff566d0cc None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:18.339538 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32526d5-e57c-4b6e-b3f2-cf9ff566d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:18.339816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32526d5-e57c-4b6e-b3f2-cf9ff566d0cc None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:18.340576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32526d5-e57c-4b6e-b3f2-cf9ff566d0cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:18.340889 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32526d5-e57c-4b6e-b3f2-cf9ff566d0cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:18.342302 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32526d5-e57c-4b6e-b3f2-cf9ff566d0cc None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:18.353708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 138/286] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:18.360591 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32526d5-e57c-4b6e-b3f2-cf9ff566d0cc None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:18.373557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b9643-4c80-4002-bb5d-a7972d70c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:18.374498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9643-4c80-4002-bb5d-a7972d70c163 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:18.374858 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9643-4c80-4002-bb5d-a7972d70c163 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:18.375139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9643-4c80-4002-bb5d-a7972d70c163 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:18.375957 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b9643-4c80-4002-bb5d-a7972d70c163 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:18.376269 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b9643-4c80-4002-bb5d-a7972d70c163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:18.377719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b9643-4c80-4002-bb5d-a7972d70c163 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:18.387653 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 149/287] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:18.393129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b9643-4c80-4002-bb5d-a7972d70c163 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:18.480012 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:18.516190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b9643-4c80-4002-bb5d-a7972d70c163 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:18.547069 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32526d5-e57c-4b6e-b3f2-cf9ff566d0cc None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:18.553266 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751426c-d4c0-48ca-8f38-1b144ce82e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:18.554393 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751426c-d4c0-48ca-8f38-1b144ce82e25 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:18.554963 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751426c-d4c0-48ca-8f38-1b144ce82e25 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:18.555386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751426c-d4c0-48ca-8f38-1b144ce82e25 None admin] PATH_INFO: `/v3/users/25cb10de8ae8408eb91a52e67d64de84` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:18.556832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751426c-d4c0-48ca-8f38-1b144ce82e25 None admin] RBAC: Authorizing `identity:get_user(user_id=25cb10de8ae8408eb91a52e67d64de84)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:18.558747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751426c-d4c0-48ca-8f38-1b144ce82e25 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:18.560882 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 150/288] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:18 2022] GET /identity/v3/users/25cb10de8ae8408eb91a52e67d64de84 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:18.566648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751426c-d4c0-48ca-8f38-1b144ce82e25 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:18.589940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:18.603464 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6294539-ff49-4bd4-9637-5e6079446af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:18.606343 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6294539-ff49-4bd4-9637-5e6079446af7 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:18.606343 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6294539-ff49-4bd4-9637-5e6079446af7 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:18.606343 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6294539-ff49-4bd4-9637-5e6079446af7 None admin] PATH_INFO: `/v3/users/3d2743ec40414e4782a31f7ffbdb5bb6` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:18.607382 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6294539-ff49-4bd4-9637-5e6079446af7 None admin] RBAC: Authorizing `identity:get_user(user_id=3d2743ec40414e4782a31f7ffbdb5bb6)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:18.609677 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6294539-ff49-4bd4-9637-5e6079446af7 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:18.616409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 139/289] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:18 2022] GET /identity/v3/users/3d2743ec40414e4782a31f7ffbdb5bb6 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:18.617975 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6294539-ff49-4bd4-9637-5e6079446af7 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:18.740913 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751426c-d4c0-48ca-8f38-1b144ce82e25 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:18.780113 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447adf6-8e26-4f34-a6f7-7b27eed3a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:18.781955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447adf6-8e26-4f34-a6f7-7b27eed3a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:18.783093 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447adf6-8e26-4f34-a6f7-7b27eed3a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:18.783716 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447adf6-8e26-4f34-a6f7-7b27eed3a5e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:18.800876 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6294539-ff49-4bd4-9637-5e6079446af7 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:18.810726 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:18.874911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e40d57-6194-4fe4-97ec-c54f4815ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:18.875759 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40d57-6194-4fe4-97ec-c54f4815ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:18.876043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40d57-6194-4fe4-97ec-c54f4815ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:18.876318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40d57-6194-4fe4-97ec-c54f4815ddc6 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:18.878426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e40d57-6194-4fe4-97ec-c54f4815ddc6 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:18.879901 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e40d57-6194-4fe4-97ec-c54f4815ddc6 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:18.883372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 140/290] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:18 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:18.888966 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e40d57-6194-4fe4-97ec-c54f4815ddc6 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:18.908789 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447adf6-8e26-4f34-a6f7-7b27eed3a5e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:18.910291 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447adf6-8e26-4f34-a6f7-7b27eed3a5e6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:18.991797 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:19.072572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e40d57-6194-4fe4-97ec-c54f4815ddc6 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:19.078549 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 151/291] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:19.085224 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447adf6-8e26-4f34-a6f7-7b27eed3a5e6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:19.156141 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13069a31-4101-4286-a411-65c8f964db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:19.157038 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13069a31-4101-4286-a411-65c8f964db61 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:19.157322 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13069a31-4101-4286-a411-65c8f964db61 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:19.157590 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13069a31-4101-4286-a411-65c8f964db61 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7/users/3d2743ec40414e4782a31f7ffbdb5bb6/roles/e0ec7191f86c4ea48d96bca7efa2bae7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:19.159653 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13069a31-4101-4286-a411-65c8f964db61 None admin] RBAC: Authorizing `identity:create_grant(project_id=83b3fa382b104cb9832f009730a50fe7, user_id=3d2743ec40414e4782a31f7ffbdb5bb6, role_id=e0ec7191f86c4ea48d96bca7efa2bae7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:19.161092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13069a31-4101-4286-a411-65c8f964db61 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:19.168593 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:19.229486 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447adf6-8e26-4f34-a6f7-7b27eed3a5e6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:19.257839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 141/292] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:42:18 2022] PUT /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7/users/3d2743ec40414e4782a31f7ffbdb5bb6/roles/e0ec7191f86c4ea48d96bca7efa2bae7 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:42:19.274698 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7303195-c1b3-4867-8014-61de58552086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:19.275675 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7303195-c1b3-4867-8014-61de58552086 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:19.275966 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7303195-c1b3-4867-8014-61de58552086 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:19.276246 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7303195-c1b3-4867-8014-61de58552086 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:19.277681 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7303195-c1b3-4867-8014-61de58552086 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:19.279451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7303195-c1b3-4867-8014-61de58552086 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:19.282288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 152/293] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:19 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:19.288778 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13069a31-4101-4286-a411-65c8f964db61 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:19.442450 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13069a31-4101-4286-a411-65c8f964db61 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:19.469676 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:19.493921 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f298d-58fd-480b-919c-cfe5d10736c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:19.494841 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f298d-58fd-480b-919c-cfe5d10736c0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:19.495320 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f298d-58fd-480b-919c-cfe5d10736c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:19.495757 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f298d-58fd-480b-919c-cfe5d10736c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:19.496732 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f298d-58fd-480b-919c-cfe5d10736c0 None admin] RBAC: Adding query filter params (role.id=08c3f41d763c4a50ae3acacf391942aa, scope.project.id=83b3fa382b104cb9832f009730a50fe7, user.id=25cb10de8ae8408eb91a52e67d64de84) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:19.497185 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f298d-58fd-480b-919c-cfe5d10736c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:19.498790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f298d-58fd-480b-919c-cfe5d10736c0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:19.511838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 142/294] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:19 2022] GET /identity/v3/role_assignments?user.id=25cb10de8ae8408eb91a52e67d64de84&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:20.365830 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab29521-c550-4a23-a2d5-b6bdb17a1171 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:20.366336 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab29521-c550-4a23-a2d5-b6bdb17a1171 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:20.366411 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab29521-c550-4a23-a2d5-b6bdb17a1171 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:20.367935 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 153/295] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:20.373313 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef294593-0c36-419c-b601-31d7ba9b1e7b None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:20.373705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef294593-0c36-419c-b601-31d7ba9b1e7b None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:20.373869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef294593-0c36-419c-b601-31d7ba9b1e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:20.391125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-ef294593-0c36-419c-b601-31d7ba9b1e7b None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:20.392649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-ef294593-0c36-419c-b601-31d7ba9b1e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:20.436113 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ab346-e7ec-45ab-84cf-74567ffa2ebf None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:20.437298 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ab346-e7ec-45ab-84cf-74567ffa2ebf None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:20.437804 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ab346-e7ec-45ab-84cf-74567ffa2ebf None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:20.439631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 154/296] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:20.445175 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283fe66-4b86-40bb-b829-ded476d272ea None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:20.445750 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283fe66-4b86-40bb-b829-ded476d272ea None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:20.446228 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283fe66-4b86-40bb-b829-ded476d272ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:20.462931 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 143/297] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:20.463426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3283fe66-4b86-40bb-b829-ded476d272ea None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:20.464941 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3283fe66-4b86-40bb-b829-ded476d272ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:20.486791 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef294593-0c36-419c-b601-31d7ba9b1e7b None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:20.545701 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 155/298] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:20.570384 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283fe66-4b86-40bb-b829-ded476d272ea None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:20.616171 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef294593-0c36-419c-b601-31d7ba9b1e7b None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:20.621477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:20.635581 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:20.660061 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9d6c3-aaa4-4893-8933-fd5c2463af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:20.660854 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9d6c3-aaa4-4893-8933-fd5c2463af5b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:20.661140 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9d6c3-aaa4-4893-8933-fd5c2463af5b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:20.661416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9d6c3-aaa4-4893-8933-fd5c2463af5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:20.672667 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9d6c3-aaa4-4893-8933-fd5c2463af5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-dcc9d6c3-aaa4-4893-8933-fd5c2463af5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:20.680502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:20.681394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:20.682209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 144/299] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:20.683781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbfbbe-4ca8-4350-aa4b-a06fee6fdb8a None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:20.683781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbfbbe-4ca8-4350-aa4b-a06fee6fdb8a None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:20.683781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbfbbe-4ca8-4350-aa4b-a06fee6fdb8a None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:20.685232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 145/300] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:20.689716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbfbbe-4ca8-4350-aa4b-a06fee6fdb8a None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:20.696519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283fe66-4b86-40bb-b829-ded476d272ea None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:20.733538 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dd49a-588d-40b1-8239-2e66635b06a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:20.734929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dd49a-588d-40b1-8239-2e66635b06a7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:20.735834 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dd49a-588d-40b1-8239-2e66635b06a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:20.736135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dd49a-588d-40b1-8239-2e66635b06a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:20.748570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dd49a-588d-40b1-8239-2e66635b06a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-595dd49a-588d-40b1-8239-2e66635b06a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:20.756426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:20.757585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:20.758421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 156/301] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:20.759249 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58ef6-8a7d-4570-a528-54ecb5ad96e7 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:20.759537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58ef6-8a7d-4570-a528-54ecb5ad96e7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:20.759817 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58ef6-8a7d-4570-a528-54ecb5ad96e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:20.778650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-59f58ef6-8a7d-4570-a528-54ecb5ad96e7 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:20.779844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-59f58ef6-8a7d-4570-a528-54ecb5ad96e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:20.807354 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbfbbe-4ca8-4350-aa4b-a06fee6fdb8a None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:20.842536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4d7b-909f-4f76-afd1-0665665e852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:20.843745 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4d7b-909f-4f76-afd1-0665665e852c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:20.844032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4d7b-909f-4f76-afd1-0665665e852c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:20.844537 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4d7b-909f-4f76-afd1-0665665e852c None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:20.845052 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a4d7b-909f-4f76-afd1-0665665e852c None admin] RBAC: Adding query filter params (name=member) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:20.845453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a4d7b-909f-4f76-afd1-0665665e852c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:20.846769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a4d7b-909f-4f76-afd1-0665665e852c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:20.855122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 157/302] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:20.855862 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f58ef6-8a7d-4570-a528-54ecb5ad96e7 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:20.867558 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 146/303] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:20.873086 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4d7b-909f-4f76-afd1-0665665e852c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:20.892824 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:20.911056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:20.970589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f58ef6-8a7d-4570-a528-54ecb5ad96e7 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:20.981863 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4d7b-909f-4f76-afd1-0665665e852c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:21.004361 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152a43a-2ed3-4c74-9b64-c5ff52c5c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:21.004997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152a43a-2ed3-4c74-9b64-c5ff52c5c4fa None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:21.005399 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152a43a-2ed3-4c74-9b64-c5ff52c5c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:21.005739 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152a43a-2ed3-4c74-9b64-c5ff52c5c4fa None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:21.006495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152a43a-2ed3-4c74-9b64-c5ff52c5c4fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:21.006837 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152a43a-2ed3-4c74-9b64-c5ff52c5c4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:21.008250 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152a43a-2ed3-4c74-9b64-c5ff52c5c4fa None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:21.017133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 158/304] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:21.017942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152a43a-2ed3-4c74-9b64-c5ff52c5c4fa None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:21.018952 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615063c3-86db-4c1f-b816-240f43b57a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:21.020006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615063c3-86db-4c1f-b816-240f43b57a2c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:21.020632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615063c3-86db-4c1f-b816-240f43b57a2c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:21.021863 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615063c3-86db-4c1f-b816-240f43b57a2c None admin] PATH_INFO: `/v3/users/0ef91f40831043afb37a9dc297202338` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:21.023342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615063c3-86db-4c1f-b816-240f43b57a2c None admin] RBAC: Authorizing `identity:get_user(user_id=0ef91f40831043afb37a9dc297202338)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:21.024951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615063c3-86db-4c1f-b816-240f43b57a2c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:21.030894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 147/305] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:20 2022] GET /identity/v3/users/0ef91f40831043afb37a9dc297202338 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:21.031681 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615063c3-86db-4c1f-b816-240f43b57a2c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:21.113932 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:21.122632 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152a43a-2ed3-4c74-9b64-c5ff52c5c4fa None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:21.138052 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615063c3-86db-4c1f-b816-240f43b57a2c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:21.140506 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:21.159282 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdc661-101a-4a14-9072-fa4d1d7c5bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:21.160133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdc661-101a-4a14-9072-fa4d1d7c5bcd None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:21.160424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdc661-101a-4a14-9072-fa4d1d7c5bcd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:21.160707 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdc661-101a-4a14-9072-fa4d1d7c5bcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:21.161904 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdc661-101a-4a14-9072-fa4d1d7c5bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:21.163394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdc661-101a-4a14-9072-fa4d1d7c5bcd None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:21.165067 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 159/306] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:21.170296 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdc661-101a-4a14-9072-fa4d1d7c5bcd None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:21.173645 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575fc36-6dd7-48c0-9feb-8a5c784b47da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:21.174519 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575fc36-6dd7-48c0-9feb-8a5c784b47da None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:21.174885 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575fc36-6dd7-48c0-9feb-8a5c784b47da None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:21.175159 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575fc36-6dd7-48c0-9feb-8a5c784b47da None admin] PATH_INFO: `/v3/users/0f97ce1e358a4f029fe53267af2adb2b` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:21.189985 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575fc36-6dd7-48c0-9feb-8a5c784b47da None admin] RBAC: Authorizing `identity:get_user(user_id=0f97ce1e358a4f029fe53267af2adb2b)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:21.191515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575fc36-6dd7-48c0-9feb-8a5c784b47da None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:21.197963 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 148/307] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:21 2022] GET /identity/v3/users/0f97ce1e358a4f029fe53267af2adb2b => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:21.198699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575fc36-6dd7-48c0-9feb-8a5c784b47da None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:21.273108 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdc661-101a-4a14-9072-fa4d1d7c5bcd None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:21.302235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575fc36-6dd7-48c0-9feb-8a5c784b47da None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:21.316078 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257837-6c58-4b16-9956-ca24f19274fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:21.316941 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257837-6c58-4b16-9956-ca24f19274fb None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:21.317218 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257837-6c58-4b16-9956-ca24f19274fb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:21.317490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257837-6c58-4b16-9956-ca24f19274fb None admin] PATH_INFO: `/v3/system/users/0ef91f40831043afb37a9dc297202338/roles/08c3f41d763c4a50ae3acacf391942aa` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:21.319002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3257837-6c58-4b16-9956-ca24f19274fb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0ef91f40831043afb37a9dc297202338, role_id=08c3f41d763c4a50ae3acacf391942aa)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:21.320406 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3257837-6c58-4b16-9956-ca24f19274fb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:21.339483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa4092-e50d-494a-8b3a-cb476af05299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:21.340369 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa4092-e50d-494a-8b3a-cb476af05299 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:21.340660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa4092-e50d-494a-8b3a-cb476af05299 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:21.340940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa4092-e50d-494a-8b3a-cb476af05299 None admin] PATH_INFO: `/v3/groups` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:21.341637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa4092-e50d-494a-8b3a-cb476af05299 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:21.343139 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa4092-e50d-494a-8b3a-cb476af05299 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:21.422657 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 160/308] 10.222.0.89 () {58 vars in 1334 bytes} [Thu May 19 19:42:21 2022] PUT /identity/v3/system/users/0ef91f40831043afb37a9dc297202338/roles/08c3f41d763c4a50ae3acacf391942aa => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:42:21.423475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257837-6c58-4b16-9956-ca24f19274fb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:21.455225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:21.477203 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 149/309] 10.222.0.89 () {60 vars in 1134 bytes} [Thu May 19 19:42:21 2022] POST /identity/v3/groups => generated 229 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:42:21.553962 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257837-6c58-4b16-9956-ca24f19274fb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:21.595634 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b0024-0703-4913-aa7d-fc5f318894f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:21.596316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0024-0703-4913-aa7d-fc5f318894f1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:21.596601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0024-0703-4913-aa7d-fc5f318894f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:21.596882 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0024-0703-4913-aa7d-fc5f318894f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:21.597767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b0024-0703-4913-aa7d-fc5f318894f1 None admin] RBAC: Adding query filter params (role.id=e0ec7191f86c4ea48d96bca7efa2bae7, user.id=0f97ce1e358a4f029fe53267af2adb2b, scope.system=all) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:21.598087 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b0024-0703-4913-aa7d-fc5f318894f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:21.599707 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b0024-0703-4913-aa7d-fc5f318894f1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:21.605783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 161/310] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 19:42:21 2022] GET /identity/v3/role_assignments?user.id=0f97ce1e358a4f029fe53267af2adb2b&scope.system=all&role.id=e0ec7191f86c4ea48d96bca7efa2bae7 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:21.872699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06447b43-a226-4c12-822c-61c6c800bee8 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:21.873064 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06447b43-a226-4c12-822c-61c6c800bee8 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:21.873268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06447b43-a226-4c12-822c-61c6c800bee8 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:21.875271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 150/311] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:21.880735 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209208-7a08-4fdd-9c01-c59e2c33c063 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:21.881268 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209208-7a08-4fdd-9c01-c59e2c33c063 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:21.881745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209208-7a08-4fdd-9c01-c59e2c33c063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:21.899575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-4b209208-7a08-4fdd-9c01-c59e2c33c063 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:21.901091 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4b209208-7a08-4fdd-9c01-c59e2c33c063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:21.975073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 162/312] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:22.002790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06447b43-a226-4c12-822c-61c6c800bee8 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:22.026074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:22.116133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06447b43-a226-4c12-822c-61c6c800bee8 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:22.157050 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9718a22-0aed-47da-a6f3-615adb2fa7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:22.157768 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9718a22-0aed-47da-a6f3-615adb2fa7d0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:22.158053 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9718a22-0aed-47da-a6f3-615adb2fa7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:22.158331 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9718a22-0aed-47da-a6f3-615adb2fa7d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:22.169644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9718a22-0aed-47da-a6f3-615adb2fa7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-e9718a22-0aed-47da-a6f3-615adb2fa7d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:22.178163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:22.179100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:22.179894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 151/313] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:22.185893 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b209208-7a08-4fdd-9c01-c59e2c33c063 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:22.207435 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:22.291873 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b209208-7a08-4fdd-9c01-c59e2c33c063 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:22.330905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f018f-8a49-46cc-ad14-6162240bd13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:22.331933 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f018f-8a49-46cc-ad14-6162240bd13c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:22.332408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f018f-8a49-46cc-ad14-6162240bd13c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:22.332872 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f018f-8a49-46cc-ad14-6162240bd13c None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:22.333842 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f018f-8a49-46cc-ad14-6162240bd13c None admin] RBAC: Adding query filter params (name=reader) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:22.334350 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f018f-8a49-46cc-ad14-6162240bd13c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:22.335959 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f018f-8a49-46cc-ad14-6162240bd13c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:22.348645 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 163/314] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:22.354165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9718a22-0aed-47da-a6f3-615adb2fa7d0 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:22.447165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:22.465437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9718a22-0aed-47da-a6f3-615adb2fa7d0 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:22.501936 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9d7ab-4482-4666-a3f3-9149114b88cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:22.503629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d7ab-4482-4666-a3f3-9149114b88cc None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:22.504124 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d7ab-4482-4666-a3f3-9149114b88cc None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:22.504587 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d7ab-4482-4666-a3f3-9149114b88cc None admin] PATH_INFO: `/v3/users/3d2743ec40414e4782a31f7ffbdb5bb6` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:22.505979 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9d7ab-4482-4666-a3f3-9149114b88cc None admin] RBAC: Authorizing `identity:get_user(user_id=3d2743ec40414e4782a31f7ffbdb5bb6)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:22.507656 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9d7ab-4482-4666-a3f3-9149114b88cc None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:22.509768 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 152/315] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:22 2022] GET /identity/v3/users/3d2743ec40414e4782a31f7ffbdb5bb6 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:22.514907 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f018f-8a49-46cc-ad14-6162240bd13c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:22.601595 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:22.622503 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f018f-8a49-46cc-ad14-6162240bd13c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:22.659198 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f98120-dafd-4cc0-a7b0-649e5913a53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:22.659850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f98120-dafd-4cc0-a7b0-649e5913a53f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:22.660133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f98120-dafd-4cc0-a7b0-649e5913a53f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:22.660412 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f98120-dafd-4cc0-a7b0-649e5913a53f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:22.734874 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f98120-dafd-4cc0-a7b0-649e5913a53f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:22.736405 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f98120-dafd-4cc0-a7b0-649e5913a53f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:22.830978 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:22.840737 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 164/316] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:22.847029 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9d7ab-4482-4666-a3f3-9149114b88cc None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:22.953152 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9d7ab-4482-4666-a3f3-9149114b88cc None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:22.988339 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36070fc-f79b-4bd6-98eb-3a9ad8f3bef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:22.989122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36070fc-f79b-4bd6-98eb-3a9ad8f3bef2 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:22.989404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36070fc-f79b-4bd6-98eb-3a9ad8f3bef2 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:22.989677 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36070fc-f79b-4bd6-98eb-3a9ad8f3bef2 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:22.990895 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36070fc-f79b-4bd6-98eb-3a9ad8f3bef2 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:22.992340 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36070fc-f79b-4bd6-98eb-3a9ad8f3bef2 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:22.994191 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 153/317] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:22 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:22.999828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f98120-dafd-4cc0-a7b0-649e5913a53f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:23.101408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f98120-dafd-4cc0-a7b0-649e5913a53f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:23.136362 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c6879-f800-40cd-8aeb-fbd99359f0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:23.137025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6879-f800-40cd-8aeb-fbd99359f0b2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:23.137307 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6879-f800-40cd-8aeb-fbd99359f0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:23.138754 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6879-f800-40cd-8aeb-fbd99359f0b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:23.138754 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c6879-f800-40cd-8aeb-fbd99359f0b2 None admin] RBAC: Adding query filter params (role.id=e0ec7191f86c4ea48d96bca7efa2bae7, scope.project.id=83b3fa382b104cb9832f009730a50fe7, user.id=3d2743ec40414e4782a31f7ffbdb5bb6) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:23.138917 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c6879-f800-40cd-8aeb-fbd99359f0b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:23.140316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c6879-f800-40cd-8aeb-fbd99359f0b2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:23.146560 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 165/318] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:22 2022] GET /identity/v3/role_assignments?user.id=3d2743ec40414e4782a31f7ffbdb5bb6&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=e0ec7191f86c4ea48d96bca7efa2bae7 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:23.760763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563de60-e1f3-400e-81fe-ec4ffd5125a4 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:23.761295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563de60-e1f3-400e-81fe-ec4ffd5125a4 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:23.761295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563de60-e1f3-400e-81fe-ec4ffd5125a4 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:23.762887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 154/319] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:23.769535 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd893-c915-46f4-b4b7-54785ec3eac0 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:23.770040 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd893-c915-46f4-b4b7-54785ec3eac0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:23.770112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd893-c915-46f4-b4b7-54785ec3eac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:23.788196 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-f09fd893-c915-46f4-b4b7-54785ec3eac0 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:23.789421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f09fd893-c915-46f4-b4b7-54785ec3eac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:23.832491 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:23.852500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fab47-fff7-4fdc-b4ac-0c4762646122 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:23.852814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fab47-fff7-4fdc-b4ac-0c4762646122 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:23.853071 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fab47-fff7-4fdc-b4ac-0c4762646122 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:23.854571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 155/320] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:23.858673 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 166/321] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:23.859838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde6fa8-745d-4ceb-9f19-ff42f50579b1 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:23.860129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde6fa8-745d-4ceb-9f19-ff42f50579b1 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:23.860406 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde6fa8-745d-4ceb-9f19-ff42f50579b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:23.878775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-dcde6fa8-745d-4ceb-9f19-ff42f50579b1 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:23.879953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-dcde6fa8-745d-4ceb-9f19-ff42f50579b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:23.881487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fd893-c915-46f4-b4b7-54785ec3eac0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:23.893352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:23.951696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 156/322] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:23.955662 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9c2e5-f9c4-4a63-9f8b-53db2cbd1dda None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:23.955947 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9c2e5-f9c4-4a63-9f8b-53db2cbd1dda None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:23.956219 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9c2e5-f9c4-4a63-9f8b-53db2cbd1dda None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:23.957961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 157/323] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:23.962775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e8730-709c-44c4-8fb7-f92812b3f462 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:23.963070 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e8730-709c-44c4-8fb7-f92812b3f462 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:23.963350 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e8730-709c-44c4-8fb7-f92812b3f462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:23.980086 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-ad2e8730-709c-44c4-8fb7-f92812b3f462 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:23.981279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-ad2e8730-709c-44c4-8fb7-f92812b3f462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:23.990539 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fd893-c915-46f4-b4b7-54785ec3eac0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:24.023624 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a585a-0112-40af-8b59-19a4380fbf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:24.024344 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a585a-0112-40af-8b59-19a4380fbf4b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:24.024616 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a585a-0112-40af-8b59-19a4380fbf4b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:24.024885 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a585a-0112-40af-8b59-19a4380fbf4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:24.034565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a585a-0112-40af-8b59-19a4380fbf4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7c3a585a-0112-40af-8b59-19a4380fbf4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:24.042137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:24.043112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:24.043914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:24.046843 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 158/324] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:24.047494 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e8730-709c-44c4-8fb7-f92812b3f462 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:24.048655 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 167/325] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:24.049360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a585a-0112-40af-8b59-19a4380fbf4b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:24.088517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:24.124578 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:24.146026 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e8730-709c-44c4-8fb7-f92812b3f462 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:24.153723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a585a-0112-40af-8b59-19a4380fbf4b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:24.178923 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b858a1-76d4-4808-b79e-ebc755914cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:24.179701 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b858a1-76d4-4808-b79e-ebc755914cdf None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:24.179981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b858a1-76d4-4808-b79e-ebc755914cdf None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:24.180251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b858a1-76d4-4808-b79e-ebc755914cdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:24.181404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b858a1-76d4-4808-b79e-ebc755914cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:24.183137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b858a1-76d4-4808-b79e-ebc755914cdf None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:24.184741 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 159/326] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:24.185486 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b858a1-76d4-4808-b79e-ebc755914cdf None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:24.187362 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4639bb-d0bb-42ff-a00d-ae1ad5e5d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:24.188021 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4639bb-d0bb-42ff-a00d-ae1ad5e5d2cc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:24.188298 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4639bb-d0bb-42ff-a00d-ae1ad5e5d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:24.188564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4639bb-d0bb-42ff-a00d-ae1ad5e5d2cc None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:24.189306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4639bb-d0bb-42ff-a00d-ae1ad5e5d2cc None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:24.189605 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4639bb-d0bb-42ff-a00d-ae1ad5e5d2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:24.191019 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4639bb-d0bb-42ff-a00d-ae1ad5e5d2cc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:24.199214 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 168/327] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:24.199837 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4639bb-d0bb-42ff-a00d-ae1ad5e5d2cc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:24.288092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b858a1-76d4-4808-b79e-ebc755914cdf None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:24.292915 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:24.298975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4639bb-d0bb-42ff-a00d-ae1ad5e5d2cc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:24.322407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca0c88-4474-4702-8dde-a34152372dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:24.323337 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca0c88-4474-4702-8dde-a34152372dff None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:24.323689 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca0c88-4474-4702-8dde-a34152372dff None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:24.324034 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca0c88-4474-4702-8dde-a34152372dff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:24.334640 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca0c88-4474-4702-8dde-a34152372dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:24.335855 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cef919-cdd9-4507-9ec2-d2bf5fefcd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:24.336525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef919-cdd9-4507-9ec2-d2bf5fefcd6f None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:24.336812 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef919-cdd9-4507-9ec2-d2bf5fefcd6f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:24.337093 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef919-cdd9-4507-9ec2-d2bf5fefcd6f None admin] PATH_INFO: `/v3/groups` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:24.337790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cef919-cdd9-4507-9ec2-d2bf5fefcd6f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:24.339284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cef919-cdd9-4507-9ec2-d2bf5fefcd6f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-09ca0c88-4474-4702-8dde-a34152372dff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:24.342294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:24.343736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:24.344576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:24.345203 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 160/328] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:24.345868 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca0c88-4474-4702-8dde-a34152372dff None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:24.350054 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:24.442545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca0c88-4474-4702-8dde-a34152372dff None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:24.444529 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 169/329] 10.222.0.89 () {60 vars in 1134 bytes} [Thu May 19 19:42:24 2022] POST /identity/v3/groups => generated 226 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:42:24.445437 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cef919-cdd9-4507-9ec2-d2bf5fefcd6f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:24.486516 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa6be2-9392-4b35-916a-7a8bd6528857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:24.487544 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6be2-9392-4b35-916a-7a8bd6528857 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:24.487721 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6be2-9392-4b35-916a-7a8bd6528857 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:24.487992 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6be2-9392-4b35-916a-7a8bd6528857 None admin] PATH_INFO: `/v3/users/0ef91f40831043afb37a9dc297202338` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:24.489296 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa6be2-9392-4b35-916a-7a8bd6528857 None admin] RBAC: Authorizing `identity:get_user(user_id=0ef91f40831043afb37a9dc297202338)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:24.490804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa6be2-9392-4b35-916a-7a8bd6528857 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:24.492605 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 161/330] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:24 2022] GET /identity/v3/users/0ef91f40831043afb37a9dc297202338 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:24.498166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa6be2-9392-4b35-916a-7a8bd6528857 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:24.577357 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cef919-cdd9-4507-9ec2-d2bf5fefcd6f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:24.578019 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:24.610556 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa6be2-9392-4b35-916a-7a8bd6528857 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:24.614575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8038302-c504-4385-b4bf-b39ebbaac16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:24.615285 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8038302-c504-4385-b4bf-b39ebbaac16f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:24.615564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8038302-c504-4385-b4bf-b39ebbaac16f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:24.615837 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8038302-c504-4385-b4bf-b39ebbaac16f None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:24.616782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8038302-c504-4385-b4bf-b39ebbaac16f None admin] RBAC: Adding query filter params (name=reader) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:24.617095 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8038302-c504-4385-b4bf-b39ebbaac16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:24.618506 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8038302-c504-4385-b4bf-b39ebbaac16f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:24.628151 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 170/331] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:24.635093 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8038302-c504-4385-b4bf-b39ebbaac16f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:24.649790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7783064-ab8d-49e5-beed-7ee0ed084b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:24.650444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7783064-ab8d-49e5-beed-7ee0ed084b00 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:24.650777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7783064-ab8d-49e5-beed-7ee0ed084b00 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:24.651053 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7783064-ab8d-49e5-beed-7ee0ed084b00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:24.651888 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7783064-ab8d-49e5-beed-7ee0ed084b00 None admin] RBAC: Adding query filter params (role.id=08c3f41d763c4a50ae3acacf391942aa, user.id=0ef91f40831043afb37a9dc297202338, scope.system=all) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:24.652202 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7783064-ab8d-49e5-beed-7ee0ed084b00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:24.653635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7783064-ab8d-49e5-beed-7ee0ed084b00 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:24.655897 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:24.672234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 162/332] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 19:42:24 2022] GET /identity/v3/role_assignments?user.id=0ef91f40831043afb37a9dc297202338&scope.system=all&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:24.758819 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8038302-c504-4385-b4bf-b39ebbaac16f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:24.798176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bbde7-fd8e-4818-9be2-4a72f2400966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:24.799108 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bbde7-fd8e-4818-9be2-4a72f2400966 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:24.799391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bbde7-fd8e-4818-9be2-4a72f2400966 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:24.799667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bbde7-fd8e-4818-9be2-4a72f2400966 None admin] PATH_INFO: `/v3/users/0f97ce1e358a4f029fe53267af2adb2b` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:24.800969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bbde7-fd8e-4818-9be2-4a72f2400966 None admin] RBAC: Authorizing `identity:get_user(user_id=0f97ce1e358a4f029fe53267af2adb2b)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:24.802451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bbde7-fd8e-4818-9be2-4a72f2400966 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:24.804187 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 171/333] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:24 2022] GET /identity/v3/users/0f97ce1e358a4f029fe53267af2adb2b => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:24.810308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7783064-ab8d-49e5-beed-7ee0ed084b00 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:24.933308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7783064-ab8d-49e5-beed-7ee0ed084b00 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:24.963415 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:24.972080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1aec8-1a32-4fb1-8cab-5ad7e977cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:24.972946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1aec8-1a32-4fb1-8cab-5ad7e977cd80 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:24.973227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1aec8-1a32-4fb1-8cab-5ad7e977cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:24.973496 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1aec8-1a32-4fb1-8cab-5ad7e977cd80 None admin] PATH_INFO: `/v3/system/users/0f97ce1e358a4f029fe53267af2adb2b/roles/e0ec7191f86c4ea48d96bca7efa2bae7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:24.979604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1aec8-1a32-4fb1-8cab-5ad7e977cd80 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0f97ce1e358a4f029fe53267af2adb2b, role_id=e0ec7191f86c4ea48d96bca7efa2bae7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:24.979604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1aec8-1a32-4fb1-8cab-5ad7e977cd80 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:25.057213 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 163/334] 10.222.0.89 () {58 vars in 1334 bytes} [Thu May 19 19:42:24 2022] PUT /identity/v3/system/users/0f97ce1e358a4f029fe53267af2adb2b/roles/e0ec7191f86c4ea48d96bca7efa2bae7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:42:27.187478 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e7d6-cfa2-4d15-b2e8-99b74fe065d8 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:27.188577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e7d6-cfa2-4d15-b2e8-99b74fe065d8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:27.189065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e7d6-cfa2-4d15-b2e8-99b74fe065d8 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:27.191007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 172/335] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:27.196263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59f31-00fc-4e26-9e78-99c2df3e0d40 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:27.197118 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59f31-00fc-4e26-9e78-99c2df3e0d40 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:27.197605 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59f31-00fc-4e26-9e78-99c2df3e0d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:27.223618 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-75c59f31-00fc-4e26-9e78-99c2df3e0d40 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:27.225156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-75c59f31-00fc-4e26-9e78-99c2df3e0d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:27.303352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 164/336] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:27.339002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e7d6-cfa2-4d15-b2e8-99b74fe065d8 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:27.459387 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:27.476279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e7d6-cfa2-4d15-b2e8-99b74fe065d8 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:27.516576 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56411b-cf1e-4817-a716-0b28741fbe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:27.517368 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56411b-cf1e-4817-a716-0b28741fbe66 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:27.517647 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56411b-cf1e-4817-a716-0b28741fbe66 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:27.517916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56411b-cf1e-4817-a716-0b28741fbe66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:27.533581 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56411b-cf1e-4817-a716-0b28741fbe66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-4d56411b-cf1e-4817-a716-0b28741fbe66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:27.541225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:27.542180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:27.543039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 173/337] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:27.548939 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c59f31-00fc-4e26-9e78-99c2df3e0d40 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:27.660052 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c59f31-00fc-4e26-9e78-99c2df3e0d40 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:27.694140 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:27.704349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd54d-d11a-4a38-b7dd-9abc2338a4f7 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:27.704966 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd54d-d11a-4a38-b7dd-9abc2338a4f7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:27.705468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd54d-d11a-4a38-b7dd-9abc2338a4f7 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:27.707564 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8183a-7931-489d-a7f1-52c450a0d113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:27.708199 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 174/338] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:27.709711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8183a-7931-489d-a7f1-52c450a0d113 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:27.709711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8183a-7931-489d-a7f1-52c450a0d113 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:27.709711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8183a-7931-489d-a7f1-52c450a0d113 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:27.709959 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8183a-7931-489d-a7f1-52c450a0d113 None admin] RBAC: Adding query filter params (name=member) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:27.710171 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8183a-7931-489d-a7f1-52c450a0d113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:27.713101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8183a-7931-489d-a7f1-52c450a0d113 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:27.715099 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e395d-a196-42d4-9c4d-1fb1cbfef0fc None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:27.715640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e395d-a196-42d4-9c4d-1fb1cbfef0fc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:27.716129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e395d-a196-42d4-9c4d-1fb1cbfef0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:27.723983 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 165/339] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:27.731732 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8183a-7931-489d-a7f1-52c450a0d113 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:27.753647 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-330e395d-a196-42d4-9c4d-1fb1cbfef0fc None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:27.755227 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-330e395d-a196-42d4-9c4d-1fb1cbfef0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:27.886637 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 175/340] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:27.904215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8183a-7931-489d-a7f1-52c450a0d113 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:27.908507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e395d-a196-42d4-9c4d-1fb1cbfef0fc None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:27.989150 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04017d07-7fac-4af7-8274-7dbdf4ae114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:27.989737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04017d07-7fac-4af7-8274-7dbdf4ae114e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:27.990123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04017d07-7fac-4af7-8274-7dbdf4ae114e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:27.990413 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04017d07-7fac-4af7-8274-7dbdf4ae114e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:28.065264 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:28.087894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04017d07-7fac-4af7-8274-7dbdf4ae114e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:28.089349 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04017d07-7fac-4af7-8274-7dbdf4ae114e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:28.096621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:28.134783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e395d-a196-42d4-9c4d-1fb1cbfef0fc None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:28.191249 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37244252-b502-4449-b8aa-b798d62451ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:28.192059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37244252-b502-4449-b8aa-b798d62451ff None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:28.192339 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37244252-b502-4449-b8aa-b798d62451ff None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:28.192616 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37244252-b502-4449-b8aa-b798d62451ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:28.204763 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37244252-b502-4449-b8aa-b798d62451ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-37244252-b502-4449-b8aa-b798d62451ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:28.215464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:28.216395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:28.217648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 176/341] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:42:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:28.219557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45615c-3c0f-434d-8657-4d1a189f54ca None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:28.219557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45615c-3c0f-434d-8657-4d1a189f54ca None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:28.219557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45615c-3c0f-434d-8657-4d1a189f54ca None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:28.220837 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 177/342] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:28.222019 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb32b15-d7f2-4d5a-b5f8-0227d45ebc70 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:28.222303 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb32b15-d7f2-4d5a-b5f8-0227d45ebc70 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:28.222573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb32b15-d7f2-4d5a-b5f8-0227d45ebc70 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:28.224076 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 178/343] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:28.226041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb32b15-d7f2-4d5a-b5f8-0227d45ebc70 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:28.234862 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 166/344] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:42:28.236342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0bc6-0e45-4ab7-8c3e-3b75095e89f2 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:28.236637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0bc6-0e45-4ab7-8c3e-3b75095e89f2 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:28.236917 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0bc6-0e45-4ab7-8c3e-3b75095e89f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:28.257766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-04fb0bc6-0e45-4ab7-8c3e-3b75095e89f2 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:28.259090 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-04fb0bc6-0e45-4ab7-8c3e-3b75095e89f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:28.339511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb32b15-d7f2-4d5a-b5f8-0227d45ebc70 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:28.363809 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 167/345] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:28.365262 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b9a8b-e2e8-4c75-aca3-92dfb422c6b5 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:28.365554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b9a8b-e2e8-4c75-aca3-92dfb422c6b5 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:28.365925 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b9a8b-e2e8-4c75-aca3-92dfb422c6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:28.384825 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cb236-948c-41d2-b647-f3009de8ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:28.385760 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb236-948c-41d2-b647-f3009de8ac0e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:28.386189 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb236-948c-41d2-b647-f3009de8ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:28.386625 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb236-948c-41d2-b647-f3009de8ac0e None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:28.387518 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cb236-948c-41d2-b647-f3009de8ac0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:28.387989 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cb236-948c-41d2-b647-f3009de8ac0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:28.390439 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cb236-948c-41d2-b647-f3009de8ac0e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:28.393568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:28.394922 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-a77b9a8b-e2e8-4c75-aca3-92dfb422c6b5 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:28.396105 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-a77b9a8b-e2e8-4c75-aca3-92dfb422c6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:28.401622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 179/346] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:28.402678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cb236-948c-41d2-b647-f3009de8ac0e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:28.418651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:28.481159 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 168/347] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:28.482340 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b9a8b-e2e8-4c75-aca3-92dfb422c6b5 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:28.512234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cb236-948c-41d2-b647-f3009de8ac0e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:28.548402 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100ecd4-124a-4d56-8789-52e68942eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:28.549529 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ecd4-124a-4d56-8789-52e68942eb91 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:28.549956 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ecd4-124a-4d56-8789-52e68942eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:28.550372 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ecd4-124a-4d56-8789-52e68942eb91 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:28.552358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100ecd4-124a-4d56-8789-52e68942eb91 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:28.554192 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100ecd4-124a-4d56-8789-52e68942eb91 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:28.557041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 180/348] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:28 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:28.558310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100ecd4-124a-4d56-8789-52e68942eb91 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:28.628914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b9a8b-e2e8-4c75-aca3-92dfb422c6b5 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:28.647101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:28.680688 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e4e7c-e2ec-4f80-a120-4dd4dde6abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:28.681678 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e4e7c-e2ec-4f80-a120-4dd4dde6abdc None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:28.682115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e4e7c-e2ec-4f80-a120-4dd4dde6abdc None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:28.682857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e4e7c-e2ec-4f80-a120-4dd4dde6abdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:28.688573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100ecd4-124a-4d56-8789-52e68942eb91 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:28.700419 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:28.726203 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47719-502d-4704-82ac-4a28ac1fdcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:28.727363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47719-502d-4704-82ac-4a28ac1fdcc7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:28.727830 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47719-502d-4704-82ac-4a28ac1fdcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:28.728299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47719-502d-4704-82ac-4a28ac1fdcc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:28.740369 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f47719-502d-4704-82ac-4a28ac1fdcc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c4f47719-502d-4704-82ac-4a28ac1fdcc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:28.749238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:28.750190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:28.751030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:28.753432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 181/349] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:28.754370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47719-502d-4704-82ac-4a28ac1fdcc7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:28.758703 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e4e7c-e2ec-4f80-a120-4dd4dde6abdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:28.759853 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e4e7c-e2ec-4f80-a120-4dd4dde6abdc None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:28.870752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47719-502d-4704-82ac-4a28ac1fdcc7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:28.872036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 169/350] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:28.872998 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e4e7c-e2ec-4f80-a120-4dd4dde6abdc None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:28.899606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:28.912064 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4d3be-92fc-44b0-9a3e-9bb3b3b35ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:28.924423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d3be-92fc-44b0-9a3e-9bb3b3b35ee7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:28.924423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d3be-92fc-44b0-9a3e-9bb3b3b35ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:28.924423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d3be-92fc-44b0-9a3e-9bb3b3b35ee7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:28.927286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4d3be-92fc-44b0-9a3e-9bb3b3b35ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c2b4d3be-92fc-44b0-9a3e-9bb3b3b35ee7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:28.935582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:28.936702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:42:28.937706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:28.938474 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:28.940139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 182/351] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:28.945768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4d3be-92fc-44b0-9a3e-9bb3b3b35ee7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:28.983666 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e4e7c-e2ec-4f80-a120-4dd4dde6abdc None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:29.024272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ec28c-649b-4abd-bd29-cefbbed73bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:29.025126 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ec28c-649b-4abd-bd29-cefbbed73bf2 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.025409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ec28c-649b-4abd-bd29-cefbbed73bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.025685 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ec28c-649b-4abd-bd29-cefbbed73bf2 None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.033761 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ec28c-649b-4abd-bd29-cefbbed73bf2 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:29.035583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ec28c-649b-4abd-bd29-cefbbed73bf2 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:29.037771 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 170/352] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:28 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:29.038536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ec28c-649b-4abd-bd29-cefbbed73bf2 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:29.069027 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4d3be-92fc-44b0-9a3e-9bb3b3b35ee7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:29.127058 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b57e62-37f1-41e9-8945-9fe7ae23f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:29.127665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57e62-37f1-41e9-8945-9fe7ae23f844 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.127946 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57e62-37f1-41e9-8945-9fe7ae23f844 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.128223 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57e62-37f1-41e9-8945-9fe7ae23f844 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.128989 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b57e62-37f1-41e9-8945-9fe7ae23f844 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:29.129296 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b57e62-37f1-41e9-8945-9fe7ae23f844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:29.130835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b57e62-37f1-41e9-8945-9fe7ae23f844 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:29.143052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 183/353] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:29.143255 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b57e62-37f1-41e9-8945-9fe7ae23f844 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:29.176227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ec28c-649b-4abd-bd29-cefbbed73bf2 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:29.192343 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:29.202525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:29.230842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e6e59-46bf-403e-bfb9-8121b83911fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:29.231711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6e59-46bf-403e-bfb9-8121b83911fa None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.232061 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6e59-46bf-403e-bfb9-8121b83911fa None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.233714 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6e59-46bf-403e-bfb9-8121b83911fa None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.235244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e6e59-46bf-403e-bfb9-8121b83911fa None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:29.236692 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e6e59-46bf-403e-bfb9-8121b83911fa None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:29.238771 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 171/354] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:29 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:29.239953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2fd1a-0372-4c8e-af98-f36cd0eeea7b None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.240273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2fd1a-0372-4c8e-af98-f36cd0eeea7b None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.240555 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2fd1a-0372-4c8e-af98-f36cd0eeea7b None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.241995 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 172/355] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:29.243842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2fd1a-0372-4c8e-af98-f36cd0eeea7b None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:29.275715 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b57e62-37f1-41e9-8945-9fe7ae23f844 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:29.323891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb1224-9564-4956-af75-d91abfcb8fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:29.324693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1224-9564-4956-af75-d91abfcb8fa5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.324965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1224-9564-4956-af75-d91abfcb8fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.325245 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1224-9564-4956-af75-d91abfcb8fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.326137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb1224-9564-4956-af75-d91abfcb8fa5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:29.326450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb1224-9564-4956-af75-d91abfcb8fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:29.327945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb1224-9564-4956-af75-d91abfcb8fa5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:29.340814 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 184/356] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:29.341655 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb1224-9564-4956-af75-d91abfcb8fa5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:29.375733 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2fd1a-0372-4c8e-af98-f36cd0eeea7b None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:29.416690 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d7132-8291-48a1-bbfa-2192a915ebe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:29.417260 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d7132-8291-48a1-bbfa-2192a915ebe5 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.417543 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d7132-8291-48a1-bbfa-2192a915ebe5 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.417806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d7132-8291-48a1-bbfa-2192a915ebe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.418674 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d7132-8291-48a1-bbfa-2192a915ebe5 None admin] RBAC: Adding query filter params (group.id=6cf171a9b24d48dba1a7649b32aa3e66, role.id=08c3f41d763c4a50ae3acacf391942aa, scope.project.id=11f8474be7594f1f9370c395b04ee7d2) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:29.418985 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d7132-8291-48a1-bbfa-2192a915ebe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:29.420958 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d7132-8291-48a1-bbfa-2192a915ebe5 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:29.426799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 173/357] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 19:42:29 2022] GET /identity/v3/role_assignments?group.id=6cf171a9b24d48dba1a7649b32aa3e66&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:29.427852 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d7132-8291-48a1-bbfa-2192a915ebe5 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:29.467439 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb1224-9564-4956-af75-d91abfcb8fa5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:29.479929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:29.490981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:29.513438 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c91bd-e5c0-4b25-b5be-3a96447a1851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:29.514148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c91bd-e5c0-4b25-b5be-3a96447a1851 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.514436 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c91bd-e5c0-4b25-b5be-3a96447a1851 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.514815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c91bd-e5c0-4b25-b5be-3a96447a1851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.580528 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d7132-8291-48a1-bbfa-2192a915ebe5 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:29.606756 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c91bd-e5c0-4b25-b5be-3a96447a1851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:29.609548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c91bd-e5c0-4b25-b5be-3a96447a1851 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:29.641408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585c209-576a-47dc-bf64-7a79c32f4a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:29.641408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585c209-576a-47dc-bf64-7a79c32f4a6d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.641408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585c209-576a-47dc-bf64-7a79c32f4a6d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.641408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585c209-576a-47dc-bf64-7a79c32f4a6d None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.641974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585c209-576a-47dc-bf64-7a79c32f4a6d None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:29.645017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585c209-576a-47dc-bf64-7a79c32f4a6d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:29.650895 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 174/358] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:29 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:29.653538 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e7a52-ec86-4bff-a552-3d803ba895d4 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.653887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e7a52-ec86-4bff-a552-3d803ba895d4 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.654166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e7a52-ec86-4bff-a552-3d803ba895d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.674477 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-fc2e7a52-ec86-4bff-a552-3d803ba895d4 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:29.675756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-fc2e7a52-ec86-4bff-a552-3d803ba895d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:29.737841 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 185/359] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:29.740321 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c37e5-a30a-461c-8653-b35f0c0a73c9 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.740321 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c37e5-a30a-461c-8653-b35f0c0a73c9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.740321 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c37e5-a30a-461c-8653-b35f0c0a73c9 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.742242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 186/360] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:29.743062 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c37e5-a30a-461c-8653-b35f0c0a73c9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:29.758249 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:29.770911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 175/361] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:29.776359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e7a52-ec86-4bff-a552-3d803ba895d4 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:29.830516 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:29.877874 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c37e5-a30a-461c-8653-b35f0c0a73c9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:29.905979 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e7a52-ec86-4bff-a552-3d803ba895d4 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:29.926847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c4370-2459-44ac-93aa-fcedcd8680eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:29.927740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4370-2459-44ac-93aa-fcedcd8680eb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.928346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4370-2459-44ac-93aa-fcedcd8680eb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.928702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4370-2459-44ac-93aa-fcedcd8680eb None admin] PATH_INFO: `/v3/users/0f97ce1e358a4f029fe53267af2adb2b` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.930113 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c4370-2459-44ac-93aa-fcedcd8680eb None admin] RBAC: Authorizing `identity:get_user(user_id=0f97ce1e358a4f029fe53267af2adb2b)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:29.932060 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c4370-2459-44ac-93aa-fcedcd8680eb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:29.934394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 187/362] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:42:29 2022] GET /identity/v3/users/0f97ce1e358a4f029fe53267af2adb2b => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:29.935789 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c4370-2459-44ac-93aa-fcedcd8680eb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:29.953314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddadfe2-48da-47ad-953f-2892bd08a1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:29.954057 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddadfe2-48da-47ad-953f-2892bd08a1bf None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.954407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddadfe2-48da-47ad-953f-2892bd08a1bf None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.955994 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddadfe2-48da-47ad-953f-2892bd08a1bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.956911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddadfe2-48da-47ad-953f-2892bd08a1bf None admin] RBAC: Adding query filter params (group.id=6cf171a9b24d48dba1a7649b32aa3e66, role.id=963eb8fa7a2943569e51dc5310a46baa, scope.project.id=11f8474be7594f1f9370c395b04ee7d2) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:29.957293 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddadfe2-48da-47ad-953f-2892bd08a1bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:29.958847 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddadfe2-48da-47ad-953f-2892bd08a1bf None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:29.966214 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 176/363] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 19:42:29 2022] GET /identity/v3/role_assignments?group.id=6cf171a9b24d48dba1a7649b32aa3e66&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=963eb8fa7a2943569e51dc5310a46baa => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:29.969597 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba237c-e367-4008-8c89-de495915bf3e None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:29.969861 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba237c-e367-4008-8c89-de495915bf3e None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:29.970262 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba237c-e367-4008-8c89-de495915bf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:29.990444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-01ba237c-e367-4008-8c89-de495915bf3e None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:29.991787 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-01ba237c-e367-4008-8c89-de495915bf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:30.044062 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:30.075757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c4370-2459-44ac-93aa-fcedcd8680eb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:30.090636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 177/364] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:30.090636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba237c-e367-4008-8c89-de495915bf3e None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:30.130178 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:30.144376 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4c163-711e-4e88-abf7-d40c7c239453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:30.145672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4c163-711e-4e88-abf7-d40c7c239453 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:30.146179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4c163-711e-4e88-abf7-d40c7c239453 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:30.146755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4c163-711e-4e88-abf7-d40c7c239453 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:30.148604 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4c163-711e-4e88-abf7-d40c7c239453 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:30.150642 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4c163-711e-4e88-abf7-d40c7c239453 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:30.153172 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 188/365] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:29 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:30.154295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4c163-711e-4e88-abf7-d40c7c239453 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:30.217329 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba237c-e367-4008-8c89-de495915bf3e None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:30.269923 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618957d-11e5-4a05-9fc2-543bb563a82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:30.270767 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618957d-11e5-4a05-9fc2-543bb563a82b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:30.271050 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618957d-11e5-4a05-9fc2-543bb563a82b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:30.271320 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618957d-11e5-4a05-9fc2-543bb563a82b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:30.284503 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4c163-711e-4e88-abf7-d40c7c239453 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:30.285818 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618957d-11e5-4a05-9fc2-543bb563a82b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-3618957d-11e5-4a05-9fc2-543bb563a82b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:30.296075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:30.297009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:30.297823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:30.298452 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 178/366] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:42:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:30.298910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618957d-11e5-4a05-9fc2-543bb563a82b None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:30.341243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8950f31-702c-4411-aa52-bf4ab4c54cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:30.341918 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950f31-702c-4411-aa52-bf4ab4c54cd1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:30.342231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950f31-702c-4411-aa52-bf4ab4c54cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:30.342818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950f31-702c-4411-aa52-bf4ab4c54cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:30.343670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8950f31-702c-4411-aa52-bf4ab4c54cd1 None admin] RBAC: Adding query filter params (role.id=e0ec7191f86c4ea48d96bca7efa2bae7, user.id=0f97ce1e358a4f029fe53267af2adb2b, scope.system=all) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:30.343979 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8950f31-702c-4411-aa52-bf4ab4c54cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:30.346305 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8950f31-702c-4411-aa52-bf4ab4c54cd1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:30.369238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 189/367] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 19:42:30 2022] GET /identity/v3/role_assignments?user.id=0f97ce1e358a4f029fe53267af2adb2b&scope.system=all&role.id=e0ec7191f86c4ea48d96bca7efa2bae7 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:30.378645 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8950f31-702c-4411-aa52-bf4ab4c54cd1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:30.378645 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:30.501071 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:30.515092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618957d-11e5-4a05-9fc2-543bb563a82b None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:30.521013 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8950f31-702c-4411-aa52-bf4ab4c54cd1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:30.574954 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fd9d3-4fee-403b-83cf-063cbf16d86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:30.575848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fd9d3-4fee-403b-83cf-063cbf16d86a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:30.576133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fd9d3-4fee-403b-83cf-063cbf16d86a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:30.576412 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fd9d3-4fee-403b-83cf-063cbf16d86a None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:30.581437 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fd9d3-4fee-403b-83cf-063cbf16d86a None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:30.581437 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fd9d3-4fee-403b-83cf-063cbf16d86a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:30.581760 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 190/368] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:30 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:30.582565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fd9d3-4fee-403b-83cf-063cbf16d86a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:30.585153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13010c18-d364-44e3-b7a7-677d89df833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:30.586246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010c18-d364-44e3-b7a7-677d89df833b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:30.586743 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010c18-d364-44e3-b7a7-677d89df833b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:30.587192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010c18-d364-44e3-b7a7-677d89df833b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:30.611804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13010c18-d364-44e3-b7a7-677d89df833b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-13010c18-d364-44e3-b7a7-677d89df833b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:30.624914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:30.625857 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 179/369] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:30.627125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13010c18-d364-44e3-b7a7-677d89df833b None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:30.666884 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:30.717078 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fd9d3-4fee-403b-83cf-063cbf16d86a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:30.776247 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76149-d246-473f-aeee-1a22ce260e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:30.777692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76149-d246-473f-aeee-1a22ce260e1a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:30.778376 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76149-d246-473f-aeee-1a22ce260e1a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:30.778829 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76149-d246-473f-aeee-1a22ce260e1a None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:30.780051 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad76149-d246-473f-aeee-1a22ce260e1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:30.780905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad76149-d246-473f-aeee-1a22ce260e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:30.782780 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad76149-d246-473f-aeee-1a22ce260e1a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:30.783574 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13010c18-d364-44e3-b7a7-677d89df833b None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:30.800201 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 191/370] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:30.800979 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76149-d246-473f-aeee-1a22ce260e1a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:30.842856 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b467c4-bb0b-44c5-913f-efe4ca089551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:30.843589 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b467c4-bb0b-44c5-913f-efe4ca089551 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:30.846589 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b467c4-bb0b-44c5-913f-efe4ca089551 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:30.847080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b467c4-bb0b-44c5-913f-efe4ca089551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:30.848504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b467c4-bb0b-44c5-913f-efe4ca089551 None admin] RBAC: Adding query filter params (group.id=6cf171a9b24d48dba1a7649b32aa3e66, role.id=08c3f41d763c4a50ae3acacf391942aa, scope.project.id=83b3fa382b104cb9832f009730a50fe7) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:30.848504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b467c4-bb0b-44c5-913f-efe4ca089551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:30.850059 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b467c4-bb0b-44c5-913f-efe4ca089551 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:30.859079 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 180/371] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 19:42:30 2022] GET /identity/v3/role_assignments?group.id=6cf171a9b24d48dba1a7649b32aa3e66&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:30.860039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b467c4-bb0b-44c5-913f-efe4ca089551 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:30.881378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:30.979140 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76149-d246-473f-aeee-1a22ce260e1a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:31.012893 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b467c4-bb0b-44c5-913f-efe4ca089551 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:31.061439 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b64e6-bb17-4b93-ad31-3b8de2c39fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:31.062051 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b64e6-bb17-4b93-ad31-3b8de2c39fa4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:31.062335 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b64e6-bb17-4b93-ad31-3b8de2c39fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:31.062641 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b64e6-bb17-4b93-ad31-3b8de2c39fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:31.063428 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b64e6-bb17-4b93-ad31-3b8de2c39fa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:31.063727 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b64e6-bb17-4b93-ad31-3b8de2c39fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:31.065175 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b64e6-bb17-4b93-ad31-3b8de2c39fa4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:31.068569 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:31.085931 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 192/372] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:31.089298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66b1ca-8518-4098-a785-3b8c8523198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:31.091147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b64e6-bb17-4b93-ad31-3b8de2c39fa4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:31.091726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66b1ca-8518-4098-a785-3b8c8523198d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:31.099005 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66b1ca-8518-4098-a785-3b8c8523198d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:31.099005 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66b1ca-8518-4098-a785-3b8c8523198d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:31.214237 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66b1ca-8518-4098-a785-3b8c8523198d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:31.216932 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66b1ca-8518-4098-a785-3b8c8523198d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:31.277021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:31.305831 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b64e6-bb17-4b93-ad31-3b8de2c39fa4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:31.341309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 181/373] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:31.353771 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1173c07-7e73-40e0-8a3f-cc8a599d4ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:31.354439 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1173c07-7e73-40e0-8a3f-cc8a599d4ff8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:31.354735 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66b1ca-8518-4098-a785-3b8c8523198d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:31.354864 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1173c07-7e73-40e0-8a3f-cc8a599d4ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:31.355007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1173c07-7e73-40e0-8a3f-cc8a599d4ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:31.458998 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:31.469853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1173c07-7e73-40e0-8a3f-cc8a599d4ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:31.471540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1173c07-7e73-40e0-8a3f-cc8a599d4ff8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:31.591985 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66b1ca-8518-4098-a785-3b8c8523198d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:31.618958 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:31.628991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 193/374] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:31.634424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1173c07-7e73-40e0-8a3f-cc8a599d4ff8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:31.644726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40188f7-b713-46dd-a487-25df838e5345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:31.645612 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40188f7-b713-46dd-a487-25df838e5345 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:31.645900 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40188f7-b713-46dd-a487-25df838e5345 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:31.646180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40188f7-b713-46dd-a487-25df838e5345 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:31.651621 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40188f7-b713-46dd-a487-25df838e5345 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:31.653101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40188f7-b713-46dd-a487-25df838e5345 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:31.655216 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 182/375] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:31 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:31.660485 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40188f7-b713-46dd-a487-25df838e5345 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:31.739754 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:31.746262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1173c07-7e73-40e0-8a3f-cc8a599d4ff8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:31.792123 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe33435-1b30-49b7-a995-ebd6e8c56c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:31.793008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33435-1b30-49b7-a995-ebd6e8c56c41 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:31.793287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33435-1b30-49b7-a995-ebd6e8c56c41 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:31.793568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33435-1b30-49b7-a995-ebd6e8c56c41 None admin] PATH_INFO: `/v3/projects/8cbf08f613684bc5800cd2a653ac6ae3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:31.796305 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe33435-1b30-49b7-a995-ebd6e8c56c41 None admin] RBAC: Authorizing `identity:get_project(project_id=8cbf08f613684bc5800cd2a653ac6ae3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:31.797797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe33435-1b30-49b7-a995-ebd6e8c56c41 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:31.799828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 194/376] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:31 2022] GET /identity/v3/projects/8cbf08f613684bc5800cd2a653ac6ae3 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:31.805685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe33435-1b30-49b7-a995-ebd6e8c56c41 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:31.821473 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40188f7-b713-46dd-a487-25df838e5345 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:31.891036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f988e-203a-424e-9f6c-21112ac0ba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:31.891901 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f988e-203a-424e-9f6c-21112ac0ba85 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:31.892186 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f988e-203a-424e-9f6c-21112ac0ba85 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:31.892462 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f988e-203a-424e-9f6c-21112ac0ba85 None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:31.893856 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f988e-203a-424e-9f6c-21112ac0ba85 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:31.895332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f988e-203a-424e-9f6c-21112ac0ba85 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:31.902420 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 183/377] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:31 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:31.906123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f988e-203a-424e-9f6c-21112ac0ba85 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:31.978198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:32.013711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe33435-1b30-49b7-a995-ebd6e8c56c41 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:32.036935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f988e-203a-424e-9f6c-21112ac0ba85 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:32.062579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e102b15-24d2-4a38-9166-b76d0fd32ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:32.063599 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e102b15-24d2-4a38-9166-b76d0fd32ae0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:32.063888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e102b15-24d2-4a38-9166-b76d0fd32ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:32.064163 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e102b15-24d2-4a38-9166-b76d0fd32ae0 None admin] PATH_INFO: `/v3/groups/0753ac188a154b72a17dbf5d67164b5c` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:32.070949 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e102b15-24d2-4a38-9166-b76d0fd32ae0 None admin] RBAC: Authorizing `identity:get_group(group_id=0753ac188a154b72a17dbf5d67164b5c)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:32.072570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e102b15-24d2-4a38-9166-b76d0fd32ae0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:32.075674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 195/378] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:31 2022] GET /identity/v3/groups/0753ac188a154b72a17dbf5d67164b5c => generated 229 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:32.077352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350a7a9-ac01-446b-8059-dad308fac988 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:32.077657 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350a7a9-ac01-446b-8059-dad308fac988 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:32.077936 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350a7a9-ac01-446b-8059-dad308fac988 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:32.085030 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1caf2c6-d459-4f29-81ab-f9871b4df164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:32.085699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caf2c6-d459-4f29-81ab-f9871b4df164 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:32.085984 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caf2c6-d459-4f29-81ab-f9871b4df164 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:32.086261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caf2c6-d459-4f29-81ab-f9871b4df164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:32.086662 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 196/379] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:32.087136 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caf2c6-d459-4f29-81ab-f9871b4df164 None admin] RBAC: Adding query filter params (group.id=6cf171a9b24d48dba1a7649b32aa3e66, role.id=963eb8fa7a2943569e51dc5310a46baa, scope.project.id=83b3fa382b104cb9832f009730a50fe7) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:32.087452 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caf2c6-d459-4f29-81ab-f9871b4df164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:32.088135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350a7a9-ac01-446b-8059-dad308fac988 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:32.089107 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caf2c6-d459-4f29-81ab-f9871b4df164 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:32.097164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 184/380] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 19:42:31 2022] GET /identity/v3/role_assignments?group.id=6cf171a9b24d48dba1a7649b32aa3e66&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=963eb8fa7a2943569e51dc5310a46baa => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:32.098473 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7540823-ba3b-48fc-837d-3792a9b2d023 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:32.098789 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7540823-ba3b-48fc-837d-3792a9b2d023 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:32.099069 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7540823-ba3b-48fc-837d-3792a9b2d023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:32.123700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-e7540823-ba3b-48fc-837d-3792a9b2d023 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:32.125347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-e7540823-ba3b-48fc-837d-3792a9b2d023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:32.134999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:32.233546 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 185/381] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:32.258063 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7540823-ba3b-48fc-837d-3792a9b2d023 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:32.271023 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350a7a9-ac01-446b-8059-dad308fac988 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:32.349789 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d0e52-ccc5-4ee0-a9bc-73b4240f2e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:32.350574 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d0e52-ccc5-4ee0-a9bc-73b4240f2e83 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:32.350788 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d0e52-ccc5-4ee0-a9bc-73b4240f2e83 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:32.351070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d0e52-ccc5-4ee0-a9bc-73b4240f2e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:32.351935 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d0e52-ccc5-4ee0-a9bc-73b4240f2e83 None admin] RBAC: Adding query filter params (group.id=0753ac188a154b72a17dbf5d67164b5c, role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=8cbf08f613684bc5800cd2a653ac6ae3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:32.352253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d0e52-ccc5-4ee0-a9bc-73b4240f2e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:32.353737 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d0e52-ccc5-4ee0-a9bc-73b4240f2e83 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:32.360652 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 197/382] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 19:42:32 2022] GET /identity/v3/role_assignments?group.id=0753ac188a154b72a17dbf5d67164b5c&scope.project.id=8cbf08f613684bc5800cd2a653ac6ae3&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:32.368892 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:32.437428 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7540823-ba3b-48fc-837d-3792a9b2d023 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:32.486850 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed3004-40a9-4b03-b4f1-b6dedb5014e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:32.487629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed3004-40a9-4b03-b4f1-b6dedb5014e2 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:32.487867 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed3004-40a9-4b03-b4f1-b6dedb5014e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:32.488144 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed3004-40a9-4b03-b4f1-b6dedb5014e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:32.505589 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed3004-40a9-4b03-b4f1-b6dedb5014e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-b6ed3004-40a9-4b03-b4f1-b6dedb5014e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:32.513696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:32.514720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:32.515536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 186/383] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:32.520950 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d0e52-ccc5-4ee0-a9bc-73b4240f2e83 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:32.661345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:32.674809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d0e52-ccc5-4ee0-a9bc-73b4240f2e83 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:32.718241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eb605-88dd-47f1-915f-91befb634e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:32.719044 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eb605-88dd-47f1-915f-91befb634e73 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:32.719323 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eb605-88dd-47f1-915f-91befb634e73 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:32.719594 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eb605-88dd-47f1-915f-91befb634e73 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:32.720348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706eb605-88dd-47f1-915f-91befb634e73 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:32.720654 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706eb605-88dd-47f1-915f-91befb634e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:32.722061 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706eb605-88dd-47f1-915f-91befb634e73 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:32.731466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 198/384] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:32.737949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed3004-40a9-4b03-b4f1-b6dedb5014e2 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:32.878848 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed3004-40a9-4b03-b4f1-b6dedb5014e2 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:32.888593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:32.917154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b051f-333b-490d-890c-86beffd8bad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:32.918396 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b051f-333b-490d-890c-86beffd8bad6 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:32.919002 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b051f-333b-490d-890c-86beffd8bad6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:32.919502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b051f-333b-490d-890c-86beffd8bad6 None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:32.921469 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b051f-333b-490d-890c-86beffd8bad6 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:32.923148 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b051f-333b-490d-890c-86beffd8bad6 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:32.928795 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 187/385] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:32 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:32.934858 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eb605-88dd-47f1-915f-91befb634e73 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:32.968264 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558218d-552a-4d83-8f8d-7ba9f683eb8b None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:32.968893 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558218d-552a-4d83-8f8d-7ba9f683eb8b None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:32.969370 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558218d-552a-4d83-8f8d-7ba9f683eb8b None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:32.971398 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 188/386] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:33.012467 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc33b2-f2de-4423-a6bc-51b644831dac None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:33.013055 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc33b2-f2de-4423-a6bc-51b644831dac None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:33.013554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc33b2-f2de-4423-a6bc-51b644831dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:33.052367 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-21dc33b2-f2de-4423-a6bc-51b644831dac None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:33.053918 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-21dc33b2-f2de-4423-a6bc-51b644831dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:33.085506 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eb605-88dd-47f1-915f-91befb634e73 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:33.174752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860578cd-1260-4b76-b6a1-1b77b96f251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:33.176297 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860578cd-1260-4b76-b6a1-1b77b96f251a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:33.176804 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860578cd-1260-4b76-b6a1-1b77b96f251a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:33.177310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860578cd-1260-4b76-b6a1-1b77b96f251a None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:33.181407 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860578cd-1260-4b76-b6a1-1b77b96f251a None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:33.184203 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860578cd-1260-4b76-b6a1-1b77b96f251a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:33.186653 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 199/387] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:32 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:33.192693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860578cd-1260-4b76-b6a1-1b77b96f251a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:33.213087 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 189/388] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:33.242742 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:33.288177 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc33b2-f2de-4423-a6bc-51b644831dac None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:33.365632 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860578cd-1260-4b76-b6a1-1b77b96f251a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:33.434427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a7261-9290-4b32-82fb-588ab6112101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:33.435391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a7261-9290-4b32-82fb-588ab6112101 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:33.435672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a7261-9290-4b32-82fb-588ab6112101 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:33.435975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a7261-9290-4b32-82fb-588ab6112101 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2/groups/6cf171a9b24d48dba1a7649b32aa3e66/roles/08c3f41d763c4a50ae3acacf391942aa` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:33.442053 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a7261-9290-4b32-82fb-588ab6112101 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f8474be7594f1f9370c395b04ee7d2, group_id=6cf171a9b24d48dba1a7649b32aa3e66, role_id=08c3f41d763c4a50ae3acacf391942aa)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:33.443658 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a7261-9290-4b32-82fb-588ab6112101 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:33.463273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc33b2-f2de-4423-a6bc-51b644831dac None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:33.501325 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4c863-5f52-4f80-91fe-0fc3c4df19f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:33.502133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c863-5f52-4f80-91fe-0fc3c4df19f9 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:33.502411 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c863-5f52-4f80-91fe-0fc3c4df19f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:33.502713 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c863-5f52-4f80-91fe-0fc3c4df19f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:33.510914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:33.515236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4c863-5f52-4f80-91fe-0fc3c4df19f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:33.531828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 200/389] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 19:42:33 2022] PUT /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2/groups/6cf171a9b24d48dba1a7649b32aa3e66/roles/08c3f41d763c4a50ae3acacf391942aa => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-b7a4c863-5f52-4f80-91fe-0fc3c4df19f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:33.532021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:33.532911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:33.533816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 190/390] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:42:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:33.539582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a7261-9290-4b32-82fb-588ab6112101 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:33.648051 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:33.667897 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a7261-9290-4b32-82fb-588ab6112101 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:33.686822 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8f1a-d53d-4dc9-805f-9f6272bc0eb4 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:33.687131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8f1a-d53d-4dc9-805f-9f6272bc0eb4 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:33.687381 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8f1a-d53d-4dc9-805f-9f6272bc0eb4 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:33.688947 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 191/391] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:33.696013 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c209db-6ab4-4ee7-ab9b-6f97380830b7 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:33.696363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c209db-6ab4-4ee7-ab9b-6f97380830b7 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:33.696699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c209db-6ab4-4ee7-ab9b-6f97380830b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:33.718181 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-f9c209db-6ab4-4ee7-ab9b-6f97380830b7 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:33.719444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-f9c209db-6ab4-4ee7-ab9b-6f97380830b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:33.740333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427686a0-c336-4640-8b52-85d6641031a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:33.741027 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427686a0-c336-4640-8b52-85d6641031a2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:33.741315 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427686a0-c336-4640-8b52-85d6641031a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:33.741597 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427686a0-c336-4640-8b52-85d6641031a2 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:33.742369 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427686a0-c336-4640-8b52-85d6641031a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:33.742707 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427686a0-c336-4640-8b52-85d6641031a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:33.744190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427686a0-c336-4640-8b52-85d6641031a2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:33.763414 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 201/392] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:33.770200 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427686a0-c336-4640-8b52-85d6641031a2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:33.801445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 192/393] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:33.825092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c209db-6ab4-4ee7-ab9b-6f97380830b7 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:33.901204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427686a0-c336-4640-8b52-85d6641031a2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:33.938867 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a374dc-782c-4477-a0bf-afc136e76aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:33.940063 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a374dc-782c-4477-a0bf-afc136e76aab None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:33.940540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a374dc-782c-4477-a0bf-afc136e76aab None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:33.941028 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a374dc-782c-4477-a0bf-afc136e76aab None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:33.942708 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a374dc-782c-4477-a0bf-afc136e76aab None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:33.944891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a374dc-782c-4477-a0bf-afc136e76aab None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:33.947058 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 202/394] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:33 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:33.953028 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a374dc-782c-4477-a0bf-afc136e76aab None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:33.986984 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:34.032558 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:34.049539 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c209db-6ab4-4ee7-ab9b-6f97380830b7 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:34.069644 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a374dc-782c-4477-a0bf-afc136e76aab None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:34.109768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cc016-4354-46ab-8abb-89c820406e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:34.111315 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc016-4354-46ab-8abb-89c820406e7b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:34.111795 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc016-4354-46ab-8abb-89c820406e7b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:34.112261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc016-4354-46ab-8abb-89c820406e7b None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:34.113731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cc016-4354-46ab-8abb-89c820406e7b None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:34.115844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cc016-4354-46ab-8abb-89c820406e7b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:34.118547 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 203/395] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:33 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:34.125592 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cc016-4354-46ab-8abb-89c820406e7b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:34.137155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ba7bd-e384-4dff-8168-c57aa76b7fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:34.138024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ba7bd-e384-4dff-8168-c57aa76b7fe6 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:34.138307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ba7bd-e384-4dff-8168-c57aa76b7fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:34.138586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ba7bd-e384-4dff-8168-c57aa76b7fe6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:34.170882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ba7bd-e384-4dff-8168-c57aa76b7fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-384ba7bd-e384-4dff-8168-c57aa76b7fe6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:34.187004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:34.187968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:34.188756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 193/396] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:34.195644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ba7bd-e384-4dff-8168-c57aa76b7fe6 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:34.231002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:34.248755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cc016-4354-46ab-8abb-89c820406e7b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:34.318525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446052b-1d9e-48d3-bb7c-ff923c13de53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:34.319448 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446052b-1d9e-48d3-bb7c-ff923c13de53 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:34.319791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446052b-1d9e-48d3-bb7c-ff923c13de53 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:34.320016 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446052b-1d9e-48d3-bb7c-ff923c13de53 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2/groups/6cf171a9b24d48dba1a7649b32aa3e66/roles/963eb8fa7a2943569e51dc5310a46baa` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:34.325715 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446052b-1d9e-48d3-bb7c-ff923c13de53 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f8474be7594f1f9370c395b04ee7d2, group_id=6cf171a9b24d48dba1a7649b32aa3e66, role_id=963eb8fa7a2943569e51dc5310a46baa)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:34.325715 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446052b-1d9e-48d3-bb7c-ff923c13de53 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:34.388248 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ba7bd-e384-4dff-8168-c57aa76b7fe6 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:34.425746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbbbdf-c29b-49be-8219-c67e0368b38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:34.426412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbbbdf-c29b-49be-8219-c67e0368b38a None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:34.426758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbbbdf-c29b-49be-8219-c67e0368b38a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:34.428885 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbbbdf-c29b-49be-8219-c67e0368b38a None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:34.428885 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbbbdf-c29b-49be-8219-c67e0368b38a None admin] RBAC: Adding query filter params (name=member) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:34.428885 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbbbdf-c29b-49be-8219-c67e0368b38a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:34.429565 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbbbdf-c29b-49be-8219-c67e0368b38a None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:34.439967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 194/397] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:34.445263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbbbdf-c29b-49be-8219-c67e0368b38a None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:34.458056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 204/398] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 19:42:34 2022] PUT /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2/groups/6cf171a9b24d48dba1a7649b32aa3e66/roles/963eb8fa7a2943569e51dc5310a46baa => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:42:34.483702 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:34.599810 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbbbdf-c29b-49be-8219-c67e0368b38a None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:34.643680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777055a-45ee-4f1e-9022-fcf1b44604dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:34.644549 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777055a-45ee-4f1e-9022-fcf1b44604dd None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:34.644909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777055a-45ee-4f1e-9022-fcf1b44604dd None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:34.645187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777055a-45ee-4f1e-9022-fcf1b44604dd None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:34.646416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777055a-45ee-4f1e-9022-fcf1b44604dd None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:34.647906 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777055a-45ee-4f1e-9022-fcf1b44604dd None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:34.649882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 195/399] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:34 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:34.655034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446052b-1d9e-48d3-bb7c-ff923c13de53 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:34.785947 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803aa56-5908-4747-8d6b-471ce242a1e9 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:34.786270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803aa56-5908-4747-8d6b-471ce242a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:34.786911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803aa56-5908-4747-8d6b-471ce242a1e9 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:34.788801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 196/400] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:34.793758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffe468-21ec-4b3f-b867-e4d788e951db None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:34.794052 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffe468-21ec-4b3f-b867-e4d788e951db None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:34.794334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffe468-21ec-4b3f-b867-e4d788e951db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:34.811751 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446052b-1d9e-48d3-bb7c-ff923c13de53 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:34.813632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-c6ffe468-21ec-4b3f-b867-e4d788e951db None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:34.814976 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-c6ffe468-21ec-4b3f-b867-e4d788e951db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:34.860217 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f3205-4922-4a8a-be33-9a261c849397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:34.861033 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f3205-4922-4a8a-be33-9a261c849397 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:34.861322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f3205-4922-4a8a-be33-9a261c849397 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:34.861603 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f3205-4922-4a8a-be33-9a261c849397 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:34.865525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f3205-4922-4a8a-be33-9a261c849397 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:34.867029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f3205-4922-4a8a-be33-9a261c849397 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:34.873438 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 205/401] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:34 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:34.884173 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f3205-4922-4a8a-be33-9a261c849397 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:34.901454 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:34.927773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 197/402] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:35.001506 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffe468-21ec-4b3f-b867-e4d788e951db None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:35.041994 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:35.058182 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f3205-4922-4a8a-be33-9a261c849397 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:35.120898 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd46b25-99e7-4c6d-b93b-c6a5a4922d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:35.122194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd46b25-99e7-4c6d-b93b-c6a5a4922d7e None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:35.122753 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd46b25-99e7-4c6d-b93b-c6a5a4922d7e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:35.123486 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd46b25-99e7-4c6d-b93b-c6a5a4922d7e None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7/groups/6cf171a9b24d48dba1a7649b32aa3e66/roles/08c3f41d763c4a50ae3acacf391942aa` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:35.127102 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffe468-21ec-4b3f-b867-e4d788e951db None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:35.128956 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd46b25-99e7-4c6d-b93b-c6a5a4922d7e None admin] RBAC: Authorizing `identity:create_grant(project_id=83b3fa382b104cb9832f009730a50fe7, group_id=6cf171a9b24d48dba1a7649b32aa3e66, role_id=08c3f41d763c4a50ae3acacf391942aa)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:35.130719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd46b25-99e7-4c6d-b93b-c6a5a4922d7e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:35.165211 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f2d17-630b-45c7-a5ed-ad83c4a3d33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:35.166031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f2d17-630b-45c7-a5ed-ad83c4a3d33a None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:35.166315 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f2d17-630b-45c7-a5ed-ad83c4a3d33a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:35.166584 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f2d17-630b-45c7-a5ed-ad83c4a3d33a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:35.178709 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f2d17-630b-45c7-a5ed-ad83c4a3d33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-b93f2d17-630b-45c7-a5ed-ad83c4a3d33a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:35.189224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:35.190109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:35.191044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 198/403] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:42:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:35.203310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f2d17-630b-45c7-a5ed-ad83c4a3d33a None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:35.227551 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 206/404] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 19:42:34 2022] PUT /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7/groups/6cf171a9b24d48dba1a7649b32aa3e66/roles/08c3f41d763c4a50ae3acacf391942aa => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:42:35.229122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a9fd-24fd-4fb7-909f-d32740659190 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:35.229419 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a9fd-24fd-4fb7-909f-d32740659190 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:35.229704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a9fd-24fd-4fb7-909f-d32740659190 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:35.235575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 207/405] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:35.237695 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305408ca-b2ed-4c11-a1de-3dbc45586c4a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:35.237985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305408ca-b2ed-4c11-a1de-3dbc45586c4a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:35.238267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305408ca-b2ed-4c11-a1de-3dbc45586c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:35.267911 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-305408ca-b2ed-4c11-a1de-3dbc45586c4a None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:35.269196 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-305408ca-b2ed-4c11-a1de-3dbc45586c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:35.350569 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:35.360194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 208/406] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:35.381128 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305408ca-b2ed-4c11-a1de-3dbc45586c4a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:35.417017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:35.472212 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f2d17-630b-45c7-a5ed-ad83c4a3d33a None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:35.526248 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6b83-fadb-424c-a404-63d94a60fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:35.527720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6b83-fadb-424c-a404-63d94a60fa88 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:35.528287 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6b83-fadb-424c-a404-63d94a60fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:35.528790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6b83-fadb-424c-a404-63d94a60fa88 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:35.530327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6b83-fadb-424c-a404-63d94a60fa88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:35.530870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6b83-fadb-424c-a404-63d94a60fa88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:35.532984 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6b83-fadb-424c-a404-63d94a60fa88 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:35.543521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 199/407] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:35.552674 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6b83-fadb-424c-a404-63d94a60fa88 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:35.566108 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305408ca-b2ed-4c11-a1de-3dbc45586c4a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:35.621073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3dcc4-a375-4320-a733-d4d45c6a2753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:35.621874 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3dcc4-a375-4320-a733-d4d45c6a2753 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:35.622157 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3dcc4-a375-4320-a733-d4d45c6a2753 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:35.622424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3dcc4-a375-4320-a733-d4d45c6a2753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:35.636570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3dcc4-a375-4320-a733-d4d45c6a2753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-16c3dcc4-a375-4320-a733-d4d45c6a2753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:35.646694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:35.647674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:35.648888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 209/408] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:42:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:35.654033 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3dcc4-a375-4320-a733-d4d45c6a2753 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:35.740124 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6b83-fadb-424c-a404-63d94a60fa88 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:35.759797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:35.807609 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e4bb3-8e78-4201-8c95-3fb65f79309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:35.808468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e4bb3-8e78-4201-8c95-3fb65f79309c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:35.808752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e4bb3-8e78-4201-8c95-3fb65f79309c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:35.809025 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e4bb3-8e78-4201-8c95-3fb65f79309c None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:35.813587 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e4bb3-8e78-4201-8c95-3fb65f79309c None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:35.815668 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e4bb3-8e78-4201-8c95-3fb65f79309c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:35.817097 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 200/409] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:35 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:35.822367 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e4bb3-8e78-4201-8c95-3fb65f79309c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:35.832748 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:35.840280 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3dcc4-a375-4320-a733-d4d45c6a2753 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:35.915925 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7bc94-ce89-4ef1-862d-9d0f0eee62c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:35.918130 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7bc94-ce89-4ef1-862d-9d0f0eee62c1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:35.919836 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7bc94-ce89-4ef1-862d-9d0f0eee62c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:35.920895 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7bc94-ce89-4ef1-862d-9d0f0eee62c1 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:35.923868 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7bc94-ce89-4ef1-862d-9d0f0eee62c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:35.924412 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7bc94-ce89-4ef1-862d-9d0f0eee62c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:35.926046 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7bc94-ce89-4ef1-862d-9d0f0eee62c1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:35.944498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 210/410] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:35.952643 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7bc94-ce89-4ef1-862d-9d0f0eee62c1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:36.001908 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e4bb3-8e78-4201-8c95-3fb65f79309c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:36.038707 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1cf1f-3fa3-4f9f-b4a1-e4a24c6e1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:36.039915 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1cf1f-3fa3-4f9f-b4a1-e4a24c6e1904 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:36.040396 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1cf1f-3fa3-4f9f-b4a1-e4a24c6e1904 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:36.040892 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1cf1f-3fa3-4f9f-b4a1-e4a24c6e1904 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:36.042287 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1cf1f-3fa3-4f9f-b4a1-e4a24c6e1904 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:36.043957 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1cf1f-3fa3-4f9f-b4a1-e4a24c6e1904 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:36.046183 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 201/411] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:35 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:36.051709 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1cf1f-3fa3-4f9f-b4a1-e4a24c6e1904 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:36.112516 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7bc94-ce89-4ef1-862d-9d0f0eee62c1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:36.130201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:36.133478 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:36.156268 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ab48d-7e1c-4684-bb7c-db84565ecdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:36.157142 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ab48d-7e1c-4684-bb7c-db84565ecdb7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:36.157393 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1cf1f-3fa3-4f9f-b4a1-e4a24c6e1904 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:36.157523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ab48d-7e1c-4684-bb7c-db84565ecdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:36.157785 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ab48d-7e1c-4684-bb7c-db84565ecdb7 None admin] PATH_INFO: `/v3/groups/0753ac188a154b72a17dbf5d67164b5c` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:36.159027 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ab48d-7e1c-4684-bb7c-db84565ecdb7 None admin] RBAC: Authorizing `identity:get_group(group_id=0753ac188a154b72a17dbf5d67164b5c)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:36.161110 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ab48d-7e1c-4684-bb7c-db84565ecdb7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:36.166725 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 211/412] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:35 2022] GET /identity/v3/groups/0753ac188a154b72a17dbf5d67164b5c => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:36.171608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ab48d-7e1c-4684-bb7c-db84565ecdb7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:36.195552 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7902-1d24-492f-91aa-2dc754ebbe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:36.196745 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7902-1d24-492f-91aa-2dc754ebbe05 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:36.197223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7902-1d24-492f-91aa-2dc754ebbe05 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:36.197691 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7902-1d24-492f-91aa-2dc754ebbe05 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7/groups/6cf171a9b24d48dba1a7649b32aa3e66/roles/963eb8fa7a2943569e51dc5310a46baa` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:36.200226 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b7902-1d24-492f-91aa-2dc754ebbe05 None admin] RBAC: Authorizing `identity:create_grant(project_id=83b3fa382b104cb9832f009730a50fe7, group_id=6cf171a9b24d48dba1a7649b32aa3e66, role_id=963eb8fa7a2943569e51dc5310a46baa)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:36.202405 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b7902-1d24-492f-91aa-2dc754ebbe05 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:36.297716 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ab48d-7e1c-4684-bb7c-db84565ecdb7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:36.314149 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 202/413] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 19:42:36 2022] PUT /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7/groups/6cf171a9b24d48dba1a7649b32aa3e66/roles/963eb8fa7a2943569e51dc5310a46baa => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:42:36.348711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc696-6a1d-4894-87d3-70ccf9e8c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:36.349587 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc696-6a1d-4894-87d3-70ccf9e8c935 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:36.349870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc696-6a1d-4894-87d3-70ccf9e8c935 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:36.350147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc696-6a1d-4894-87d3-70ccf9e8c935 None admin] PATH_INFO: `/v3/projects/8cbf08f613684bc5800cd2a653ac6ae3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:36.351362 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdc696-6a1d-4894-87d3-70ccf9e8c935 None admin] RBAC: Authorizing `identity:get_project(project_id=8cbf08f613684bc5800cd2a653ac6ae3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:36.352841 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdc696-6a1d-4894-87d3-70ccf9e8c935 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:36.354769 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 212/414] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:36 2022] GET /identity/v3/projects/8cbf08f613684bc5800cd2a653ac6ae3 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:36.364046 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7902-1d24-492f-91aa-2dc754ebbe05 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:36.466519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a6d30-9825-4120-8eba-b19248206cbf None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:36.466732 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a6d30-9825-4120-8eba-b19248206cbf None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:36.467097 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a6d30-9825-4120-8eba-b19248206cbf None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:36.468634 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 213/415] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:36.477433 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33754f-6261-480b-af98-7d53c6cb4257 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:36.481701 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33754f-6261-480b-af98-7d53c6cb4257 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:36.482229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33754f-6261-480b-af98-7d53c6cb4257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:36.502323 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-cb33754f-6261-480b-af98-7d53c6cb4257 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:36.504052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cb33754f-6261-480b-af98-7d53c6cb4257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:36.539451 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7902-1d24-492f-91aa-2dc754ebbe05 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:36.587359 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:36.591417 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4ec51-fe91-47b4-a45e-d5b4a91fea59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:36.592817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ec51-fe91-47b4-a45e-d5b4a91fea59 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:36.593402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ec51-fe91-47b4-a45e-d5b4a91fea59 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:36.594165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ec51-fe91-47b4-a45e-d5b4a91fea59 None admin] PATH_INFO: `/v3/projects/8cbf08f613684bc5800cd2a653ac6ae3/groups/0753ac188a154b72a17dbf5d67164b5c/roles/4f7e6c1b02094f72ae978c3558b530a9` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:36.596858 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4ec51-fe91-47b4-a45e-d5b4a91fea59 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cbf08f613684bc5800cd2a653ac6ae3, group_id=0753ac188a154b72a17dbf5d67164b5c, role_id=4f7e6c1b02094f72ae978c3558b530a9)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:36.598455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 214/416] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:36.600550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4ec51-fe91-47b4-a45e-d5b4a91fea59 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:36.603134 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:36.624055 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33754f-6261-480b-af98-7d53c6cb4257 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:36.707145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 203/417] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 19:42:36 2022] PUT /identity/v3/projects/8cbf08f613684bc5800cd2a653ac6ae3/groups/0753ac188a154b72a17dbf5d67164b5c/roles/4f7e6c1b02094f72ae978c3558b530a9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:42:36.755128 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33754f-6261-480b-af98-7d53c6cb4257 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:36.806311 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d206d31-97a9-4b0b-99c4-3d5462ffb432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:36.807636 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d206d31-97a9-4b0b-99c4-3d5462ffb432 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:36.808085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d206d31-97a9-4b0b-99c4-3d5462ffb432 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:36.808498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d206d31-97a9-4b0b-99c4-3d5462ffb432 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:36.820446 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d206d31-97a9-4b0b-99c4-3d5462ffb432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7d206d31-97a9-4b0b-99c4-3d5462ffb432 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:36.835385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:36.836525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:36.837565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:36.844334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 215/418] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:36.845673 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4ec51-fe91-47b4-a45e-d5b4a91fea59 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:37.011901 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4ec51-fe91-47b4-a45e-d5b4a91fea59 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:37.055149 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1b950-ed95-4523-a383-4154653c2889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:37.055824 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1b950-ed95-4523-a383-4154653c2889 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:37.056113 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1b950-ed95-4523-a383-4154653c2889 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:37.056395 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1b950-ed95-4523-a383-4154653c2889 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:37.057151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1b950-ed95-4523-a383-4154653c2889 None admin] RBAC: Adding query filter params (name=member) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:37.057726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1b950-ed95-4523-a383-4154653c2889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:37.059198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1b950-ed95-4523-a383-4154653c2889 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:37.068235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 204/419] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:37.073226 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d206d31-97a9-4b0b-99c4-3d5462ffb432 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:37.147513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:37.209368 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d084d-5012-4bfd-8829-62cd3b9137df None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:37.209705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d084d-5012-4bfd-8829-62cd3b9137df None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:37.209929 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d084d-5012-4bfd-8829-62cd3b9137df None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:37.211562 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 205/420] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:37.216723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e0072-ece5-44f1-ac9b-4116613b07b3 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:37.217554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e0072-ece5-44f1-ac9b-4116613b07b3 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:37.217931 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e0072-ece5-44f1-ac9b-4116613b07b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:37.240245 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d206d31-97a9-4b0b-99c4-3d5462ffb432 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:37.241385 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-690e0072-ece5-44f1-ac9b-4116613b07b3 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:37.242594 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-690e0072-ece5-44f1-ac9b-4116613b07b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:37.290173 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a43a12-3b5b-4e83-8538-f9986e1d8e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:37.291068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43a12-3b5b-4e83-8538-f9986e1d8e71 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:37.291929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43a12-3b5b-4e83-8538-f9986e1d8e71 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:37.292358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43a12-3b5b-4e83-8538-f9986e1d8e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:37.358502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:37.394391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a43a12-3b5b-4e83-8538-f9986e1d8e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:37.396265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a43a12-3b5b-4e83-8538-f9986e1d8e71 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:37.400694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 206/421] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:37.448492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e0072-ece5-44f1-ac9b-4116613b07b3 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:37.486977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:37.558718 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 216/422] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:37.566392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a43a12-3b5b-4e83-8538-f9986e1d8e71 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:37.615685 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e0072-ece5-44f1-ac9b-4116613b07b3 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:37.664057 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cf5ee-4c74-4b50-8f85-3df0f5459853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:37.664893 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cf5ee-4c74-4b50-8f85-3df0f5459853 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:37.665175 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cf5ee-4c74-4b50-8f85-3df0f5459853 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:37.665447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cf5ee-4c74-4b50-8f85-3df0f5459853 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:37.687725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cf5ee-4c74-4b50-8f85-3df0f5459853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-ea5cf5ee-4c74-4b50-8f85-3df0f5459853 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:37.705270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:37.706261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:37.707131 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 207/423] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:42:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:37.714373 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cf5ee-4c74-4b50-8f85-3df0f5459853 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:37.789802 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:37.820866 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a43a12-3b5b-4e83-8538-f9986e1d8e71 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:37.849614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cf5ee-4c74-4b50-8f85-3df0f5459853 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:37.885117 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2ed11-6a2b-4957-a586-eba041b24f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:37.886226 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ed11-6a2b-4957-a586-eba041b24f08 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:37.886509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ed11-6a2b-4957-a586-eba041b24f08 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:37.886817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ed11-6a2b-4957-a586-eba041b24f08 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:37.887571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2ed11-6a2b-4957-a586-eba041b24f08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:37.887882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2ed11-6a2b-4957-a586-eba041b24f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:37.889934 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2ed11-6a2b-4957-a586-eba041b24f08 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:37.898835 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 208/424] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:37.904148 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2ed11-6a2b-4957-a586-eba041b24f08 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:37.938100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e0e5e-8291-41c9-b2c3-650a63b47408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:37.938997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0e5e-8291-41c9-b2c3-650a63b47408 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:37.939282 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0e5e-8291-41c9-b2c3-650a63b47408 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:37.939555 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0e5e-8291-41c9-b2c3-650a63b47408 None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:37.940793 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e0e5e-8291-41c9-b2c3-650a63b47408 None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:37.942227 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e0e5e-8291-41c9-b2c3-650a63b47408 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:37.944099 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 217/425] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:37 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:37.945103 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76dcb9-b157-4f2b-8bae-a12884d83efe None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:37.945386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76dcb9-b157-4f2b-8bae-a12884d83efe None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:37.945663 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76dcb9-b157-4f2b-8bae-a12884d83efe None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:37.951150 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 218/426] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:37.952926 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187cccd-a129-4b62-b61b-5d9d16eb60b5 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:37.953215 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187cccd-a129-4b62-b61b-5d9d16eb60b5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:37.953491 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187cccd-a129-4b62-b61b-5d9d16eb60b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:37.969880 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-f187cccd-a129-4b62-b61b-5d9d16eb60b5 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:37.971086 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f187cccd-a129-4b62-b61b-5d9d16eb60b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:37.980806 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:38.025805 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2ed11-6a2b-4957-a586-eba041b24f08 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:38.036887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:38.063348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 219/427] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:38.064398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187cccd-a129-4b62-b61b-5d9d16eb60b5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:38.070855 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb95368-3822-498f-8760-deec45d90815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:38.071602 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb95368-3822-498f-8760-deec45d90815 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:38.071829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb95368-3822-498f-8760-deec45d90815 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:38.072110 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb95368-3822-498f-8760-deec45d90815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:38.160207 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb95368-3822-498f-8760-deec45d90815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:38.161708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb95368-3822-498f-8760-deec45d90815 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:38.191658 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187cccd-a129-4b62-b61b-5d9d16eb60b5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:38.236195 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6f1e8-f1e4-43f6-8f3e-c6774c5738c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:38.237323 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6f1e8-f1e4-43f6-8f3e-c6774c5738c6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:38.237747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6f1e8-f1e4-43f6-8f3e-c6774c5738c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:38.238158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6f1e8-f1e4-43f6-8f3e-c6774c5738c6 None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:38.239652 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6f1e8-f1e4-43f6-8f3e-c6774c5738c6 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:38.241995 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6f1e8-f1e4-43f6-8f3e-c6774c5738c6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:38.250419 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 220/428] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:38 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:38.250419 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6f1e8-f1e4-43f6-8f3e-c6774c5738c6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:38.267343 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:38.284590 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 209/429] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:38.285929 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb95368-3822-498f-8760-deec45d90815 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:38.300734 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:38.362050 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6f1e8-f1e4-43f6-8f3e-c6774c5738c6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:38.398597 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ccae3-0ea6-4650-8317-cad73f31b605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:38.399685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ccae3-0ea6-4650-8317-cad73f31b605 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:38.400137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ccae3-0ea6-4650-8317-cad73f31b605 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:38.400462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ccae3-0ea6-4650-8317-cad73f31b605 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:38.413262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ccae3-0ea6-4650-8317-cad73f31b605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:38.416706 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb95368-3822-498f-8760-deec45d90815 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-d50ccae3-0ea6-4650-8317-cad73f31b605 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:38.422349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:38.423471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:42:38.424442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:38.425598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 221/430] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:38.431381 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ccae3-0ea6-4650-8317-cad73f31b605 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:38.457500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37e0c1-dad3-424d-b0dd-c9eefc687f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:38.458439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37e0c1-dad3-424d-b0dd-c9eefc687f72 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:38.458941 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37e0c1-dad3-424d-b0dd-c9eefc687f72 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:38.459468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37e0c1-dad3-424d-b0dd-c9eefc687f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:38.460563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37e0c1-dad3-424d-b0dd-c9eefc687f72 None admin] RBAC: Adding query filter params (group.id=6cf171a9b24d48dba1a7649b32aa3e66, role.id=08c3f41d763c4a50ae3acacf391942aa, scope.project.id=11f8474be7594f1f9370c395b04ee7d2) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:38.461045 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37e0c1-dad3-424d-b0dd-c9eefc687f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:38.462760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37e0c1-dad3-424d-b0dd-c9eefc687f72 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:38.474716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 210/431] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 19:42:38 2022] GET /identity/v3/role_assignments?group.id=6cf171a9b24d48dba1a7649b32aa3e66&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:38.475948 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37e0c1-dad3-424d-b0dd-c9eefc687f72 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:38.520005 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:38.548565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ccae3-0ea6-4650-8317-cad73f31b605 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:38.594650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9e0cb-22b9-4854-a7b8-277fa998397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:38.594650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9e0cb-22b9-4854-a7b8-277fa998397e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:38.594650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9e0cb-22b9-4854-a7b8-277fa998397e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:38.594650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9e0cb-22b9-4854-a7b8-277fa998397e None admin] PATH_INFO: `/v3/projects/11f8474be7594f1f9370c395b04ee7d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:38.595088 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9e0cb-22b9-4854-a7b8-277fa998397e None admin] RBAC: Authorizing `identity:get_project(project_id=11f8474be7594f1f9370c395b04ee7d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:38.595088 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9e0cb-22b9-4854-a7b8-277fa998397e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:38.595088 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 222/432] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:38 2022] GET /identity/v3/projects/11f8474be7594f1f9370c395b04ee7d2 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:38.599041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9e0cb-22b9-4854-a7b8-277fa998397e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:38.624402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:38.677635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37e0c1-dad3-424d-b0dd-c9eefc687f72 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:38.722316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b5033-0b5b-47da-8c3b-9098e50c5eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:38.723470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b5033-0b5b-47da-8c3b-9098e50c5eae None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:38.723954 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b5033-0b5b-47da-8c3b-9098e50c5eae None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:38.725116 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b5033-0b5b-47da-8c3b-9098e50c5eae None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:38.726443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b5033-0b5b-47da-8c3b-9098e50c5eae None admin] RBAC: Adding query filter params (name=member) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:38.727005 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b5033-0b5b-47da-8c3b-9098e50c5eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:38.728935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b5033-0b5b-47da-8c3b-9098e50c5eae None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:38.740238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 211/433] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:38.746679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b5033-0b5b-47da-8c3b-9098e50c5eae None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:38.816507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9e0cb-22b9-4854-a7b8-277fa998397e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:38.860559 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a0150-979c-40eb-9aa4-89061fa8eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:38.862578 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0150-979c-40eb-9aa4-89061fa8eb62 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:38.863141 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0150-979c-40eb-9aa4-89061fa8eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:38.863597 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0150-979c-40eb-9aa4-89061fa8eb62 None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:38.864989 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a0150-979c-40eb-9aa4-89061fa8eb62 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:38.866637 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a0150-979c-40eb-9aa4-89061fa8eb62 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:38.868766 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 223/434] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:38 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:38.870129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965df026-fbbe-419b-bc31-54b7858bab67 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:38.870561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965df026-fbbe-419b-bc31-54b7858bab67 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:38.871003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965df026-fbbe-419b-bc31-54b7858bab67 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:38.872447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 224/435] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:38.874295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965df026-fbbe-419b-bc31-54b7858bab67 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:38.887345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:38.905815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b5033-0b5b-47da-8c3b-9098e50c5eae None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:38.948096 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791d60e-2807-430a-8d57-379f4cd0a813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:38.948758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791d60e-2807-430a-8d57-379f4cd0a813 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:38.949041 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791d60e-2807-430a-8d57-379f4cd0a813 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:38.949316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791d60e-2807-430a-8d57-379f4cd0a813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:38.953767 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:39.008454 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965df026-fbbe-419b-bc31-54b7858bab67 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:39.039126 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791d60e-2807-430a-8d57-379f4cd0a813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:39.040609 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791d60e-2807-430a-8d57-379f4cd0a813 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:39.060060 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22a0bd-de11-46a0-828b-66b33b7febec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:39.060753 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22a0bd-de11-46a0-828b-66b33b7febec None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:39.061033 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22a0bd-de11-46a0-828b-66b33b7febec None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:39.061306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22a0bd-de11-46a0-828b-66b33b7febec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:39.062656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22a0bd-de11-46a0-828b-66b33b7febec None admin] RBAC: Adding query filter params (group.id=6cf171a9b24d48dba1a7649b32aa3e66, role.id=963eb8fa7a2943569e51dc5310a46baa, scope.project.id=11f8474be7594f1f9370c395b04ee7d2) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:39.062656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22a0bd-de11-46a0-828b-66b33b7febec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:39.064015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22a0bd-de11-46a0-828b-66b33b7febec None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:39.072561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 225/436] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 19:42:38 2022] GET /identity/v3/role_assignments?group.id=6cf171a9b24d48dba1a7649b32aa3e66&scope.project.id=11f8474be7594f1f9370c395b04ee7d2&role.id=963eb8fa7a2943569e51dc5310a46baa => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:39.073891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64560848-9f49-4a69-a1dd-67264be58be4 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:39.074177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64560848-9f49-4a69-a1dd-67264be58be4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:39.074441 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64560848-9f49-4a69-a1dd-67264be58be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:39.101433 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-64560848-9f49-4a69-a1dd-67264be58be4 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:39.103461 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-64560848-9f49-4a69-a1dd-67264be58be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:39.168930 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 212/437] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:39.174466 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791d60e-2807-430a-8d57-379f4cd0a813 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:39.210020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 226/438] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:39.218332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:39.243894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64560848-9f49-4a69-a1dd-67264be58be4 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:39.247424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:39.310411 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791d60e-2807-430a-8d57-379f4cd0a813 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:39.357619 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eba2c-5e0a-4735-82a8-4ec76ae20207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:39.358479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eba2c-5e0a-4735-82a8-4ec76ae20207 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:39.360983 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eba2c-5e0a-4735-82a8-4ec76ae20207 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:39.360983 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eba2c-5e0a-4735-82a8-4ec76ae20207 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:39.361580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eba2c-5e0a-4735-82a8-4ec76ae20207 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:39.363143 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eba2c-5e0a-4735-82a8-4ec76ae20207 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:39.365168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 213/439] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:39 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:39.370213 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eba2c-5e0a-4735-82a8-4ec76ae20207 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:39.398534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64560848-9f49-4a69-a1dd-67264be58be4 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:39.436395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afda1c8-397e-477a-9d66-8f0566c9d4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:39.437141 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afda1c8-397e-477a-9d66-8f0566c9d4d2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:39.437423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afda1c8-397e-477a-9d66-8f0566c9d4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:39.437698 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afda1c8-397e-477a-9d66-8f0566c9d4d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:39.448698 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afda1c8-397e-477a-9d66-8f0566c9d4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-9afda1c8-397e-477a-9d66-8f0566c9d4d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:39.457286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:39.458243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:39.459466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 227/440] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:42:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:39.460148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72588d4-6470-44be-b2b0-ddbc9e28f43a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:39.460148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72588d4-6470-44be-b2b0-ddbc9e28f43a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:39.460367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72588d4-6470-44be-b2b0-ddbc9e28f43a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:39.463714 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 228/441] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:39.465930 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72588d4-6470-44be-b2b0-ddbc9e28f43a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:39.487745 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eba2c-5e0a-4735-82a8-4ec76ae20207 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:39.490488 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:39.527903 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09785c84-825a-42f0-9805-c632a6b10957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:39.528586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09785c84-825a-42f0-9805-c632a6b10957 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:39.528897 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09785c84-825a-42f0-9805-c632a6b10957 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:39.529702 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09785c84-825a-42f0-9805-c632a6b10957 None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:39.531029 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09785c84-825a-42f0-9805-c632a6b10957 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:39.532439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09785c84-825a-42f0-9805-c632a6b10957 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:39.534048 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 214/442] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:39 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:39.535226 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db871b-0abf-4ebd-be6b-532c5343ad30 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:39.535508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db871b-0abf-4ebd-be6b-532c5343ad30 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:39.535781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db871b-0abf-4ebd-be6b-532c5343ad30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:39.551186 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:39.553375 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-38db871b-0abf-4ebd-be6b-532c5343ad30 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:39.554695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-38db871b-0abf-4ebd-be6b-532c5343ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:39.590970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72588d4-6470-44be-b2b0-ddbc9e28f43a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:39.621774 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 215/443] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:39.622445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db871b-0abf-4ebd-be6b-532c5343ad30 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:39.624498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff48dac-0afe-42b3-ab1b-fce26554c272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:39.625160 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff48dac-0afe-42b3-ab1b-fce26554c272 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:39.625446 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff48dac-0afe-42b3-ab1b-fce26554c272 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:39.625724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff48dac-0afe-42b3-ab1b-fce26554c272 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:39.626474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff48dac-0afe-42b3-ab1b-fce26554c272 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:39.626917 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff48dac-0afe-42b3-ab1b-fce26554c272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:39.628206 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff48dac-0afe-42b3-ab1b-fce26554c272 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:39.637943 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 229/444] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:39.643827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff48dac-0afe-42b3-ab1b-fce26554c272 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:39.721599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:39.724355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db871b-0abf-4ebd-be6b-532c5343ad30 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:39.742693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff48dac-0afe-42b3-ab1b-fce26554c272 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:39.757434 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784487c-98e6-43c4-899b-00926bb48c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:39.758087 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784487c-98e6-43c4-899b-00926bb48c01 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:39.758372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784487c-98e6-43c4-899b-00926bb48c01 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:39.758671 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784487c-98e6-43c4-899b-00926bb48c01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:39.759520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784487c-98e6-43c4-899b-00926bb48c01 None admin] RBAC: Adding query filter params (group.id=6cf171a9b24d48dba1a7649b32aa3e66, role.id=08c3f41d763c4a50ae3acacf391942aa, scope.project.id=83b3fa382b104cb9832f009730a50fe7) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:39.759834 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784487c-98e6-43c4-899b-00926bb48c01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:39.761263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784487c-98e6-43c4-899b-00926bb48c01 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:39.765699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:39.767868 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 216/445] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 19:42:39 2022] GET /identity/v3/role_assignments?group.id=6cf171a9b24d48dba1a7649b32aa3e66&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=08c3f41d763c4a50ae3acacf391942aa => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:39.768635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784487c-98e6-43c4-899b-00926bb48c01 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:39.787903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dddb2-5d7c-4d13-8eb8-dfe5512b0c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:39.788683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dddb2-5d7c-4d13-8eb8-dfe5512b0c9b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:39.789073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dddb2-5d7c-4d13-8eb8-dfe5512b0c9b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:39.789434 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dddb2-5d7c-4d13-8eb8-dfe5512b0c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:39.867058 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dddb2-5d7c-4d13-8eb8-dfe5512b0c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:39.868574 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dddb2-5d7c-4d13-8eb8-dfe5512b0c9b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:39.878575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784487c-98e6-43c4-899b-00926bb48c01 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:39.917838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa60f3-56ec-4e4e-bb00-60becf652b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:39.918664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa60f3-56ec-4e4e-bb00-60becf652b4e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:39.918952 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa60f3-56ec-4e4e-bb00-60becf652b4e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:39.919576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa60f3-56ec-4e4e-bb00-60becf652b4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:39.931295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa60f3-56ec-4e4e-bb00-60becf652b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-bbaa60f3-56ec-4e4e-bb00-60becf652b4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:39.939263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:39.940227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:39.941066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 217/446] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:42:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:39.946365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa60f3-56ec-4e4e-bb00-60becf652b4e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:39.977140 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:39.983387 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 230/447] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:42:39.989017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dddb2-5d7c-4d13-8eb8-dfe5512b0c9b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:40.019772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:40.071014 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa60f3-56ec-4e4e-bb00-60becf652b4e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:40.112843 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dddb2-5d7c-4d13-8eb8-dfe5512b0c9b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:40.115730 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08352153-fbbe-4a54-9b48-0b1331e783ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:40.116495 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352153-fbbe-4a54-9b48-0b1331e783ec None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:40.116780 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352153-fbbe-4a54-9b48-0b1331e783ec None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:40.117190 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352153-fbbe-4a54-9b48-0b1331e783ec None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:40.118831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08352153-fbbe-4a54-9b48-0b1331e783ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:40.118831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08352153-fbbe-4a54-9b48-0b1331e783ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:40.119553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08352153-fbbe-4a54-9b48-0b1331e783ec None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:40.129307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 218/448] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:40.135796 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08352153-fbbe-4a54-9b48-0b1331e783ec None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:40.153330 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5870f5e-674c-4c16-8b64-f42c6c280dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:40.154207 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5870f5e-674c-4c16-8b64-f42c6c280dd6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:40.154490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5870f5e-674c-4c16-8b64-f42c6c280dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:40.154804 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5870f5e-674c-4c16-8b64-f42c6c280dd6 None admin] PATH_INFO: `/v3/projects/83b3fa382b104cb9832f009730a50fe7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:40.156124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5870f5e-674c-4c16-8b64-f42c6c280dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=83b3fa382b104cb9832f009730a50fe7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:40.157477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5870f5e-674c-4c16-8b64-f42c6c280dd6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:40.159187 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 231/449] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:39 2022] GET /identity/v3/projects/83b3fa382b104cb9832f009730a50fe7 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:40.164567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5870f5e-674c-4c16-8b64-f42c6c280dd6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:40.223509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:40.238444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08352153-fbbe-4a54-9b48-0b1331e783ec None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:40.255409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:40.263806 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5870f5e-674c-4c16-8b64-f42c6c280dd6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:40.276033 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236c5f-efd9-499d-a899-55411100e204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:40.276726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236c5f-efd9-499d-a899-55411100e204 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:40.277009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236c5f-efd9-499d-a899-55411100e204 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:40.277290 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236c5f-efd9-499d-a899-55411100e204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:40.300686 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37089637-e0f1-4255-bc1c-5cb4cd72f7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:40.301538 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089637-e0f1-4255-bc1c-5cb4cd72f7a3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:40.301819 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089637-e0f1-4255-bc1c-5cb4cd72f7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:40.302093 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089637-e0f1-4255-bc1c-5cb4cd72f7a3 None admin] PATH_INFO: `/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:40.303295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37089637-e0f1-4255-bc1c-5cb4cd72f7a3 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf171a9b24d48dba1a7649b32aa3e66)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:40.304760 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37089637-e0f1-4255-bc1c-5cb4cd72f7a3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:40.306368 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 232/450] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:40 2022] GET /identity/v3/groups/6cf171a9b24d48dba1a7649b32aa3e66 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:40.312227 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37089637-e0f1-4255-bc1c-5cb4cd72f7a3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:40.345158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12236c5f-efd9-499d-a899-55411100e204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:40.346645 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12236c5f-efd9-499d-a899-55411100e204 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:40.408430 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37089637-e0f1-4255-bc1c-5cb4cd72f7a3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:40.426887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:40.441824 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 219/451] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:42:40.442020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527d8aa-5b0e-46f7-8d32-8f4e344de14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:40.442776 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527d8aa-5b0e-46f7-8d32-8f4e344de14a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:40.443122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527d8aa-5b0e-46f7-8d32-8f4e344de14a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:40.443460 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527d8aa-5b0e-46f7-8d32-8f4e344de14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:40.444291 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527d8aa-5b0e-46f7-8d32-8f4e344de14a None admin] RBAC: Adding query filter params (group.id=6cf171a9b24d48dba1a7649b32aa3e66, role.id=963eb8fa7a2943569e51dc5310a46baa, scope.project.id=83b3fa382b104cb9832f009730a50fe7) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:40.444601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527d8aa-5b0e-46f7-8d32-8f4e344de14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:40.446033 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527d8aa-5b0e-46f7-8d32-8f4e344de14a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:40.447364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236c5f-efd9-499d-a899-55411100e204 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:40.458668 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 233/452] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 19:42:40 2022] GET /identity/v3/role_assignments?group.id=6cf171a9b24d48dba1a7649b32aa3e66&scope.project.id=83b3fa382b104cb9832f009730a50fe7&role.id=963eb8fa7a2943569e51dc5310a46baa => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:40.557500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236c5f-efd9-499d-a899-55411100e204 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:40.593983 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dd567-591a-4e7a-8be4-806edf8fd389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:40.594903 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dd567-591a-4e7a-8be4-806edf8fd389 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:40.595186 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dd567-591a-4e7a-8be4-806edf8fd389 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:40.595460 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dd567-591a-4e7a-8be4-806edf8fd389 None admin] PATH_INFO: `/v3/projects/8cbf08f613684bc5800cd2a653ac6ae3` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:40.596729 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dd567-591a-4e7a-8be4-806edf8fd389 None admin] RBAC: Authorizing `identity:get_project(project_id=8cbf08f613684bc5800cd2a653ac6ae3)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:40.598207 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dd567-591a-4e7a-8be4-806edf8fd389 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:40.599983 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 220/453] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:42:40 2022] GET /identity/v3/projects/8cbf08f613684bc5800cd2a653ac6ae3 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:40.605637 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527d8aa-5b0e-46f7-8d32-8f4e344de14a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:40.632631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:40.708239 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527d8aa-5b0e-46f7-8d32-8f4e344de14a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:40.742282 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b337066-2764-49ea-859e-72eeef575192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:40.743178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b337066-2764-49ea-859e-72eeef575192 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:40.743461 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b337066-2764-49ea-859e-72eeef575192 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:40.743736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b337066-2764-49ea-859e-72eeef575192 None admin] PATH_INFO: `/v3/groups/0753ac188a154b72a17dbf5d67164b5c` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:40.744933 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b337066-2764-49ea-859e-72eeef575192 None admin] RBAC: Authorizing `identity:get_group(group_id=0753ac188a154b72a17dbf5d67164b5c)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:40.746374 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b337066-2764-49ea-859e-72eeef575192 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:40.748585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 234/454] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 19:42:40 2022] GET /identity/v3/groups/0753ac188a154b72a17dbf5d67164b5c => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:40.754499 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dd567-591a-4e7a-8be4-806edf8fd389 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:40.812738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:40.856882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dd567-591a-4e7a-8be4-806edf8fd389 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:40.890009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab17339-b7a4-4920-8265-eab0b093c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:40.890685 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17339-b7a4-4920-8265-eab0b093c05f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:40.890974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17339-b7a4-4920-8265-eab0b093c05f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:40.891252 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17339-b7a4-4920-8265-eab0b093c05f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:40.892084 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab17339-b7a4-4920-8265-eab0b093c05f None admin] RBAC: Adding query filter params (group.id=0753ac188a154b72a17dbf5d67164b5c, role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=8cbf08f613684bc5800cd2a653ac6ae3) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:40.892402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab17339-b7a4-4920-8265-eab0b093c05f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:40.893839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab17339-b7a4-4920-8265-eab0b093c05f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:40.899546 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 221/455] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 19:42:40 2022] GET /identity/v3/role_assignments?group.id=0753ac188a154b72a17dbf5d67164b5c&scope.project.id=8cbf08f613684bc5800cd2a653ac6ae3&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:43.661451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86759e80-6681-4c00-bc48-0fb213580701 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:43.662463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86759e80-6681-4c00-bc48-0fb213580701 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:43.662989 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86759e80-6681-4c00-bc48-0fb213580701 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:43.664858 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 235/456] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:43.670873 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd23e1-6679-4ae5-b2de-c01403ea5dce None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:43.671815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd23e1-6679-4ae5-b2de-c01403ea5dce None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:43.672334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd23e1-6679-4ae5-b2de-c01403ea5dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:43.700153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-55fd23e1-6679-4ae5-b2de-c01403ea5dce None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:43.701887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-55fd23e1-6679-4ae5-b2de-c01403ea5dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:43.785288 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 222/457] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:43.821573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86759e80-6681-4c00-bc48-0fb213580701 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:43.851639 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4794fe0-d7d7-438c-895e-e4d458228cf6 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:43.851942 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4794fe0-d7d7-438c-895e-e4d458228cf6 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:43.852208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4794fe0-d7d7-438c-895e-e4d458228cf6 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:43.853577 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 223/458] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:43.864040 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd79bf-80ca-4c69-874e-f14a9f8bbdfe None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:43.864668 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd79bf-80ca-4c69-874e-f14a9f8bbdfe None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:43.865144 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd79bf-80ca-4c69-874e-f14a9f8bbdfe None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:43.867119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 224/459] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:43.868352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9225-df2d-45f8-95c2-3f06d8d947e3 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:43.868832 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9225-df2d-45f8-95c2-3f06d8d947e3 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:43.869319 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9225-df2d-45f8-95c2-3f06d8d947e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:43.886769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-f8ec9225-df2d-45f8-95c2-3f06d8d947e3 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:43.888235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-f8ec9225-df2d-45f8-95c2-3f06d8d947e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:43.933644 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:43.945803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86759e80-6681-4c00-bc48-0fb213580701 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:43.948455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:43.979353 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 225/460] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:43.981947 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd952e-2ddb-4852-b88c-dd3f6f62afca None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:43.983292 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd952e-2ddb-4852-b88c-dd3f6f62afca None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:43.983816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd952e-2ddb-4852-b88c-dd3f6f62afca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:43.990686 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d570746-492a-4eaf-8c19-fcc28b299880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:43.991785 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d570746-492a-4eaf-8c19-fcc28b299880 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:43.992288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d570746-492a-4eaf-8c19-fcc28b299880 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:43.992769 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d570746-492a-4eaf-8c19-fcc28b299880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:44.005590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d570746-492a-4eaf-8c19-fcc28b299880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:44.005778 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-b4fd952e-2ddb-4852-b88c-dd3f6f62afca None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:44.006960 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-b4fd952e-2ddb-4852-b88c-dd3f6f62afca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:44.007827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d570746-492a-4eaf-8c19-fcc28b299880 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-9d570746-492a-4eaf-8c19-fcc28b299880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:44.038124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:44.039117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:44.039994 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:44.039994 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:44.039994 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:44.039994 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:44.039994 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 236/461] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:44.040470 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d570746-492a-4eaf-8c19-fcc28b299880 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:44.082811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 226/462] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:44.087707 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd952e-2ddb-4852-b88c-dd3f6f62afca None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:44.164048 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d570746-492a-4eaf-8c19-fcc28b299880 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:44.205204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751af840-0140-48ed-a869-6b2d671d528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:44.205914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751af840-0140-48ed-a869-6b2d671d528b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:44.206192 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751af840-0140-48ed-a869-6b2d671d528b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:44.206465 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751af840-0140-48ed-a869-6b2d671d528b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:44.217141 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751af840-0140-48ed-a869-6b2d671d528b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:44.218706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751af840-0140-48ed-a869-6b2d671d528b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:44.220257 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd952e-2ddb-4852-b88c-dd3f6f62afca None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:44.222049 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:44.230299 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-751af840-0140-48ed-a869-6b2d671d528b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:44.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:44.239894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:44.240758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:44.240758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:44.240758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:44.240758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:44.240758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 237/463] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:44.241446 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751af840-0140-48ed-a869-6b2d671d528b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:44.260163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e989f-2cf0-4313-8367-1dae4ad0a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:44.261087 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e989f-2cf0-4313-8367-1dae4ad0a992 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:44.261370 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e989f-2cf0-4313-8367-1dae4ad0a992 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:44.261641 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e989f-2cf0-4313-8367-1dae4ad0a992 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:44.262635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e989f-2cf0-4313-8367-1dae4ad0a992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:44.263366 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e989f-2cf0-4313-8367-1dae4ad0a992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:44.264828 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e989f-2cf0-4313-8367-1dae4ad0a992 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:44.281201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 227/464] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:44.282760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc20b6-4e32-4517-8e92-8eff67ce107b None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:44.283211 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc20b6-4e32-4517-8e92-8eff67ce107b None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:44.283675 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc20b6-4e32-4517-8e92-8eff67ce107b None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:44.285338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 228/465] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:44.286191 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc20b6-4e32-4517-8e92-8eff67ce107b None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:44.355003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751af840-0140-48ed-a869-6b2d671d528b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:44.391184 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b062d-fd51-4019-9fe1-79f1b8119aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:44.392122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b062d-fd51-4019-9fe1-79f1b8119aad None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:44.392287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b062d-fd51-4019-9fe1-79f1b8119aad None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:44.392534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b062d-fd51-4019-9fe1-79f1b8119aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:44.402016 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc20b6-4e32-4517-8e92-8eff67ce107b None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:44.403000 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b062d-fd51-4019-9fe1-79f1b8119aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:44.405469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b062d-fd51-4019-9fe1-79f1b8119aad None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a81b062d-fd51-4019-9fe1-79f1b8119aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:44.425847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:44.431711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:44.432899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:44.432899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:44.432899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:44.432899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:44.432899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 238/466] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:44.432899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b062d-fd51-4019-9fe1-79f1b8119aad None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:44.449334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42267437-38b7-4520-8944-e672752d2e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:44.450081 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267437-38b7-4520-8944-e672752d2e86 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:44.450441 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267437-38b7-4520-8944-e672752d2e86 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:44.450847 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267437-38b7-4520-8944-e672752d2e86 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:44.451657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42267437-38b7-4520-8944-e672752d2e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:44.452035 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42267437-38b7-4520-8944-e672752d2e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:44.453478 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42267437-38b7-4520-8944-e672752d2e86 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:44.465385 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 229/467] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:44.466787 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388e8c5-9ae4-4c52-ac35-f42ef82f03d1 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:44.467150 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388e8c5-9ae4-4c52-ac35-f42ef82f03d1 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:44.467499 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388e8c5-9ae4-4c52-ac35-f42ef82f03d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:44.484682 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-7388e8c5-9ae4-4c52-ac35-f42ef82f03d1 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:44.485865 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-7388e8c5-9ae4-4c52-ac35-f42ef82f03d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:44.486985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:44.511071 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:44.541128 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b062d-fd51-4019-9fe1-79f1b8119aad None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:44.562774 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 230/468] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:44.562774 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388e8c5-9ae4-4c52-ac35-f42ef82f03d1 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:44.581573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a5b51-6c00-4896-9368-a0c407b772a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:44.582353 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a5b51-6c00-4896-9368-a0c407b772a0 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:44.582669 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a5b51-6c00-4896-9368-a0c407b772a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:44.582955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a5b51-6c00-4896-9368-a0c407b772a0 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:44.583673 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a5b51-6c00-4896-9368-a0c407b772a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:44.585180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a5b51-6c00-4896-9368-a0c407b772a0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:44.672592 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388e8c5-9ae4-4c52-ac35-f42ef82f03d1 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:44.680838 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 239/469] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:42:44 2022] POST /identity/v3/users => generated 248 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:42:44.682743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a5b51-6c00-4896-9368-a0c407b772a0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:44.718766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281602e4-ee93-4180-8e88-03b2ac514a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:44.719660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281602e4-ee93-4180-8e88-03b2ac514a85 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:44.719953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281602e4-ee93-4180-8e88-03b2ac514a85 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:44.720291 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281602e4-ee93-4180-8e88-03b2ac514a85 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:44.721460 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281602e4-ee93-4180-8e88-03b2ac514a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:44.721779 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281602e4-ee93-4180-8e88-03b2ac514a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:44.723244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281602e4-ee93-4180-8e88-03b2ac514a85 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:44.740955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 231/470] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:44.742258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281602e4-ee93-4180-8e88-03b2ac514a85 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:44.768247 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:44.839025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a5b51-6c00-4896-9368-a0c407b772a0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:44.843581 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:44.878877 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281602e4-ee93-4180-8e88-03b2ac514a85 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:44.891306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e891d-8bb8-491a-a6df-eba2f0b3d7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:44.891984 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e891d-8bb8-491a-a6df-eba2f0b3d7a1 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:44.892271 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e891d-8bb8-491a-a6df-eba2f0b3d7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:44.892591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e891d-8bb8-491a-a6df-eba2f0b3d7a1 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:44.893354 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e891d-8bb8-491a-a6df-eba2f0b3d7a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:44.896532 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e891d-8bb8-491a-a6df-eba2f0b3d7a1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:44.917300 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea845-01d9-4e88-9f51-fbbcd56b7891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:44.918358 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea845-01d9-4e88-9f51-fbbcd56b7891 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:44.918921 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea845-01d9-4e88-9f51-fbbcd56b7891 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:44.919026 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea845-01d9-4e88-9f51-fbbcd56b7891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:44.932703 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbea845-01d9-4e88-9f51-fbbcd56b7891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:44.934190 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbea845-01d9-4e88-9f51-fbbcd56b7891 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-3cbea845-01d9-4e88-9f51-fbbcd56b7891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:44.953390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:44.954513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:44.955598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:44.955598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:44.955598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:44.955598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:44.955598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 232/471] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:44.955598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea845-01d9-4e88-9f51-fbbcd56b7891 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:45.031670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:45.039023 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 240/472] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:42:44 2022] POST /identity/v3/users => generated 248 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:42:45.040327 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e891d-8bb8-491a-a6df-eba2f0b3d7a1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:45.124717 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea845-01d9-4e88-9f51-fbbcd56b7891 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:45.168924 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e891d-8bb8-491a-a6df-eba2f0b3d7a1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:45.208553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee513e7-dd5a-4c4a-8d2e-e2f5d85c8e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:45.209320 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee513e7-dd5a-4c4a-8d2e-e2f5d85c8e62 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:45.209609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee513e7-dd5a-4c4a-8d2e-e2f5d85c8e62 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:45.209888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee513e7-dd5a-4c4a-8d2e-e2f5d85c8e62 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:45.210647 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee513e7-dd5a-4c4a-8d2e-e2f5d85c8e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:45.210962 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee513e7-dd5a-4c4a-8d2e-e2f5d85c8e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:45.212384 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee513e7-dd5a-4c4a-8d2e-e2f5d85c8e62 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:45.217056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48e2e6-283d-482f-ba68-b5c1cb4b1fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:45.217753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48e2e6-283d-482f-ba68-b5c1cb4b1fc4 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:45.218043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48e2e6-283d-482f-ba68-b5c1cb4b1fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:45.218327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48e2e6-283d-482f-ba68-b5c1cb4b1fc4 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:45.219094 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48e2e6-283d-482f-ba68-b5c1cb4b1fc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:45.220594 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48e2e6-283d-482f-ba68-b5c1cb4b1fc4 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:45.227508 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 241/473] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:45.233281 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee513e7-dd5a-4c4a-8d2e-e2f5d85c8e62 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:45.269011 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:45.353320 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 233/474] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:42:44 2022] POST /identity/v3/users => generated 246 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:42:45.356608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dd6b1-30a0-4e3c-933b-36fbcf8d1803 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:45.356903 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dd6b1-30a0-4e3c-933b-36fbcf8d1803 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:45.357217 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dd6b1-30a0-4e3c-933b-36fbcf8d1803 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:45.363129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 234/475] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:45.369473 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dde46e-f71c-42da-9ca1-83d0510544b3 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:45.369798 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dde46e-f71c-42da-9ca1-83d0510544b3 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:45.370035 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dde46e-f71c-42da-9ca1-83d0510544b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:45.370922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee513e7-dd5a-4c4a-8d2e-e2f5d85c8e62 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:45.403766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-53dde46e-f71c-42da-9ca1-83d0510544b3 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:45.406509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-53dde46e-f71c-42da-9ca1-83d0510544b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:45.442983 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a19beb-82a5-4cd7-a105-58fabf9cb441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:45.443692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19beb-82a5-4cd7-a105-58fabf9cb441 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:45.444032 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19beb-82a5-4cd7-a105-58fabf9cb441 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:45.444317 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19beb-82a5-4cd7-a105-58fabf9cb441 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:45.445059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a19beb-82a5-4cd7-a105-58fabf9cb441 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:45.446569 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a19beb-82a5-4cd7-a105-58fabf9cb441 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:45.511115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 235/476] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:45.537136 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dde46e-f71c-42da-9ca1-83d0510544b3 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:45.538999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 242/477] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:42:45 2022] POST /identity/v3/users => generated 249 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:42:45.610700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:45.666780 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dde46e-f71c-42da-9ca1-83d0510544b3 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:45.711678 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001edb5-77a5-4a43-851e-35dfe17194cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:45.712348 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001edb5-77a5-4a43-851e-35dfe17194cc None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:45.712627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001edb5-77a5-4a43-851e-35dfe17194cc None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:45.712901 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001edb5-77a5-4a43-851e-35dfe17194cc None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:45.713666 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001edb5-77a5-4a43-851e-35dfe17194cc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:45.716255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001edb5-77a5-4a43-851e-35dfe17194cc None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:45.752831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.sql.core [None req-0001edb5-77a5-4a43-851e-35dfe17194cc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 19:42:45.752831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 19:42:45.752831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [parameters: {'id': 'e862307c2c4043be885d90859376e748', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 19:42:45.752831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92089) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-0001edb5-77a5-4a43-851e-35dfe17194cc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application conn.query(q) May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result.read() May 19 19:42:45.771427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return ref.to_dict() May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:42:45.772372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application next(self.gen) May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application yield resource May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application next(self.gen) May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.session.rollback() May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.force_reraise() May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise self.value May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application session.commit() May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 19:42:45.773775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._prepare_impl() May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.session.flush() May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._flush(objects) May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application compat.raise_( May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application flush_context.execute() May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rec.execute(self) May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 19:42:45.774935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:42:45.775830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application conn.query(q) May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result.read() May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:42:45.776669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [parameters: {'id': 'e862307c2c4043be885d90859376e748', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:45.777479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 19:42:45.780039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:45.782029 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 236/478] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 19:42:45 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:45.782165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a19beb-82a5-4cd7-a105-58fabf9cb441 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:45.871873 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:45.896907 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a19beb-82a5-4cd7-a105-58fabf9cb441 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:45.936922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c9961-cbe4-4d36-a2bd-66e755ed46a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:45.937754 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9961-cbe4-4d36-a2bd-66e755ed46a7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:45.938041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9961-cbe4-4d36-a2bd-66e755ed46a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:45.938320 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9961-cbe4-4d36-a2bd-66e755ed46a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:45.950423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c9961-cbe4-4d36-a2bd-66e755ed46a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ef8c9961-cbe4-4d36-a2bd-66e755ed46a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:45.959631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:45.960523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:45.961324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 243/479] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:42:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:45.967055 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001edb5-77a5-4a43-851e-35dfe17194cc None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:46.090286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001edb5-77a5-4a43-851e-35dfe17194cc None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:46.111501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:46.136285 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad995c06-c20b-444a-a46c-35ac93b39d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:46.136928 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995c06-c20b-444a-a46c-35ac93b39d9b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:46.137230 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995c06-c20b-444a-a46c-35ac93b39d9b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:46.137508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995c06-c20b-444a-a46c-35ac93b39d9b None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:46.138833 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad995c06-c20b-444a-a46c-35ac93b39d9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:46.139194 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad995c06-c20b-444a-a46c-35ac93b39d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:46.140559 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad995c06-c20b-444a-a46c-35ac93b39d9b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:46.158147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 237/480] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:47.166419 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6190-17a0-4480-a418-e32fb0521824 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:47.166990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6190-17a0-4480-a418-e32fb0521824 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:47.166990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6190-17a0-4480-a418-e32fb0521824 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:47.168683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 244/481] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:47.174366 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4cf4-e76f-487a-820e-260c92ff5b78 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:47.174781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4cf4-e76f-487a-820e-260c92ff5b78 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:47.174962 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4cf4-e76f-487a-820e-260c92ff5b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:47.194563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-199c4cf4-e76f-487a-820e-260c92ff5b78 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:47.195797 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-199c4cf4-e76f-487a-820e-260c92ff5b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:47.285662 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 238/482] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:47.310372 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e6190-17a0-4480-a418-e32fb0521824 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:47.442344 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e6190-17a0-4480-a418-e32fb0521824 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:47.475634 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1879d-72c1-4054-97a4-8952d37f8f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:47.476421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1879d-72c1-4054-97a4-8952d37f8f38 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:47.476702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1879d-72c1-4054-97a4-8952d37f8f38 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:47.476975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1879d-72c1-4054-97a4-8952d37f8f38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:47.479694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:47.488577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1879d-72c1-4054-97a4-8952d37f8f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0ea1879d-72c1-4054-97a4-8952d37f8f38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:47.496427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:47.507254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:47.508068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 245/483] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:47.508753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c4cf4-e76f-487a-820e-260c92ff5b78 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:47.652804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c4cf4-e76f-487a-820e-260c92ff5b78 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:47.668004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:47.698376 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a7e0e-a243-4d58-a59b-595df51baa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:47.699001 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a7e0e-a243-4d58-a59b-595df51baa62 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:47.699286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a7e0e-a243-4d58-a59b-595df51baa62 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:47.699565 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a7e0e-a243-4d58-a59b-595df51baa62 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:47.700397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a7e0e-a243-4d58-a59b-595df51baa62 None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:47.701270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a7e0e-a243-4d58-a59b-595df51baa62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:47.702691 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a7e0e-a243-4d58-a59b-595df51baa62 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:47.716613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 239/484] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:42:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:47.723699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1879d-72c1-4054-97a4-8952d37f8f38 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:47.884168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f7c1-4e8c-4a29-ac60-fad4e6f5a0d2 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:47.884523 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f7c1-4e8c-4a29-ac60-fad4e6f5a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:47.884731 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f7c1-4e8c-4a29-ac60-fad4e6f5a0d2 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:47.886317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 240/485] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:47.891943 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1cfe-3788-46e6-ab71-dc8883465a86 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:47.892228 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1cfe-3788-46e6-ab71-dc8883465a86 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:47.892511 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1cfe-3788-46e6-ab71-dc8883465a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:47.903241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1879d-72c1-4054-97a4-8952d37f8f38 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:47.936203 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-788f1cfe-3788-46e6-ab71-dc8883465a86 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:47.937405 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-788f1cfe-3788-46e6-ab71-dc8883465a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:47.940225 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c397a6d-fc4f-437c-921b-6799aeb519e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:47.941263 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c397a6d-fc4f-437c-921b-6799aeb519e6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:47.941745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c397a6d-fc4f-437c-921b-6799aeb519e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:47.942255 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c397a6d-fc4f-437c-921b-6799aeb519e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:47.954940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c397a6d-fc4f-437c-921b-6799aeb519e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:47.957208 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c397a6d-fc4f-437c-921b-6799aeb519e6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7c397a6d-fc4f-437c-921b-6799aeb519e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:47.980827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:47.981768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:47.983200 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:47.983200 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:47.983200 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:47.983200 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:47.994384 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 246/486] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:48.000479 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c397a6d-fc4f-437c-921b-6799aeb519e6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:48.087887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 241/487] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:48.098936 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:48.111681 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f1cfe-3788-46e6-ab71-dc8883465a86 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:48.161408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c397a6d-fc4f-437c-921b-6799aeb519e6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:48.213565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206709d-ce51-4e03-b847-9aa53a3a71eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:48.214186 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206709d-ce51-4e03-b847-9aa53a3a71eb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.214418 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206709d-ce51-4e03-b847-9aa53a3a71eb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.214727 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206709d-ce51-4e03-b847-9aa53a3a71eb None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:48.215460 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206709d-ce51-4e03-b847-9aa53a3a71eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:48.215776 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206709d-ce51-4e03-b847-9aa53a3a71eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:48.217319 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206709d-ce51-4e03-b847-9aa53a3a71eb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:48.244534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 247/488] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:48.251747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206709d-ce51-4e03-b847-9aa53a3a71eb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:48.322204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f1cfe-3788-46e6-ab71-dc8883465a86 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:48.326301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:48.363487 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92faec1-1286-4cdd-a432-b9a71431322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:48.364931 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92faec1-1286-4cdd-a432-b9a71431322c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.365444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92faec1-1286-4cdd-a432-b9a71431322c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.366078 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92faec1-1286-4cdd-a432-b9a71431322c None admin] PATH_INFO: `/v3/roles/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:48.377490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92faec1-1286-4cdd-a432-b9a71431322c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:48.381845 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206709d-ce51-4e03-b847-9aa53a3a71eb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-a92faec1-1286-4cdd-a432-b9a71431322c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:48.386301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:48.387374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:48.388234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:48.390912 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:48.392133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 242/489] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:48.393590 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212eaed-3003-4e6e-8df5-86d5b8a4e2b0 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.394133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212eaed-3003-4e6e-8df5-86d5b8a4e2b0 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.394627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212eaed-3003-4e6e-8df5-86d5b8a4e2b0 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:48.400390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 243/490] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:48.401416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212eaed-3003-4e6e-8df5-86d5b8a4e2b0 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:48.422805 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d36d1-52ea-4bbd-a0bc-abd7a23059a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:48.423736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d36d1-52ea-4bbd-a0bc-abd7a23059a6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.424106 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d36d1-52ea-4bbd-a0bc-abd7a23059a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.424457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d36d1-52ea-4bbd-a0bc-abd7a23059a6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:48.433161 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d36d1-52ea-4bbd-a0bc-abd7a23059a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:48.435371 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d36d1-52ea-4bbd-a0bc-abd7a23059a6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-6c5d36d1-52ea-4bbd-a0bc-abd7a23059a6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:42:48.452487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:48.453619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:48.454542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:48.454542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:48.454542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:42:48.454542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:42:48.454542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:42:48.454542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:42:48.454542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:42:48.454542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:42:48.454542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 19:42:48.454542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:48.459261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 248/491] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:48.460745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4ff04-c366-4f4b-9b6d-cecd4ea83201 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.461103 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4ff04-c366-4f4b-9b6d-cecd4ea83201 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.461771 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4ff04-c366-4f4b-9b6d-cecd4ea83201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:48.480397 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-83b4ff04-c366-4f4b-9b6d-cecd4ea83201 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:48.481600 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-83b4ff04-c366-4f4b-9b6d-cecd4ea83201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:48.521759 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212eaed-3003-4e6e-8df5-86d5b8a4e2b0 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:48.554668 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 249/492] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:48.554668 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4ff04-c366-4f4b-9b6d-cecd4ea83201 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:48.573630 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a407fc-f4d9-415f-a80a-14487d6265fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:48.574648 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a407fc-f4d9-415f-a80a-14487d6265fe None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.575165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a407fc-f4d9-415f-a80a-14487d6265fe None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.575642 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a407fc-f4d9-415f-a80a-14487d6265fe None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:48.577057 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a407fc-f4d9-415f-a80a-14487d6265fe None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:48.577370 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a407fc-f4d9-415f-a80a-14487d6265fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:48.578928 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a407fc-f4d9-415f-a80a-14487d6265fe None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:48.587447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 244/493] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:42:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:48.588541 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93f1ed-62f9-4ef6-aca5-9124d0289760 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.588899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93f1ed-62f9-4ef6-aca5-9124d0289760 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.589188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93f1ed-62f9-4ef6-aca5-9124d0289760 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:48.590552 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 245/494] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:48.595767 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93f1ed-62f9-4ef6-aca5-9124d0289760 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:48.623678 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:48.660635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:48.664381 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4ff04-c366-4f4b-9b6d-cecd4ea83201 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:48.700257 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7d8c0-a492-4a11-854e-750099a68e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:48.701587 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d8c0-a492-4a11-854e-750099a68e6d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.701871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d8c0-a492-4a11-854e-750099a68e6d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.702153 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d8c0-a492-4a11-854e-750099a68e6d None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:48.703097 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7d8c0-a492-4a11-854e-750099a68e6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:48.703413 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7d8c0-a492-4a11-854e-750099a68e6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:48.703984 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93f1ed-62f9-4ef6-aca5-9124d0289760 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:48.704900 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7d8c0-a492-4a11-854e-750099a68e6d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:48.741631 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff66d0-d5be-4248-8242-2eba07bbb2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:48.742326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff66d0-d5be-4248-8242-2eba07bbb2ef None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.742640 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff66d0-d5be-4248-8242-2eba07bbb2ef None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.742915 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff66d0-d5be-4248-8242-2eba07bbb2ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:48.747939 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 250/495] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 19:42:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:48.747939 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c988b4-5fe6-44dc-b50c-6abca2937cac None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.747939 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c988b4-5fe6-44dc-b50c-6abca2937cac None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.747939 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c988b4-5fe6-44dc-b50c-6abca2937cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:48.758843 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff66d0-d5be-4248-8242-2eba07bbb2ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:48.764547 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-02c988b4-5fe6-44dc-b50c-6abca2937cac None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:48.765755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-02c988b4-5fe6-44dc-b50c-6abca2937cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-1eff66d0-d5be-4248-8242-2eba07bbb2ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:48.767210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:48.768101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:48.768940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 246/496] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:48.769608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff66d0-d5be-4248-8242-2eba07bbb2ef None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:48.841346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 251/497] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:48.842701 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c988b4-5fe6-44dc-b50c-6abca2937cac None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:48.885779 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:48.902416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff66d0-d5be-4248-8242-2eba07bbb2ef None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:48.935635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:48.939711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289dff0-9e4b-4a52-9fc2-0c9f6533f12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:48.940517 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289dff0-9e4b-4a52-9fc2-0c9f6533f12e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.940799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289dff0-9e4b-4a52-9fc2-0c9f6533f12e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.941075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289dff0-9e4b-4a52-9fc2-0c9f6533f12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:48.951843 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c988b4-5fe6-44dc-b50c-6abca2937cac None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:48.953581 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289dff0-9e4b-4a52-9fc2-0c9f6533f12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:48.955192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289dff0-9e4b-4a52-9fc2-0c9f6533f12e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-c289dff0-9e4b-4a52-9fc2-0c9f6533f12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:48.975295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:48.976261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:48.982155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:48.982155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:48.982155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:48.982155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:48.982155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 247/498] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:48.982155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289dff0-9e4b-4a52-9fc2-0c9f6533f12e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:48.998143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b565588-65d4-494c-bd1a-73df038d404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:48.998876 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b565588-65d4-494c-bd1a-73df038d404b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:48.999228 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b565588-65d4-494c-bd1a-73df038d404b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:48.999579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b565588-65d4-494c-bd1a-73df038d404b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.073509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b565588-65d4-494c-bd1a-73df038d404b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:49.075043 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b565588-65d4-494c-bd1a-73df038d404b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:49.099429 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289dff0-9e4b-4a52-9fc2-0c9f6533f12e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:49.134490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51ccc5-9fc3-4623-a124-6ca1a53b1e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:49.135195 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ccc5-9fc3-4623-a124-6ca1a53b1e2f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.135476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ccc5-9fc3-4623-a124-6ca1a53b1e2f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.135755 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ccc5-9fc3-4623-a124-6ca1a53b1e2f None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.136509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51ccc5-9fc3-4623-a124-6ca1a53b1e2f None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:49.136817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51ccc5-9fc3-4623-a124-6ca1a53b1e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:49.138212 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51ccc5-9fc3-4623-a124-6ca1a53b1e2f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:49.143286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:49.147644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 248/499] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:42:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:49.148500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51ccc5-9fc3-4623-a124-6ca1a53b1e2f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:49.165904 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:49.182724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 252/500] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:49.183542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b565588-65d4-494c-bd1a-73df038d404b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:49.250180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51ccc5-9fc3-4623-a124-6ca1a53b1e2f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:49.281378 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b565588-65d4-494c-bd1a-73df038d404b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:49.284933 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eca8f-5139-499c-aff2-c268be181839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:49.285815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eca8f-5139-499c-aff2-c268be181839 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.285987 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eca8f-5139-499c-aff2-c268be181839 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.286270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eca8f-5139-499c-aff2-c268be181839 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.296298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eca8f-5139-499c-aff2-c268be181839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-2c6eca8f-5139-499c-aff2-c268be181839 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:49.303902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:49.304821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:49.305652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 249/501] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:49.306557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f7bd-18e6-4c1c-adce-f44eac7e1af5 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.306557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f7bd-18e6-4c1c-adce-f44eac7e1af5 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.306824 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f7bd-18e6-4c1c-adce-f44eac7e1af5 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.308294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 250/502] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:49.308971 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3f7bd-18e6-4c1c-adce-f44eac7e1af5 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:49.322741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2b302-c483-4948-8fd8-04375d852cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:49.323416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2b302-c483-4948-8fd8-04375d852cd1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.323698 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2b302-c483-4948-8fd8-04375d852cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.323971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2b302-c483-4948-8fd8-04375d852cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.324698 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2b302-c483-4948-8fd8-04375d852cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:49.325004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2b302-c483-4948-8fd8-04375d852cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:49.326991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2b302-c483-4948-8fd8-04375d852cd1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:49.338659 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 253/503] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:49.339409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2b302-c483-4948-8fd8-04375d852cd1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:49.374294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:49.394467 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:49.417243 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3f7bd-18e6-4c1c-adce-f44eac7e1af5 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:49.448906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2b302-c483-4948-8fd8-04375d852cd1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:49.451255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcddc0-daec-450a-b6ae-450fdfe03f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:49.452036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcddc0-daec-450a-b6ae-450fdfe03f9c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.452322 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcddc0-daec-450a-b6ae-450fdfe03f9c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.452597 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcddc0-daec-450a-b6ae-450fdfe03f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.462500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcddc0-daec-450a-b6ae-450fdfe03f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:49.463971 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcddc0-daec-450a-b6ae-450fdfe03f9c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-28bcddc0-daec-450a-b6ae-450fdfe03f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:49.481638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:49.482842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:49.484135 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:49.484135 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:49.484135 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:49.484135 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:49.484135 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 251/504] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:49.484413 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac867fe-4088-4cd8-b2d0-8ebd667d1d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:49.484500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcddc0-daec-450a-b6ae-450fdfe03f9c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:49.485323 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac867fe-4088-4cd8-b2d0-8ebd667d1d81 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.485613 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac867fe-4088-4cd8-b2d0-8ebd667d1d81 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.485890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac867fe-4088-4cd8-b2d0-8ebd667d1d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.497606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac867fe-4088-4cd8-b2d0-8ebd667d1d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:49.499117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac867fe-4088-4cd8-b2d0-8ebd667d1d81 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5ac867fe-4088-4cd8-b2d0-8ebd667d1d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:49.516794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:49.517693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:49.518568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:49.518568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:49.518568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:49.518568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:49.518568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 254/505] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:49.519534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488ba0-73a6-4ce8-bee5-01eec779741c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.519826 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488ba0-73a6-4ce8-bee5-01eec779741c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.520106 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488ba0-73a6-4ce8-bee5-01eec779741c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.537273 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-9b488ba0-73a6-4ce8-bee5-01eec779741c None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:49.538464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9b488ba0-73a6-4ce8-bee5-01eec779741c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:49.588344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcddc0-daec-450a-b6ae-450fdfe03f9c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:49.601446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:49.606894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 255/506] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:49.607737 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b488ba0-73a6-4ce8-bee5-01eec779741c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:49.626342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa6b18-0fa5-4afe-a3ff-b3e0b0181b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:49.627062 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa6b18-0fa5-4afe-a3ff-b3e0b0181b0e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.627345 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa6b18-0fa5-4afe-a3ff-b3e0b0181b0e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.627624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa6b18-0fa5-4afe-a3ff-b3e0b0181b0e None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.633136 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa6b18-0fa5-4afe-a3ff-b3e0b0181b0e None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:49.633136 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa6b18-0fa5-4afe-a3ff-b3e0b0181b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:49.633136 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa6b18-0fa5-4afe-a3ff-b3e0b0181b0e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:49.635506 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:49.639174 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 252/507] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:42:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:49.639939 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa6b18-0fa5-4afe-a3ff-b3e0b0181b0e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:49.709921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b488ba0-73a6-4ce8-bee5-01eec779741c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:49.739763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa6b18-0fa5-4afe-a3ff-b3e0b0181b0e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:49.743012 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d57004-837c-4c44-943d-9df75bbe924d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:49.743805 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57004-837c-4c44-943d-9df75bbe924d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.744089 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57004-837c-4c44-943d-9df75bbe924d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.744367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57004-837c-4c44-943d-9df75bbe924d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.751304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d57004-837c-4c44-943d-9df75bbe924d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:49.752759 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d57004-837c-4c44-943d-9df75bbe924d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-e6d57004-837c-4c44-943d-9df75bbe924d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:42:49.767497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:49.768366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:49.769264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:49.769264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:49.769264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:42:49.769264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:42:49.769264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:42:49.769264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:42:49.769264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:42:49.769264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:42:49.769264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:42:49.769264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:49.769264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 256/508] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:49.770503 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d57004-837c-4c44-943d-9df75bbe924d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:49.773339 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fded9-1bdd-48dd-a6a0-8e9e352ec305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:49.773996 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fded9-1bdd-48dd-a6a0-8e9e352ec305 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.774284 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fded9-1bdd-48dd-a6a0-8e9e352ec305 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.774562 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fded9-1bdd-48dd-a6a0-8e9e352ec305 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.775318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fded9-1bdd-48dd-a6a0-8e9e352ec305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:49.775639 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fded9-1bdd-48dd-a6a0-8e9e352ec305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:49.776987 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fded9-1bdd-48dd-a6a0-8e9e352ec305 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:49.789434 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 253/509] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:49.790221 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fded9-1bdd-48dd-a6a0-8e9e352ec305 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:49.823773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:49.858918 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:49.870196 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d57004-837c-4c44-943d-9df75bbe924d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:49.889771 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fded9-1bdd-48dd-a6a0-8e9e352ec305 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:49.903896 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f135d32-124e-4fb7-a4df-9c5f6dffc209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:49.904563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f135d32-124e-4fb7-a4df-9c5f6dffc209 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.904848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f135d32-124e-4fb7-a4df-9c5f6dffc209 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.905126 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f135d32-124e-4fb7-a4df-9c5f6dffc209 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.905851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f135d32-124e-4fb7-a4df-9c5f6dffc209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:49.906164 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f135d32-124e-4fb7-a4df-9c5f6dffc209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:49.907583 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f135d32-124e-4fb7-a4df-9c5f6dffc209 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:49.918843 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 257/510] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:49.919770 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f135d32-124e-4fb7-a4df-9c5f6dffc209 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:49.938971 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73371646-35d8-4241-8398-b97e66c1732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:49.939761 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371646-35d8-4241-8398-b97e66c1732e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:49.940043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371646-35d8-4241-8398-b97e66c1732e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:49.940317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371646-35d8-4241-8398-b97e66c1732e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:49.950338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73371646-35d8-4241-8398-b97e66c1732e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:49.952405 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73371646-35d8-4241-8398-b97e66c1732e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-73371646-35d8-4241-8398-b97e66c1732e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:49.969407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:49.970255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:49.971418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:49.971418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:49.971418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:49.971418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:49.971418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 254/511] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:49.971418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73371646-35d8-4241-8398-b97e66c1732e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:50.022784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f135d32-124e-4fb7-a4df-9c5f6dffc209 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:50.055305 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6da773-ad21-418d-8a2c-fe6448356cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:50.056092 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6da773-ad21-418d-8a2c-fe6448356cac None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:50.056377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6da773-ad21-418d-8a2c-fe6448356cac None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:50.056657 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6da773-ad21-418d-8a2c-fe6448356cac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:50.057861 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:50.068148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6da773-ad21-418d-8a2c-fe6448356cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:50.069611 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6da773-ad21-418d-8a2c-fe6448356cac None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:50.072717 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73371646-35d8-4241-8398-b97e66c1732e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:50.078105 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0b6da773-ad21-418d-8a2c-fe6448356cac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:50.087847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:50.088743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:50.089600 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:50.089600 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:50.089600 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:50.089600 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:50.089600 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 258/512] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:50.089861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6da773-ad21-418d-8a2c-fe6448356cac None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:50.113100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505594f0-93be-4edc-8452-c88521a5f04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:50.113874 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505594f0-93be-4edc-8452-c88521a5f04e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:50.114185 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505594f0-93be-4edc-8452-c88521a5f04e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:50.114463 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505594f0-93be-4edc-8452-c88521a5f04e None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:50.115354 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505594f0-93be-4edc-8452-c88521a5f04e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:50.115664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505594f0-93be-4edc-8452-c88521a5f04e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:50.117098 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505594f0-93be-4edc-8452-c88521a5f04e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:50.153880 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 255/513] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 19:42:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:50.154636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505594f0-93be-4edc-8452-c88521a5f04e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:50.190262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6da773-ad21-418d-8a2c-fe6448356cac None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:50.223638 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc155d-89ff-4da9-94be-211419cfabea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:50.224425 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc155d-89ff-4da9-94be-211419cfabea None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:50.224708 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc155d-89ff-4da9-94be-211419cfabea None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:50.224988 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc155d-89ff-4da9-94be-211419cfabea None admin] PATH_INFO: `/v3/users/nova` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:50.233738 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc155d-89ff-4da9-94be-211419cfabea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:50.235235 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc155d-89ff-4da9-94be-211419cfabea None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-36dc155d-89ff-4da9-94be-211419cfabea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:42:50.249544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:50.250501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 259/514] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 19:42:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:50.251474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc155d-89ff-4da9-94be-211419cfabea None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:50.257314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505594f0-93be-4edc-8452-c88521a5f04e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:50.291158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7707f9f-d3ba-47cf-95de-b16e57617554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:50.291948 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7707f9f-d3ba-47cf-95de-b16e57617554 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:50.292234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7707f9f-d3ba-47cf-95de-b16e57617554 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:50.292509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7707f9f-d3ba-47cf-95de-b16e57617554 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:50.299827 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7707f9f-d3ba-47cf-95de-b16e57617554 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:50.301359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7707f9f-d3ba-47cf-95de-b16e57617554 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:50.311903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-d7707f9f-d3ba-47cf-95de-b16e57617554 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:42:50.316801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:50.317649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:50.318498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:42:50.318498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:42:50.318498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:42:50.318498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:42:50.318498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:42:50.318498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:42:50.318498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:50.318498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:50.318498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 256/515] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:50.319165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7707f9f-d3ba-47cf-95de-b16e57617554 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:50.323246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:50.357908 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc155d-89ff-4da9-94be-211419cfabea None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:50.391881 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ffa3a-8acc-426d-92dd-b1467debfe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:50.392540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ffa3a-8acc-426d-92dd-b1467debfe8e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:50.392824 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ffa3a-8acc-426d-92dd-b1467debfe8e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:50.393101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ffa3a-8acc-426d-92dd-b1467debfe8e None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:50.393820 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ffa3a-8acc-426d-92dd-b1467debfe8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:50.394130 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ffa3a-8acc-426d-92dd-b1467debfe8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:50.395593 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ffa3a-8acc-426d-92dd-b1467debfe8e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:50.408257 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 260/516] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:50.409048 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ffa3a-8acc-426d-92dd-b1467debfe8e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:50.421860 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7707f9f-d3ba-47cf-95de-b16e57617554 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:50.456830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5fe5-e67f-471b-8d01-d2877322aaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:50.457477 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5fe5-e67f-471b-8d01-d2877322aaef None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:50.457756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5fe5-e67f-471b-8d01-d2877322aaef None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:50.458028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5fe5-e67f-471b-8d01-d2877322aaef None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:50.458777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c5fe5-e67f-471b-8d01-d2877322aaef None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:50.459082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c5fe5-e67f-471b-8d01-d2877322aaef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:50.460449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c5fe5-e67f-471b-8d01-d2877322aaef None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:50.473026 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 257/517] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:50.473803 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5fe5-e67f-471b-8d01-d2877322aaef None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:50.512473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ffa3a-8acc-426d-92dd-b1467debfe8e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:50.533384 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:50.534567 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:50.547702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca765-bf8e-4192-a888-93f8e7cf7d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:50.548277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca765-bf8e-4192-a888-93f8e7cf7d30 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:50.548562 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca765-bf8e-4192-a888-93f8e7cf7d30 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:50.548834 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca765-bf8e-4192-a888-93f8e7cf7d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:50.572488 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5fe5-e67f-471b-8d01-d2877322aaef None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:50.607653 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4bb9c-5b25-482a-9292-5b97fdfb243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:50.608299 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4bb9c-5b25-482a-9292-5b97fdfb243e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:50.608581 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4bb9c-5b25-482a-9292-5b97fdfb243e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:50.608853 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4bb9c-5b25-482a-9292-5b97fdfb243e None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:50.609679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4bb9c-5b25-482a-9292-5b97fdfb243e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:50.609992 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4bb9c-5b25-482a-9292-5b97fdfb243e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:50.611444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4bb9c-5b25-482a-9292-5b97fdfb243e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:50.615630 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ca765-bf8e-4192-a888-93f8e7cf7d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:50.617112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ca765-bf8e-4192-a888-93f8e7cf7d30 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:50.628059 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 258/518] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 19:42:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:50.628916 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4bb9c-5b25-482a-9292-5b97fdfb243e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:50.720518 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 261/519] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:50.721145 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca765-bf8e-4192-a888-93f8e7cf7d30 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:50.726825 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4bb9c-5b25-482a-9292-5b97fdfb243e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:50.743437 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:50.749516 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:50.760040 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afa1da-3f09-41d4-ae12-71101fe4fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:50.760684 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afa1da-3f09-41d4-ae12-71101fe4fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:50.760970 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afa1da-3f09-41d4-ae12-71101fe4fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:50.761246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afa1da-3f09-41d4-ae12-71101fe4fbb6 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:50.762031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afa1da-3f09-41d4-ae12-71101fe4fbb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:50.762368 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afa1da-3f09-41d4-ae12-71101fe4fbb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:50.763848 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afa1da-3f09-41d4-ae12-71101fe4fbb6 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:50.781202 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 259/520] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:50.781993 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afa1da-3f09-41d4-ae12-71101fe4fbb6 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:50.820875 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca765-bf8e-4192-a888-93f8e7cf7d30 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:50.853991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889d233-f10c-4159-b40f-3b7b93417eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:50.854684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889d233-f10c-4159-b40f-3b7b93417eee None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:50.854973 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889d233-f10c-4159-b40f-3b7b93417eee None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:50.855251 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889d233-f10c-4159-b40f-3b7b93417eee None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:50.855959 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889d233-f10c-4159-b40f-3b7b93417eee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:50.858011 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889d233-f10c-4159-b40f-3b7b93417eee None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:50.879870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afa1da-3f09-41d4-ae12-71101fe4fbb6 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:50.913145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5357f-f77b-47bb-be05-12f96891294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:50.913955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5357f-f77b-47bb-be05-12f96891294d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:50.914237 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5357f-f77b-47bb-be05-12f96891294d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:50.914513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5357f-f77b-47bb-be05-12f96891294d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:50.922112 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5357f-f77b-47bb-be05-12f96891294d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:50.923578 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5357f-f77b-47bb-be05-12f96891294d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:50.935138 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 262/521] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:42:50 2022] POST /identity/v3/users => generated 247 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:42:50.935965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889d233-f10c-4159-b40f-3b7b93417eee None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-17e5357f-f77b-47bb-be05-12f96891294d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:42:50.939951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:50.941015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:50.941938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:50.941938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:50.941938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:42:50.941938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:42:50.941938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:42:50.941938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:42:50.941938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:42:50.941938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:42:50.941938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:42:50.941938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:50.941938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 260/522] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:50.942526 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5357f-f77b-47bb-be05-12f96891294d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:51.002706 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:51.033320 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:51.059710 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889d233-f10c-4159-b40f-3b7b93417eee None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:51.068835 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5357f-f77b-47bb-be05-12f96891294d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:51.099923 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f939989-49a9-41ee-90f7-bee8ef1ffbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:51.100497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f939989-49a9-41ee-90f7-bee8ef1ffbe8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:51.100784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f939989-49a9-41ee-90f7-bee8ef1ffbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:51.101060 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f939989-49a9-41ee-90f7-bee8ef1ffbe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:51.107456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806eae1-0e29-49ae-82ac-c715747994d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:51.108251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806eae1-0e29-49ae-82ac-c715747994d5 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:51.108534 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806eae1-0e29-49ae-82ac-c715747994d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:51.108807 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806eae1-0e29-49ae-82ac-c715747994d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:51.119482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806eae1-0e29-49ae-82ac-c715747994d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:51.120944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806eae1-0e29-49ae-82ac-c715747994d5 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-5806eae1-0e29-49ae-82ac-c715747994d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:51.140173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:51.141056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:51.141914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:51.141914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:51.141914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:51.141914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:51.141914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 261/523] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:51.142253 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806eae1-0e29-49ae-82ac-c715747994d5 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:51.186871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f939989-49a9-41ee-90f7-bee8ef1ffbe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:51.188397 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f939989-49a9-41ee-90f7-bee8ef1ffbe8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:51.259481 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:51.266547 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806eae1-0e29-49ae-82ac-c715747994d5 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:51.274767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:51.303176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 263/524] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:51.304298 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f939989-49a9-41ee-90f7-bee8ef1ffbe8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:51.311333 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04848176-2fae-436f-bddf-08558f7d7778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:51.312201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04848176-2fae-436f-bddf-08558f7d7778 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:51.312622 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04848176-2fae-436f-bddf-08558f7d7778 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:51.313031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04848176-2fae-436f-bddf-08558f7d7778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:51.314020 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04848176-2fae-436f-bddf-08558f7d7778 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=f7a7e57b60ef49a49da8dba370faec4c) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:51.314555 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04848176-2fae-436f-bddf-08558f7d7778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:51.316139 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04848176-2fae-436f-bddf-08558f7d7778 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:51.322736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 262/525] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:51 2022] GET /identity/v3/role_assignments?user.id=f7a7e57b60ef49a49da8dba370faec4c&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:51.327991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04848176-2fae-436f-bddf-08558f7d7778 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:51.428440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f939989-49a9-41ee-90f7-bee8ef1ffbe8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:51.468770 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161b480-9f15-4de4-ad19-f2babe0a6a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:51.469548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161b480-9f15-4de4-ad19-f2babe0a6a92 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:51.469992 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161b480-9f15-4de4-ad19-f2babe0a6a92 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:51.470325 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161b480-9f15-4de4-ad19-f2babe0a6a92 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:51.471368 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161b480-9f15-4de4-ad19-f2babe0a6a92 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:51.471731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161b480-9f15-4de4-ad19-f2babe0a6a92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:51.473265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161b480-9f15-4de4-ad19-f2babe0a6a92 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:51.473841 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04848176-2fae-436f-bddf-08558f7d7778 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:51.494344 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 264/526] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 19:42:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:51.495338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161b480-9f15-4de4-ad19-f2babe0a6a92 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:51.528215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c0ced-74b8-469f-b24b-002bd3a6327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:51.529085 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0ced-74b8-469f-b24b-002bd3a6327b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:51.529384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0ced-74b8-469f-b24b-002bd3a6327b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:51.529667 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0ced-74b8-469f-b24b-002bd3a6327b None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:51.530812 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c0ced-74b8-469f-b24b-002bd3a6327b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:51.531414 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c0ced-74b8-469f-b24b-002bd3a6327b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:51.533010 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c0ced-74b8-469f-b24b-002bd3a6327b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:51.539947 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:51.548216 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 263/527] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:51.554427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c0ced-74b8-469f-b24b-002bd3a6327b None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:51.571102 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:51.618885 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161b480-9f15-4de4-ad19-f2babe0a6a92 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:51.656472 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b03ab-48d8-42b4-8ed2-02e15d05fc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:51.657273 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b03ab-48d8-42b4-8ed2-02e15d05fc59 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:51.657593 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b03ab-48d8-42b4-8ed2-02e15d05fc59 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:51.658026 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b03ab-48d8-42b4-8ed2-02e15d05fc59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:51.670038 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b03ab-48d8-42b4-8ed2-02e15d05fc59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:51.671687 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b03ab-48d8-42b4-8ed2-02e15d05fc59 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:51.680428 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c0ced-74b8-469f-b24b-002bd3a6327b None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-678b03ab-48d8-42b4-8ed2-02e15d05fc59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:51.691190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:51.692129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:51.692991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:51.692991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:51.692991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:51.692991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:51.692991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 265/528] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:51.693756 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b03ab-48d8-42b4-8ed2-02e15d05fc59 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:51.726307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d0d3-35b3-4ae0-8005-cfa5ac7f1833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:51.726992 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d0d3-35b3-4ae0-8005-cfa5ac7f1833 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:51.727533 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d0d3-35b3-4ae0-8005-cfa5ac7f1833 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:51.727815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d0d3-35b3-4ae0-8005-cfa5ac7f1833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:51.787720 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:51.808066 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b03ab-48d8-42b4-8ed2-02e15d05fc59 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:51.824547 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086d0d3-35b3-4ae0-8005-cfa5ac7f1833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:51.827858 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086d0d3-35b3-4ae0-8005-cfa5ac7f1833 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:51.845514 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5611c-0d8c-480d-907d-19fe7435a134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:51.846457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5611c-0d8c-480d-907d-19fe7435a134 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:51.846854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5611c-0d8c-480d-907d-19fe7435a134 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:51.847300 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5611c-0d8c-480d-907d-19fe7435a134 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:51.852338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:51.855878 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5611c-0d8c-480d-907d-19fe7435a134 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:51.858230 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5611c-0d8c-480d-907d-19fe7435a134 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-9ab5611c-0d8c-480d-907d-19fe7435a134 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:42:51.873969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:51.875085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:51.876079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:42:51.876079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:42:51.876079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:42:51.876079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:42:51.876079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:42:51.876079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:42:51.876079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:51.876079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:51.882516 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 266/529] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:51.883685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5611c-0d8c-480d-907d-19fe7435a134 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:51.946684 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 264/530] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:51.947595 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d0d3-35b3-4ae0-8005-cfa5ac7f1833 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:52.016962 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5611c-0d8c-480d-907d-19fe7435a134 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:52.054491 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d0d3-35b3-4ae0-8005-cfa5ac7f1833 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:52.057887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f54f6f-4be0-47ea-b05e-cd062c064351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:52.058561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f54f6f-4be0-47ea-b05e-cd062c064351 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:52.058874 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f54f6f-4be0-47ea-b05e-cd062c064351 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:52.059150 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f54f6f-4be0-47ea-b05e-cd062c064351 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:52.059908 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f54f6f-4be0-47ea-b05e-cd062c064351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:52.060218 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f54f6f-4be0-47ea-b05e-cd062c064351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:52.061621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f54f6f-4be0-47ea-b05e-cd062c064351 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:52.073468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:52.074808 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 267/531] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:52.075766 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f54f6f-4be0-47ea-b05e-cd062c064351 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:52.090631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:52.104511 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58ea9e-b61f-40ba-8eff-2a1a017d6c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:52.105181 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58ea9e-b61f-40ba-8eff-2a1a017d6c14 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:52.105528 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58ea9e-b61f-40ba-8eff-2a1a017d6c14 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:52.105807 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58ea9e-b61f-40ba-8eff-2a1a017d6c14 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:52.107333 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58ea9e-b61f-40ba-8eff-2a1a017d6c14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:52.108117 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58ea9e-b61f-40ba-8eff-2a1a017d6c14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:52.109453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58ea9e-b61f-40ba-8eff-2a1a017d6c14 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:52.123196 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 265/532] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:42:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:52.124178 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58ea9e-b61f-40ba-8eff-2a1a017d6c14 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:52.205198 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f54f6f-4be0-47ea-b05e-cd062c064351 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:52.238257 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58ea9e-b61f-40ba-8eff-2a1a017d6c14 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:52.254479 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7b13f-622a-4fb7-b31c-defabf0c9efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:52.255320 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7b13f-622a-4fb7-b31c-defabf0c9efd None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:52.255758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7b13f-622a-4fb7-b31c-defabf0c9efd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:52.256046 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7b13f-622a-4fb7-b31c-defabf0c9efd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:52.269856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7b13f-622a-4fb7-b31c-defabf0c9efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:52.271369 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7b13f-622a-4fb7-b31c-defabf0c9efd None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:52.273557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e478b-99a1-449b-8684-43e45b06ae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:52.274337 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e478b-99a1-449b-8684-43e45b06ae59 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:52.274689 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e478b-99a1-449b-8684-43e45b06ae59 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:52.274967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e478b-99a1-449b-8684-43e45b06ae59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:52.285199 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e478b-99a1-449b-8684-43e45b06ae59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:52.286659 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e478b-99a1-449b-8684-43e45b06ae59 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-71a7b13f-622a-4fb7-b31c-defabf0c9efd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:52.295070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:52.296065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:52.297059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:52.297059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:52.297059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:52.297059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:52.298865 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 268/533] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:52.299848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7b13f-622a-4fb7-b31c-defabf0c9efd None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-715e478b-99a1-449b-8684-43e45b06ae59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:42:52.301236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:52.302223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:52.303332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:42:52.303332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:42:52.303332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:42:52.303332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:42:52.303332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:42:52.303332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:42:52.303332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:52.303332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:52.307262 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 266/534] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:52.308070 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e478b-99a1-449b-8684-43e45b06ae59 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:52.354897 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:52.375865 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:52.418979 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e478b-99a1-449b-8684-43e45b06ae59 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:52.428943 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7b13f-622a-4fb7-b31c-defabf0c9efd None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:52.458793 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309f390-3b45-4ba9-8156-2f6e0a5f567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:52.459973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309f390-3b45-4ba9-8156-2f6e0a5f567e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:52.460645 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309f390-3b45-4ba9-8156-2f6e0a5f567e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:52.461067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309f390-3b45-4ba9-8156-2f6e0a5f567e None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:52.462092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309f390-3b45-4ba9-8156-2f6e0a5f567e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:52.462562 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309f390-3b45-4ba9-8156-2f6e0a5f567e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:52.464613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309f390-3b45-4ba9-8156-2f6e0a5f567e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:52.471174 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ed72f-bc09-4820-a461-93d52be7ff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:52.471980 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ed72f-bc09-4820-a461-93d52be7ff44 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:52.472357 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ed72f-bc09-4820-a461-93d52be7ff44 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:52.472727 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ed72f-bc09-4820-a461-93d52be7ff44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:52.473761 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ed72f-bc09-4820-a461-93d52be7ff44 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=c9b1205c2ccb4c959e0b8302f3d2add4) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:52.474168 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ed72f-bc09-4820-a461-93d52be7ff44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:52.475892 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ed72f-bc09-4820-a461-93d52be7ff44 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:52.479494 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 267/535] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:52.481082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309f390-3b45-4ba9-8156-2f6e0a5f567e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:52.482711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 269/536] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:52 2022] GET /identity/v3/role_assignments?user.id=c9b1205c2ccb4c959e0b8302f3d2add4&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:52.484100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ed72f-bc09-4820-a461-93d52be7ff44 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:52.684083 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:52.691796 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309f390-3b45-4ba9-8156-2f6e0a5f567e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:52.698464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ed72f-bc09-4820-a461-93d52be7ff44 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:52.747712 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ba893-a743-45ce-af95-72754d400e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:52.748832 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ba893-a743-45ce-af95-72754d400e6d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:52.750274 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ba893-a743-45ce-af95-72754d400e6d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:52.750923 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ba893-a743-45ce-af95-72754d400e6d None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:52.752954 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ba893-a743-45ce-af95-72754d400e6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:52.753453 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:52.754463 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ba893-a743-45ce-af95-72754d400e6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:52.756830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ba893-a743-45ce-af95-72754d400e6d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:52.772821 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be4d5c-7044-490b-b67b-047562fd2e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:52.774804 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4d5c-7044-490b-b67b-047562fd2e3a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:52.775090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4d5c-7044-490b-b67b-047562fd2e3a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:52.775364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4d5c-7044-490b-b67b-047562fd2e3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:52.777503 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 268/537] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:52.783628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ba893-a743-45ce-af95-72754d400e6d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:52.798524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be4d5c-7044-490b-b67b-047562fd2e3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:52.800045 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be4d5c-7044-490b-b67b-047562fd2e3a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-e1be4d5c-7044-490b-b67b-047562fd2e3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:42:52.831772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:52.832672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:52.833530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:42:52.833530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:42:52.833530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:42:52.833530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:42:52.833530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:42:52.833530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:42:52.833530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:52.833530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:52.835472 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 270/538] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:52.838367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be4d5c-7044-490b-b67b-047562fd2e3a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:53.004035 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be4d5c-7044-490b-b67b-047562fd2e3a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:53.036583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ba893-a743-45ce-af95-72754d400e6d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:53.041582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1bd74-5b5e-421b-8dfa-0a53aadef90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:53.042257 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1bd74-5b5e-421b-8dfa-0a53aadef90f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:53.042548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1bd74-5b5e-421b-8dfa-0a53aadef90f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:53.042872 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1bd74-5b5e-421b-8dfa-0a53aadef90f None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:53.044674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1bd74-5b5e-421b-8dfa-0a53aadef90f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:53.045002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1bd74-5b5e-421b-8dfa-0a53aadef90f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:53.046642 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1bd74-5b5e-421b-8dfa-0a53aadef90f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:53.067418 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 271/539] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:53.072910 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1bd74-5b5e-421b-8dfa-0a53aadef90f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:53.125133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f86a78-6b2a-4f0b-b433-29a0f2ecf729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:53.125799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86a78-6b2a-4f0b-b433-29a0f2ecf729 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:53.126082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86a78-6b2a-4f0b-b433-29a0f2ecf729 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:53.126357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86a78-6b2a-4f0b-b433-29a0f2ecf729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:53.127237 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f86a78-6b2a-4f0b-b433-29a0f2ecf729 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:53.127553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f86a78-6b2a-4f0b-b433-29a0f2ecf729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:53.128987 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f86a78-6b2a-4f0b-b433-29a0f2ecf729 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:53.145348 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 269/540] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:52 2022] GET /identity/v3/role_assignments?user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:53.155102 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:53.261272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1bd74-5b5e-421b-8dfa-0a53aadef90f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:53.268282 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53b8a-385c-420b-aee2-0680b768ffea None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:53.268608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53b8a-385c-420b-aee2-0680b768ffea None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:53.268838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53b8a-385c-420b-aee2-0680b768ffea None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:53.270357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 270/541] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:53.275621 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d20522-712a-459b-a078-2bfb637d1a60 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:53.275905 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d20522-712a-459b-a078-2bfb637d1a60 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:53.276179 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d20522-712a-459b-a078-2bfb637d1a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:53.314629 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8293047-1231-4b18-987d-3e94764df7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:53.314629 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293047-1231-4b18-987d-3e94764df7e6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:53.314629 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293047-1231-4b18-987d-3e94764df7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:53.315025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293047-1231-4b18-987d-3e94764df7e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:53.315606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293047-1231-4b18-987d-3e94764df7e6 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=096d4037981e4bd488e30d43485579bb) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:53.315921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293047-1231-4b18-987d-3e94764df7e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:53.317624 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293047-1231-4b18-987d-3e94764df7e6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:53.327675 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 272/542] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:53 2022] GET /identity/v3/role_assignments?user.id=096d4037981e4bd488e30d43485579bb&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:53.331477 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-79d20522-712a-459b-a078-2bfb637d1a60 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:53.333107 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-79d20522-712a-459b-a078-2bfb637d1a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:53.352808 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:53.449473 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 271/543] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:53.488413 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8293047-1231-4b18-987d-3e94764df7e6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:53.632309 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8293047-1231-4b18-987d-3e94764df7e6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:53.640424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:53.669835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a39609-c88c-45dd-82cd-b031e66bd91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:53.670703 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a39609-c88c-45dd-82cd-b031e66bd91d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:53.671045 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a39609-c88c-45dd-82cd-b031e66bd91d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:53.671322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a39609-c88c-45dd-82cd-b031e66bd91d None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:53.682813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a39609-c88c-45dd-82cd-b031e66bd91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-18a39609-c88c-45dd-82cd-b031e66bd91d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:53.690945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:53.694445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:53.695288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 273/544] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:53.698637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d20522-712a-459b-a078-2bfb637d1a60 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:53.818534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d45d7-5458-4207-a933-0a9f7573448f None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:53.818876 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d45d7-5458-4207-a933-0a9f7573448f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:53.819117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d45d7-5458-4207-a933-0a9f7573448f None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:53.820680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 274/545] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:42:53.825797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cb9c7-cf84-473b-b929-243caaf7ec78 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:53.826354 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cb9c7-cf84-473b-b929-243caaf7ec78 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:53.826871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cb9c7-cf84-473b-b929-243caaf7ec78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:53.830124 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d20522-712a-459b-a078-2bfb637d1a60 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:53.845677 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-bf0cb9c7-cf84-473b-b929-243caaf7ec78 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:53.847244 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-bf0cb9c7-cf84-473b-b929-243caaf7ec78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:53.887258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ef2b7-a18b-45f0-a20d-169a2e054e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:53.887881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ef2b7-a18b-45f0-a20d-169a2e054e77 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:53.888168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ef2b7-a18b-45f0-a20d-169a2e054e77 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:53.888445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ef2b7-a18b-45f0-a20d-169a2e054e77 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:53.889201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ef2b7-a18b-45f0-a20d-169a2e054e77 None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:53.889508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ef2b7-a18b-45f0-a20d-169a2e054e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:53.890912 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ef2b7-a18b-45f0-a20d-169a2e054e77 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:53.909944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 272/546] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:42:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:53.915264 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ef2b7-a18b-45f0-a20d-169a2e054e77 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:53.923418 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 275/547] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:42:53.944146 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:53.947029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cb9c7-cf84-473b-b929-243caaf7ec78 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:54.064693 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ef2b7-a18b-45f0-a20d-169a2e054e77 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:54.105651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a26fb-cb9c-4be4-b146-303adf8c8237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:54.107778 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a26fb-cb9c-4be4-b146-303adf8c8237 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:54.108922 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a26fb-cb9c-4be4-b146-303adf8c8237 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:54.110578 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a26fb-cb9c-4be4-b146-303adf8c8237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:54.113984 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:54.127874 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cb9c7-cf84-473b-b929-243caaf7ec78 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:54.132437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a26fb-cb9c-4be4-b146-303adf8c8237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:54.135055 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a26fb-cb9c-4be4-b146-303adf8c8237 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-a02a26fb-cb9c-4be4-b146-303adf8c8237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:54.156505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:54.157397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:54.158809 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:54.158809 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:54.158809 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:54.158809 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:54.161115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 273/548] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:54.166928 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a26fb-cb9c-4be4-b146-303adf8c8237 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:54.223344 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ecaeb-f004-4dd2-8c4c-24fa5751d2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:54.224169 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ecaeb-f004-4dd2-8c4c-24fa5751d2f9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:54.224458 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ecaeb-f004-4dd2-8c4c-24fa5751d2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:54.224740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ecaeb-f004-4dd2-8c4c-24fa5751d2f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:54.242104 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:54.247817 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ecaeb-f004-4dd2-8c4c-24fa5751d2f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-143ecaeb-f004-4dd2-8c4c-24fa5751d2f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:54.267724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:54.269276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:54.270132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 276/549] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:54.280787 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ecaeb-f004-4dd2-8c4c-24fa5751d2f9 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:54.288566 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a26fb-cb9c-4be4-b146-303adf8c8237 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:54.355818 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f874a80-372e-4799-89fb-42c5ca1fc733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:54.356621 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f874a80-372e-4799-89fb-42c5ca1fc733 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:54.356906 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f874a80-372e-4799-89fb-42c5ca1fc733 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:54.357180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f874a80-372e-4799-89fb-42c5ca1fc733 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:54.357959 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f874a80-372e-4799-89fb-42c5ca1fc733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:54.358268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f874a80-372e-4799-89fb-42c5ca1fc733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:54.359670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f874a80-372e-4799-89fb-42c5ca1fc733 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:54.385818 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 274/550] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:54.391767 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f874a80-372e-4799-89fb-42c5ca1fc733 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:54.476648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ecaeb-f004-4dd2-8c4c-24fa5751d2f9 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:54.540708 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fe962-d5a3-420a-9492-1aa7c038ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:54.541483 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fe962-d5a3-420a-9492-1aa7c038ea48 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:54.541683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fe962-d5a3-420a-9492-1aa7c038ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:54.541906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fe962-d5a3-420a-9492-1aa7c038ea48 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:54.542676 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fe962-d5a3-420a-9492-1aa7c038ea48 None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:54.542986 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fe962-d5a3-420a-9492-1aa7c038ea48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:54.544429 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fe962-d5a3-420a-9492-1aa7c038ea48 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:54.562157 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 277/551] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:42:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:54.569340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fe962-d5a3-420a-9492-1aa7c038ea48 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:54.581943 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f874a80-372e-4799-89fb-42c5ca1fc733 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:54.606532 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:54.633452 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:54.649812 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da60759-8c91-4474-9192-30c97c5ce14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:54.650614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60759-8c91-4474-9192-30c97c5ce14c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:54.650901 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60759-8c91-4474-9192-30c97c5ce14c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:54.651172 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60759-8c91-4474-9192-30c97c5ce14c None admin] PATH_INFO: `/v3/users/swift` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:54.661896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da60759-8c91-4474-9192-30c97c5ce14c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:54.663361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da60759-8c91-4474-9192-30c97c5ce14c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-8da60759-8c91-4474-9192-30c97c5ce14c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:42:54.685657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:54.686651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:54.687647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:54.687647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:54.687647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:42:54.687647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:42:54.687647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:42:54.687647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:42:54.687647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:42:54.687647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:42:54.687647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:42:54.687647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:54.687647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 275/552] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:42:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:54.697477 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da60759-8c91-4474-9192-30c97c5ce14c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:54.757502 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fe962-d5a3-420a-9492-1aa7c038ea48 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:54.809227 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6599453-1075-4d97-b725-b8d4bc3bd993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:54.810632 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6599453-1075-4d97-b725-b8d4bc3bd993 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:54.811170 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6599453-1075-4d97-b725-b8d4bc3bd993 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:54.811501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6599453-1075-4d97-b725-b8d4bc3bd993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:54.823162 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6599453-1075-4d97-b725-b8d4bc3bd993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:54.825162 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6599453-1075-4d97-b725-b8d4bc3bd993 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b6599453-1075-4d97-b725-b8d4bc3bd993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:54.844790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:54.845736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:54.846640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:54.846640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:54.846640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:54.846640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:54.846640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 278/553] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:54.853651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6599453-1075-4d97-b725-b8d4bc3bd993 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:54.890755 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da60759-8c91-4474-9192-30c97c5ce14c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:54.928073 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6bcf-5be8-4c98-aaf4-e5c034ca2cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:54.929149 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6bcf-5be8-4c98-aaf4-e5c034ca2cb4 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:54.929661 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6bcf-5be8-4c98-aaf4-e5c034ca2cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:54.930139 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6bcf-5be8-4c98-aaf4-e5c034ca2cb4 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:54.931218 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f6bcf-5be8-4c98-aaf4-e5c034ca2cb4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:54.931738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f6bcf-5be8-4c98-aaf4-e5c034ca2cb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:54.933679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f6bcf-5be8-4c98-aaf4-e5c034ca2cb4 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:54.953206 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 276/554] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 19:42:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:54.960697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6bcf-5be8-4c98-aaf4-e5c034ca2cb4 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:55.014471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:55.029027 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:55.071508 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6599453-1075-4d97-b725-b8d4bc3bd993 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:55.111653 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6bcf-5be8-4c98-aaf4-e5c034ca2cb4 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:55.122920 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fad4d8-5c5e-42a7-98b5-b955fffaae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:55.123599 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fad4d8-5c5e-42a7-98b5-b955fffaae7c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.123883 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fad4d8-5c5e-42a7-98b5-b955fffaae7c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.124156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fad4d8-5c5e-42a7-98b5-b955fffaae7c None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.124890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fad4d8-5c5e-42a7-98b5-b955fffaae7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:55.125202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fad4d8-5c5e-42a7-98b5-b955fffaae7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:55.126599 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fad4d8-5c5e-42a7-98b5-b955fffaae7c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:55.150008 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e64ae-d64b-4009-a414-ea0abb708353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:55.150731 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e64ae-d64b-4009-a414-ea0abb708353 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.151029 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e64ae-d64b-4009-a414-ea0abb708353 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.151666 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e64ae-d64b-4009-a414-ea0abb708353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.154775 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 279/555] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:42:55.161162 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fad4d8-5c5e-42a7-98b5-b955fffaae7c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:55.230635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e64ae-d64b-4009-a414-ea0abb708353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:55.232938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e64ae-d64b-4009-a414-ea0abb708353 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:55.295020 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:55.349803 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 277/556] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:42:55.354713 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fad4d8-5c5e-42a7-98b5-b955fffaae7c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:55.355320 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e64ae-d64b-4009-a414-ea0abb708353 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:55.387107 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:55.391750 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216da14-dbe2-4b42-b9be-92fbd9a496fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:55.392675 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216da14-dbe2-4b42-b9be-92fbd9a496fe None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.393031 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216da14-dbe2-4b42-b9be-92fbd9a496fe None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.393411 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216da14-dbe2-4b42-b9be-92fbd9a496fe None admin] PATH_INFO: `/v3/users/glance` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.401766 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216da14-dbe2-4b42-b9be-92fbd9a496fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:55.403945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216da14-dbe2-4b42-b9be-92fbd9a496fe None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c216da14-dbe2-4b42-b9be-92fbd9a496fe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:42:55.420115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:55.425025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:55.425985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:55.425985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:55.425985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:42:55.425985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:42:55.425985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:42:55.425985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:42:55.425985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:42:55.425985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:42:55.425985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 19:42:55.425985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:55.425985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 280/557] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:42:55.430652 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216da14-dbe2-4b42-b9be-92fbd9a496fe None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:55.537468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e64ae-d64b-4009-a414-ea0abb708353 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:55.570887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216da14-dbe2-4b42-b9be-92fbd9a496fe None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:55.581486 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639590bf-38e6-4dd4-94dc-03cdcde720f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:55.582281 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639590bf-38e6-4dd4-94dc-03cdcde720f9 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.582562 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639590bf-38e6-4dd4-94dc-03cdcde720f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.582862 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639590bf-38e6-4dd4-94dc-03cdcde720f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.594124 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639590bf-38e6-4dd4-94dc-03cdcde720f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:55.595674 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639590bf-38e6-4dd4-94dc-03cdcde720f9 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:55.598567 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:55.613370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33dbd7-cf04-4b51-bcb0-8978b6662ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:55.614315 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33dbd7-cf04-4b51-bcb0-8978b6662ece None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-639590bf-38e6-4dd4-94dc-03cdcde720f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:55.614651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:55.615811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:55.616995 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:55.616995 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:55.616995 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:55.616995 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:55.616995 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 278/558] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:55.617347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7fe57-a460-4b62-8f99-65b843af5dde None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.617724 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7fe57-a460-4b62-8f99-65b843af5dde None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.617868 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7fe57-a460-4b62-8f99-65b843af5dde None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.618260 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33dbd7-cf04-4b51-bcb0-8978b6662ece None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.618764 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33dbd7-cf04-4b51-bcb0-8978b6662ece None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.623569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 279/559] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:55.623569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7fe57-a460-4b62-8f99-65b843af5dde None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:55.624160 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33dbd7-cf04-4b51-bcb0-8978b6662ece None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:55.624674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33dbd7-cf04-4b51-bcb0-8978b6662ece None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:55.626771 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33dbd7-cf04-4b51-bcb0-8978b6662ece None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:55.658205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 281/560] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 19:42:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:55.658205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339809fa-a0cb-4383-8707-65552b433a63 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.658205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339809fa-a0cb-4383-8707-65552b433a63 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.658205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339809fa-a0cb-4383-8707-65552b433a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.683181 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-339809fa-a0cb-4383-8707-65552b433a63 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:55.685487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-339809fa-a0cb-4383-8707-65552b433a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:55.741641 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7fe57-a460-4b62-8f99-65b843af5dde None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:55.741860 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:55.777785 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 282/561] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:55.777785 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339809fa-a0cb-4383-8707-65552b433a63 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:55.782110 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8644587-d273-4977-ba5f-d5a74fb2d3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:55.782827 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8644587-d273-4977-ba5f-d5a74fb2d3f1 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.783115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8644587-d273-4977-ba5f-d5a74fb2d3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.783396 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8644587-d273-4977-ba5f-d5a74fb2d3f1 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.784160 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8644587-d273-4977-ba5f-d5a74fb2d3f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:55.784475 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8644587-d273-4977-ba5f-d5a74fb2d3f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:55.785904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8644587-d273-4977-ba5f-d5a74fb2d3f1 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:55.798967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 280/562] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:55.800300 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c3ab0-46e9-4f75-9e72-6babfb51e4d3 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.800599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c3ab0-46e9-4f75-9e72-6babfb51e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.801403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c3ab0-46e9-4f75-9e72-6babfb51e4d3 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.806640 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 281/563] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:55.807760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c3ab0-46e9-4f75-9e72-6babfb51e4d3 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:55.866437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:55.890690 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339809fa-a0cb-4383-8707-65552b433a63 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:55.912932 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c3ab0-46e9-4f75-9e72-6babfb51e4d3 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:55.926154 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d265-6610-4a2d-a816-90e18caeae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:55.926975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d265-6610-4a2d-a816-90e18caeae79 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.927264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d265-6610-4a2d-a816-90e18caeae79 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.927538 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d265-6610-4a2d-a816-90e18caeae79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.938382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d265-6610-4a2d-a816-90e18caeae79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:55.939879 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d265-6610-4a2d-a816-90e18caeae79 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:55.951048 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cbe79-651e-4bb9-b2af-5bd9a2206ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:55.951836 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cbe79-651e-4bb9-b2af-5bd9a2206ae0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.952118 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cbe79-651e-4bb9-b2af-5bd9a2206ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.952399 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cbe79-651e-4bb9-b2af-5bd9a2206ae0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ffc6d265-6610-4a2d-a816-90e18caeae79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:55.957828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:55.958741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:55.959694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:55.959694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:55.959694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:55.959694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:55.963507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 283/564] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:55.964355 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d265-6610-4a2d-a816-90e18caeae79 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:55.964564 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cbe79-651e-4bb9-b2af-5bd9a2206ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-2e7cbe79-651e-4bb9-b2af-5bd9a2206ae0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:55.972664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:55.973614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:55.974480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 282/565] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:55.975243 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599577c-6db4-4e6a-961f-76cc057c2f1c None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.975531 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599577c-6db4-4e6a-961f-76cc057c2f1c None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.975531 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599577c-6db4-4e6a-961f-76cc057c2f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.992034 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-9599577c-6db4-4e6a-961f-76cc057c2f1c None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:55.993205 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-9599577c-6db4-4e6a-961f-76cc057c2f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:55.997751 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:56.059001 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 283/566] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:56.060265 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599577c-6db4-4e6a-961f-76cc057c2f1c None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:56.082562 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d265-6610-4a2d-a816-90e18caeae79 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:56.108486 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:56.117435 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d128585-1fdb-4111-b72c-9b59a069647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:56.118155 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d128585-1fdb-4111-b72c-9b59a069647a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.118434 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d128585-1fdb-4111-b72c-9b59a069647a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.118747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d128585-1fdb-4111-b72c-9b59a069647a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.125908 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d128585-1fdb-4111-b72c-9b59a069647a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:56.127380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d128585-1fdb-4111-b72c-9b59a069647a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0d128585-1fdb-4111-b72c-9b59a069647a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:42:56.141416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:56.142476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:56.143621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:42:56.143621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:42:56.143621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:42:56.143621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:42:56.143621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:42:56.143621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:42:56.143621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:56.143621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:56.143621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 284/567] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:56.144111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690321f-3202-4375-b614-137926eb75be None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.144111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690321f-3202-4375-b614-137926eb75be None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.144267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690321f-3202-4375-b614-137926eb75be None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.149445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 285/568] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:56.150194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690321f-3202-4375-b614-137926eb75be None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:56.164856 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599577c-6db4-4e6a-961f-76cc057c2f1c None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:56.199759 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0978-f3ec-4302-b8cf-56786f2e9534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:56.200421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0978-f3ec-4302-b8cf-56786f2e9534 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.200702 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0978-f3ec-4302-b8cf-56786f2e9534 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.200985 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0978-f3ec-4302-b8cf-56786f2e9534 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.201710 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e0978-f3ec-4302-b8cf-56786f2e9534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:56.202019 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e0978-f3ec-4302-b8cf-56786f2e9534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:56.203429 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e0978-f3ec-4302-b8cf-56786f2e9534 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:56.218774 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 284/569] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:56.218774 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0978-f3ec-4302-b8cf-56786f2e9534 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:56.242268 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:56.253343 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690321f-3202-4375-b614-137926eb75be None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:56.287852 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aff471-b506-49fd-9f07-ed5f97ea070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:56.288434 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aff471-b506-49fd-9f07-ed5f97ea070c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.288715 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aff471-b506-49fd-9f07-ed5f97ea070c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.289005 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aff471-b506-49fd-9f07-ed5f97ea070c None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.289756 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aff471-b506-49fd-9f07-ed5f97ea070c None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:56.290064 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aff471-b506-49fd-9f07-ed5f97ea070c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:56.291469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aff471-b506-49fd-9f07-ed5f97ea070c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:56.300013 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 286/570] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:56.300803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aff471-b506-49fd-9f07-ed5f97ea070c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:56.320607 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0978-f3ec-4302-b8cf-56786f2e9534 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:56.328240 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:56.366818 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83453df6-d660-45fa-abdb-fbcbe7cbf127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:56.367897 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83453df6-d660-45fa-abdb-fbcbe7cbf127 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.368114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83453df6-d660-45fa-abdb-fbcbe7cbf127 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.368394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83453df6-d660-45fa-abdb-fbcbe7cbf127 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.381346 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83453df6-d660-45fa-abdb-fbcbe7cbf127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-83453df6-d660-45fa-abdb-fbcbe7cbf127 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:56.389099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:56.390208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:56.391279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:56.394815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 285/571] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:56.396259 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff20a-eb0b-4936-a69b-25725ad80dcb None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.396542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff20a-eb0b-4936-a69b-25725ad80dcb None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.396820 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff20a-eb0b-4936-a69b-25725ad80dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.403026 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aff471-b506-49fd-9f07-ed5f97ea070c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:56.412775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-6fcff20a-eb0b-4936-a69b-25725ad80dcb None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:56.413945 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-6fcff20a-eb0b-4936-a69b-25725ad80dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:56.438913 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e057b9-73e1-40ae-8784-a6c9a08ae6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:56.439573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e057b9-73e1-40ae-8784-a6c9a08ae6c7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.439855 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e057b9-73e1-40ae-8784-a6c9a08ae6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.440130 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e057b9-73e1-40ae-8784-a6c9a08ae6c7 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.440915 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e057b9-73e1-40ae-8784-a6c9a08ae6c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:56.441229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e057b9-73e1-40ae-8784-a6c9a08ae6c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:56.442695 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e057b9-73e1-40ae-8784-a6c9a08ae6c7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:56.455044 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 287/572] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:56.455841 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e057b9-73e1-40ae-8784-a6c9a08ae6c7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:56.472024 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:56.484347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 286/573] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:56.485168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff20a-eb0b-4936-a69b-25725ad80dcb None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:56.558281 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e057b9-73e1-40ae-8784-a6c9a08ae6c7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:56.584353 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:56.589921 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff20a-eb0b-4936-a69b-25725ad80dcb None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:56.591904 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dd975-02f5-4688-89f3-7db479c9ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:56.592659 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dd975-02f5-4688-89f3-7db479c9ea05 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.592996 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dd975-02f5-4688-89f3-7db479c9ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.598503 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dd975-02f5-4688-89f3-7db479c9ea05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.599985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dd975-02f5-4688-89f3-7db479c9ea05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:56.601441 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dd975-02f5-4688-89f3-7db479c9ea05 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-781dd975-02f5-4688-89f3-7db479c9ea05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:42:56.615570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:56.616477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:56.617410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:42:56.617410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:42:56.617410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:42:56.617410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:42:56.617410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:42:56.617410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:42:56.617410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:56.617410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:56.617847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 288/574] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:56.618466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dd975-02f5-4688-89f3-7db479c9ea05 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:56.629108 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014621ae-03e2-475e-a5c6-4ebdbfbe2ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:56.629893 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014621ae-03e2-475e-a5c6-4ebdbfbe2ff8 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.630175 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014621ae-03e2-475e-a5c6-4ebdbfbe2ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.630451 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014621ae-03e2-475e-a5c6-4ebdbfbe2ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.640668 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014621ae-03e2-475e-a5c6-4ebdbfbe2ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:56.642095 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014621ae-03e2-475e-a5c6-4ebdbfbe2ff8 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-014621ae-03e2-475e-a5c6-4ebdbfbe2ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:56.660067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:56.661198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:56.662515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:56.662515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:56.662515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:56.662515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:56.662515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 287/575] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:56.662515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014621ae-03e2-475e-a5c6-4ebdbfbe2ff8 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:56.691255 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:56.720841 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dd975-02f5-4688-89f3-7db479c9ea05 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:56.754254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ccc59-27bd-4545-abcf-2d78f82f459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:56.754955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ccc59-27bd-4545-abcf-2d78f82f459a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.755241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ccc59-27bd-4545-abcf-2d78f82f459a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.755520 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ccc59-27bd-4545-abcf-2d78f82f459a None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.756272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ccc59-27bd-4545-abcf-2d78f82f459a None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:56.756582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ccc59-27bd-4545-abcf-2d78f82f459a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:56.757968 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ccc59-27bd-4545-abcf-2d78f82f459a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:56.760540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014621ae-03e2-475e-a5c6-4ebdbfbe2ff8 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:56.766357 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 289/576] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:56.767185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ccc59-27bd-4545-abcf-2d78f82f459a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:56.797274 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828068f1-93a6-459f-b323-3ff6b8902327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:56.797912 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828068f1-93a6-459f-b323-3ff6b8902327 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.798191 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828068f1-93a6-459f-b323-3ff6b8902327 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.798463 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828068f1-93a6-459f-b323-3ff6b8902327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.799360 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828068f1-93a6-459f-b323-3ff6b8902327 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=4741a268ae704e9582c1bb72f9c425a9) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:56.799674 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828068f1-93a6-459f-b323-3ff6b8902327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:56.801092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828068f1-93a6-459f-b323-3ff6b8902327 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:56.806440 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 288/577] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/role_assignments?user.id=4741a268ae704e9582c1bb72f9c425a9&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:56.807494 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828068f1-93a6-459f-b323-3ff6b8902327 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:56.836286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:56.875801 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ccc59-27bd-4545-abcf-2d78f82f459a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:56.912840 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374116e-0141-4572-9494-6bfc0cc9b477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:56.913658 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374116e-0141-4572-9494-6bfc0cc9b477 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.913942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374116e-0141-4572-9494-6bfc0cc9b477 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.914245 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374116e-0141-4572-9494-6bfc0cc9b477 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.916492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:56.927613 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374116e-0141-4572-9494-6bfc0cc9b477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5374116e-0141-4572-9494-6bfc0cc9b477 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:56.935922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:56.937085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:56.938133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:56.938954 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828068f1-93a6-459f-b323-3ff6b8902327 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:56.946122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 290/578] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:56.947170 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374116e-0141-4572-9494-6bfc0cc9b477 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:56.977908 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334046e8-bbe9-484f-88b7-a433fab42a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:56.978571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334046e8-bbe9-484f-88b7-a433fab42a9e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:56.978882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334046e8-bbe9-484f-88b7-a433fab42a9e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:56.979158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334046e8-bbe9-484f-88b7-a433fab42a9e None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:56.979955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334046e8-bbe9-484f-88b7-a433fab42a9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:56.980264 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334046e8-bbe9-484f-88b7-a433fab42a9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:56.981729 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334046e8-bbe9-484f-88b7-a433fab42a9e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:56.998998 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 289/579] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:57.000470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334046e8-bbe9-484f-88b7-a433fab42a9e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:57.066124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374116e-0141-4572-9494-6bfc0cc9b477 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:57.083925 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:57.102782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1416200-30d7-4db5-9666-b1a510588c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:57.103450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1416200-30d7-4db5-9666-b1a510588c3f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:57.103733 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1416200-30d7-4db5-9666-b1a510588c3f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:57.104011 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1416200-30d7-4db5-9666-b1a510588c3f None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:57.104843 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1416200-30d7-4db5-9666-b1a510588c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:57.105150 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1416200-30d7-4db5-9666-b1a510588c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:57.106559 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1416200-30d7-4db5-9666-b1a510588c3f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:57.116087 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334046e8-bbe9-484f-88b7-a433fab42a9e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:57.118650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 291/580] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:57.119548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1416200-30d7-4db5-9666-b1a510588c3f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:57.151132 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf58e57-2d04-400c-84e6-92547fa8669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:57.151846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf58e57-2d04-400c-84e6-92547fa8669f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:57.152134 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf58e57-2d04-400c-84e6-92547fa8669f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:57.152413 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf58e57-2d04-400c-84e6-92547fa8669f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:57.163680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf58e57-2d04-400c-84e6-92547fa8669f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:57.165116 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf58e57-2d04-400c-84e6-92547fa8669f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-7cf58e57-2d04-400c-84e6-92547fa8669f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:57.182180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:57.183215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:57.184257 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:57.184257 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:57.184257 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:57.184257 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:57.184257 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 290/581] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:57.184257 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf58e57-2d04-400c-84e6-92547fa8669f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:57.190132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:57.236353 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1416200-30d7-4db5-9666-b1a510588c3f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:57.270561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcabecd-7a91-43f5-bb33-9a9d50d2381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:57.271360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcabecd-7a91-43f5-bb33-9a9d50d2381c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:57.271717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcabecd-7a91-43f5-bb33-9a9d50d2381c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:57.272064 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcabecd-7a91-43f5-bb33-9a9d50d2381c None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:57.272878 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcabecd-7a91-43f5-bb33-9a9d50d2381c None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:57.273251 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcabecd-7a91-43f5-bb33-9a9d50d2381c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:57.274768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcabecd-7a91-43f5-bb33-9a9d50d2381c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:57.283730 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 292/582] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:42:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:57.284250 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcabecd-7a91-43f5-bb33-9a9d50d2381c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:57.292116 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf58e57-2d04-400c-84e6-92547fa8669f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:57.327552 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608bafd-5989-4d2d-b1f4-77ba31e39934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:57.328466 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608bafd-5989-4d2d-b1f4-77ba31e39934 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:57.328749 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608bafd-5989-4d2d-b1f4-77ba31e39934 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:57.329023 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608bafd-5989-4d2d-b1f4-77ba31e39934 None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/f7a7e57b60ef49a49da8dba370faec4c/roles/6832675179fb4d0894f7273b883164b1` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:57.343575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608bafd-5989-4d2d-b1f4-77ba31e39934 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=f7a7e57b60ef49a49da8dba370faec4c, role_id=6832675179fb4d0894f7273b883164b1)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:57.345068 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608bafd-5989-4d2d-b1f4-77ba31e39934 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:57.390116 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcabecd-7a91-43f5-bb33-9a9d50d2381c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:57.398591 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:57.422371 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327dd4e-ce8d-4f50-937d-66db587cfe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:57.423143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327dd4e-ce8d-4f50-937d-66db587cfe6a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:57.423428 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327dd4e-ce8d-4f50-937d-66db587cfe6a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:57.423703 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327dd4e-ce8d-4f50-937d-66db587cfe6a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:57.430994 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327dd4e-ce8d-4f50-937d-66db587cfe6a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:57.432818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327dd4e-ce8d-4f50-937d-66db587cfe6a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-6327dd4e-ce8d-4f50-937d-66db587cfe6a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:42:57.447332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:57.448542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 293/583] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:42:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:57.454921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327dd4e-ce8d-4f50-937d-66db587cfe6a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:57.463034 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 291/584] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:42:57 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/f7a7e57b60ef49a49da8dba370faec4c/roles/6832675179fb4d0894f7273b883164b1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:42:57.473153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608bafd-5989-4d2d-b1f4-77ba31e39934 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:57.492414 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:57.577946 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327dd4e-ce8d-4f50-937d-66db587cfe6a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:57.613977 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608bafd-5989-4d2d-b1f4-77ba31e39934 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:57.624724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88a6e4-db66-4fd4-8d44-b913d2a70099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:57.625405 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88a6e4-db66-4fd4-8d44-b913d2a70099 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:57.625690 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88a6e4-db66-4fd4-8d44-b913d2a70099 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:57.625968 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88a6e4-db66-4fd4-8d44-b913d2a70099 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:57.627283 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88a6e4-db66-4fd4-8d44-b913d2a70099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:57.627597 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88a6e4-db66-4fd4-8d44-b913d2a70099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:57.629705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88a6e4-db66-4fd4-8d44-b913d2a70099 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:57.646344 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 294/585] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:57.647158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88a6e4-db66-4fd4-8d44-b913d2a70099 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:57.656134 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870b9b2-9993-4095-9711-eb4f9cd07702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:57.657137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870b9b2-9993-4095-9711-eb4f9cd07702 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:57.657523 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870b9b2-9993-4095-9711-eb4f9cd07702 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:57.657927 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870b9b2-9993-4095-9711-eb4f9cd07702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:57.671437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870b9b2-9993-4095-9711-eb4f9cd07702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:57.672218 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870b9b2-9993-4095-9711-eb4f9cd07702 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:57.688560 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-1870b9b2-9993-4095-9711-eb4f9cd07702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:57.693147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:57.694334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:57.702956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:57.702956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:57.702956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:57.702956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:57.702956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 292/586] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:57.702956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870b9b2-9993-4095-9711-eb4f9cd07702 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:57.731090 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:57.762717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88a6e4-db66-4fd4-8d44-b913d2a70099 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:57.799052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527ca07-1b47-46cd-927b-e1dc6f77e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:57.800071 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527ca07-1b47-46cd-927b-e1dc6f77e6b1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:57.800511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527ca07-1b47-46cd-927b-e1dc6f77e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:57.800944 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527ca07-1b47-46cd-927b-e1dc6f77e6b1 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:57.801944 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527ca07-1b47-46cd-927b-e1dc6f77e6b1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:57.802420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527ca07-1b47-46cd-927b-e1dc6f77e6b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:57.804047 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527ca07-1b47-46cd-927b-e1dc6f77e6b1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:57.823730 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 295/587] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 19:42:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:57.824232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870b9b2-9993-4095-9711-eb4f9cd07702 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:57.825053 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527ca07-1b47-46cd-927b-e1dc6f77e6b1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:57.877628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0aa50-2525-46fa-9ae0-914f57e470d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:57.879096 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0aa50-2525-46fa-9ae0-914f57e470d4 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:57.880414 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0aa50-2525-46fa-9ae0-914f57e470d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:57.880892 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0aa50-2525-46fa-9ae0-914f57e470d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:57.892779 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0aa50-2525-46fa-9ae0-914f57e470d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:57.895086 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0aa50-2525-46fa-9ae0-914f57e470d4 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-7cc0aa50-2525-46fa-9ae0-914f57e470d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:42:57.915700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:57.916946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:57.918123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:57.918123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:57.918123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:42:57.918123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:42:57.918123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:42:57.918123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:42:57.918123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:42:57.918123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:42:57.918123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:42:57.918123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:57.925138 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 293/588] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 19:42:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:57.925138 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0aa50-2525-46fa-9ae0-914f57e470d4 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:57.942752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:57.954354 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527ca07-1b47-46cd-927b-e1dc6f77e6b1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.004312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e78c8-3b04-4863-9f3d-7d6363758e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.005285 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e78c8-3b04-4863-9f3d-7d6363758e5b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.005799 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e78c8-3b04-4863-9f3d-7d6363758e5b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.006176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e78c8-3b04-4863-9f3d-7d6363758e5b None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.007047 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e78c8-3b04-4863-9f3d-7d6363758e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:58.007708 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e78c8-3b04-4863-9f3d-7d6363758e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.010108 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e78c8-3b04-4863-9f3d-7d6363758e5b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.025180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:58.033376 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 296/589] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:58.033376 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e78c8-3b04-4863-9f3d-7d6363758e5b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.047571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0aa50-2525-46fa-9ae0-914f57e470d4 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.087071 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426381-ed51-40d9-af43-26d0bc817883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.088136 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426381-ed51-40d9-af43-26d0bc817883 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.088651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426381-ed51-40d9-af43-26d0bc817883 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.089083 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426381-ed51-40d9-af43-26d0bc817883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.101155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd426381-ed51-40d9-af43-26d0bc817883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.102923 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd426381-ed51-40d9-af43-26d0bc817883 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-dd426381-ed51-40d9-af43-26d0bc817883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:58.122624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:58.123870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:58.124958 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:58.124958 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:58.124958 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:58.124958 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:58.126861 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 294/590] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:58.127888 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426381-ed51-40d9-af43-26d0bc817883 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.167950 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e78c8-3b04-4863-9f3d-7d6363758e5b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.214721 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3c296-8d61-406f-a054-125f93646114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.216571 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3c296-8d61-406f-a054-125f93646114 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.217038 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3c296-8d61-406f-a054-125f93646114 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.217495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3c296-8d61-406f-a054-125f93646114 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.218529 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3c296-8d61-406f-a054-125f93646114 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:58.219050 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3c296-8d61-406f-a054-125f93646114 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.220817 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3c296-8d61-406f-a054-125f93646114 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.238849 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426381-ed51-40d9-af43-26d0bc817883 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.239839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 297/591] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:58.245257 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3c296-8d61-406f-a054-125f93646114 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.266994 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:58.283052 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f5a47-b447-4c5c-a166-e7c5da382247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.283052 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f5a47-b447-4c5c-a166-e7c5da382247 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.283052 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f5a47-b447-4c5c-a166-e7c5da382247 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.283463 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f5a47-b447-4c5c-a166-e7c5da382247 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.292004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f5a47-b447-4c5c-a166-e7c5da382247 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.297015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f5a47-b447-4c5c-a166-e7c5da382247 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.297333 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-288f5a47-b447-4c5c-a166-e7c5da382247 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:42:58.317334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:58.318518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:58.319801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:58.319801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:58.319801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:42:58.319801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:42:58.319801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:42:58.319801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:42:58.319801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:42:58.319801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:42:58.319801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:42:58.319801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:58.326430 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 295/592] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:58.326430 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f5a47-b447-4c5c-a166-e7c5da382247 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.374076 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3c296-8d61-406f-a054-125f93646114 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.410207 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96db348-cea5-4ffc-bb4d-9bafd27fb2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.411232 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96db348-cea5-4ffc-bb4d-9bafd27fb2c7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.411717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96db348-cea5-4ffc-bb4d-9bafd27fb2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.412151 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96db348-cea5-4ffc-bb4d-9bafd27fb2c7 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.413160 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96db348-cea5-4ffc-bb4d-9bafd27fb2c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:58.413688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96db348-cea5-4ffc-bb4d-9bafd27fb2c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.415425 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96db348-cea5-4ffc-bb4d-9bafd27fb2c7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.428614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 298/593] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:58.429815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96db348-cea5-4ffc-bb4d-9bafd27fb2c7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.456270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f5a47-b447-4c5c-a166-e7c5da382247 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.503554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8878f-4565-45d6-80ae-08185e545f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.504673 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8878f-4565-45d6-80ae-08185e545f18 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.505180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8878f-4565-45d6-80ae-08185e545f18 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.505661 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8878f-4565-45d6-80ae-08185e545f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.506508 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:58.518435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8878f-4565-45d6-80ae-08185e545f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.520342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8878f-4565-45d6-80ae-08185e545f18 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-47a8878f-4565-45d6-80ae-08185e545f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:58.538583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:58.539557 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:58.540453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:58.540453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:58.540453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:58.540453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:58.542016 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96db348-cea5-4ffc-bb4d-9bafd27fb2c7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.543540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 296/594] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:58.549407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8878f-4565-45d6-80ae-08185e545f18 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.585806 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcc31b-9aca-4b87-9330-b80da9e7f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.586488 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcc31b-9aca-4b87-9330-b80da9e7f75f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.586825 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcc31b-9aca-4b87-9330-b80da9e7f75f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.587107 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcc31b-9aca-4b87-9330-b80da9e7f75f None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.588235 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcc31b-9aca-4b87-9330-b80da9e7f75f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:58.588552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcc31b-9aca-4b87-9330-b80da9e7f75f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.591020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcc31b-9aca-4b87-9330-b80da9e7f75f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.605956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:58.620622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 299/595] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:58.620622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcc31b-9aca-4b87-9330-b80da9e7f75f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.667301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8878f-4565-45d6-80ae-08185e545f18 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.714698 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038e2d-e644-49e4-b1eb-09420e24c726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.715990 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038e2d-e644-49e4-b1eb-09420e24c726 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.716281 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038e2d-e644-49e4-b1eb-09420e24c726 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.716556 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038e2d-e644-49e4-b1eb-09420e24c726 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.726877 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4038e2d-e644-49e4-b1eb-09420e24c726 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.728671 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4038e2d-e644-49e4-b1eb-09420e24c726 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.744427 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcc31b-9aca-4b87-9330-b80da9e7f75f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-c4038e2d-e644-49e4-b1eb-09420e24c726 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:42:58.750758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:58.751679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:58.752586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:42:58.752586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:42:58.752586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:42:58.752586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:42:58.752586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:42:58.752586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:42:58.752586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:58.752586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:58.752586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 297/596] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:58.754567 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038e2d-e644-49e4-b1eb-09420e24c726 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.775685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:58.782432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ff31f-7e99-4480-92c6-7108cfd4b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.791680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff31f-7e99-4480-92c6-7108cfd4b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.791680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff31f-7e99-4480-92c6-7108cfd4b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.791680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff31f-7e99-4480-92c6-7108cfd4b4e2 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.791680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ff31f-7e99-4480-92c6-7108cfd4b4e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:58.791680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ff31f-7e99-4480-92c6-7108cfd4b4e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.791680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ff31f-7e99-4480-92c6-7108cfd4b4e2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.799412 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 300/597] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:58.800592 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ff31f-7e99-4480-92c6-7108cfd4b4e2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.877846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038e2d-e644-49e4-b1eb-09420e24c726 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.895301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:58.926916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ff31f-7e99-4480-92c6-7108cfd4b4e2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.933672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d497a6-a9c7-4be9-a1fc-5bd5a67139a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.934995 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d497a6-a9c7-4be9-a1fc-5bd5a67139a0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.935514 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d497a6-a9c7-4be9-a1fc-5bd5a67139a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.936699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d497a6-a9c7-4be9-a1fc-5bd5a67139a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.951382 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d497a6-a9c7-4be9-a1fc-5bd5a67139a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.953684 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d497a6-a9c7-4be9-a1fc-5bd5a67139a0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.965458 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e36ba9-4494-4947-802b-9471d590deee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.966753 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e36ba9-4494-4947-802b-9471d590deee None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.967041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e36ba9-4494-4947-802b-9471d590deee None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.967318 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e36ba9-4494-4947-802b-9471d590deee None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.968155 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e36ba9-4494-4947-802b-9471d590deee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:58.968472 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e36ba9-4494-4947-802b-9471d590deee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.969982 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e36ba9-4494-4947-802b-9471d590deee None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-74d497a6-a9c7-4be9-a1fc-5bd5a67139a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:42:58.977490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:58.978384 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:58.979324 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:42:58.979324 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:42:58.979324 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:42:58.979324 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:58.982082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 298/598] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:58.982082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d497a6-a9c7-4be9-a1fc-5bd5a67139a0 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.988202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 301/599] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:58.989525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e36ba9-4494-4947-802b-9471d590deee None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:59.055855 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:59.092665 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d497a6-a9c7-4be9-a1fc-5bd5a67139a0 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:59.120656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e36ba9-4494-4947-802b-9471d590deee None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:59.129455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7c3f0-e822-4a3c-8fc6-253ec192d8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:59.130251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c3f0-e822-4a3c-8fc6-253ec192d8f8 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:59.130536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c3f0-e822-4a3c-8fc6-253ec192d8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:59.130846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c3f0-e822-4a3c-8fc6-253ec192d8f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:59.138894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7c3f0-e822-4a3c-8fc6-253ec192d8f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:59.140456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7c3f0-e822-4a3c-8fc6-253ec192d8f8 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-30c7c3f0-e822-4a3c-8fc6-253ec192d8f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:42:59.154535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:59.155633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:59.156694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:42:59.156694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:42:59.156694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:42:59.156694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:42:59.156694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:42:59.156694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:42:59.156694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:59.156694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:42:59.156694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 299/600] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:59.157412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7c3f0-e822-4a3c-8fc6-253ec192d8f8 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:59.163277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3ea0d-9940-4c2c-b293-fe0db040b60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:59.163941 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3ea0d-9940-4c2c-b293-fe0db040b60d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:59.164213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3ea0d-9940-4c2c-b293-fe0db040b60d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:59.164484 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3ea0d-9940-4c2c-b293-fe0db040b60d None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:59.165200 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3ea0d-9940-4c2c-b293-fe0db040b60d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:59.165503 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3ea0d-9940-4c2c-b293-fe0db040b60d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:59.166921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3ea0d-9940-4c2c-b293-fe0db040b60d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:59.179812 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 302/601] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:59.181105 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7f0a7-7ad5-43d5-bfe7-1a9790a1cd9e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:59.181396 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7f0a7-7ad5-43d5-bfe7-1a9790a1cd9e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:59.181680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7f0a7-7ad5-43d5-bfe7-1a9790a1cd9e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:59.183319 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 303/602] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:59.187824 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7f0a7-7ad5-43d5-bfe7-1a9790a1cd9e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:59.191491 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:59.272981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7c3f0-e822-4a3c-8fc6-253ec192d8f8 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:59.303425 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7f0a7-7ad5-43d5-bfe7-1a9790a1cd9e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:59.308495 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f29edc-d995-4ba6-a3f3-22a62ec3ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:59.309969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f29edc-d995-4ba6-a3f3-22a62ec3ec03 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:59.310327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f29edc-d995-4ba6-a3f3-22a62ec3ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:59.310707 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f29edc-d995-4ba6-a3f3-22a62ec3ec03 None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/c9b1205c2ccb4c959e0b8302f3d2add4/roles/6832675179fb4d0894f7273b883164b1` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:59.317254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:59.332871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f29edc-d995-4ba6-a3f3-22a62ec3ec03 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=c9b1205c2ccb4c959e0b8302f3d2add4, role_id=6832675179fb4d0894f7273b883164b1)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:59.334534 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f29edc-d995-4ba6-a3f3-22a62ec3ec03 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:59.344279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2021c-57e6-4473-aec0-617d33e74e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:59.345072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2021c-57e6-4473-aec0-617d33e74e92 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:59.345334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2021c-57e6-4473-aec0-617d33e74e92 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:59.345943 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2021c-57e6-4473-aec0-617d33e74e92 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:59.347098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2021c-57e6-4473-aec0-617d33e74e92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:59.347878 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2021c-57e6-4473-aec0-617d33e74e92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:59.349374 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2021c-57e6-4473-aec0-617d33e74e92 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:59.362212 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 304/603] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:59.363057 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2021c-57e6-4473-aec0-617d33e74e92 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:59.427967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 300/604] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:42:59 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/c9b1205c2ccb4c959e0b8302f3d2add4/roles/6832675179fb4d0894f7273b883164b1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:42:59.427967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010f696-42c3-4d05-842d-0f7f5319e76b None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:59.427967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010f696-42c3-4d05-842d-0f7f5319e76b None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:59.427967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010f696-42c3-4d05-842d-0f7f5319e76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:59.443262 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-3010f696-42c3-4d05-842d-0f7f5319e76b None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:59.444855 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-3010f696-42c3-4d05-842d-0f7f5319e76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:59.489235 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2021c-57e6-4473-aec0-617d33e74e92 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:59.528517 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 301/605] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:42:59.529341 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010f696-42c3-4d05-842d-0f7f5319e76b None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:59.532144 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:59.546636 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33011ed7-7452-4920-9539-6129c9261ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:59.549707 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33011ed7-7452-4920-9539-6129c9261ecb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:59.549707 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33011ed7-7452-4920-9539-6129c9261ecb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:59.549707 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33011ed7-7452-4920-9539-6129c9261ecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:59.562440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33011ed7-7452-4920-9539-6129c9261ecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:59.563878 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33011ed7-7452-4920-9539-6129c9261ecb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-33011ed7-7452-4920-9539-6129c9261ecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:42:59.583272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:59.584310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:59.585233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:42:59.585233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:42:59.585233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:42:59.585233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:42:59.585233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:42:59.585233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:42:59.585233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:42:59.585233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:59.585233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 305/606] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:42:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:59.585726 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33011ed7-7452-4920-9539-6129c9261ecb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:59.629719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:59.666826 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010f696-42c3-4d05-842d-0f7f5319e76b None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:59.711528 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80cfd2-3971-4449-947c-0ddac48cef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:59.712423 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80cfd2-3971-4449-947c-0ddac48cef77 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:59.712711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80cfd2-3971-4449-947c-0ddac48cef77 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:59.712989 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80cfd2-3971-4449-947c-0ddac48cef77 None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/84b4164dd21a4ec0bd3d50cd46d7d5e8/roles/6832675179fb4d0894f7273b883164b1` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:59.720895 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33011ed7-7452-4920-9539-6129c9261ecb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:59.729500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80cfd2-3971-4449-947c-0ddac48cef77 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=84b4164dd21a4ec0bd3d50cd46d7d5e8, role_id=6832675179fb4d0894f7273b883164b1)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:59.730979 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80cfd2-3971-4449-947c-0ddac48cef77 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:59.757988 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b04dbf-6bb5-489c-b559-05021ceb63b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:59.758815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04dbf-6bb5-489c-b559-05021ceb63b4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:59.759097 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04dbf-6bb5-489c-b559-05021ceb63b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:59.759371 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04dbf-6bb5-489c-b559-05021ceb63b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:59.770493 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b04dbf-6bb5-489c-b559-05021ceb63b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-50b04dbf-6bb5-489c-b559-05021ceb63b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:42:59.778740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:42:59.779965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 306/607] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:42:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:42:59.780970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b04dbf-6bb5-489c-b559-05021ceb63b4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:59.831679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 302/608] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:42:59 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/84b4164dd21a4ec0bd3d50cd46d7d5e8/roles/6832675179fb4d0894f7273b883164b1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:42:59.832424 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80cfd2-3971-4449-947c-0ddac48cef77 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:59.907673 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:59.919517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:42:59.937240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b04dbf-6bb5-489c-b559-05021ceb63b4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:59.964679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80cfd2-3971-4449-947c-0ddac48cef77 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:59.988136 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238275eb-7a6d-4a09-9fdf-5a687d50c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:59.989480 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238275eb-7a6d-4a09-9fdf-5a687d50c491 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:59.990003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238275eb-7a6d-4a09-9fdf-5a687d50c491 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:59.990437 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238275eb-7a6d-4a09-9fdf-5a687d50c491 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:59.992038 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238275eb-7a6d-4a09-9fdf-5a687d50c491 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:42:59.992552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238275eb-7a6d-4a09-9fdf-5a687d50c491 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:59.994736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238275eb-7a6d-4a09-9fdf-5a687d50c491 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:00.004469 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4d4a0-a1af-4661-92e4-b4ba24534991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:00.005160 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d4a0-a1af-4661-92e4-b4ba24534991 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.005520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d4a0-a1af-4661-92e4-b4ba24534991 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.005867 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d4a0-a1af-4661-92e4-b4ba24534991 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.006780 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4d4a0-a1af-4661-92e4-b4ba24534991 None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:00.007156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4d4a0-a1af-4661-92e4-b4ba24534991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:00.008748 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4d4a0-a1af-4661-92e4-b4ba24534991 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:00.012163 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 307/609] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:00.014254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a5586-2427-47b6-a89a-3ffaebef067a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.014738 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a5586-2427-47b6-a89a-3ffaebef067a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.015169 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a5586-2427-47b6-a89a-3ffaebef067a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.017554 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 308/610] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:00.019344 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a5586-2427-47b6-a89a-3ffaebef067a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.024400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 303/611] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:42:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:00.024951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec238e7-9457-435a-b472-e8e73def5cc1 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.025293 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec238e7-9457-435a-b472-e8e73def5cc1 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.025578 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec238e7-9457-435a-b472-e8e73def5cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.044729 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-5ec238e7-9457-435a-b472-e8e73def5cc1 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:00.045946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-5ec238e7-9457-435a-b472-e8e73def5cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:00.128513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 304/612] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:00.134806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec238e7-9457-435a-b472-e8e73def5cc1 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.165622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a5586-2427-47b6-a89a-3ffaebef067a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:00.201838 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b4972-3341-401c-ae15-7ab02888ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:00.202752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4972-3341-401c-ae15-7ab02888ecd6 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.203029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4972-3341-401c-ae15-7ab02888ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.203194 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:00.203303 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4972-3341-401c-ae15-7ab02888ecd6 None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/096d4037981e4bd488e30d43485579bb/roles/6832675179fb4d0894f7273b883164b1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.219304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b4972-3341-401c-ae15-7ab02888ecd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=096d4037981e4bd488e30d43485579bb, role_id=6832675179fb4d0894f7273b883164b1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:00.220846 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b4972-3341-401c-ae15-7ab02888ecd6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:00.264454 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec238e7-9457-435a-b472-e8e73def5cc1 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:00.275199 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:00.282197 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 309/613] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:43:00 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/096d4037981e4bd488e30d43485579bb/roles/6832675179fb4d0894f7273b883164b1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:43:00.283518 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b4972-3341-401c-ae15-7ab02888ecd6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.305072 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ed5dd-521b-4953-9daf-8d74fd0334e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:00.306217 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed5dd-521b-4953-9daf-8d74fd0334e7 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.306684 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed5dd-521b-4953-9daf-8d74fd0334e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.307381 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed5dd-521b-4953-9daf-8d74fd0334e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.320683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ed5dd-521b-4953-9daf-8d74fd0334e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:00.322496 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ed5dd-521b-4953-9daf-8d74fd0334e7 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-fd7ed5dd-521b-4953-9daf-8d74fd0334e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:00.344123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:00.349017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:00.350160 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:00.350160 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:00.350160 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:00.350160 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:00.350160 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 305/614] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:00.359801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ed5dd-521b-4953-9daf-8d74fd0334e7 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.424518 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b4972-3341-401c-ae15-7ab02888ecd6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:00.475584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8fdb-7487-4110-8beb-a0a2420ff441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:00.476732 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8fdb-7487-4110-8beb-a0a2420ff441 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.477168 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8fdb-7487-4110-8beb-a0a2420ff441 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.477594 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8fdb-7487-4110-8beb-a0a2420ff441 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.507239 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d8fdb-7487-4110-8beb-a0a2420ff441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-6b6d8fdb-7487-4110-8beb-a0a2420ff441 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:00.516234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:00.517515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:00.518452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:00.520992 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 310/615] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:00.526960 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8fdb-7487-4110-8beb-a0a2420ff441 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.595073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:00.636394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8fdb-7487-4110-8beb-a0a2420ff441 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:00.643183 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:00.650821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ed5dd-521b-4953-9daf-8d74fd0334e7 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:00.690454 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c24f0-842b-4f90-8d34-4855f148bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:00.691080 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c24f0-842b-4f90-8d34-4855f148bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.691361 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c24f0-842b-4f90-8d34-4855f148bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.691628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c24f0-842b-4f90-8d34-4855f148bfa2 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.692372 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c24f0-842b-4f90-8d34-4855f148bfa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:00.692672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c24f0-842b-4f90-8d34-4855f148bfa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:00.694040 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c24f0-842b-4f90-8d34-4855f148bfa2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:00.698364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03304e-1f64-46ef-b40b-6ae41971829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:00.699046 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03304e-1f64-46ef-b40b-6ae41971829c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.699324 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03304e-1f64-46ef-b40b-6ae41971829c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.699592 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03304e-1f64-46ef-b40b-6ae41971829c None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.700355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03304e-1f64-46ef-b40b-6ae41971829c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:00.700657 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03304e-1f64-46ef-b40b-6ae41971829c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:00.701995 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03304e-1f64-46ef-b40b-6ae41971829c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:00.718490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 311/616] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:00.723993 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c24f0-842b-4f90-8d34-4855f148bfa2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.735292 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 306/617] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:00.741301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03304e-1f64-46ef-b40b-6ae41971829c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.875358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c24f0-842b-4f90-8d34-4855f148bfa2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:00.901667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:00.915822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b24c8c-5953-4200-8bea-60d17f51cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:00.916795 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b24c8c-5953-4200-8bea-60d17f51cf48 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.917081 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b24c8c-5953-4200-8bea-60d17f51cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.917355 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b24c8c-5953-4200-8bea-60d17f51cf48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.930189 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b24c8c-5953-4200-8bea-60d17f51cf48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:00.932871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b24c8c-5953-4200-8bea-60d17f51cf48 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c3b24c8c-5953-4200-8bea-60d17f51cf48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:00.953871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:00.959267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:00.960191 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:00.960191 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:00.960191 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:00.960191 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:00.960191 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 312/618] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:00.961480 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b24c8c-5953-4200-8bea-60d17f51cf48 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.987466 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03304e-1f64-46ef-b40b-6ae41971829c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:01.065168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08641e55-2f0c-40ba-b68a-2a4d839b311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:01.066321 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08641e55-2f0c-40ba-b68a-2a4d839b311e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:01.066617 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08641e55-2f0c-40ba-b68a-2a4d839b311e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:01.066894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08641e55-2f0c-40ba-b68a-2a4d839b311e None admin] PATH_INFO: `/v3/users/swift` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:01.084387 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08641e55-2f0c-40ba-b68a-2a4d839b311e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:01.085840 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08641e55-2f0c-40ba-b68a-2a4d839b311e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-08641e55-2f0c-40ba-b68a-2a4d839b311e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:01.113318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:01.114379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:01.115391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:01.115391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:01.115391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:01.115391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:01.115391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:01.115391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:01.115391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:01.115391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:01.115391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:43:01.115391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:01.115391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 307/619] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:01.128041 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08641e55-2f0c-40ba-b68a-2a4d839b311e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:01.164942 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:01.176840 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b24c8c-5953-4200-8bea-60d17f51cf48 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:01.218316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6155088-28f4-4424-b2c6-374d2f4ca3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:01.219003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6155088-28f4-4424-b2c6-374d2f4ca3b5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:01.219280 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6155088-28f4-4424-b2c6-374d2f4ca3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:01.219550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6155088-28f4-4424-b2c6-374d2f4ca3b5 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:01.220279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6155088-28f4-4424-b2c6-374d2f4ca3b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:01.220588 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6155088-28f4-4424-b2c6-374d2f4ca3b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:01.221970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6155088-28f4-4424-b2c6-374d2f4ca3b5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:01.249021 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 313/620] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:01.255933 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6155088-28f4-4424-b2c6-374d2f4ca3b5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:01.322127 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:01.333780 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08641e55-2f0c-40ba-b68a-2a4d839b311e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:01.372295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9d6fb-c442-4609-94ea-eea11afbca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:01.372962 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9d6fb-c442-4609-94ea-eea11afbca7d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:01.373245 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9d6fb-c442-4609-94ea-eea11afbca7d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:01.373522 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9d6fb-c442-4609-94ea-eea11afbca7d None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:01.374368 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9d6fb-c442-4609-94ea-eea11afbca7d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:01.374698 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9d6fb-c442-4609-94ea-eea11afbca7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:01.376111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9d6fb-c442-4609-94ea-eea11afbca7d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:01.414332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 308/621] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 19:43:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:01.421105 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9d6fb-c442-4609-94ea-eea11afbca7d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:01.473216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6155088-28f4-4424-b2c6-374d2f4ca3b5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:01.517067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:01.530350 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19155a59-8b09-4405-b0be-087b6c209130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:01.531186 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19155a59-8b09-4405-b0be-087b6c209130 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:01.531477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19155a59-8b09-4405-b0be-087b6c209130 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:01.531799 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19155a59-8b09-4405-b0be-087b6c209130 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:01.539401 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19155a59-8b09-4405-b0be-087b6c209130 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:01.541101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19155a59-8b09-4405-b0be-087b6c209130 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-19155a59-8b09-4405-b0be-087b6c209130 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:01.558392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:01.559495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:01.560463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:01.560463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:01.560463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:01.560463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:01.560463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:01.560463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:01.560463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:01.560463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:01.560463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 19:43:01.560463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:01.564684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 314/622] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:43:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:01.566431 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19155a59-8b09-4405-b0be-087b6c209130 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:01.608540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9d6fb-c442-4609-94ea-eea11afbca7d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:01.676344 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:01.687426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19155a59-8b09-4405-b0be-087b6c209130 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:01.707046 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ced883-7cff-427d-8f8e-d1bdeceecdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:01.707842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced883-7cff-427d-8f8e-d1bdeceecdf0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:01.708124 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced883-7cff-427d-8f8e-d1bdeceecdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:01.708398 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced883-7cff-427d-8f8e-d1bdeceecdf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:01.727617 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ced883-7cff-427d-8f8e-d1bdeceecdf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:01.729009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ced883-7cff-427d-8f8e-d1bdeceecdf0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:01.741922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e26f4-9c90-4f19-a4bb-ad7c55e182ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:01.742617 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e26f4-9c90-4f19-a4bb-ad7c55e182ab None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:01.742915 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e26f4-9c90-4f19-a4bb-ad7c55e182ab None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:01.743201 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e26f4-9c90-4f19-a4bb-ad7c55e182ab None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:01.744050 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e26f4-9c90-4f19-a4bb-ad7c55e182ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:01.744807 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e26f4-9c90-4f19-a4bb-ad7c55e182ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:01.746359 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e26f4-9c90-4f19-a4bb-ad7c55e182ab None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:01.765591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 315/623] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 19:43:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-b9ced883-7cff-427d-8f8e-d1bdeceecdf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:01.770585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:01.771508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:01.772432 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:01.772432 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:01.772432 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:01.772432 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:01.772432 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 309/624] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:01.773130 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e26f4-9c90-4f19-a4bb-ad7c55e182ab None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:01.779526 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ced883-7cff-427d-8f8e-d1bdeceecdf0 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:01.883019 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e26f4-9c90-4f19-a4bb-ad7c55e182ab None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:01.923383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394553a-2783-45c1-9751-f2c79c645020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:01.924056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394553a-2783-45c1-9751-f2c79c645020 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:01.924339 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394553a-2783-45c1-9751-f2c79c645020 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:01.924609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394553a-2783-45c1-9751-f2c79c645020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:01.951003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:02.002705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394553a-2783-45c1-9751-f2c79c645020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:02.002705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394553a-2783-45c1-9751-f2c79c645020 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:02.116321 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 316/625] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:02.117689 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51da30-5d36-4907-b451-a242ada351c5 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.117980 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51da30-5d36-4907-b451-a242ada351c5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.118256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51da30-5d36-4907-b451-a242ada351c5 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.119847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 317/626] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:02.120290 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ced883-7cff-427d-8f8e-d1bdeceecdf0 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:02.124076 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51da30-5d36-4907-b451-a242ada351c5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:02.151200 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:02.159239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c12ed-3ceb-42a8-83f1-19be4332fd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:02.159914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c12ed-3ceb-42a8-83f1-19be4332fd1f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.160204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c12ed-3ceb-42a8-83f1-19be4332fd1f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.163177 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c12ed-3ceb-42a8-83f1-19be4332fd1f None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.163177 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c12ed-3ceb-42a8-83f1-19be4332fd1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:02.163177 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c12ed-3ceb-42a8-83f1-19be4332fd1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:02.163177 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c12ed-3ceb-42a8-83f1-19be4332fd1f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:02.175725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 310/627] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:02.177143 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce859d1-5dc3-4553-bc52-cef28b6603cd None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.177432 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce859d1-5dc3-4553-bc52-cef28b6603cd None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.177709 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce859d1-5dc3-4553-bc52-cef28b6603cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.194856 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-bce859d1-5dc3-4553-bc52-cef28b6603cd None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:02.197060 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-bce859d1-5dc3-4553-bc52-cef28b6603cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:02.198148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:02.264157 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51da30-5d36-4907-b451-a242ada351c5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:02.271530 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 311/628] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:02.272463 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce859d1-5dc3-4553-bc52-cef28b6603cd None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:02.311905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eec36c-248d-4afc-878b-2d881b3b7e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:02.312849 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eec36c-248d-4afc-878b-2d881b3b7e16 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.313213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eec36c-248d-4afc-878b-2d881b3b7e16 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.313556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eec36c-248d-4afc-878b-2d881b3b7e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.330350 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eec36c-248d-4afc-878b-2d881b3b7e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:02.332051 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eec36c-248d-4afc-878b-2d881b3b7e16 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-37eec36c-248d-4afc-878b-2d881b3b7e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:02.358903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:02.360148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:02.361256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:02.361256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:02.361256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:02.361256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:02.361256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 318/629] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:02.366629 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eec36c-248d-4afc-878b-2d881b3b7e16 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:02.394430 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce859d1-5dc3-4553-bc52-cef28b6603cd None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:02.413254 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:02.433162 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a805bc5-d76b-4d1a-b97d-defea63df931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:02.434127 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a805bc5-d76b-4d1a-b97d-defea63df931 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.434546 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a805bc5-d76b-4d1a-b97d-defea63df931 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.434968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a805bc5-d76b-4d1a-b97d-defea63df931 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.442391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a805bc5-d76b-4d1a-b97d-defea63df931 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:02.444076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a805bc5-d76b-4d1a-b97d-defea63df931 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-3a805bc5-d76b-4d1a-b97d-defea63df931 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:02.459882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:02.461047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:02.461999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:02.461999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:02.461999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:02.461999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:02.461999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:02.461999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:02.461999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:02.461999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:02.462810 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 312/630] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:02.463802 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a805bc5-d76b-4d1a-b97d-defea63df931 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:02.496738 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eec36c-248d-4afc-878b-2d881b3b7e16 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:02.500254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:02.539291 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad0ae8-7dbd-4c16-9cf6-9e927e19a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:02.540131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad0ae8-7dbd-4c16-9cf6-9e927e19a276 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.540421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad0ae8-7dbd-4c16-9cf6-9e927e19a276 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.540699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad0ae8-7dbd-4c16-9cf6-9e927e19a276 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.555321 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad0ae8-7dbd-4c16-9cf6-9e927e19a276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-53ad0ae8-7dbd-4c16-9cf6-9e927e19a276 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:02.566408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:02.567509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 319/631] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:43:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:02.573158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad0ae8-7dbd-4c16-9cf6-9e927e19a276 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:02.577391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a805bc5-d76b-4d1a-b97d-defea63df931 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:02.615837 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4c52-6631-4361-821e-83e8d355a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:02.616943 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4c52-6631-4361-821e-83e8d355a470 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.617400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4c52-6631-4361-821e-83e8d355a470 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.617859 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4c52-6631-4361-821e-83e8d355a470 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.618610 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c4c52-6631-4361-821e-83e8d355a470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:02.618936 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c4c52-6631-4361-821e-83e8d355a470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:02.620340 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c4c52-6631-4361-821e-83e8d355a470 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:02.633170 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 313/632] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:02.634501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6aff4-9290-4d2a-a834-28dfa45a05af None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.634831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6aff4-9290-4d2a-a834-28dfa45a05af None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.638739 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6aff4-9290-4d2a-a834-28dfa45a05af None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.638739 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 314/633] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:02.638739 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6aff4-9290-4d2a-a834-28dfa45a05af None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:02.676742 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:02.692902 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad0ae8-7dbd-4c16-9cf6-9e927e19a276 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:02.728969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63819ab9-e16d-4c09-8496-9c16cea2f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:02.729634 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63819ab9-e16d-4c09-8496-9c16cea2f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.734591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63819ab9-e16d-4c09-8496-9c16cea2f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.734591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63819ab9-e16d-4c09-8496-9c16cea2f9c7 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.734591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63819ab9-e16d-4c09-8496-9c16cea2f9c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:02.734591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63819ab9-e16d-4c09-8496-9c16cea2f9c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:02.734591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63819ab9-e16d-4c09-8496-9c16cea2f9c7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:02.745053 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 320/634] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:02.745875 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63819ab9-e16d-4c09-8496-9c16cea2f9c7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:02.750892 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6aff4-9290-4d2a-a834-28dfa45a05af None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:02.781671 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:02.788660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585c8dc-eb9e-4fa0-92ba-80c31508818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:02.791680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c8dc-eb9e-4fa0-92ba-80c31508818a None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.791680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c8dc-eb9e-4fa0-92ba-80c31508818a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.791680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585c8dc-eb9e-4fa0-92ba-80c31508818a None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.791680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585c8dc-eb9e-4fa0-92ba-80c31508818a None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:02.792128 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585c8dc-eb9e-4fa0-92ba-80c31508818a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:02.793347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585c8dc-eb9e-4fa0-92ba-80c31508818a None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:02.801972 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 315/635] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:02.803318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053440b-9eb0-42a2-8971-a9ab18505b26 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.803616 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053440b-9eb0-42a2-8971-a9ab18505b26 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.803889 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053440b-9eb0-42a2-8971-a9ab18505b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.820712 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-3053440b-9eb0-42a2-8971-a9ab18505b26 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:02.821882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-3053440b-9eb0-42a2-8971-a9ab18505b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:02.856873 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63819ab9-e16d-4c09-8496-9c16cea2f9c7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:02.886555 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 316/636] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:02.888074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053440b-9eb0-42a2-8971-a9ab18505b26 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:02.890799 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a6e4f-14e4-4713-b3f0-d30e1e040ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:02.891592 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a6e4f-14e4-4713-b3f0-d30e1e040ee3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.891876 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a6e4f-14e4-4713-b3f0-d30e1e040ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.892152 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a6e4f-14e4-4713-b3f0-d30e1e040ee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.911681 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a6e4f-14e4-4713-b3f0-d30e1e040ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:02.913167 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a6e4f-14e4-4713-b3f0-d30e1e040ee3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:02.921712 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-082a6e4f-14e4-4713-b3f0-d30e1e040ee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:02.927382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:02.928408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:02.929360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:02.929360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:02.929360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:02.929360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:02.929360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:02.929360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:02.929360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:02.929360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:02.929360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 321/637] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:02.930340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7902-c211-49b2-92f1-d0820ee9d46b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:02.930340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7902-c211-49b2-92f1-d0820ee9d46b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:02.930340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7902-c211-49b2-92f1-d0820ee9d46b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:02.931615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 322/638] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:02.935221 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e7902-c211-49b2-92f1-d0820ee9d46b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:02.999586 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053440b-9eb0-42a2-8971-a9ab18505b26 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:03.020981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:03.032012 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34e1bc-35ae-4c1a-94f7-da245dd89be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:03.032877 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34e1bc-35ae-4c1a-94f7-da245dd89be3 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.033155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34e1bc-35ae-4c1a-94f7-da245dd89be3 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.033425 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34e1bc-35ae-4c1a-94f7-da245dd89be3 None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/4741a268ae704e9582c1bb72f9c425a9/roles/6832675179fb4d0894f7273b883164b1` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.036864 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e7902-c211-49b2-92f1-d0820ee9d46b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:03.047944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34e1bc-35ae-4c1a-94f7-da245dd89be3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=4741a268ae704e9582c1bb72f9c425a9, role_id=6832675179fb4d0894f7273b883164b1)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:03.049297 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34e1bc-35ae-4c1a-94f7-da245dd89be3 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:03.071424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1696a1-d9c9-4860-8156-13bf7a5061ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:03.072228 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1696a1-d9c9-4860-8156-13bf7a5061ea None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.072491 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1696a1-d9c9-4860-8156-13bf7a5061ea None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.072761 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1696a1-d9c9-4860-8156-13bf7a5061ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.082505 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1696a1-d9c9-4860-8156-13bf7a5061ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:03.084066 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1696a1-d9c9-4860-8156-13bf7a5061ea None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-aa1696a1-d9c9-4860-8156-13bf7a5061ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:03.101202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:03.102240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:03.103401 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:03.103401 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:03.103401 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:03.103401 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:03.103401 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 323/639] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:03.103401 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1696a1-d9c9-4860-8156-13bf7a5061ea None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:03.116046 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 317/640] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:43:02 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/4741a268ae704e9582c1bb72f9c425a9/roles/6832675179fb4d0894f7273b883164b1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:03.116939 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34e1bc-35ae-4c1a-94f7-da245dd89be3 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:03.218976 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1696a1-d9c9-4860-8156-13bf7a5061ea None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:03.221811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:03.244784 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34e1bc-35ae-4c1a-94f7-da245dd89be3 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:03.258855 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc69f4-3256-4559-8e6d-ce2a0f65385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:03.259669 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc69f4-3256-4559-8e6d-ce2a0f65385e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.259955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc69f4-3256-4559-8e6d-ce2a0f65385e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.260214 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc69f4-3256-4559-8e6d-ce2a0f65385e None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.263257 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:03.273009 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc69f4-3256-4559-8e6d-ce2a0f65385e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c3fc69f4-3256-4559-8e6d-ce2a0f65385e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:03.281635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:03.282749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:03.283628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:03.287963 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 324/641] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:43:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:03.288905 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0865-25dd-4d6b-8426-26b8ff426ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:03.289394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d21e2f-e6b3-41e8-9002-2695ac9239c2 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.289682 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d21e2f-e6b3-41e8-9002-2695ac9239c2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.289906 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0865-25dd-4d6b-8426-26b8ff426ef0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.290008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d21e2f-e6b3-41e8-9002-2695ac9239c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.290174 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0865-25dd-4d6b-8426-26b8ff426ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.290507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0865-25dd-4d6b-8426-26b8ff426ef0 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.291351 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b0865-25dd-4d6b-8426-26b8ff426ef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:03.291670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b0865-25dd-4d6b-8426-26b8ff426ef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:03.293278 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b0865-25dd-4d6b-8426-26b8ff426ef0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:03.312915 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 318/642] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:03.314045 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0865-25dd-4d6b-8426-26b8ff426ef0 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:03.319764 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-77d21e2f-e6b3-41e8-9002-2695ac9239c2 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:03.321046 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-77d21e2f-e6b3-41e8-9002-2695ac9239c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:03.398640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 325/643] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:03.398640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d21e2f-e6b3-41e8-9002-2695ac9239c2 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:03.438554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0865-25dd-4d6b-8426-26b8ff426ef0 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:03.473437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d15f1-88e2-4f4f-9219-8fc4caab0d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:03.474247 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d15f1-88e2-4f4f-9219-8fc4caab0d95 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.474648 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d15f1-88e2-4f4f-9219-8fc4caab0d95 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.475002 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d15f1-88e2-4f4f-9219-8fc4caab0d95 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.475731 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d15f1-88e2-4f4f-9219-8fc4caab0d95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:03.476033 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d15f1-88e2-4f4f-9219-8fc4caab0d95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:03.477383 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d15f1-88e2-4f4f-9219-8fc4caab0d95 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:03.485769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:03.491321 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 319/644] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:03.496243 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d15f1-88e2-4f4f-9219-8fc4caab0d95 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:03.504754 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d21e2f-e6b3-41e8-9002-2695ac9239c2 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:03.534813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:03.545079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ad50c-cd11-4198-83aa-1a5cc9fdd62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:03.547563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ad50c-cd11-4198-83aa-1a5cc9fdd62e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.547563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ad50c-cd11-4198-83aa-1a5cc9fdd62e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.547563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ad50c-cd11-4198-83aa-1a5cc9fdd62e None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.547563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ad50c-cd11-4198-83aa-1a5cc9fdd62e None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:03.547929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ad50c-cd11-4198-83aa-1a5cc9fdd62e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:03.549032 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ad50c-cd11-4198-83aa-1a5cc9fdd62e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:03.563238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 326/645] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:43:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:03.563238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ad50c-cd11-4198-83aa-1a5cc9fdd62e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:03.606552 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d15f1-88e2-4f4f-9219-8fc4caab0d95 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:03.647024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b70957-0230-404a-bebf-660da7ad7044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:03.647688 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70957-0230-404a-bebf-660da7ad7044 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.647969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70957-0230-404a-bebf-660da7ad7044 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.648237 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70957-0230-404a-bebf-660da7ad7044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.649082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b70957-0230-404a-bebf-660da7ad7044 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=f7a7e57b60ef49a49da8dba370faec4c) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:03.649399 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b70957-0230-404a-bebf-660da7ad7044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:03.650865 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b70957-0230-404a-bebf-660da7ad7044 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:03.656839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 320/646] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:03 2022] GET /identity/v3/role_assignments?user.id=f7a7e57b60ef49a49da8dba370faec4c&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:03.657635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b70957-0230-404a-bebf-660da7ad7044 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:03.680210 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ad50c-cd11-4198-83aa-1a5cc9fdd62e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:03.721598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57f65e-e3a8-433b-8d8a-f582f9200b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:03.722725 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57f65e-e3a8-433b-8d8a-f582f9200b94 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.723156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57f65e-e3a8-433b-8d8a-f582f9200b94 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.723695 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57f65e-e3a8-433b-8d8a-f582f9200b94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.737097 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57f65e-e3a8-433b-8d8a-f582f9200b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:03.743381 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-6e57f65e-e3a8-433b-8d8a-f582f9200b94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:03.748118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:03.749358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:03.761295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:03.762489 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 327/647] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:43:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:03.763662 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57f65e-e3a8-433b-8d8a-f582f9200b94 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:03.794302 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b70957-0230-404a-bebf-660da7ad7044 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:03.828385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:03.844910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2236102-b47b-473e-a711-677bb582ec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:03.846087 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2236102-b47b-473e-a711-677bb582ec00 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.846630 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2236102-b47b-473e-a711-677bb582ec00 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.847348 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2236102-b47b-473e-a711-677bb582ec00 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.860982 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2236102-b47b-473e-a711-677bb582ec00 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:03.863483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2236102-b47b-473e-a711-677bb582ec00 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-a2236102-b47b-473e-a711-677bb582ec00 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:03.884580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:03.885806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:03.886974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:03.886974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:03.886974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:03.886974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:03.886974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:03.886974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:03.886974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:03.886974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:03.886974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:43:03.886974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:03.893707 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 321/648] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:43:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:03.893707 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2236102-b47b-473e-a711-677bb582ec00 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:03.903360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57f65e-e3a8-433b-8d8a-f582f9200b94 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:03.956048 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7faa4a-2e1e-409c-9865-118d8616b7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:03.956878 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7faa4a-2e1e-409c-9865-118d8616b7eb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.957262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7faa4a-2e1e-409c-9865-118d8616b7eb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.957539 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7faa4a-2e1e-409c-9865-118d8616b7eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.970562 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7faa4a-2e1e-409c-9865-118d8616b7eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:03.972070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7faa4a-2e1e-409c-9865-118d8616b7eb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-8d7faa4a-2e1e-409c-9865-118d8616b7eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:03.991661 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:03.992665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:03.993575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:03.993575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:03.993575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:03.993575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:03.993575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 328/649] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:03.993854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7faa4a-2e1e-409c-9865-118d8616b7eb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.038634 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2236102-b47b-473e-a711-677bb582ec00 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.067628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:04.080085 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58726246-8d15-43af-be24-e7fc1e4334f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.080773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58726246-8d15-43af-be24-e7fc1e4334f4 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.081132 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58726246-8d15-43af-be24-e7fc1e4334f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.081486 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58726246-8d15-43af-be24-e7fc1e4334f4 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.082327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58726246-8d15-43af-be24-e7fc1e4334f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:04.082726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58726246-8d15-43af-be24-e7fc1e4334f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.085041 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58726246-8d15-43af-be24-e7fc1e4334f4 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.096097 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 322/650] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:43:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:04.096940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58726246-8d15-43af-be24-e7fc1e4334f4 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.122817 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:04.126910 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7faa4a-2e1e-409c-9865-118d8616b7eb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.175868 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebbd1b-a90b-4aa5-b201-066aced2ea2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.176790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebbd1b-a90b-4aa5-b201-066aced2ea2f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.177077 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebbd1b-a90b-4aa5-b201-066aced2ea2f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.177956 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebbd1b-a90b-4aa5-b201-066aced2ea2f None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.178978 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebbd1b-a90b-4aa5-b201-066aced2ea2f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:04.179433 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebbd1b-a90b-4aa5-b201-066aced2ea2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.182301 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebbd1b-a90b-4aa5-b201-066aced2ea2f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.205687 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 329/651] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 19:43:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:04.207069 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebbd1b-a90b-4aa5-b201-066aced2ea2f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.221843 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58726246-8d15-43af-be24-e7fc1e4334f4 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.266535 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c67b6-829f-458e-9416-5c16e88d472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.267780 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c67b6-829f-458e-9416-5c16e88d472f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.268099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c67b6-829f-458e-9416-5c16e88d472f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.268707 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c67b6-829f-458e-9416-5c16e88d472f None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.269782 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c67b6-829f-458e-9416-5c16e88d472f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:04.270101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c67b6-829f-458e-9416-5c16e88d472f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.272068 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c67b6-829f-458e-9416-5c16e88d472f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.295460 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 323/652] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:04.295460 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c67b6-829f-458e-9416-5c16e88d472f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.347428 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebbd1b-a90b-4aa5-b201-066aced2ea2f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.371435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:04.386321 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576050f-bebf-4dd0-95b9-dc6d49b05601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.387562 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576050f-bebf-4dd0-95b9-dc6d49b05601 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.388013 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576050f-bebf-4dd0-95b9-dc6d49b05601 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.388526 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576050f-bebf-4dd0-95b9-dc6d49b05601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.400629 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576050f-bebf-4dd0-95b9-dc6d49b05601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.402170 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576050f-bebf-4dd0-95b9-dc6d49b05601 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-d576050f-bebf-4dd0-95b9-dc6d49b05601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:04.422176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:04.423194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:04.424119 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:04.424119 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:04.424119 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:04.424119 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:04.428100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 330/653] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:04.429020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576050f-bebf-4dd0-95b9-dc6d49b05601 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.442997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:04.445226 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c67b6-829f-458e-9416-5c16e88d472f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.484842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216dd45-24b6-489c-a2e8-9633e3ae4e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.485859 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216dd45-24b6-489c-a2e8-9633e3ae4e3f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.486352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216dd45-24b6-489c-a2e8-9633e3ae4e3f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.486900 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216dd45-24b6-489c-a2e8-9633e3ae4e3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.542133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576050f-bebf-4dd0-95b9-dc6d49b05601 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.574253 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216dd45-24b6-489c-a2e8-9633e3ae4e3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.576662 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216dd45-24b6-489c-a2e8-9633e3ae4e3f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.583994 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabb447-0135-45c6-97ee-31cd231cf51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.584792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb447-0135-45c6-97ee-31cd231cf51d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.585071 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb447-0135-45c6-97ee-31cd231cf51d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.585343 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb447-0135-45c6-97ee-31cd231cf51d None admin] PATH_INFO: `/v3/users/nova` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.593828 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabb447-0135-45c6-97ee-31cd231cf51d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.595364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabb447-0135-45c6-97ee-31cd231cf51d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-4eabb447-0135-45c6-97ee-31cd231cf51d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:04.611723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:04.612758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:04.613717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:04.613717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:04.613717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:04.613717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:04.613717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:04.613717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:04.613717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:04.613717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:04.613717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:43:04.613717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:04.617546 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 331/654] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:04.618407 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabb447-0135-45c6-97ee-31cd231cf51d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.640601 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:04.712830 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:04.723869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 324/655] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:04.725264 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216dd45-24b6-489c-a2e8-9633e3ae4e3f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.764248 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabb447-0135-45c6-97ee-31cd231cf51d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.822568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6a005-b42b-4681-a743-e46c23700421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.823666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6a005-b42b-4681-a743-e46c23700421 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.824126 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6a005-b42b-4681-a743-e46c23700421 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.824655 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6a005-b42b-4681-a743-e46c23700421 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.826457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6a005-b42b-4681-a743-e46c23700421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:04.827003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6a005-b42b-4681-a743-e46c23700421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.829431 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6a005-b42b-4681-a743-e46c23700421 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.849420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 332/656] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:04.857866 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6a005-b42b-4681-a743-e46c23700421 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.912079 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216dd45-24b6-489c-a2e8-9633e3ae4e3f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.976897 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19947d7e-c292-40ef-a367-28193247e3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.978118 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19947d7e-c292-40ef-a367-28193247e3f5 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.978644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19947d7e-c292-40ef-a367-28193247e3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.979095 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19947d7e-c292-40ef-a367-28193247e3f5 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.980838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19947d7e-c292-40ef-a367-28193247e3f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:04.981372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19947d7e-c292-40ef-a367-28193247e3f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.984021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19947d7e-c292-40ef-a367-28193247e3f5 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.027159 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 325/657] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:05.028764 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19947d7e-c292-40ef-a367-28193247e3f5 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.030405 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6a005-b42b-4681-a743-e46c23700421 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.033255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.089493 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88026e01-2085-4bc5-9b87-5dddcdea577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.091548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88026e01-2085-4bc5-9b87-5dddcdea577d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.092016 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88026e01-2085-4bc5-9b87-5dddcdea577d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.092474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88026e01-2085-4bc5-9b87-5dddcdea577d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.111342 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88026e01-2085-4bc5-9b87-5dddcdea577d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.113928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88026e01-2085-4bc5-9b87-5dddcdea577d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.114981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-88026e01-2085-4bc5-9b87-5dddcdea577d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:05.151609 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:05.154185 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:05.156974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:05.156974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:05.156974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:05.156974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:05.156974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 333/658] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:05.158635 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88026e01-2085-4bc5-9b87-5dddcdea577d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.186225 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19947d7e-c292-40ef-a367-28193247e3f5 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.223275 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d06d39-e413-4954-b91c-86f7ec2f3897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.224100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06d39-e413-4954-b91c-86f7ec2f3897 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.224347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06d39-e413-4954-b91c-86f7ec2f3897 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.224623 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06d39-e413-4954-b91c-86f7ec2f3897 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.240031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d06d39-e413-4954-b91c-86f7ec2f3897 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.241709 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d06d39-e413-4954-b91c-86f7ec2f3897 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-48d06d39-e413-4954-b91c-86f7ec2f3897 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:05.264314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:05.266286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 326/659] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:43:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:05.267869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d06d39-e413-4954-b91c-86f7ec2f3897 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.333188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88026e01-2085-4bc5-9b87-5dddcdea577d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.348262 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.380477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb355b-e908-41b5-9bd3-9668d6bc41d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.381383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb355b-e908-41b5-9bd3-9668d6bc41d7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.381735 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb355b-e908-41b5-9bd3-9668d6bc41d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.382088 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb355b-e908-41b5-9bd3-9668d6bc41d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.400796 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d06d39-e413-4954-b91c-86f7ec2f3897 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.447416 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.452621 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088599dc-95f2-4b6f-8079-10c09b9db3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.454045 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088599dc-95f2-4b6f-8079-10c09b9db3b1 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.454519 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088599dc-95f2-4b6f-8079-10c09b9db3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.455274 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088599dc-95f2-4b6f-8079-10c09b9db3b1 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.456483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088599dc-95f2-4b6f-8079-10c09b9db3b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:05.457291 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088599dc-95f2-4b6f-8079-10c09b9db3b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.459373 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088599dc-95f2-4b6f-8079-10c09b9db3b1 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.466376 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb355b-e908-41b5-9bd3-9668d6bc41d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.467929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb355b-e908-41b5-9bd3-9668d6bc41d7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.480192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 327/660] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:05.480192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088599dc-95f2-4b6f-8079-10c09b9db3b1 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.611899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 334/661] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:05.612763 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb355b-e908-41b5-9bd3-9668d6bc41d7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.613483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088599dc-95f2-4b6f-8079-10c09b9db3b1 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.645466 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.658544 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b9646-e9b4-42f9-9e96-901fd19330df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.659627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b9646-e9b4-42f9-9e96-901fd19330df None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.660108 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b9646-e9b4-42f9-9e96-901fd19330df None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.660580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b9646-e9b4-42f9-9e96-901fd19330df None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.661701 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b9646-e9b4-42f9-9e96-901fd19330df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:05.662200 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b9646-e9b4-42f9-9e96-901fd19330df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.664035 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b9646-e9b4-42f9-9e96-901fd19330df None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.685023 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 328/662] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 19:43:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:05.686178 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b9646-e9b4-42f9-9e96-901fd19330df None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.705109 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.724610 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb355b-e908-41b5-9bd3-9668d6bc41d7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.762713 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade75c6-8020-481b-b90f-65fc94023fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.763507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade75c6-8020-481b-b90f-65fc94023fb7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.763786 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade75c6-8020-481b-b90f-65fc94023fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.764057 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade75c6-8020-481b-b90f-65fc94023fb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.771536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade75c6-8020-481b-b90f-65fc94023fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.773007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade75c6-8020-481b-b90f-65fc94023fb7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-8ade75c6-8020-481b-b90f-65fc94023fb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:05.788563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:05.789494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:05.791056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:05.791056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:05.791056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:05.791056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:05.791056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:05.791056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:05.791056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:05.791056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:05.791502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b9646-e9b4-42f9-9e96-901fd19330df None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.791577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 335/663] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:05.791577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade75c6-8020-481b-b90f-65fc94023fb7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.827937 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc286d08-efa6-4751-bf19-48a9a4ebe8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.828756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286d08-efa6-4751-bf19-48a9a4ebe8df None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.829003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286d08-efa6-4751-bf19-48a9a4ebe8df None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.829279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286d08-efa6-4751-bf19-48a9a4ebe8df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.839654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc286d08-efa6-4751-bf19-48a9a4ebe8df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.841633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc286d08-efa6-4751-bf19-48a9a4ebe8df None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-fc286d08-efa6-4751-bf19-48a9a4ebe8df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:05.860403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:05.861336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:05.862295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:05.862295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:05.862295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:05.862295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:05.862295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 329/664] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:05.863174 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690aa3-ef84-4f78-9836-77409f2d4dc7 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.863174 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690aa3-ef84-4f78-9836-77409f2d4dc7 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.863411 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690aa3-ef84-4f78-9836-77409f2d4dc7 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.866733 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 330/665] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:05.866733 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c690aa3-ef84-4f78-9836-77409f2d4dc7 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.899879 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.900985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade75c6-8020-481b-b90f-65fc94023fb7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.938582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8902c64-25e1-41cf-a2b0-e6b1d12d8adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.939564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8902c64-25e1-41cf-a2b0-e6b1d12d8adc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.940001 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8902c64-25e1-41cf-a2b0-e6b1d12d8adc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.940420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8902c64-25e1-41cf-a2b0-e6b1d12d8adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.955425 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.979922 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c690aa3-ef84-4f78-9836-77409f2d4dc7 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:06.015301 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8902c64-25e1-41cf-a2b0-e6b1d12d8adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:06.015494 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ec5da-c724-4c6d-89b8-f189d57ffc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:06.015983 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ec5da-c724-4c6d-89b8-f189d57ffc03 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.016334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ec5da-c724-4c6d-89b8-f189d57ffc03 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.016612 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ec5da-c724-4c6d-89b8-f189d57ffc03 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.016830 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8902c64-25e1-41cf-a2b0-e6b1d12d8adc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:06.017401 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ec5da-c724-4c6d-89b8-f189d57ffc03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:06.017707 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ec5da-c724-4c6d-89b8-f189d57ffc03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:06.019135 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ec5da-c724-4c6d-89b8-f189d57ffc03 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:06.036330 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 331/666] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:06.036330 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ec5da-c724-4c6d-89b8-f189d57ffc03 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:06.136711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 336/667] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:06.138406 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f25d9-b555-4179-b623-4d56d815eba4 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.138726 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f25d9-b555-4179-b623-4d56d815eba4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.139004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f25d9-b555-4179-b623-4d56d815eba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.146507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:06.156147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-2f8f25d9-b555-4179-b623-4d56d815eba4 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:06.157533 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2f8f25d9-b555-4179-b623-4d56d815eba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:06.157652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ec5da-c724-4c6d-89b8-f189d57ffc03 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:06.195119 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:06.198660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193296b-8ed6-4e69-9f05-7dccdf10cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:06.199321 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193296b-8ed6-4e69-9f05-7dccdf10cfde None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.200175 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193296b-8ed6-4e69-9f05-7dccdf10cfde None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.200591 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193296b-8ed6-4e69-9f05-7dccdf10cfde None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.218670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193296b-8ed6-4e69-9f05-7dccdf10cfde None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:06.218670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193296b-8ed6-4e69-9f05-7dccdf10cfde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:06.218670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193296b-8ed6-4e69-9f05-7dccdf10cfde None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:06.218670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 332/668] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:06.218670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193296b-8ed6-4e69-9f05-7dccdf10cfde None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:06.230471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 337/669] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:06.232113 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923b505-3a6e-444d-9940-d70d7110a493 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.232580 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923b505-3a6e-444d-9940-d70d7110a493 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.233062 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923b505-3a6e-444d-9940-d70d7110a493 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.235056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 338/670] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:06.235855 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923b505-3a6e-444d-9940-d70d7110a493 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:06.330239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193296b-8ed6-4e69-9f05-7dccdf10cfde None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:06.352132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923b505-3a6e-444d-9940-d70d7110a493 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:06.363626 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5da3ac-0caf-49e8-ad9e-f0408a41ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:06.364277 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5da3ac-0caf-49e8-ad9e-f0408a41ee48 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.364561 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5da3ac-0caf-49e8-ad9e-f0408a41ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.364838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5da3ac-0caf-49e8-ad9e-f0408a41ee48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.365683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5da3ac-0caf-49e8-ad9e-f0408a41ee48 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=c9b1205c2ccb4c959e0b8302f3d2add4) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:06.366300 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5da3ac-0caf-49e8-ad9e-f0408a41ee48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:06.367466 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5da3ac-0caf-49e8-ad9e-f0408a41ee48 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:06.386682 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 333/671] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:06 2022] GET /identity/v3/role_assignments?user.id=c9b1205c2ccb4c959e0b8302f3d2add4&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:06.386682 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5da3ac-0caf-49e8-ad9e-f0408a41ee48 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:06.389608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90babf-6592-4af3-85e2-6915378dc09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:06.390431 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90babf-6592-4af3-85e2-6915378dc09a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.390740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90babf-6592-4af3-85e2-6915378dc09a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.391016 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90babf-6592-4af3-85e2-6915378dc09a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.398840 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:06.402722 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90babf-6592-4af3-85e2-6915378dc09a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:06.405479 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90babf-6592-4af3-85e2-6915378dc09a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-1b90babf-6592-4af3-85e2-6915378dc09a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:06.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:06.428139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:06.429073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:06.429073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:06.429073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:06.429073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:06.429073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 339/672] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:06.429955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640412a-e1d1-421f-bc75-af9c0684d716 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.430394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640412a-e1d1-421f-bc75-af9c0684d716 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.430504 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640412a-e1d1-421f-bc75-af9c0684d716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.450539 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-2640412a-e1d1-421f-bc75-af9c0684d716 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:06.451790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2640412a-e1d1-421f-bc75-af9c0684d716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:06.473890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:06.498722 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5da3ac-0caf-49e8-ad9e-f0408a41ee48 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:06.537327 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 340/673] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:06.537327 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640412a-e1d1-421f-bc75-af9c0684d716 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:06.550116 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d09bd5-63e3-4059-afeb-f6d09e310809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:06.551268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d09bd5-63e3-4059-afeb-f6d09e310809 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.551876 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d09bd5-63e3-4059-afeb-f6d09e310809 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.552165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d09bd5-63e3-4059-afeb-f6d09e310809 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.561175 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d09bd5-63e3-4059-afeb-f6d09e310809 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:06.562903 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d09bd5-63e3-4059-afeb-f6d09e310809 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-32d09bd5-63e3-4059-afeb-f6d09e310809 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:06.578738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:06.579697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:06.580680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:06.580680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:06.580680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:06.580680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:06.580680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:06.580680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:06.580680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:06.580680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:06.580680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 334/674] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:06.581168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d09bd5-63e3-4059-afeb-f6d09e310809 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:06.674129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:06.699284 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d09bd5-63e3-4059-afeb-f6d09e310809 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:06.738898 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8efeb2-3380-4b99-a851-3c2ec1693169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:06.739521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efeb2-3380-4b99-a851-3c2ec1693169 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.739812 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efeb2-3380-4b99-a851-3c2ec1693169 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.740095 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efeb2-3380-4b99-a851-3c2ec1693169 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.740840 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8efeb2-3380-4b99-a851-3c2ec1693169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:06.741152 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8efeb2-3380-4b99-a851-3c2ec1693169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:06.742526 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8efeb2-3380-4b99-a851-3c2ec1693169 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:06.755342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 335/675] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:06.756160 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8efeb2-3380-4b99-a851-3c2ec1693169 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:06.781087 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640412a-e1d1-421f-bc75-af9c0684d716 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:06.821526 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171252b-eaff-417d-bcae-ff80e9d10e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:06.822579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171252b-eaff-417d-bcae-ff80e9d10e39 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.823031 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171252b-eaff-417d-bcae-ff80e9d10e39 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.823526 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171252b-eaff-417d-bcae-ff80e9d10e39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.835045 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171252b-eaff-417d-bcae-ff80e9d10e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-e171252b-eaff-417d-bcae-ff80e9d10e39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:06.843606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:06.844706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:06.845582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:06.846219 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 341/676] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:43:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:06.846726 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171252b-eaff-417d-bcae-ff80e9d10e39 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:06.865410 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8efeb2-3380-4b99-a851-3c2ec1693169 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:06.866577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:06.901933 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddff1e-0239-4ffa-b317-5d034ab99134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:06.903326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddff1e-0239-4ffa-b317-5d034ab99134 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.903695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddff1e-0239-4ffa-b317-5d034ab99134 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.904006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddff1e-0239-4ffa-b317-5d034ab99134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.907167 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:06.915649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddff1e-0239-4ffa-b317-5d034ab99134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:06.917126 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddff1e-0239-4ffa-b317-5d034ab99134 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-e4ddff1e-0239-4ffa-b317-5d034ab99134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:06.936635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:06.937604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:06.938522 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:06.938522 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:06.938522 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:06.938522 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:06.938522 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 336/677] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:06.939503 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddff1e-0239-4ffa-b317-5d034ab99134 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:06.983769 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171252b-eaff-417d-bcae-ff80e9d10e39 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:07.019914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4d290-26df-42e5-a5fe-6f83966aeb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:07.020497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4d290-26df-42e5-a5fe-6f83966aeb89 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.020787 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4d290-26df-42e5-a5fe-6f83966aeb89 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.021061 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4d290-26df-42e5-a5fe-6f83966aeb89 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.021868 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4d290-26df-42e5-a5fe-6f83966aeb89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:07.022179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4d290-26df-42e5-a5fe-6f83966aeb89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:07.023654 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4d290-26df-42e5-a5fe-6f83966aeb89 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:07.041150 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 342/678] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:07.041150 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4d290-26df-42e5-a5fe-6f83966aeb89 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:07.059629 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddff1e-0239-4ffa-b317-5d034ab99134 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:07.094013 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d41f-ed22-46bb-ac2f-1e48f47980d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:07.094892 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d41f-ed22-46bb-ac2f-1e48f47980d9 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.095176 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d41f-ed22-46bb-ac2f-1e48f47980d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.095452 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d41f-ed22-46bb-ac2f-1e48f47980d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.102363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387d41f-ed22-46bb-ac2f-1e48f47980d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:07.103846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387d41f-ed22-46bb-ac2f-1e48f47980d9 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-b387d41f-ed22-46bb-ac2f-1e48f47980d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:07.117766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:07.118750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:07.125201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:07.125201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:07.125201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:07.125201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:07.125201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:07.125201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:07.125201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:07.125201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:07.125201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 337/679] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:07.125201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d41f-ed22-46bb-ac2f-1e48f47980d9 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:07.126799 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:07.158570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4d290-26df-42e5-a5fe-6f83966aeb89 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:07.172741 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:07.200886 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834fe31-d856-4d2a-a041-1ee5f07dcd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:07.201560 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834fe31-d856-4d2a-a041-1ee5f07dcd15 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.201852 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834fe31-d856-4d2a-a041-1ee5f07dcd15 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.202133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834fe31-d856-4d2a-a041-1ee5f07dcd15 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.202923 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834fe31-d856-4d2a-a041-1ee5f07dcd15 None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:07.203231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834fe31-d856-4d2a-a041-1ee5f07dcd15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:07.204624 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834fe31-d856-4d2a-a041-1ee5f07dcd15 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:07.214253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 343/680] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:43:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:07.215246 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834fe31-d856-4d2a-a041-1ee5f07dcd15 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:07.238137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d41f-ed22-46bb-ac2f-1e48f47980d9 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:07.275334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55932cb9-def8-421b-a062-31abef673b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:07.275917 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55932cb9-def8-421b-a062-31abef673b36 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.276231 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55932cb9-def8-421b-a062-31abef673b36 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.276474 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55932cb9-def8-421b-a062-31abef673b36 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.277205 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55932cb9-def8-421b-a062-31abef673b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:07.277556 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55932cb9-def8-421b-a062-31abef673b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:07.279002 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55932cb9-def8-421b-a062-31abef673b36 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:07.295093 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 338/681] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:07.295948 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55932cb9-def8-421b-a062-31abef673b36 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:07.330394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834fe31-d856-4d2a-a041-1ee5f07dcd15 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:07.366204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562a224-2bf1-493e-8013-6702a836c458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:07.367152 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562a224-2bf1-493e-8013-6702a836c458 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.367594 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562a224-2bf1-493e-8013-6702a836c458 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.368019 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562a224-2bf1-493e-8013-6702a836c458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.368987 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562a224-2bf1-493e-8013-6702a836c458 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:07.369464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562a224-2bf1-493e-8013-6702a836c458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:07.370933 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562a224-2bf1-493e-8013-6702a836c458 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:07.375406 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:07.388017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 344/682] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:07 2022] GET /identity/v3/role_assignments?user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:07.388017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562a224-2bf1-493e-8013-6702a836c458 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:07.419459 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55932cb9-def8-421b-a062-31abef673b36 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:07.430970 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:07.460358 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cbceb-fbc1-4aae-8c7c-e1965accca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:07.461028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cbceb-fbc1-4aae-8c7c-e1965accca38 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.461310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cbceb-fbc1-4aae-8c7c-e1965accca38 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.461585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cbceb-fbc1-4aae-8c7c-e1965accca38 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.462395 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cbceb-fbc1-4aae-8c7c-e1965accca38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:07.462842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cbceb-fbc1-4aae-8c7c-e1965accca38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:07.464315 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cbceb-fbc1-4aae-8c7c-e1965accca38 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:07.477977 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 339/683] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:07.479113 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cbceb-fbc1-4aae-8c7c-e1965accca38 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:07.512073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562a224-2bf1-493e-8013-6702a836c458 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:07.551008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9684e-bc7f-4964-8935-dc58484518a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:07.551744 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9684e-bc7f-4964-8935-dc58484518a8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.552035 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9684e-bc7f-4964-8935-dc58484518a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.552314 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9684e-bc7f-4964-8935-dc58484518a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.566199 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9684e-bc7f-4964-8935-dc58484518a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:07.567722 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9684e-bc7f-4964-8935-dc58484518a8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b1e9684e-bc7f-4964-8935-dc58484518a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:07.587242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:07.589002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:07.590879 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:07.590879 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:07.590879 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:07.590879 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:07.590879 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 345/684] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:07.590879 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9684e-bc7f-4964-8935-dc58484518a8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:07.602821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cbceb-fbc1-4aae-8c7c-e1965accca38 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:07.655141 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e648a4-5cbe-48d1-8492-209c0e6e3659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:07.655989 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e648a4-5cbe-48d1-8492-209c0e6e3659 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.656375 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e648a4-5cbe-48d1-8492-209c0e6e3659 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.656755 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e648a4-5cbe-48d1-8492-209c0e6e3659 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.657791 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e648a4-5cbe-48d1-8492-209c0e6e3659 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:07.659332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e648a4-5cbe-48d1-8492-209c0e6e3659 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:07.669664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:07.725459 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9684e-bc7f-4964-8935-dc58484518a8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:07.746000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 340/685] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:43:07 2022] POST /identity/v3/users => generated 254 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:07.749296 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e648a4-5cbe-48d1-8492-209c0e6e3659 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:07.780760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:07.800368 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe41cb3-8ecf-4e0d-899a-5d303f4d8717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:07.801098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe41cb3-8ecf-4e0d-899a-5d303f4d8717 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.801330 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe41cb3-8ecf-4e0d-899a-5d303f4d8717 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.801604 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe41cb3-8ecf-4e0d-899a-5d303f4d8717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.805886 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe41cb3-8ecf-4e0d-899a-5d303f4d8717 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=096d4037981e4bd488e30d43485579bb) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:07.806215 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe41cb3-8ecf-4e0d-899a-5d303f4d8717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:07.808017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe41cb3-8ecf-4e0d-899a-5d303f4d8717 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:07.821954 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 346/686] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:07 2022] GET /identity/v3/role_assignments?user.id=096d4037981e4bd488e30d43485579bb&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:07.929779 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e648a4-5cbe-48d1-8492-209c0e6e3659 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:07.981706 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee526a4-673b-430f-95fa-abb3fe5164ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:07.982395 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee526a4-673b-430f-95fa-abb3fe5164ef None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.982704 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee526a4-673b-430f-95fa-abb3fe5164ef None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.982981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee526a4-673b-430f-95fa-abb3fe5164ef None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.983745 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee526a4-673b-430f-95fa-abb3fe5164ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:07.984053 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee526a4-673b-430f-95fa-abb3fe5164ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:07.985494 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee526a4-673b-430f-95fa-abb3fe5164ef None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:08.006295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 341/687] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:08.012570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe41cb3-8ecf-4e0d-899a-5d303f4d8717 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:08.135018 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe41cb3-8ecf-4e0d-899a-5d303f4d8717 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:08.153309 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:08.172606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa949e-df7b-4560-9ca4-97b74e918bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:08.173407 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa949e-df7b-4560-9ca4-97b74e918bf8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.182751 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa949e-df7b-4560-9ca4-97b74e918bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.182751 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa949e-df7b-4560-9ca4-97b74e918bf8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.182751 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa949e-df7b-4560-9ca4-97b74e918bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:08.184577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa949e-df7b-4560-9ca4-97b74e918bf8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-23fa949e-df7b-4560-9ca4-97b74e918bf8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:08.199464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:08.200543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:08.201501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:08.201501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:08.201501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:08.201501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:08.201501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:08.201501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:08.201501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:08.201501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:08.201501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:43:08.201501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:08.201501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 347/688] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:43:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:08.209033 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee526a4-673b-430f-95fa-abb3fe5164ef None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:08.301378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:08.319152 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee526a4-673b-430f-95fa-abb3fe5164ef None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:08.356352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87f9e5-63d8-4c01-8095-e86f8b46cd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:08.357022 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87f9e5-63d8-4c01-8095-e86f8b46cd89 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.357307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87f9e5-63d8-4c01-8095-e86f8b46cd89 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.357581 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87f9e5-63d8-4c01-8095-e86f8b46cd89 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.358434 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87f9e5-63d8-4c01-8095-e86f8b46cd89 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:08.358779 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87f9e5-63d8-4c01-8095-e86f8b46cd89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:08.360215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87f9e5-63d8-4c01-8095-e86f8b46cd89 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:08.379891 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 342/689] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 19:43:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:08.387841 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa949e-df7b-4560-9ca4-97b74e918bf8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:08.523386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa949e-df7b-4560-9ca4-97b74e918bf8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:08.591745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090fd91-ea2d-4874-93ad-72c30601838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:08.592600 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090fd91-ea2d-4874-93ad-72c30601838c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.592891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090fd91-ea2d-4874-93ad-72c30601838c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.593174 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090fd91-ea2d-4874-93ad-72c30601838c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.659868 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:08.689115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090fd91-ea2d-4874-93ad-72c30601838c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:08.690622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090fd91-ea2d-4874-93ad-72c30601838c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:08.808655 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 348/690] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:08.814746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87f9e5-63d8-4c01-8095-e86f8b46cd89 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:08.954900 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133537eb-469c-489e-aa74-ef1e039562cb None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.955259 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133537eb-469c-489e-aa74-ef1e039562cb None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.955381 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133537eb-469c-489e-aa74-ef1e039562cb None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.960493 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 349/691] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:08.962754 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3fbf-73f9-4a2c-b12f-0687af45bc7e None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.962754 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3fbf-73f9-4a2c-b12f-0687af45bc7e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.964571 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3fbf-73f9-4a2c-b12f-0687af45bc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.966152 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87f9e5-63d8-4c01-8095-e86f8b46cd89 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:08.995905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b9eb3fbf-73f9-4a2c-b12f-0687af45bc7e None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:08.998723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b9eb3fbf-73f9-4a2c-b12f-0687af45bc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:09.011208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943433a-d8eb-4157-b1ab-291669815442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:09.012039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943433a-d8eb-4157-b1ab-291669815442 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:09.012325 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943433a-d8eb-4157-b1ab-291669815442 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:09.012600 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943433a-d8eb-4157-b1ab-291669815442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:09.030199 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943433a-d8eb-4157-b1ab-291669815442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:09.031669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943433a-d8eb-4157-b1ab-291669815442 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:09.033457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-a943433a-d8eb-4157-b1ab-291669815442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:09.051409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:09.052363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:09.053310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:09.053310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:09.053310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:09.053310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:09.053310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 343/692] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:09.061125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943433a-d8eb-4157-b1ab-291669815442 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:09.136705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 350/693] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:09.171200 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb3fbf-73f9-4a2c-b12f-0687af45bc7e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:09.179313 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:09.197756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943433a-d8eb-4157-b1ab-291669815442 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:09.236478 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1f264-2ef8-4fc4-88c6-273a2b20fc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:09.237158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f264-2ef8-4fc4-88c6-273a2b20fc11 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:09.237454 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f264-2ef8-4fc4-88c6-273a2b20fc11 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:09.237739 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f264-2ef8-4fc4-88c6-273a2b20fc11 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:09.238478 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1f264-2ef8-4fc4-88c6-273a2b20fc11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:09.238818 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1f264-2ef8-4fc4-88c6-273a2b20fc11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:09.240303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1f264-2ef8-4fc4-88c6-273a2b20fc11 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:09.254003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 344/694] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:09.261255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1f264-2ef8-4fc4-88c6-273a2b20fc11 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:09.326552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb3fbf-73f9-4a2c-b12f-0687af45bc7e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:09.344691 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:09.363929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c8de6-e6e2-443c-a9cf-1197692b5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:09.364745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c8de6-e6e2-443c-a9cf-1197692b5ef4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:09.365032 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c8de6-e6e2-443c-a9cf-1197692b5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:09.365311 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c8de6-e6e2-443c-a9cf-1197692b5ef4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:09.365974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c8de6-e6e2-443c-a9cf-1197692b5ef4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:09.367394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c8de6-e6e2-443c-a9cf-1197692b5ef4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-2a5c8de6-e6e2-443c-a9cf-1197692b5ef4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:09.382085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:09.383143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:43:09.383999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:09.392151 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 351/695] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 19:43:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:09.393701 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1f264-2ef8-4fc4-88c6-273a2b20fc11 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:09.397846 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c8de6-e6e2-443c-a9cf-1197692b5ef4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:09.451738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02887043-46df-4c65-99fe-58d804235f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:09.452536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02887043-46df-4c65-99fe-58d804235f72 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:09.452816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02887043-46df-4c65-99fe-58d804235f72 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:09.453093 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02887043-46df-4c65-99fe-58d804235f72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:09.470231 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02887043-46df-4c65-99fe-58d804235f72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:09.471705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02887043-46df-4c65-99fe-58d804235f72 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:09.477771 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-02887043-46df-4c65-99fe-58d804235f72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:09.503751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:09.505811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:09.507953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:09.507953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:09.507953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:09.507953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:09.507953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:09.507953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:09.507953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:09.507953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:09.507953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 345/696] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:09.513608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c8de6-e6e2-443c-a9cf-1197692b5ef4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:09.516139 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02887043-46df-4c65-99fe-58d804235f72 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:09.551425 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132d12b-1d58-40b6-98bc-7385bbac0e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:09.552152 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132d12b-1d58-40b6-98bc-7385bbac0e60 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:09.552445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132d12b-1d58-40b6-98bc-7385bbac0e60 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:09.552725 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132d12b-1d58-40b6-98bc-7385bbac0e60 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:09.553449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132d12b-1d58-40b6-98bc-7385bbac0e60 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:09.553760 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132d12b-1d58-40b6-98bc-7385bbac0e60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:09.555262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132d12b-1d58-40b6-98bc-7385bbac0e60 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:09.561067 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 352/697] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 19:43:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:09.566073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132d12b-1d58-40b6-98bc-7385bbac0e60 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:09.693569 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132d12b-1d58-40b6-98bc-7385bbac0e60 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:09.738824 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b36a45-ee1f-4a97-b138-5e928ccde4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:09.739499 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b36a45-ee1f-4a97-b138-5e928ccde4b5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:09.739787 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b36a45-ee1f-4a97-b138-5e928ccde4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:09.740067 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b36a45-ee1f-4a97-b138-5e928ccde4b5 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:09.740784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b36a45-ee1f-4a97-b138-5e928ccde4b5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:09.741095 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b36a45-ee1f-4a97-b138-5e928ccde4b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:09.742504 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b36a45-ee1f-4a97-b138-5e928ccde4b5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:09.751423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:09.762842 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 353/698] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 19:43:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:09.768128 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02887043-46df-4c65-99fe-58d804235f72 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:09.785995 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:09.814105 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903f94b-7dab-4d24-903e-d84b1e7224ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:09.814808 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903f94b-7dab-4d24-903e-d84b1e7224ac None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:09.815412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903f94b-7dab-4d24-903e-d84b1e7224ac None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:09.815412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903f94b-7dab-4d24-903e-d84b1e7224ac None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:09.816161 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903f94b-7dab-4d24-903e-d84b1e7224ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:09.816530 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903f94b-7dab-4d24-903e-d84b1e7224ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:09.818030 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903f94b-7dab-4d24-903e-d84b1e7224ac None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:09.836191 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 346/699] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:09.843356 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b36a45-ee1f-4a97-b138-5e928ccde4b5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:10.010596 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b36a45-ee1f-4a97-b138-5e928ccde4b5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:10.062259 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5b5a9-759d-48bf-b3bf-47f5300dc901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:10.063291 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5b5a9-759d-48bf-b3bf-47f5300dc901 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:10.063779 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5b5a9-759d-48bf-b3bf-47f5300dc901 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:10.064260 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5b5a9-759d-48bf-b3bf-47f5300dc901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:10.065644 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5b5a9-759d-48bf-b3bf-47f5300dc901 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=4741a268ae704e9582c1bb72f9c425a9) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:10.066182 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5b5a9-759d-48bf-b3bf-47f5300dc901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:10.066469 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1e6d-3daa-4622-a5c7-d3ddc0ae228f None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:10.066808 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1e6d-3daa-4622-a5c7-d3ddc0ae228f None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:10.067089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb1e6d-3daa-4622-a5c7-d3ddc0ae228f None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:10.068570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5b5a9-759d-48bf-b3bf-47f5300dc901 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:10.068769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 347/700] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:10.075514 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac5f05-5468-4f5e-82bf-c062f22b522e None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:10.075794 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac5f05-5468-4f5e-82bf-c062f22b522e None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:10.076077 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac5f05-5468-4f5e-82bf-c062f22b522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:10.081694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 354/701] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:09 2022] GET /identity/v3/role_assignments?user.id=4741a268ae704e9582c1bb72f9c425a9&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:10.097773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-2bac5f05-5468-4f5e-82bf-c062f22b522e None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:10.099044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-2bac5f05-5468-4f5e-82bf-c062f22b522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:10.177837 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 348/702] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:10.211101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5b5a9-759d-48bf-b3bf-47f5300dc901 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:10.292937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:10.339224 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5b5a9-759d-48bf-b3bf-47f5300dc901 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:10.380468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4414298-e55f-47a2-a544-fe68fd9bb70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:10.381281 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414298-e55f-47a2-a544-fe68fd9bb70a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:10.381570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414298-e55f-47a2-a544-fe68fd9bb70a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:10.381851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414298-e55f-47a2-a544-fe68fd9bb70a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:10.393927 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4414298-e55f-47a2-a544-fe68fd9bb70a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a4414298-e55f-47a2-a544-fe68fd9bb70a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:10.401656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:10.402683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:10.403584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 355/703] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:43:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:10.411083 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac5f05-5468-4f5e-82bf-c062f22b522e None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:10.523995 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac5f05-5468-4f5e-82bf-c062f22b522e None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:10.526546 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:10.566573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c5eb-7542-4d24-9b26-36dba2013725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:10.567368 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c5eb-7542-4d24-9b26-36dba2013725 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:10.567654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c5eb-7542-4d24-9b26-36dba2013725 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:10.567929 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c5eb-7542-4d24-9b26-36dba2013725 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:10.568717 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0c5eb-7542-4d24-9b26-36dba2013725 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:10.569033 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0c5eb-7542-4d24-9b26-36dba2013725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:10.570445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0c5eb-7542-4d24-9b26-36dba2013725 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:10.580206 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 349/704] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:43:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:10.585650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4414298-e55f-47a2-a544-fe68fd9bb70a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:10.698166 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4414298-e55f-47a2-a544-fe68fd9bb70a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:10.726171 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:10.744080 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa103946-6358-4174-bd9a-fc3892761d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:10.744961 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa103946-6358-4174-bd9a-fc3892761d31 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:10.745247 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa103946-6358-4174-bd9a-fc3892761d31 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:10.745526 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa103946-6358-4174-bd9a-fc3892761d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:10.752075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda89854-82d5-46e4-ba37-b7059234104e None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:10.752399 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda89854-82d5-46e4-ba37-b7059234104e None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:10.752639 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda89854-82d5-46e4-ba37-b7059234104e None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:10.754377 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 350/705] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:10.760501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa103946-6358-4174-bd9a-fc3892761d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:10.762091 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa103946-6358-4174-bd9a-fc3892761d31 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:10.763150 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3b0ee-a404-41c6-b941-2047864dcb84 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:10.763444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3b0ee-a404-41c6-b941-2047864dcb84 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:10.763728 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3b0ee-a404-41c6-b941-2047864dcb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-aa103946-6358-4174-bd9a-fc3892761d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:10.782020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:10.784114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:10.785379 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:10.785379 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:10.785379 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:10.785379 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:10.785379 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 356/706] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:10.791227 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa103946-6358-4174-bd9a-fc3892761d31 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:10.796166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-20d3b0ee-a404-41c6-b941-2047864dcb84 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:10.797346 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-20d3b0ee-a404-41c6-b941-2047864dcb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:10.924215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 351/707] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:10.938423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa103946-6358-4174-bd9a-fc3892761d31 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:10.948725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334de43-e6fe-4c52-8b1c-b3378f0810ea None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:10.948725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334de43-e6fe-4c52-8b1c-b3378f0810ea None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:10.948725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334de43-e6fe-4c52-8b1c-b3378f0810ea None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:10.949366 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 352/708] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:10.950216 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334de43-e6fe-4c52-8b1c-b3378f0810ea None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:10.980409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983e54d-62c7-4c11-8d1a-f2a12017d8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:10.981647 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983e54d-62c7-4c11-8d1a-f2a12017d8ae None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:10.981931 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983e54d-62c7-4c11-8d1a-f2a12017d8ae None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:10.982204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983e54d-62c7-4c11-8d1a-f2a12017d8ae None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:10.982957 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983e54d-62c7-4c11-8d1a-f2a12017d8ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:10.983266 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983e54d-62c7-4c11-8d1a-f2a12017d8ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:10.984651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983e54d-62c7-4c11-8d1a-f2a12017d8ae None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:10.997396 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 357/709] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:10.999055 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e63867-affc-4e1e-b481-59690f95959a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:10.999508 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e63867-affc-4e1e-b481-59690f95959a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:10.999965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e63867-affc-4e1e-b481-59690f95959a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.025802 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b5e63867-affc-4e1e-b481-59690f95959a None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:11.027988 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b5e63867-affc-4e1e-b481-59690f95959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:11.065909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:11.067402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:11.073559 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334de43-e6fe-4c52-8b1c-b3378f0810ea None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:11.110413 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48284c-962a-4412-a5ce-3d147c3e2f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:11.111693 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48284c-962a-4412-a5ce-3d147c3e2f59 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.112177 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48284c-962a-4412-a5ce-3d147c3e2f59 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.112632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48284c-962a-4412-a5ce-3d147c3e2f59 None admin] PATH_INFO: `/v3/services/network` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.113497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48284c-962a-4412-a5ce-3d147c3e2f59 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:11.115092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48284c-962a-4412-a5ce-3d147c3e2f59 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-dc48284c-962a-4412-a5ce-3d147c3e2f59 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:11.130548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:11.131628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:43:11.132497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:11.133247 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 358/710] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:11.133247 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e63867-affc-4e1e-b481-59690f95959a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:11.135609 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 353/711] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:10 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:11.145247 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48284c-962a-4412-a5ce-3d147c3e2f59 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:11.259877 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e63867-affc-4e1e-b481-59690f95959a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:11.274887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48284c-962a-4412-a5ce-3d147c3e2f59 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:11.298992 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752401d-097c-433a-ad21-a32c46be9dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:11.300012 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752401d-097c-433a-ad21-a32c46be9dad None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.300444 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752401d-097c-433a-ad21-a32c46be9dad None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.300862 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752401d-097c-433a-ad21-a32c46be9dad None admin] PATH_INFO: `/v3/users/nova` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.309132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752401d-097c-433a-ad21-a32c46be9dad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:11.310809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752401d-097c-433a-ad21-a32c46be9dad None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c752401d-097c-433a-ad21-a32c46be9dad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:11.327475 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:11.328685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:11.329664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:11.329664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:11.329664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:11.329664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:11.329664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:11.329664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:11.329664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:11.329664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:11.329664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:43:11.329664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:11.330211 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2fe25-2d3d-4def-99b0-df4d4034dc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:11.330211 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2fe25-2d3d-4def-99b0-df4d4034dc8c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.330211 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2fe25-2d3d-4def-99b0-df4d4034dc8c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.330432 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2fe25-2d3d-4def-99b0-df4d4034dc8c None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.331052 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2fe25-2d3d-4def-99b0-df4d4034dc8c None admin] RBAC: Adding query filter params (name=network) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:11.331363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2fe25-2d3d-4def-99b0-df4d4034dc8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:11.332562 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 359/712] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 19:43:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:11.333650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752401d-097c-433a-ad21-a32c46be9dad None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:11.335272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2fe25-2d3d-4def-99b0-df4d4034dc8c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:11.346328 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 354/713] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:11.347554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2fe25-2d3d-4def-99b0-df4d4034dc8c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:11.368709 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:11.375649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:11.459804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2fe25-2d3d-4def-99b0-df4d4034dc8c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:11.473111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752401d-097c-433a-ad21-a32c46be9dad None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:11.501517 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2266ec-c81b-434a-a8e2-4b4141d61875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:11.502630 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2266ec-c81b-434a-a8e2-4b4141d61875 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.502923 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2266ec-c81b-434a-a8e2-4b4141d61875 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.503199 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2266ec-c81b-434a-a8e2-4b4141d61875 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.504337 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2266ec-c81b-434a-a8e2-4b4141d61875 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:11.504656 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2266ec-c81b-434a-a8e2-4b4141d61875 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:11.506785 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2266ec-c81b-434a-a8e2-4b4141d61875 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:11.515585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7688d0-4638-4d74-ba6d-7df6f07a71f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:11.516668 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7688d0-4638-4d74-ba6d-7df6f07a71f9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.517220 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7688d0-4638-4d74-ba6d-7df6f07a71f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.517787 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7688d0-4638-4d74-ba6d-7df6f07a71f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.528888 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 355/714] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 19:43:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:11.533875 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2266ec-c81b-434a-a8e2-4b4141d61875 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:11.535234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7688d0-4638-4d74-ba6d-7df6f07a71f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7d7688d0-4638-4d74-ba6d-7df6f07a71f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:11.545474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:11.546573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:11.547492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:11.553515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 360/715] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:43:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:11.553515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7688d0-4638-4d74-ba6d-7df6f07a71f9 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:11.624797 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:11.649402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2266ec-c81b-434a-a8e2-4b4141d61875 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:11.663772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:11.680991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7688d0-4638-4d74-ba6d-7df6f07a71f9 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:11.706110 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1343962-a702-4867-b18f-bc09116a5452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:11.707891 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1343962-a702-4867-b18f-bc09116a5452 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.708785 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1343962-a702-4867-b18f-bc09116a5452 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.710192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1343962-a702-4867-b18f-bc09116a5452 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.712075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1343962-a702-4867-b18f-bc09116a5452 None admin] RBAC: Adding query filter params (type=network) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:11.713560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1343962-a702-4867-b18f-bc09116a5452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:11.717179 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1343962-a702-4867-b18f-bc09116a5452 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:11.722186 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e196363-dc5d-4439-b1ca-883ad316f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:11.723121 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e196363-dc5d-4439-b1ca-883ad316f0af None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.723463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e196363-dc5d-4439-b1ca-883ad316f0af None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.723845 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e196363-dc5d-4439-b1ca-883ad316f0af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.729765 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 356/716] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:11.731440 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1343962-a702-4867-b18f-bc09116a5452 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:11.853162 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e196363-dc5d-4439-b1ca-883ad316f0af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:11.854576 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e196363-dc5d-4439-b1ca-883ad316f0af None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:11.947190 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1343962-a702-4867-b18f-bc09116a5452 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:11.963537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 361/717] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:11.964056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:11.970387 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e196363-dc5d-4439-b1ca-883ad316f0af None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:11.984396 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6bddf-4c78-4e8b-a6d7-60eed4ef1dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:11.985064 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bddf-4c78-4e8b-a6d7-60eed4ef1dd0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.987307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bddf-4c78-4e8b-a6d7-60eed4ef1dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.987307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bddf-4c78-4e8b-a6d7-60eed4ef1dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.987307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6bddf-4c78-4e8b-a6d7-60eed4ef1dd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:11.987307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6bddf-4c78-4e8b-a6d7-60eed4ef1dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:11.988205 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6bddf-4c78-4e8b-a6d7-60eed4ef1dd0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:11.997843 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 357/718] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:43:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:12.003298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6bddf-4c78-4e8b-a6d7-60eed4ef1dd0 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:12.018631 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:12.088995 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e196363-dc5d-4439-b1ca-883ad316f0af None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:12.126694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2eb0a-782a-4ed9-af2c-794e609e061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:12.127997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2eb0a-782a-4ed9-af2c-794e609e061c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:12.128497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2eb0a-782a-4ed9-af2c-794e609e061c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:12.128956 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2eb0a-782a-4ed9-af2c-794e609e061c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:12.133605 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6bddf-4c78-4e8b-a6d7-60eed4ef1dd0 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:12.141548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2eb0a-782a-4ed9-af2c-794e609e061c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:12.143413 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2eb0a-782a-4ed9-af2c-794e609e061c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:12.173187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60521075-ae13-4807-8344-edfedb034489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:12.174064 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60521075-ae13-4807-8344-edfedb034489 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:12.174449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60521075-ae13-4807-8344-edfedb034489 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:12.174828 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60521075-ae13-4807-8344-edfedb034489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-69a2eb0a-782a-4ed9-af2c-794e609e061c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:12.183743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:12.184660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:12.185614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:12.185614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:12.185614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:12.185614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:12.186795 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60521075-ae13-4807-8344-edfedb034489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:12.187957 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 362/719] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:12.190379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60521075-ae13-4807-8344-edfedb034489 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:12.193118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2eb0a-782a-4ed9-af2c-794e609e061c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-60521075-ae13-4807-8344-edfedb034489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:12.209235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:12.210446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:12.211636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:12.211636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:12.211636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:12.211636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:12.213219 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 358/720] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:12.220375 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60521075-ae13-4807-8344-edfedb034489 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:12.254975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:12.332619 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2eb0a-782a-4ed9-af2c-794e609e061c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:12.377042 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad377-54b2-460e-b67d-e5cb04cd03a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:12.377591 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:12.377930 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad377-54b2-460e-b67d-e5cb04cd03a8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:12.378263 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad377-54b2-460e-b67d-e5cb04cd03a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:12.378829 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad377-54b2-460e-b67d-e5cb04cd03a8 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:12.381148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ad377-54b2-460e-b67d-e5cb04cd03a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:12.381148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ad377-54b2-460e-b67d-e5cb04cd03a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:12.382140 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ad377-54b2-460e-b67d-e5cb04cd03a8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:12.397654 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 363/721] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:12.404949 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad377-54b2-460e-b67d-e5cb04cd03a8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:12.484661 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60521075-ae13-4807-8344-edfedb034489 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:12.565508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04a15-a665-42a8-a275-6ef53feffbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:12.566470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04a15-a665-42a8-a275-6ef53feffbcb None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:12.566921 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04a15-a665-42a8-a275-6ef53feffbcb None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:12.567353 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04a15-a665-42a8-a275-6ef53feffbcb None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:12.568241 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef04a15-a665-42a8-a275-6ef53feffbcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:12.568712 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef04a15-a665-42a8-a275-6ef53feffbcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:12.570320 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef04a15-a665-42a8-a275-6ef53feffbcb None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:12.595908 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 359/722] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:12.603600 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04a15-a665-42a8-a275-6ef53feffbcb None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:12.604549 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:12.616616 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad377-54b2-460e-b67d-e5cb04cd03a8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:12.677390 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dee7a2-07aa-4f4c-9eb1-636b96c2d95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:12.678112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dee7a2-07aa-4f4c-9eb1-636b96c2d95a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:12.678390 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dee7a2-07aa-4f4c-9eb1-636b96c2d95a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:12.678688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dee7a2-07aa-4f4c-9eb1-636b96c2d95a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:12.687091 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dee7a2-07aa-4f4c-9eb1-636b96c2d95a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:12.688554 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dee7a2-07aa-4f4c-9eb1-636b96c2d95a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c5dee7a2-07aa-4f4c-9eb1-636b96c2d95a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:12.703906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:12.705017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:12.706222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:12.706222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:12.706222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:12.706222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:12.706222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:12.706222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:12.706222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:12.706222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:12.706222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 364/723] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:12.706853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e78b5-fa17-4d26-839f-c174cb15ff26 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:12.707147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e78b5-fa17-4d26-839f-c174cb15ff26 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:12.710047 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e78b5-fa17-4d26-839f-c174cb15ff26 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:12.713067 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 365/724] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:12.713920 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e78b5-fa17-4d26-839f-c174cb15ff26 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:12.746525 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04a15-a665-42a8-a275-6ef53feffbcb None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:12.772465 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:12.787660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c796732-5058-4db5-b2b1-90b50d32a74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:12.788466 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c796732-5058-4db5-b2b1-90b50d32a74c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:12.788799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c796732-5058-4db5-b2b1-90b50d32a74c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:12.789385 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c796732-5058-4db5-b2b1-90b50d32a74c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:12.797372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c796732-5058-4db5-b2b1-90b50d32a74c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:12.798908 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c796732-5058-4db5-b2b1-90b50d32a74c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-1c796732-5058-4db5-b2b1-90b50d32a74c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:12.816961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:12.818028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:12.819043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:12.819043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:12.819043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:12.819043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:12.819043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:12.819043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:12.819043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:12.819043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:12.819043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:12.819043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:12.822524 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 360/725] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 19:43:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:12.824847 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c86b54-a8e9-4d33-9a97-1b1d1335a844 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:12.825077 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c86b54-a8e9-4d33-9a97-1b1d1335a844 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:12.825332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c86b54-a8e9-4d33-9a97-1b1d1335a844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:12.844824 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-d6c86b54-a8e9-4d33-9a97-1b1d1335a844 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:12.846182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-d6c86b54-a8e9-4d33-9a97-1b1d1335a844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:12.856773 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e78b5-fa17-4d26-839f-c174cb15ff26 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:12.896433 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800ac49-1864-47b9-a70e-92fb8cada389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:12.897335 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ac49-1864-47b9-a70e-92fb8cada389 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:12.897623 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ac49-1864-47b9-a70e-92fb8cada389 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:12.897900 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ac49-1864-47b9-a70e-92fb8cada389 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:12.898722 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800ac49-1864-47b9-a70e-92fb8cada389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:12.899037 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800ac49-1864-47b9-a70e-92fb8cada389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:12.901070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800ac49-1864-47b9-a70e-92fb8cada389 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:12.918898 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 366/726] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:12.919793 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800ac49-1864-47b9-a70e-92fb8cada389 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:12.940266 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:12.945045 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 361/727] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:12.946559 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c86b54-a8e9-4d33-9a97-1b1d1335a844 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:13.026864 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800ac49-1864-47b9-a70e-92fb8cada389 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:13.061444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c86b54-a8e9-4d33-9a97-1b1d1335a844 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:13.063170 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a0075-86bc-4b63-9753-a65cc98566c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:13.064577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a0075-86bc-4b63-9753-a65cc98566c3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:13.064577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a0075-86bc-4b63-9753-a65cc98566c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:13.064577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a0075-86bc-4b63-9753-a65cc98566c3 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:13.065214 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a0075-86bc-4b63-9753-a65cc98566c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:13.065523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a0075-86bc-4b63-9753-a65cc98566c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:13.066965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a0075-86bc-4b63-9753-a65cc98566c3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:13.072910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:13.085528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 367/728] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 19:43:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:13.086345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a0075-86bc-4b63-9753-a65cc98566c3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:13.104194 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bd44d-f5ec-45fc-940f-4d4d6471ee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:13.105374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bd44d-f5ec-45fc-940f-4d4d6471ee5b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:13.106304 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bd44d-f5ec-45fc-940f-4d4d6471ee5b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:13.106571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bd44d-f5ec-45fc-940f-4d4d6471ee5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:13.107506 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bd44d-f5ec-45fc-940f-4d4d6471ee5b None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:13.107823 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bd44d-f5ec-45fc-940f-4d4d6471ee5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:13.109454 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bd44d-f5ec-45fc-940f-4d4d6471ee5b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:13.116160 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 362/729] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:12 2022] GET /identity/v3/role_assignments?user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:13.117595 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072f7b2-ce0a-4763-a95a-625fe6dfa118 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:13.117891 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072f7b2-ce0a-4763-a95a-625fe6dfa118 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:13.118172 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072f7b2-ce0a-4763-a95a-625fe6dfa118 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:13.119694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 363/730] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:13.124837 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072f7b2-ce0a-4763-a95a-625fe6dfa118 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:13.195812 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:13.234008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a0075-86bc-4b63-9753-a65cc98566c3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:13.263686 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072f7b2-ce0a-4763-a95a-625fe6dfa118 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:13.276570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cac755-371b-4b9f-a74e-23557928be29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:13.277608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cac755-371b-4b9f-a74e-23557928be29 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:13.278111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cac755-371b-4b9f-a74e-23557928be29 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:13.278567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cac755-371b-4b9f-a74e-23557928be29 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:13.280286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cac755-371b-4b9f-a74e-23557928be29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:13.282980 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cac755-371b-4b9f-a74e-23557928be29 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:13.306440 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a995b-a5a3-4e15-8c9b-cff1a0e06d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:13.307401 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a995b-a5a3-4e15-8c9b-cff1a0e06d37 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:13.307686 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a995b-a5a3-4e15-8c9b-cff1a0e06d37 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:13.307970 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a995b-a5a3-4e15-8c9b-cff1a0e06d37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:13.359045 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:13.378955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 368/731] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:43:13 2022] POST /identity/v3/services => generated 251 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:13.382168 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3475-452a-408b-ae70-5eee2e06a2b7 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:13.382788 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3475-452a-408b-ae70-5eee2e06a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:13.383360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3475-452a-408b-ae70-5eee2e06a2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:13.388497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a995b-a5a3-4e15-8c9b-cff1a0e06d37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:13.390130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a995b-a5a3-4e15-8c9b-cff1a0e06d37 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:13.406733 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-2a1b3475-452a-408b-ae70-5eee2e06a2b7 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:13.409213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2a1b3475-452a-408b-ae70-5eee2e06a2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:13.515505 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 369/732] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:13.540572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b3475-452a-408b-ae70-5eee2e06a2b7 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:13.614521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 364/733] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:13.615310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:13.620177 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a995b-a5a3-4e15-8c9b-cff1a0e06d37 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:13.674172 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b3475-452a-408b-ae70-5eee2e06a2b7 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:13.717459 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1319be-07d6-4b04-91ec-56dbf0934698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:13.718271 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1319be-07d6-4b04-91ec-56dbf0934698 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:13.718557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1319be-07d6-4b04-91ec-56dbf0934698 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:13.718875 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1319be-07d6-4b04-91ec-56dbf0934698 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:13.733246 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1319be-07d6-4b04-91ec-56dbf0934698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-1b1319be-07d6-4b04-91ec-56dbf0934698 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:13.741421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:13.742442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:13.743329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 370/734] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:43:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:13.750034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1319be-07d6-4b04-91ec-56dbf0934698 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:13.775480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:13.814969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a995b-a5a3-4e15-8c9b-cff1a0e06d37 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:13.858842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b978b8-d21a-4b5b-97b3-bb39ff9ab297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:13.859805 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b978b8-d21a-4b5b-97b3-bb39ff9ab297 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:13.860352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b978b8-d21a-4b5b-97b3-bb39ff9ab297 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:13.860581 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b978b8-d21a-4b5b-97b3-bb39ff9ab297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:13.872636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b978b8-d21a-4b5b-97b3-bb39ff9ab297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:13.874233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b978b8-d21a-4b5b-97b3-bb39ff9ab297 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:13.882439 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1319be-07d6-4b04-91ec-56dbf0934698 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-30b978b8-d21a-4b5b-97b3-bb39ff9ab297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:13.894421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:13.895568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:13.896681 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:13.896681 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:13.896681 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:13.896681 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:13.898275 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 365/735] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:13.904290 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b978b8-d21a-4b5b-97b3-bb39ff9ab297 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:13.910674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:13.929107 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57647d-109b-4530-8766-3bcd771d18db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:13.930582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57647d-109b-4530-8766-3bcd771d18db None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:13.931111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57647d-109b-4530-8766-3bcd771d18db None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:13.932181 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57647d-109b-4530-8766-3bcd771d18db None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:13.933359 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57647d-109b-4530-8766-3bcd771d18db None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:13.933920 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57647d-109b-4530-8766-3bcd771d18db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:13.936279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57647d-109b-4530-8766-3bcd771d18db None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:13.948688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 371/736] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:43:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:13.954832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57647d-109b-4530-8766-3bcd771d18db None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:14.024604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b978b8-d21a-4b5b-97b3-bb39ff9ab297 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:14.056340 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:14.078812 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2ec0f-216a-4622-8205-d5d37e923628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:14.082881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2ec0f-216a-4622-8205-d5d37e923628 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.083423 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2ec0f-216a-4622-8205-d5d37e923628 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.083942 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2ec0f-216a-4622-8205-d5d37e923628 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.085006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2ec0f-216a-4622-8205-d5d37e923628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:14.085663 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2ec0f-216a-4622-8205-d5d37e923628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:14.088363 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2ec0f-216a-4622-8205-d5d37e923628 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:14.111304 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 366/737] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:14.117576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2ec0f-216a-4622-8205-d5d37e923628 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:14.119770 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57647d-109b-4530-8766-3bcd771d18db None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:14.199889 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af1a6e-5466-4d4e-9185-532949f275a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:14.201002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af1a6e-5466-4d4e-9185-532949f275a1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.201471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af1a6e-5466-4d4e-9185-532949f275a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.201954 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af1a6e-5466-4d4e-9185-532949f275a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.225992 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af1a6e-5466-4d4e-9185-532949f275a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:14.232251 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af1a6e-5466-4d4e-9185-532949f275a1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-59af1a6e-5466-4d4e-9185-532949f275a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:14.274832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:14.275844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:14.276782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:14.276782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:14.276782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:14.276782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:14.276782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 372/738] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:14.284073 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af1a6e-5466-4d4e-9185-532949f275a1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:14.289990 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2ec0f-216a-4622-8205-d5d37e923628 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:14.330143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:14.348074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b41714-118a-4626-a7d7-d039957a6973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:14.348919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b41714-118a-4626-a7d7-d039957a6973 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.349209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b41714-118a-4626-a7d7-d039957a6973 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.349487 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b41714-118a-4626-a7d7-d039957a6973 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.364242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b41714-118a-4626-a7d7-d039957a6973 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:14.366907 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b41714-118a-4626-a7d7-d039957a6973 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-c3b41714-118a-4626-a7d7-d039957a6973 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:14.392760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:14.393725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:14.394670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:14.394670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:14.394670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:14.394670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:14.394670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:14.394670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:14.394670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:14.394670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:14.403681 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 367/739] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:14.409521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b41714-118a-4626-a7d7-d039957a6973 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:14.422035 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af1a6e-5466-4d4e-9185-532949f275a1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:14.468248 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712a986-281b-4c07-945a-21c145363f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:14.468924 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712a986-281b-4c07-945a-21c145363f48 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.469210 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712a986-281b-4c07-945a-21c145363f48 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.469490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712a986-281b-4c07-945a-21c145363f48 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.470230 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712a986-281b-4c07-945a-21c145363f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:14.470541 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712a986-281b-4c07-945a-21c145363f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:14.471967 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712a986-281b-4c07-945a-21c145363f48 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:14.488818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 373/740] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:14.490312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695317-b236-49b3-8e17-784da71d32f4 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.490626 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695317-b236-49b3-8e17-784da71d32f4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.490910 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695317-b236-49b3-8e17-784da71d32f4 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.496529 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 374/741] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:14.496846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:14.497682 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695317-b236-49b3-8e17-784da71d32f4 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:14.553811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b41714-118a-4626-a7d7-d039957a6973 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:14.593122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a88d58-d34a-404d-8dcf-798136f61e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:14.594118 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a88d58-d34a-404d-8dcf-798136f61e90 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.594552 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a88d58-d34a-404d-8dcf-798136f61e90 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.595003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a88d58-d34a-404d-8dcf-798136f61e90 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.595959 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a88d58-d34a-404d-8dcf-798136f61e90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:14.596422 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a88d58-d34a-404d-8dcf-798136f61e90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:14.598039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a88d58-d34a-404d-8dcf-798136f61e90 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:14.607161 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695317-b236-49b3-8e17-784da71d32f4 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:14.611417 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 368/742] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:14.612867 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccacd82-b71c-497f-a49a-77149cd63a80 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.613313 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccacd82-b71c-497f-a49a-77149cd63a80 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.613744 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccacd82-b71c-497f-a49a-77149cd63a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.617497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:14.631637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-cccacd82-b71c-497f-a49a-77149cd63a80 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:14.633114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-cccacd82-b71c-497f-a49a-77149cd63a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:14.645139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee1291-80c3-4f2d-b1b6-496dc96156c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:14.646154 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1291-80c3-4f2d-b1b6-496dc96156c4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.646292 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1291-80c3-4f2d-b1b6-496dc96156c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.646529 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1291-80c3-4f2d-b1b6-496dc96156c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.654953 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee1291-80c3-4f2d-b1b6-496dc96156c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:14.656487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee1291-80c3-4f2d-b1b6-496dc96156c4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ceee1291-80c3-4f2d-b1b6-496dc96156c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:14.672457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:14.673740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:14.674972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:14.674972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:14.674972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:14.674972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:14.674972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:14.674972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:14.674972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:14.674972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:14.674972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:43:14.674972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:14.674972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 375/743] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:43:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:14.675589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee1291-80c3-4f2d-b1b6-496dc96156c4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:14.711420 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 369/744] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:14.712568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccacd82-b71c-497f-a49a-77149cd63a80 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:14.749425 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:14.809447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee1291-80c3-4f2d-b1b6-496dc96156c4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:14.823354 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccacd82-b71c-497f-a49a-77149cd63a80 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:14.844826 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07294f9e-083c-4c46-9adf-25fe8dd55ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:14.845418 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07294f9e-083c-4c46-9adf-25fe8dd55ef5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.845708 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07294f9e-083c-4c46-9adf-25fe8dd55ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.846346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07294f9e-083c-4c46-9adf-25fe8dd55ef5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.846913 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07294f9e-083c-4c46-9adf-25fe8dd55ef5 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=4e4b9ebe2ac648558b5f0133e8af8727) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:14.847231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07294f9e-083c-4c46-9adf-25fe8dd55ef5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:14.848679 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07294f9e-083c-4c46-9adf-25fe8dd55ef5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:14.854805 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 376/745] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:14 2022] GET /identity/v3/role_assignments?user.id=4e4b9ebe2ac648558b5f0133e8af8727&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:14.855743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07294f9e-083c-4c46-9adf-25fe8dd55ef5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:14.862748 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb10f6e-5263-4781-a6e5-872ce92434cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:14.863699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb10f6e-5263-4781-a6e5-872ce92434cc None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.864167 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb10f6e-5263-4781-a6e5-872ce92434cc None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.864611 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb10f6e-5263-4781-a6e5-872ce92434cc None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.865750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb10f6e-5263-4781-a6e5-872ce92434cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:14.866265 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb10f6e-5263-4781-a6e5-872ce92434cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:14.867916 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb10f6e-5263-4781-a6e5-872ce92434cc None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:14.878410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:14.891075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 370/746] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 19:43:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:14.896528 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb10f6e-5263-4781-a6e5-872ce92434cc None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:14.970561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07294f9e-083c-4c46-9adf-25fe8dd55ef5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.007423 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.010672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88e65c-bcbc-4ea3-a70c-1875b6fc44ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.011276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e65c-bcbc-4ea3-a70c-1875b6fc44ee None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.011611 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e65c-bcbc-4ea3-a70c-1875b6fc44ee None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.011892 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e65c-bcbc-4ea3-a70c-1875b6fc44ee None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.012665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88e65c-bcbc-4ea3-a70c-1875b6fc44ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:15.014166 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88e65c-bcbc-4ea3-a70c-1875b6fc44ee None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:15.018117 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb10f6e-5263-4781-a6e5-872ce92434cc None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.057523 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba26e2-17ac-40e4-9dc0-51b75dd09e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.058200 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba26e2-17ac-40e4-9dc0-51b75dd09e38 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.059116 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba26e2-17ac-40e4-9dc0-51b75dd09e38 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.059404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba26e2-17ac-40e4-9dc0-51b75dd09e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.106863 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 377/747] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:43:14 2022] POST /identity/v3/services => generated 240 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:15.142531 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba26e2-17ac-40e4-9dc0-51b75dd09e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:15.144881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba26e2-17ac-40e4-9dc0-51b75dd09e38 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:15.256315 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.265424 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 371/748] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:43:15.271710 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88e65c-bcbc-4ea3-a70c-1875b6fc44ee None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.419001 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.430835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88e65c-bcbc-4ea3-a70c-1875b6fc44ee None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.470273 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59d353-92b9-4efc-9ac9-27ed9a9d36bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.471272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59d353-92b9-4efc-9ac9-27ed9a9d36bc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.471561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59d353-92b9-4efc-9ac9-27ed9a9d36bc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.471839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59d353-92b9-4efc-9ac9-27ed9a9d36bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.483438 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59d353-92b9-4efc-9ac9-27ed9a9d36bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:15.484920 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59d353-92b9-4efc-9ac9-27ed9a9d36bc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ee59d353-92b9-4efc-9ac9-27ed9a9d36bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:15.503380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:15.504331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:15.505222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:15.505222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:15.505222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:15.505222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:15.505222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 378/749] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:15.511532 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba26e2-17ac-40e4-9dc0-51b75dd09e38 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.545441 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153158-e51f-4e97-a351-23b2a20a3527 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.545762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153158-e51f-4e97-a351-23b2a20a3527 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.546000 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153158-e51f-4e97-a351-23b2a20a3527 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.547844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 379/750] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:15.553945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606238a7-6bf6-445c-84d7-865bbf23b519 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.554241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606238a7-6bf6-445c-84d7-865bbf23b519 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.554529 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606238a7-6bf6-445c-84d7-865bbf23b519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.577063 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-606238a7-6bf6-445c-84d7-865bbf23b519 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:15.578264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-606238a7-6bf6-445c-84d7-865bbf23b519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:15.636339 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba26e2-17ac-40e4-9dc0-51b75dd09e38 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.654632 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 380/751] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:15.674433 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606238a7-6bf6-445c-84d7-865bbf23b519 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.692727 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb45ced-c119-4350-b241-5e5e798ead4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.693744 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb45ced-c119-4350-b241-5e5e798ead4f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.694224 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb45ced-c119-4350-b241-5e5e798ead4f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.694758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb45ced-c119-4350-b241-5e5e798ead4f None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.695728 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb45ced-c119-4350-b241-5e5e798ead4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:15.696270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb45ced-c119-4350-b241-5e5e798ead4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:15.697980 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb45ced-c119-4350-b241-5e5e798ead4f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:15.718456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 372/752] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:15.723837 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb45ced-c119-4350-b241-5e5e798ead4f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.735054 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.779870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606238a7-6bf6-445c-84d7-865bbf23b519 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.816019 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda2ec2-8172-476c-b1eb-a0dd728e37dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.816980 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2ec2-8172-476c-b1eb-a0dd728e37dc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.817273 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2ec2-8172-476c-b1eb-a0dd728e37dc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.817554 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2ec2-8172-476c-b1eb-a0dd728e37dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.819397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.829462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda2ec2-8172-476c-b1eb-a0dd728e37dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-2dda2ec2-8172-476c-b1eb-a0dd728e37dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:15.837346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:15.838270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:15.839178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:15.842738 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 381/753] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:15.845530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda2ec2-8172-476c-b1eb-a0dd728e37dc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.926254 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb45ced-c119-4350-b241-5e5e798ead4f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.995083 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02061aea-b149-451e-a303-bec414d23a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.996232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02061aea-b149-451e-a303-bec414d23a91 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.996522 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02061aea-b149-451e-a303-bec414d23a91 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.996797 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02061aea-b149-451e-a303-bec414d23a91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.004966 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02061aea-b149-451e-a303-bec414d23a91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.006394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02061aea-b149-451e-a303-bec414d23a91 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.012644 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda2ec2-8172-476c-b1eb-a0dd728e37dc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-02061aea-b149-451e-a303-bec414d23a91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:16.021864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:16.022811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:16.023710 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:16.023710 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:16.023710 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:16.023710 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:16.023710 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:16.023710 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:16.023710 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:16.023710 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:16.024577 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 373/754] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:16.030440 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02061aea-b149-451e-a303-bec414d23a91 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.048713 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.086891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18358945-8ed9-4a73-974f-95eff23d996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.087611 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18358945-8ed9-4a73-974f-95eff23d996c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.087899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18358945-8ed9-4a73-974f-95eff23d996c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.088176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18358945-8ed9-4a73-974f-95eff23d996c None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.088937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18358945-8ed9-4a73-974f-95eff23d996c None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:16.089241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18358945-8ed9-4a73-974f-95eff23d996c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.090705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18358945-8ed9-4a73-974f-95eff23d996c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.110256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 382/755] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:16.116123 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18358945-8ed9-4a73-974f-95eff23d996c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.189574 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02061aea-b149-451e-a303-bec414d23a91 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.223154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.264697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48df60a-699a-47d1-987c-58f84015af1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.265374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df60a-699a-47d1-987c-58f84015af1c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.265655 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df60a-699a-47d1-987c-58f84015af1c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.265930 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df60a-699a-47d1-987c-58f84015af1c None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.266780 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48df60a-699a-47d1-987c-58f84015af1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:16.267093 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48df60a-699a-47d1-987c-58f84015af1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.268593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48df60a-699a-47d1-987c-58f84015af1c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.301008 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 374/756] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:16.307403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48df60a-699a-47d1-987c-58f84015af1c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.338981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18358945-8ed9-4a73-974f-95eff23d996c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.422247 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601db44-8ec7-4635-9d4a-07f9b07d2bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.423076 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601db44-8ec7-4635-9d4a-07f9b07d2bae None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.423356 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601db44-8ec7-4635-9d4a-07f9b07d2bae None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.423630 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601db44-8ec7-4635-9d4a-07f9b07d2bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.436562 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601db44-8ec7-4635-9d4a-07f9b07d2bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.438029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601db44-8ec7-4635-9d4a-07f9b07d2bae None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b601db44-8ec7-4635-9d4a-07f9b07d2bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:16.457177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:16.459442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:16.461666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:16.461666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:16.461666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:16.461666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:16.461666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 383/757] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:16.461666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad22fe3-25ec-48c0-b552-d138a4fc99fc None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.461666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad22fe3-25ec-48c0-b552-d138a4fc99fc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.462556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad22fe3-25ec-48c0-b552-d138a4fc99fc None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.470662 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48df60a-699a-47d1-987c-58f84015af1c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.470932 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 384/758] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:16.471085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad22fe3-25ec-48c0-b552-d138a4fc99fc None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.506821 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.509146 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ce80e-4a8c-4e48-bc56-7d9235ae3ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.509913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ce80e-4a8c-4e48-bc56-7d9235ae3ea0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.510204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ce80e-4a8c-4e48-bc56-7d9235ae3ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.510565 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ce80e-4a8c-4e48-bc56-7d9235ae3ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.511576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ce80e-4a8c-4e48-bc56-7d9235ae3ea0 None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=4741a268ae704e9582c1bb72f9c425a9) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:16.511896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ce80e-4a8c-4e48-bc56-7d9235ae3ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.514309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ce80e-4a8c-4e48-bc56-7d9235ae3ea0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.521067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 375/759] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/role_assignments?user.id=4741a268ae704e9582c1bb72f9c425a9&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:16.522789 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235fbfa-79dc-437a-a297-b5141fcdb79c None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.523088 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235fbfa-79dc-437a-a297-b5141fcdb79c None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.523373 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235fbfa-79dc-437a-a297-b5141fcdb79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.549330 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-5235fbfa-79dc-437a-a297-b5141fcdb79c None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:16.551618 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-5235fbfa-79dc-437a-a297-b5141fcdb79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:16.594525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad22fe3-25ec-48c0-b552-d138a4fc99fc None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.596162 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.636517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfba14-67db-4a31-b556-95dd72b975eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.637395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfba14-67db-4a31-b556-95dd72b975eb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.637879 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfba14-67db-4a31-b556-95dd72b975eb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.638218 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfba14-67db-4a31-b556-95dd72b975eb None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.639168 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfba14-67db-4a31-b556-95dd72b975eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:16.639545 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfba14-67db-4a31-b556-95dd72b975eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.641094 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfba14-67db-4a31-b556-95dd72b975eb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.647149 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 376/760] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:16.665389 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 385/761] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:16.671262 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235fbfa-79dc-437a-a297-b5141fcdb79c None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.677786 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfba14-67db-4a31-b556-95dd72b975eb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.852245 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.863342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235fbfa-79dc-437a-a297-b5141fcdb79c None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.877094 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfba14-67db-4a31-b556-95dd72b975eb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.929609 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586c496-1757-441d-ab75-e26b6d0603f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.930403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586c496-1757-441d-ab75-e26b6d0603f1 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.930702 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586c496-1757-441d-ab75-e26b6d0603f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.930978 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586c496-1757-441d-ab75-e26b6d0603f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.934707 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000acea1-69c8-4516-88c6-6b445df01675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.935524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000acea1-69c8-4516-88c6-6b445df01675 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.935795 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000acea1-69c8-4516-88c6-6b445df01675 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.936061 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000acea1-69c8-4516-88c6-6b445df01675 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.936717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000acea1-69c8-4516-88c6-6b445df01675 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.938105 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000acea1-69c8-4516-88c6-6b445df01675 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.947208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586c496-1757-441d-ab75-e26b6d0603f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.949024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586c496-1757-441d-ab75-e26b6d0603f1 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-000acea1-69c8-4516-88c6-6b445df01675 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:16.959614 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:16.961861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:16.963977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 386/762] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:16.975432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000acea1-69c8-4516-88c6-6b445df01675 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-5586c496-1757-441d-ab75-e26b6d0603f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:16.979204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:16.981894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:16.984182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:16.984182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:16.984182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:16.984182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:16.984182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:16.984182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:16.984182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:16.984182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:16.984182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:43:16.984182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:16.984182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 377/763] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:16.991822 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586c496-1757-441d-ab75-e26b6d0603f1 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.048132 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:17.162584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000acea1-69c8-4516-88c6-6b445df01675 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.186986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586c496-1757-441d-ab75-e26b6d0603f1 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.198534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04a537-b4ba-4749-a21c-435c6ed1d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.199765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04a537-b4ba-4749-a21c-435c6ed1d907 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.200041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04a537-b4ba-4749-a21c-435c6ed1d907 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.200314 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04a537-b4ba-4749-a21c-435c6ed1d907 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.201021 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04a537-b4ba-4749-a21c-435c6ed1d907 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:17.201325 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04a537-b4ba-4749-a21c-435c6ed1d907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.202729 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04a537-b4ba-4749-a21c-435c6ed1d907 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.208029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 387/764] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:17.213458 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04a537-b4ba-4749-a21c-435c6ed1d907 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.234921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:17.239228 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48fe2f-2132-44ea-b8e6-cc0807162706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.239904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48fe2f-2132-44ea-b8e6-cc0807162706 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.240191 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48fe2f-2132-44ea-b8e6-cc0807162706 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.240471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48fe2f-2132-44ea-b8e6-cc0807162706 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.241326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48fe2f-2132-44ea-b8e6-cc0807162706 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:17.241641 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48fe2f-2132-44ea-b8e6-cc0807162706 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.243104 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48fe2f-2132-44ea-b8e6-cc0807162706 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.262181 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 378/765] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:17.267649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48fe2f-2132-44ea-b8e6-cc0807162706 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.436282 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48fe2f-2132-44ea-b8e6-cc0807162706 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.437910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:17.482193 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f59a0-008d-437c-b161-107f407dc62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.483065 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f59a0-008d-437c-b161-107f407dc62a None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.483356 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f59a0-008d-437c-b161-107f407dc62a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.483637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f59a0-008d-437c-b161-107f407dc62a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.498585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f59a0-008d-437c-b161-107f407dc62a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.500105 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f59a0-008d-437c-b161-107f407dc62a None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.508655 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04a537-b4ba-4749-a21c-435c6ed1d907 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-072f59a0-008d-437c-b161-107f407dc62a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:17.533613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:17.534625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:17.535648 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:17.535648 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:17.535648 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:17.535648 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:17.535648 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 379/766] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:17.537311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921918a-4014-498a-894d-6ad92679b4ec None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.537600 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921918a-4014-498a-894d-6ad92679b4ec None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.537882 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921918a-4014-498a-894d-6ad92679b4ec None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.545632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 380/767] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:17.546589 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921918a-4014-498a-894d-6ad92679b4ec None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.571450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151d1c-58a8-4a6a-98d0-a1998ad8c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.572138 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151d1c-58a8-4a6a-98d0-a1998ad8c9dd None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.574646 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151d1c-58a8-4a6a-98d0-a1998ad8c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.574646 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151d1c-58a8-4a6a-98d0-a1998ad8c9dd None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.574646 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151d1c-58a8-4a6a-98d0-a1998ad8c9dd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:17.574646 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151d1c-58a8-4a6a-98d0-a1998ad8c9dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.575956 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151d1c-58a8-4a6a-98d0-a1998ad8c9dd None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.587670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 388/768] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:17.593846 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc95df-b9a7-42da-9e14-2fc031044028 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.594133 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc95df-b9a7-42da-9e14-2fc031044028 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.594409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc95df-b9a7-42da-9e14-2fc031044028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.615144 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-91cc95df-b9a7-42da-9e14-2fc031044028 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:17.617363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-91cc95df-b9a7-42da-9e14-2fc031044028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:17.674200 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921918a-4014-498a-894d-6ad92679b4ec None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d153-1c14-4edc-a298-439c5d2a5ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.714022 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d153-1c14-4edc-a298-439c5d2a5ac0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.714405 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d153-1c14-4edc-a298-439c5d2a5ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.714769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d153-1c14-4edc-a298-439c5d2a5ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.715571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d153-1c14-4edc-a298-439c5d2a5ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:17.715884 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d153-1c14-4edc-a298-439c5d2a5ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.717328 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d153-1c14-4edc-a298-439c5d2a5ac0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.728008 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:17.730527 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 381/769] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:17.732894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d153-1c14-4edc-a298-439c5d2a5ac0 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.766729 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 389/770] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:17.768055 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc95df-b9a7-42da-9e14-2fc031044028 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.792441 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:17.854771 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d153-1c14-4edc-a298-439c5d2a5ac0 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.891367 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f5be4-fc38-47d8-91c8-4fcc4f07b8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.892424 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f5be4-fc38-47d8-91c8-4fcc4f07b8df None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.892915 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f5be4-fc38-47d8-91c8-4fcc4f07b8df None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.893395 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f5be4-fc38-47d8-91c8-4fcc4f07b8df None admin] PATH_INFO: `/v3/endpoints` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.894395 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f5be4-fc38-47d8-91c8-4fcc4f07b8df None admin] RBAC: Adding query filter params (interface=public, service_id=ca8045178fc54736a826efd3846565ea, region_id=RegionOne) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:17.894967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f5be4-fc38-47d8-91c8-4fcc4f07b8df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.896538 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f5be4-fc38-47d8-91c8-4fcc4f07b8df None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.906701 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 382/771] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/endpoints?service_id=ca8045178fc54736a826efd3846565ea&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:17.907852 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f5be4-fc38-47d8-91c8-4fcc4f07b8df None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:18.016672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:18.023951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc95df-b9a7-42da-9e14-2fc031044028 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:18.070387 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846db09c-2ab7-4d63-bafb-cb02a36dd73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:18.071222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846db09c-2ab7-4d63-bafb-cb02a36dd73c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.071509 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846db09c-2ab7-4d63-bafb-cb02a36dd73c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.071788 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846db09c-2ab7-4d63-bafb-cb02a36dd73c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.074461 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f5be4-fc38-47d8-91c8-4fcc4f07b8df None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:18.084963 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846db09c-2ab7-4d63-bafb-cb02a36dd73c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:18.086435 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846db09c-2ab7-4d63-bafb-cb02a36dd73c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-846db09c-2ab7-4d63-bafb-cb02a36dd73c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:18.101101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:18.102098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:18.103029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:18.103029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:18.103029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:18.103029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:18.103029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:18.103029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:18.103029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:18.103029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:18.103029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 390/772] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:18.103526 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846db09c-2ab7-4d63-bafb-cb02a36dd73c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:18.127959 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f5453-cc40-4676-8aec-f11d7ed534ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:18.129185 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f5453-cc40-4676-8aec-f11d7ed534ec None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.130246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f5453-cc40-4676-8aec-f11d7ed534ec None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.130786 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f5453-cc40-4676-8aec-f11d7ed534ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.144678 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f5453-cc40-4676-8aec-f11d7ed534ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-100f5453-cc40-4676-8aec-f11d7ed534ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:18.152726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:18.153699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:18.154593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:18.160325 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 383/773] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:18.160325 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f5453-cc40-4676-8aec-f11d7ed534ec None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:18.180500 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:18.211751 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846db09c-2ab7-4d63-bafb-cb02a36dd73c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:18.255418 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc1a91-8b00-452d-8c7f-2077a35ec311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:18.256342 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc1a91-8b00-452d-8c7f-2077a35ec311 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.256931 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc1a91-8b00-452d-8c7f-2077a35ec311 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.257240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc1a91-8b00-452d-8c7f-2077a35ec311 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.258222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc1a91-8b00-452d-8c7f-2077a35ec311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:18.260125 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc1a91-8b00-452d-8c7f-2077a35ec311 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:18.265192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f5453-cc40-4676-8aec-f11d7ed534ec None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:18.266822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 391/774] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 19:43:18 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:18.268080 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08faaa-1b11-45cb-ab50-5e404fed2288 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.268368 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08faaa-1b11-45cb-ab50-5e404fed2288 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.268642 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08faaa-1b11-45cb-ab50-5e404fed2288 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.269937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 392/775] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:18.270664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08faaa-1b11-45cb-ab50-5e404fed2288 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:18.321757 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:18.333731 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940a1cd-0cf0-4caf-8306-b18fc869743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:18.334411 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a1cd-0cf0-4caf-8306-b18fc869743f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.334749 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a1cd-0cf0-4caf-8306-b18fc869743f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.335032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a1cd-0cf0-4caf-8306-b18fc869743f None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.335851 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940a1cd-0cf0-4caf-8306-b18fc869743f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:18.336163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940a1cd-0cf0-4caf-8306-b18fc869743f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:18.337639 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940a1cd-0cf0-4caf-8306-b18fc869743f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:18.357199 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 384/776] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:18.357199 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37f9f4-2e83-4a69-ba41-2753e007dbc0 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.357199 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37f9f4-2e83-4a69-ba41-2753e007dbc0 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.357199 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37f9f4-2e83-4a69-ba41-2753e007dbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.374306 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-be37f9f4-2e83-4a69-ba41-2753e007dbc0 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:18.375709 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-be37f9f4-2e83-4a69-ba41-2753e007dbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:18.428927 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08faaa-1b11-45cb-ab50-5e404fed2288 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:18.458645 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 385/777] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:18.458645 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37f9f4-2e83-4a69-ba41-2753e007dbc0 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:18.488347 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b660dbb-3f54-4423-811e-18b874b4cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:18.489357 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b660dbb-3f54-4423-811e-18b874b4cdce None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.489838 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b660dbb-3f54-4423-811e-18b874b4cdce None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.490325 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b660dbb-3f54-4423-811e-18b874b4cdce None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.491346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b660dbb-3f54-4423-811e-18b874b4cdce None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:18.491844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b660dbb-3f54-4423-811e-18b874b4cdce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:18.493910 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b660dbb-3f54-4423-811e-18b874b4cdce None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:18.497727 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:18.506932 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 393/778] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:43:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:18.507634 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b660dbb-3f54-4423-811e-18b874b4cdce None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:18.576715 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37f9f4-2e83-4a69-ba41-2753e007dbc0 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:18.598597 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:18.621776 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d04e0-b2c0-4ece-af58-6abbb0bda3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:18.622902 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b660dbb-3f54-4423-811e-18b874b4cdce None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:18.623554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d04e0-b2c0-4ece-af58-6abbb0bda3b8 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.624004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d04e0-b2c0-4ece-af58-6abbb0bda3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.628426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d04e0-b2c0-4ece-af58-6abbb0bda3b8 None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/84b4164dd21a4ec0bd3d50cd46d7d5e8/roles/4f7e6c1b02094f72ae978c3558b530a9` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.628426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d04e0-b2c0-4ece-af58-6abbb0bda3b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=84b4164dd21a4ec0bd3d50cd46d7d5e8, role_id=4f7e6c1b02094f72ae978c3558b530a9)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:18.629298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d04e0-b2c0-4ece-af58-6abbb0bda3b8 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:18.659689 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562449ea-99a9-45c8-bb9e-5553555d03f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:18.660489 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562449ea-99a9-45c8-bb9e-5553555d03f3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.660779 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562449ea-99a9-45c8-bb9e-5553555d03f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.661057 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562449ea-99a9-45c8-bb9e-5553555d03f3 None admin] PATH_INFO: `/v3/services/network` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.661719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562449ea-99a9-45c8-bb9e-5553555d03f3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:18.663148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562449ea-99a9-45c8-bb9e-5553555d03f3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-562449ea-99a9-45c8-bb9e-5553555d03f3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:18.675699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:18.682345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:18.683308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 394/779] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:18 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:18.684116 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562449ea-99a9-45c8-bb9e-5553555d03f3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:18.715472 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 386/780] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:43:18 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/84b4164dd21a4ec0bd3d50cd46d7d5e8/roles/4f7e6c1b02094f72ae978c3558b530a9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:18.717188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d04e0-b2c0-4ece-af58-6abbb0bda3b8 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:18.832839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:18.853996 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d04e0-b2c0-4ece-af58-6abbb0bda3b8 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:18.901061 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f447a-44fb-4532-8feb-c63757076fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:18.903097 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f447a-44fb-4532-8feb-c63757076fef None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.903804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f447a-44fb-4532-8feb-c63757076fef None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.904296 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f447a-44fb-4532-8feb-c63757076fef None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.906169 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f447a-44fb-4532-8feb-c63757076fef None admin] RBAC: Adding query filter params (name=network) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:18.906765 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f447a-44fb-4532-8feb-c63757076fef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:18.907914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562449ea-99a9-45c8-bb9e-5553555d03f3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:18.908872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f447a-44fb-4532-8feb-c63757076fef None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:18.916850 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 387/781] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:18.924417 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f447a-44fb-4532-8feb-c63757076fef None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:18.999024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:19.013842 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78add1-6324-46d8-a0e4-b8f37acdbdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:19.014700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78add1-6324-46d8-a0e4-b8f37acdbdfb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.014990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78add1-6324-46d8-a0e4-b8f37acdbdfb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.015331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78add1-6324-46d8-a0e4-b8f37acdbdfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.029607 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78add1-6324-46d8-a0e4-b8f37acdbdfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:19.031129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78add1-6324-46d8-a0e4-b8f37acdbdfb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:19.049937 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f447a-44fb-4532-8feb-c63757076fef None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-fd78add1-6324-46d8-a0e4-b8f37acdbdfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:19.050916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:19.051791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:19.052755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:19.052755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:19.052755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:19.052755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:19.057006 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 395/782] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:19.059570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78add1-6324-46d8-a0e4-b8f37acdbdfb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:19.101645 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee5660-022c-4ac6-b9ba-b1b2daaf950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:19.102710 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee5660-022c-4ac6-b9ba-b1b2daaf950b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.103217 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee5660-022c-4ac6-b9ba-b1b2daaf950b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.103696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee5660-022c-4ac6-b9ba-b1b2daaf950b None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.104633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee5660-022c-4ac6-b9ba-b1b2daaf950b None admin] RBAC: Adding query filter params (type=network) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:19.105807 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee5660-022c-4ac6-b9ba-b1b2daaf950b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:19.107944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee5660-022c-4ac6-b9ba-b1b2daaf950b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:19.114186 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 388/783] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:19.115714 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e08e3-6e6b-4a91-8e29-4806e2de3c0f None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.116090 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e08e3-6e6b-4a91-8e29-4806e2de3c0f None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.116553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e08e3-6e6b-4a91-8e29-4806e2de3c0f None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.118396 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 389/784] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:19.122361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e08e3-6e6b-4a91-8e29-4806e2de3c0f None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:19.197123 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78add1-6324-46d8-a0e4-b8f37acdbdfb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:19.216206 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:19.237337 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:19.241605 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e08e3-6e6b-4a91-8e29-4806e2de3c0f None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:19.243730 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8499556-0efe-4a51-b6dc-a93a89e2bfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:19.245244 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8499556-0efe-4a51-b6dc-a93a89e2bfb7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.245542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8499556-0efe-4a51-b6dc-a93a89e2bfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.246349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8499556-0efe-4a51-b6dc-a93a89e2bfb7 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.247219 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8499556-0efe-4a51-b6dc-a93a89e2bfb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:19.247683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8499556-0efe-4a51-b6dc-a93a89e2bfb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:19.249751 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8499556-0efe-4a51-b6dc-a93a89e2bfb7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:19.267168 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 396/785] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:19.268837 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd7eac-0d03-4fa5-b43e-7299b61288f2 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.269251 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd7eac-0d03-4fa5-b43e-7299b61288f2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.269651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd7eac-0d03-4fa5-b43e-7299b61288f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.290063 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b0fd7eac-0d03-4fa5-b43e-7299b61288f2 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:19.291454 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b0fd7eac-0d03-4fa5-b43e-7299b61288f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:19.296876 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6b3c-dc65-4767-ad58-4b8502a1d513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:19.297548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6b3c-dc65-4767-ad58-4b8502a1d513 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.297965 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6b3c-dc65-4767-ad58-4b8502a1d513 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.298251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6b3c-dc65-4767-ad58-4b8502a1d513 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.299087 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6b3c-dc65-4767-ad58-4b8502a1d513 None admin] RBAC: Adding query filter params (interface=public, service_id=16ed87fd46c24cce87f4a38cff8bb60f, region_id=RegionOne) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:19.299405 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6b3c-dc65-4767-ad58-4b8502a1d513 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:19.300770 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6b3c-dc65-4767-ad58-4b8502a1d513 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:19.312781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 390/786] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 19:43:19 2022] GET /identity/v3/endpoints?service_id=16ed87fd46c24cce87f4a38cff8bb60f&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:19.312781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6b3c-dc65-4767-ad58-4b8502a1d513 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:19.386930 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 397/787] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:19.388132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd7eac-0d03-4fa5-b43e-7299b61288f2 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:19.456479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6b3c-dc65-4767-ad58-4b8502a1d513 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:19.503310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a13c2-6040-42b0-be2f-c0ca3d5ad6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:19.504117 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a13c2-6040-42b0-be2f-c0ca3d5ad6d4 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.504402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a13c2-6040-42b0-be2f-c0ca3d5ad6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.504678 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a13c2-6040-42b0-be2f-c0ca3d5ad6d4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.516359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a13c2-6040-42b0-be2f-c0ca3d5ad6d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:19.519691 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a13c2-6040-42b0-be2f-c0ca3d5ad6d4 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:19.524346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd7eac-0d03-4fa5-b43e-7299b61288f2 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:19.528157 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-473a13c2-6040-42b0-be2f-c0ca3d5ad6d4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:19.541431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:19.543775 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:19.544752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:19.544752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:19.544752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:19.544752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:19.544752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:19.544752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:19.544752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:19.544752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:19.544752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:19.544752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:19.547415 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 391/788] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 19:43:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:19.548505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a13c2-6040-42b0-be2f-c0ca3d5ad6d4 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:19.572612 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1284c62-39c8-40ef-b711-0980dfd24630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:19.573471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1284c62-39c8-40ef-b711-0980dfd24630 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.573986 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1284c62-39c8-40ef-b711-0980dfd24630 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.574371 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1284c62-39c8-40ef-b711-0980dfd24630 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.575322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1284c62-39c8-40ef-b711-0980dfd24630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:19.576907 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1284c62-39c8-40ef-b711-0980dfd24630 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:19.583011 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:19.584810 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 398/789] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 19:43:19 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:19.586037 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1284c62-39c8-40ef-b711-0980dfd24630 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:19.678950 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a13c2-6040-42b0-be2f-c0ca3d5ad6d4 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:19.718034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1284c62-39c8-40ef-b711-0980dfd24630 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:19.738475 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39104113-6390-4209-9312-d79065be331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:19.739705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39104113-6390-4209-9312-d79065be331d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.740496 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39104113-6390-4209-9312-d79065be331d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.741838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39104113-6390-4209-9312-d79065be331d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.767138 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39104113-6390-4209-9312-d79065be331d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-39104113-6390-4209-9312-d79065be331d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:19.777829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:19.779267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:19.780151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:19.795517 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 392/790] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:43:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:19.798693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af2d72-2188-4555-b470-cb78ad078438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:19.799779 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af2d72-2188-4555-b470-cb78ad078438 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.800298 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af2d72-2188-4555-b470-cb78ad078438 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.800792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af2d72-2188-4555-b470-cb78ad078438 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.801868 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af2d72-2188-4555-b470-cb78ad078438 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:19.802388 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af2d72-2188-4555-b470-cb78ad078438 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:19.804131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af2d72-2188-4555-b470-cb78ad078438 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:19.809155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39104113-6390-4209-9312-d79065be331d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:19.845479 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 399/791] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 19:43:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:19.852383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af2d72-2188-4555-b470-cb78ad078438 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:19.886500 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:19.968566 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af2d72-2188-4555-b470-cb78ad078438 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:19.990464 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:20.005926 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf500b1-e626-4d42-ab8c-222c8ff514f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.007121 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf500b1-e626-4d42-ab8c-222c8ff514f7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.007956 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf500b1-e626-4d42-ab8c-222c8ff514f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.008587 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf500b1-e626-4d42-ab8c-222c8ff514f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.020995 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf500b1-e626-4d42-ab8c-222c8ff514f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.022799 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf500b1-e626-4d42-ab8c-222c8ff514f7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:20.029430 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39104113-6390-4209-9312-d79065be331d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-cdf500b1-e626-4d42-ab8c-222c8ff514f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:20.045299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:20.046306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:20.047311 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:20.047311 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:20.047311 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:20.047311 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:20.049613 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 400/792] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:20.054989 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf500b1-e626-4d42-ab8c-222c8ff514f7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.091294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f5620-1946-42d8-9744-b1ba29092cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.092407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f5620-1946-42d8-9744-b1ba29092cca None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.092920 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f5620-1946-42d8-9744-b1ba29092cca None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.093408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f5620-1946-42d8-9744-b1ba29092cca None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.094369 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f5620-1946-42d8-9744-b1ba29092cca None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:20.094926 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f5620-1946-42d8-9744-b1ba29092cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.096523 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f5620-1946-42d8-9744-b1ba29092cca None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:20.110795 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 393/793] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:43:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:20.113800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f5620-1946-42d8-9744-b1ba29092cca None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.226649 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f5620-1946-42d8-9744-b1ba29092cca None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.238996 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:20.263590 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96685314-64a2-4af8-831b-b98753786bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.264442 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685314-64a2-4af8-831b-b98753786bb1 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.264732 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685314-64a2-4af8-831b-b98753786bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.265009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685314-64a2-4af8-831b-b98753786bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.267085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf500b1-e626-4d42-ab8c-222c8ff514f7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.277492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96685314-64a2-4af8-831b-b98753786bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.279023 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96685314-64a2-4af8-831b-b98753786bb1 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:20.290640 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-96685314-64a2-4af8-831b-b98753786bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:20.298961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:20.300323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:20.301232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:20.301232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:20.301232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:20.301232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:20.305132 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 394/794] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:20.306891 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96685314-64a2-4af8-831b-b98753786bb1 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.326502 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf7684-d0e2-45a7-9857-8a8f3de49685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.326502 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7684-d0e2-45a7-9857-8a8f3de49685 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.326502 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7684-d0e2-45a7-9857-8a8f3de49685 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.326502 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7684-d0e2-45a7-9857-8a8f3de49685 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.327039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf7684-d0e2-45a7-9857-8a8f3de49685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:20.327039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf7684-d0e2-45a7-9857-8a8f3de49685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.330651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf7684-d0e2-45a7-9857-8a8f3de49685 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:20.359090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 401/795] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:20.364451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf7684-d0e2-45a7-9857-8a8f3de49685 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.424447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96685314-64a2-4af8-831b-b98753786bb1 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.478217 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39763991-94fe-49e0-9ae6-8b67b4d091f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.479625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763991-94fe-49e0-9ae6-8b67b4d091f9 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.481145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763991-94fe-49e0-9ae6-8b67b4d091f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.481433 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763991-94fe-49e0-9ae6-8b67b4d091f9 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.482172 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39763991-94fe-49e0-9ae6-8b67b4d091f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:20.482486 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39763991-94fe-49e0-9ae6-8b67b4d091f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.485296 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39763991-94fe-49e0-9ae6-8b67b4d091f9 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:20.519931 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 395/796] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:20.524371 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39763991-94fe-49e0-9ae6-8b67b4d091f9 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.569573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf7684-d0e2-45a7-9857-8a8f3de49685 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.637432 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:20.653246 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4eba6-9d1e-41e0-86cf-4742c401e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.654058 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4eba6-9d1e-41e0-86cf-4742c401e981 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.654339 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4eba6-9d1e-41e0-86cf-4742c401e981 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.654636 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4eba6-9d1e-41e0-86cf-4742c401e981 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.671793 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4eba6-9d1e-41e0-86cf-4742c401e981 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.673277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4eba6-9d1e-41e0-86cf-4742c401e981 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:20.680407 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:20.690774 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39763991-94fe-49e0-9ae6-8b67b4d091f9 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0ed4eba6-9d1e-41e0-86cf-4742c401e981 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:20.705052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:20.710734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:20.711670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:20.711670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:20.711670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:20.711670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:20.711670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:20.711670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:20.711670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:20.711670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:20.711670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 402/797] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:20.711670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4eba6-9d1e-41e0-86cf-4742c401e981 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.747274 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef56dec-4170-4735-9a0f-8e2ca10bb62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.748365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef56dec-4170-4735-9a0f-8e2ca10bb62f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.752013 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef56dec-4170-4735-9a0f-8e2ca10bb62f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.752521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef56dec-4170-4735-9a0f-8e2ca10bb62f None admin] PATH_INFO: `/v3/users/swift` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.767505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef56dec-4170-4735-9a0f-8e2ca10bb62f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.770553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef56dec-4170-4735-9a0f-8e2ca10bb62f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-7ef56dec-4170-4735-9a0f-8e2ca10bb62f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:20.795184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:20.796326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:20.797756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:20.797756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:20.797756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:20.797756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:20.797756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:20.797756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:20.797756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:20.797756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:20.797756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:43:20.797756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:20.797756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 396/798] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:20.802129 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef56dec-4170-4735-9a0f-8e2ca10bb62f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.888878 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4eba6-9d1e-41e0-86cf-4742c401e981 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.923710 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef56dec-4170-4735-9a0f-8e2ca10bb62f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.930264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b2908-78bd-44dc-b963-354fc128257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.931074 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b2908-78bd-44dc-b963-354fc128257d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.931621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b2908-78bd-44dc-b963-354fc128257d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.931894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b2908-78bd-44dc-b963-354fc128257d None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.932690 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b2908-78bd-44dc-b963-354fc128257d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:20.933021 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b2908-78bd-44dc-b963-354fc128257d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.934589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b2908-78bd-44dc-b963-354fc128257d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:20.942700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:20.949378 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 403/799] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:20.950982 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66e386-7409-41e4-a60d-8536c594dcfd None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.951423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66e386-7409-41e4-a60d-8536c594dcfd None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.951870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66e386-7409-41e4-a60d-8536c594dcfd None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.958361 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 404/800] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:20.960685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66e386-7409-41e4-a60d-8536c594dcfd None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.969979 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafd374-977e-44bf-84cd-38609558cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.971575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafd374-977e-44bf-84cd-38609558cc34 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.972079 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafd374-977e-44bf-84cd-38609558cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.972493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafd374-977e-44bf-84cd-38609558cc34 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.973932 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafd374-977e-44bf-84cd-38609558cc34 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:20.974747 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafd374-977e-44bf-84cd-38609558cc34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.976666 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafd374-977e-44bf-84cd-38609558cc34 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.001100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 397/801] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:21.003515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac24e2-78e1-4753-8b8d-5771d5959db1 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.003809 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac24e2-78e1-4753-8b8d-5771d5959db1 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.004091 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac24e2-78e1-4753-8b8d-5771d5959db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.027625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-d8ac24e2-78e1-4753-8b8d-5771d5959db1 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:21.028522 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-d8ac24e2-78e1-4753-8b8d-5771d5959db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:21.034136 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.083716 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66e386-7409-41e4-a60d-8536c594dcfd None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.106764 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 398/802] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:21.106764 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac24e2-78e1-4753-8b8d-5771d5959db1 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.145140 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba10a7-63be-4b0f-a946-7e5a46c473bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.146179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba10a7-63be-4b0f-a946-7e5a46c473bc None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.146558 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba10a7-63be-4b0f-a946-7e5a46c473bc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.147019 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba10a7-63be-4b0f-a946-7e5a46c473bc None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/4e4b9ebe2ac648558b5f0133e8af8727/roles/6832675179fb4d0894f7273b883164b1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.165443 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba10a7-63be-4b0f-a946-7e5a46c473bc None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=4e4b9ebe2ac648558b5f0133e8af8727, role_id=6832675179fb4d0894f7273b883164b1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.167101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba10a7-63be-4b0f-a946-7e5a46c473bc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.202950 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac24e2-78e1-4753-8b8d-5771d5959db1 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.210860 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.242236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522237a-00a5-45c9-9d69-69960f26c6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.243095 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522237a-00a5-45c9-9d69-69960f26c6c0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.243393 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522237a-00a5-45c9-9d69-69960f26c6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.243672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522237a-00a5-45c9-9d69-69960f26c6c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.247025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 405/803] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:43:20 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/4e4b9ebe2ac648558b5f0133e8af8727/roles/6832675179fb4d0894f7273b883164b1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:21.248219 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba10a7-63be-4b0f-a946-7e5a46c473bc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.258426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522237a-00a5-45c9-9d69-69960f26c6c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.267812 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522237a-00a5-45c9-9d69-69960f26c6c0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-9522237a-00a5-45c9-9d69-69960f26c6c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:21.298799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:21.300271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:21.301197 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:21.301197 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:21.301197 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:21.301197 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:21.301197 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 399/804] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:21.305932 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522237a-00a5-45c9-9d69-69960f26c6c0 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.403658 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba10a7-63be-4b0f-a946-7e5a46c473bc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.422976 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.453783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d4aca-d58b-4c60-a43f-22e8fbabe432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.455127 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d4aca-d58b-4c60-a43f-22e8fbabe432 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.455651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d4aca-d58b-4c60-a43f-22e8fbabe432 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.456237 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d4aca-d58b-4c60-a43f-22e8fbabe432 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.457118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d4aca-d58b-4c60-a43f-22e8fbabe432 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.460467 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d4aca-d58b-4c60-a43f-22e8fbabe432 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-808d4aca-d58b-4c60-a43f-22e8fbabe432 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:21.474704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:21.477287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:43:21.478159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:21.480150 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 406/805] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:21.486447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d4aca-d58b-4c60-a43f-22e8fbabe432 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.517966 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522237a-00a5-45c9-9d69-69960f26c6c0 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.557185 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20fcf8-866b-4b89-a3e7-1a539e3e63ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.557887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20fcf8-866b-4b89-a3e7-1a539e3e63ce None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.558724 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20fcf8-866b-4b89-a3e7-1a539e3e63ce None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.559005 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20fcf8-866b-4b89-a3e7-1a539e3e63ce None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.559738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20fcf8-866b-4b89-a3e7-1a539e3e63ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:21.560044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20fcf8-866b-4b89-a3e7-1a539e3e63ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.561426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20fcf8-866b-4b89-a3e7-1a539e3e63ce None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.573468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 400/806] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:21.579609 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ced06-ee3d-4aa3-861c-d66335281696 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.579903 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ced06-ee3d-4aa3-861c-d66335281696 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.580187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ced06-ee3d-4aa3-861c-d66335281696 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.581678 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 401/807] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:21.582730 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ced06-ee3d-4aa3-861c-d66335281696 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.602155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.611176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d4aca-d58b-4c60-a43f-22e8fbabe432 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.651412 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60ca2e-e5bf-43a1-a79f-942199c25c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.652465 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60ca2e-e5bf-43a1-a79f-942199c25c63 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.653003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60ca2e-e5bf-43a1-a79f-942199c25c63 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.654247 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60ca2e-e5bf-43a1-a79f-942199c25c63 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.655194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60ca2e-e5bf-43a1-a79f-942199c25c63 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:21.655699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60ca2e-e5bf-43a1-a79f-942199c25c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.657400 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60ca2e-e5bf-43a1-a79f-942199c25c63 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.663047 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 407/808] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:21.669345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0e09-6a01-4fa2-bca1-3d591af08fdb None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.670211 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0e09-6a01-4fa2-bca1-3d591af08fdb None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.670736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0e09-6a01-4fa2-bca1-3d591af08fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.689904 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-754b0e09-6a01-4fa2-bca1-3d591af08fdb None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:21.691413 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-754b0e09-6a01-4fa2-bca1-3d591af08fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:21.696588 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ced06-ee3d-4aa3-861c-d66335281696 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.723873 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.736287 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbeb85-d7ad-4ed0-8637-27c106cc67a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.737201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbeb85-d7ad-4ed0-8637-27c106cc67a0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.737532 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbeb85-d7ad-4ed0-8637-27c106cc67a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.737817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbeb85-d7ad-4ed0-8637-27c106cc67a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.746348 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbeb85-d7ad-4ed0-8637-27c106cc67a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.748019 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbeb85-d7ad-4ed0-8637-27c106cc67a0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-86fbeb85-d7ad-4ed0-8637-27c106cc67a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:21.764436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:21.765484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:21.766404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:21.766404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:21.766404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:21.766404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:21.766404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:21.766404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:21.766404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:21.766404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:21.766404 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 402/809] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:21.767107 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbeb85-d7ad-4ed0-8637-27c106cc67a0 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.773478 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 408/810] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:21.774749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0e09-6a01-4fa2-bca1-3d591af08fdb None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.855863 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.880240 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbeb85-d7ad-4ed0-8637-27c106cc67a0 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.883198 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0e09-6a01-4fa2-bca1-3d591af08fdb None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.919635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d8db7-def5-493f-9af1-14b7edc92c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.920303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8db7-def5-493f-9af1-14b7edc92c47 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.920588 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8db7-def5-493f-9af1-14b7edc92c47 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.920863 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8db7-def5-493f-9af1-14b7edc92c47 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.921735 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d8db7-def5-493f-9af1-14b7edc92c47 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:21.922050 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d8db7-def5-493f-9af1-14b7edc92c47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.922367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678844e8-5d6d-4913-b9d4-bc8b233955ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.923560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d8db7-def5-493f-9af1-14b7edc92c47 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.923757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678844e8-5d6d-4913-b9d4-bc8b233955ab None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.924202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678844e8-5d6d-4913-b9d4-bc8b233955ab None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.924742 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678844e8-5d6d-4913-b9d4-bc8b233955ab None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.925833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678844e8-5d6d-4913-b9d4-bc8b233955ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:21.926312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678844e8-5d6d-4913-b9d4-bc8b233955ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.927948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678844e8-5d6d-4913-b9d4-bc8b233955ab None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.934205 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 403/811] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:21.934205 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d8db7-def5-493f-9af1-14b7edc92c47 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.946708 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 409/812] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:21.947841 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678844e8-5d6d-4913-b9d4-bc8b233955ab None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.978209 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.046325 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d8db7-def5-493f-9af1-14b7edc92c47 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.061044 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678844e8-5d6d-4913-b9d4-bc8b233955ab None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.084233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba206-ee59-4a97-a1af-299c96387183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.085026 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba206-ee59-4a97-a1af-299c96387183 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.085312 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba206-ee59-4a97-a1af-299c96387183 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.085591 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba206-ee59-4a97-a1af-299c96387183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.097915 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eba206-ee59-4a97-a1af-299c96387183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:22.099685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa1780-06ad-4a7b-9329-d37a74eb7900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.100556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa1780-06ad-4a7b-9329-d37a74eb7900 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.101034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa1780-06ad-4a7b-9329-d37a74eb7900 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.101483 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa1780-06ad-4a7b-9329-d37a74eb7900 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.102404 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa1780-06ad-4a7b-9329-d37a74eb7900 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.103981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa1780-06ad-4a7b-9329-d37a74eb7900 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-59eba206-ee59-4a97-a1af-299c96387183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:22.106550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:22.107498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:22.108352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 404/813] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:22.109067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba206-ee59-4a97-a1af-299c96387183 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.111750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.210650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 410/814] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 19:43:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:22.210650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa1780-06ad-4a7b-9329-d37a74eb7900 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.226060 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba206-ee59-4a97-a1af-299c96387183 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.294013 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f844-38e1-4205-9f74-6c9cf5762c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.294920 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f844-38e1-4205-9f74-6c9cf5762c2b None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.295204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f844-38e1-4205-9f74-6c9cf5762c2b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.295503 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f844-38e1-4205-9f74-6c9cf5762c2b None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/4741a268ae704e9582c1bb72f9c425a9/roles/4f7e6c1b02094f72ae978c3558b530a9` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.297770 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5f844-38e1-4205-9f74-6c9cf5762c2b None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=4741a268ae704e9582c1bb72f9c425a9, role_id=4f7e6c1b02094f72ae978c3558b530a9)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.299347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5f844-38e1-4205-9f74-6c9cf5762c2b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.324099 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.344742 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa1780-06ad-4a7b-9329-d37a74eb7900 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.377060 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 405/815] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:43:22 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/4741a268ae704e9582c1bb72f9c425a9/roles/4f7e6c1b02094f72ae978c3558b530a9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:22.380734 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8905d1-86b1-48a6-b6b6-b7a5c26990d8 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.381447 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8905d1-86b1-48a6-b6b6-b7a5c26990d8 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.382031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8905d1-86b1-48a6-b6b6-b7a5c26990d8 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.388783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930ab3-5cf0-4ae0-b653-dac9778924b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.388783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930ab3-5cf0-4ae0-b653-dac9778924b0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.388783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930ab3-5cf0-4ae0-b653-dac9778924b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.388783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930ab3-5cf0-4ae0-b653-dac9778924b0 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.389214 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930ab3-5cf0-4ae0-b653-dac9778924b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:22.389214 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930ab3-5cf0-4ae0-b653-dac9778924b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.389749 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 406/816] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:22.390182 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930ab3-5cf0-4ae0-b653-dac9778924b0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.392143 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeedf95-b448-47de-836e-fdb9fe3a1bc9 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.394065 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeedf95-b448-47de-836e-fdb9fe3a1bc9 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.394065 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeedf95-b448-47de-836e-fdb9fe3a1bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.403713 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 411/817] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:22.411744 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930ab3-5cf0-4ae0-b653-dac9778924b0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.427679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-4eeedf95-b448-47de-836e-fdb9fe3a1bc9 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:22.427679 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-4eeedf95-b448-47de-836e-fdb9fe3a1bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:22.507159 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.531921 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 407/818] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:22.562021 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930ab3-5cf0-4ae0-b653-dac9778924b0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.563861 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeedf95-b448-47de-836e-fdb9fe3a1bc9 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.623588 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ce084-4849-4ddf-a298-ecde24a26527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.624409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ce084-4849-4ddf-a298-ecde24a26527 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.624689 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ce084-4849-4ddf-a298-ecde24a26527 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.624969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ce084-4849-4ddf-a298-ecde24a26527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.638210 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ce084-4849-4ddf-a298-ecde24a26527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.639842 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ce084-4849-4ddf-a298-ecde24a26527 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.642862 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-e24ce084-4849-4ddf-a298-ecde24a26527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:22.659782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:22.660981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:22.672510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:22.672510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:22.672510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:22.672510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:22.672510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 412/819] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:22.672510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ce084-4849-4ddf-a298-ecde24a26527 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.717020 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeedf95-b448-47de-836e-fdb9fe3a1bc9 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.779181 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7579a28-f69e-4769-88cc-6ee22f524210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.781190 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7579a28-f69e-4769-88cc-6ee22f524210 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.782273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7579a28-f69e-4769-88cc-6ee22f524210 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.782942 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7579a28-f69e-4769-88cc-6ee22f524210 None admin] PATH_INFO: `/v3/services/network` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.784583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7579a28-f69e-4769-88cc-6ee22f524210 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.787902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7579a28-f69e-4769-88cc-6ee22f524210 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-a7579a28-f69e-4769-88cc-6ee22f524210 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:22.813553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:22.814658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:43:22.815599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:22.821493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 408/820] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:22.827090 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7579a28-f69e-4769-88cc-6ee22f524210 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.902731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ce084-4849-4ddf-a298-ecde24a26527 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.904689 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.960941 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7579a28-f69e-4769-88cc-6ee22f524210 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.965056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255c029-466d-479a-b4b4-008684b8b6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.965721 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255c029-466d-479a-b4b4-008684b8b6ec None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.965998 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255c029-466d-479a-b4b4-008684b8b6ec None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.966267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255c029-466d-479a-b4b4-008684b8b6ec None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.968148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255c029-466d-479a-b4b4-008684b8b6ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:22.968148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255c029-466d-479a-b4b4-008684b8b6ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.968674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255c029-466d-479a-b4b4-008684b8b6ec None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.994544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 413/821] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:23.002460 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255c029-466d-479a-b4b4-008684b8b6ec None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:23.062953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f114d-290d-4fc6-b444-35f13e36a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:23.064109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f114d-290d-4fc6-b444-35f13e36a427 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.064338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f114d-290d-4fc6-b444-35f13e36a427 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.064610 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f114d-290d-4fc6-b444-35f13e36a427 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.065323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f114d-290d-4fc6-b444-35f13e36a427 None admin] RBAC: Adding query filter params (name=network) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:23.065626 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f114d-290d-4fc6-b444-35f13e36a427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:23.066998 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f114d-290d-4fc6-b444-35f13e36a427 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:23.072188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 409/822] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:23.077851 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f114d-290d-4fc6-b444-35f13e36a427 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:23.099978 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:23.181876 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255c029-466d-479a-b4b4-008684b8b6ec None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:23.229269 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32537e76-b941-447d-8636-43bc190c83f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:23.230623 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32537e76-b941-447d-8636-43bc190c83f8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.230945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32537e76-b941-447d-8636-43bc190c83f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.231914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32537e76-b941-447d-8636-43bc190c83f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.250932 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32537e76-b941-447d-8636-43bc190c83f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:23.252403 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32537e76-b941-447d-8636-43bc190c83f8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:23.270127 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f114d-290d-4fc6-b444-35f13e36a427 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-32537e76-b941-447d-8636-43bc190c83f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:23.278468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:23.279490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:23.280455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:23.280455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:23.280455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:23.280455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:23.280455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:23.280455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:23.280455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:23.280455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:23.280455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:43:23.280455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:23.284589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 414/823] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 19:43:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:23.294497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32537e76-b941-447d-8636-43bc190c83f8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:23.315096 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:23.354158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0fa62-487a-4250-bcc1-8f7a1d76ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:23.357997 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0fa62-487a-4250-bcc1-8f7a1d76ba4d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.358312 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0fa62-487a-4250-bcc1-8f7a1d76ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.358592 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0fa62-487a-4250-bcc1-8f7a1d76ba4d None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.359347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0fa62-487a-4250-bcc1-8f7a1d76ba4d None admin] RBAC: Adding query filter params (type=network) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:23.359654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0fa62-487a-4250-bcc1-8f7a1d76ba4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:23.361038 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0fa62-487a-4250-bcc1-8f7a1d76ba4d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:23.377948 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 410/824] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:23.380123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0fa62-487a-4250-bcc1-8f7a1d76ba4d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:23.464794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32537e76-b941-447d-8636-43bc190c83f8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:23.485363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:23.510429 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff1e0-70dd-460d-8834-d62ed9433a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:23.512850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff1e0-70dd-460d-8834-d62ed9433a61 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.513161 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff1e0-70dd-460d-8834-d62ed9433a61 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.513437 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff1e0-70dd-460d-8834-d62ed9433a61 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.514315 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ff1e0-70dd-460d-8834-d62ed9433a61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:23.514636 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ff1e0-70dd-460d-8834-d62ed9433a61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:23.522506 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ff1e0-70dd-460d-8834-d62ed9433a61 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:23.547897 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 415/825] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 19:43:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:23.553565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff1e0-70dd-460d-8834-d62ed9433a61 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:23.654251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0fa62-487a-4250-bcc1-8f7a1d76ba4d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:23.730192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3806d-b39a-4a1e-b32e-d386983441ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:23.730890 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3806d-b39a-4a1e-b32e-d386983441ef None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.731174 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3806d-b39a-4a1e-b32e-d386983441ef None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.731450 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3806d-b39a-4a1e-b32e-d386983441ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.732215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3806d-b39a-4a1e-b32e-d386983441ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:23.735339 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3806d-b39a-4a1e-b32e-d386983441ef None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:23.757055 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff1e0-70dd-460d-8834-d62ed9433a61 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:23.815314 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeea726-d1f9-4bc0-bbdf-93989e1f4b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:23.815989 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeea726-d1f9-4bc0-bbdf-93989e1f4b45 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.816274 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeea726-d1f9-4bc0-bbdf-93989e1f4b45 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.816535 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeea726-d1f9-4bc0-bbdf-93989e1f4b45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.835061 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 411/826] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 19:43:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:23.836652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70887e-1fed-4274-9bdf-76f14ba28a62 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.836943 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70887e-1fed-4274-9bdf-76f14ba28a62 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.837229 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70887e-1fed-4274-9bdf-76f14ba28a62 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.838911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 412/827] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:23.845605 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb89cb-1985-4e62-865d-a268eb93bf64 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.845912 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb89cb-1985-4e62-865d-a268eb93bf64 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.846178 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb89cb-1985-4e62-865d-a268eb93bf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.883621 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-cedb89cb-1985-4e62-865d-a268eb93bf64 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:23.887212 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-cedb89cb-1985-4e62-865d-a268eb93bf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:23.915550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:23.929771 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:23.996915 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeea726-d1f9-4bc0-bbdf-93989e1f4b45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:24.000218 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeea726-d1f9-4bc0-bbdf-93989e1f4b45 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:24.006099 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 413/828] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:24.050121 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb89cb-1985-4e62-865d-a268eb93bf64 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.125977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 416/829] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 19:43:24.131971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeea726-d1f9-4bc0-bbdf-93989e1f4b45 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.213080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb89cb-1985-4e62-865d-a268eb93bf64 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:24.242714 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:24.255301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617b3d9-eff1-4fc6-8902-652b024af7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:24.256686 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617b3d9-eff1-4fc6-8902-652b024af7ad None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.257207 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617b3d9-eff1-4fc6-8902-652b024af7ad None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.257696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617b3d9-eff1-4fc6-8902-652b024af7ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.273114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617b3d9-eff1-4fc6-8902-652b024af7ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:24.278550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeea726-d1f9-4bc0-bbdf-93989e1f4b45 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-9617b3d9-eff1-4fc6-8902-652b024af7ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:24.282839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:24.283955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:43:24.285344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:24.289686 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 414/830] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:24.294376 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617b3d9-eff1-4fc6-8902-652b024af7ad None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.328490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698d91-97ef-4df4-a9c6-bc2b616974af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:24.328911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:24.330109 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698d91-97ef-4df4-a9c6-bc2b616974af None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.330407 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698d91-97ef-4df4-a9c6-bc2b616974af None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.330728 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698d91-97ef-4df4-a9c6-bc2b616974af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.345989 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da698d91-97ef-4df4-a9c6-bc2b616974af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:24.347799 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da698d91-97ef-4df4-a9c6-bc2b616974af None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-da698d91-97ef-4df4-a9c6-bc2b616974af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:24.378688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:24.379909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:24.380960 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:24.380960 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:24.380960 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:24.380960 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:24.383741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 417/831] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:24.389527 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698d91-97ef-4df4-a9c6-bc2b616974af None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.432758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617b3d9-eff1-4fc6-8902-652b024af7ad None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:24.473950 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd00bc-48b7-46b0-850f-034953a1d993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:24.474773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd00bc-48b7-46b0-850f-034953a1d993 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.475165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd00bc-48b7-46b0-850f-034953a1d993 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.475547 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd00bc-48b7-46b0-850f-034953a1d993 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.476579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd00bc-48b7-46b0-850f-034953a1d993 None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:24.477034 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd00bc-48b7-46b0-850f-034953a1d993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:24.478533 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd00bc-48b7-46b0-850f-034953a1d993 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:24.488389 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 415/832] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:24.494934 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd00bc-48b7-46b0-850f-034953a1d993 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.520907 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698d91-97ef-4df4-a9c6-bc2b616974af None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:24.562665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:24.571743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eaf25-c7c2-4a2d-a65b-f53f75db46d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:24.572524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eaf25-c7c2-4a2d-a65b-f53f75db46d7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.572813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eaf25-c7c2-4a2d-a65b-f53f75db46d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.573092 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eaf25-c7c2-4a2d-a65b-f53f75db46d7 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.585301 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eaf25-c7c2-4a2d-a65b-f53f75db46d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:24.585301 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eaf25-c7c2-4a2d-a65b-f53f75db46d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:24.585301 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eaf25-c7c2-4a2d-a65b-f53f75db46d7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:24.592019 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 418/833] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:24.597094 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eaf25-c7c2-4a2d-a65b-f53f75db46d7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.617436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:24.638533 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd00bc-48b7-46b0-850f-034953a1d993 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:24.685070 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa0c01-776b-45bf-9dfc-4f227f112ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:24.685798 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0c01-776b-45bf-9dfc-4f227f112ffa None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.686078 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0c01-776b-45bf-9dfc-4f227f112ffa None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.686350 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa0c01-776b-45bf-9dfc-4f227f112ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.699661 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa0c01-776b-45bf-9dfc-4f227f112ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:24.700877 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa0c01-776b-45bf-9dfc-4f227f112ffa None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-48aa0c01-776b-45bf-9dfc-4f227f112ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:24.728400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:24.729361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:24.730924 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:24.730924 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:24.730924 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:24.730924 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:24.734954 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 416/834] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:24.736476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa0c01-776b-45bf-9dfc-4f227f112ffa None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.745147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eaf25-c7c2-4a2d-a65b-f53f75db46d7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:24.793712 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bd909-dcf8-4aa7-a6bb-77f37ff9ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:24.794540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bd909-dcf8-4aa7-a6bb-77f37ff9ba4c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.794864 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bd909-dcf8-4aa7-a6bb-77f37ff9ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.795231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bd909-dcf8-4aa7-a6bb-77f37ff9ba4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.802997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bd909-dcf8-4aa7-a6bb-77f37ff9ba4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:24.804503 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bd909-dcf8-4aa7-a6bb-77f37ff9ba4c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-396bd909-dcf8-4aa7-a6bb-77f37ff9ba4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:24.825524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:24.826513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:24.827474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:24.827474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:24.827474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:24.827474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:24.827474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:24.827474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:24.827474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:24.827474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:24.831053 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 419/835] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:24.837253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bd909-dcf8-4aa7-a6bb-77f37ff9ba4c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.881201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa0c01-776b-45bf-9dfc-4f227f112ffa None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:24.901148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:24.930709 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4edfdc-bf52-4d0e-82b2-28eb54595a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:24.932025 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edfdc-bf52-4d0e-82b2-28eb54595a28 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.932585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edfdc-bf52-4d0e-82b2-28eb54595a28 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.932585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edfdc-bf52-4d0e-82b2-28eb54595a28 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.933747 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4edfdc-bf52-4d0e-82b2-28eb54595a28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:24.934064 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4edfdc-bf52-4d0e-82b2-28eb54595a28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:24.936014 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4edfdc-bf52-4d0e-82b2-28eb54595a28 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:24.939125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:24.957556 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 417/836] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:24.957556 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fb260-f034-40de-b32d-79a47dc8273f None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.957556 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fb260-f034-40de-b32d-79a47dc8273f None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.957556 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fb260-f034-40de-b32d-79a47dc8273f None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.957556 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 418/837] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:24.961651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fb260-f034-40de-b32d-79a47dc8273f None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.976951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bd909-dcf8-4aa7-a6bb-77f37ff9ba4c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.019230 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2cfb6-a8f5-419a-9a30-39af817c72ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.019870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2cfb6-a8f5-419a-9a30-39af817c72ed None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.020131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2cfb6-a8f5-419a-9a30-39af817c72ed None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.020407 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2cfb6-a8f5-419a-9a30-39af817c72ed None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.021205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2cfb6-a8f5-419a-9a30-39af817c72ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:25.021539 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2cfb6-a8f5-419a-9a30-39af817c72ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.023033 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2cfb6-a8f5-419a-9a30-39af817c72ed None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.035534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 420/838] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:25.036794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db72b-b7e0-43e4-bc73-57bcc04359ab None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.037082 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db72b-b7e0-43e4-bc73-57bcc04359ab None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.037360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db72b-b7e0-43e4-bc73-57bcc04359ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.054209 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-559db72b-b7e0-43e4-bc73-57bcc04359ab None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:25.055450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-559db72b-b7e0-43e4-bc73-57bcc04359ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:25.074836 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fb260-f034-40de-b32d-79a47dc8273f None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.112461 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee299be5-0818-4c5a-9533-1ac8fffcb935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.113736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee299be5-0818-4c5a-9533-1ac8fffcb935 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.114225 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee299be5-0818-4c5a-9533-1ac8fffcb935 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.114663 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee299be5-0818-4c5a-9533-1ac8fffcb935 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.123617 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee299be5-0818-4c5a-9533-1ac8fffcb935 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.125088 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee299be5-0818-4c5a-9533-1ac8fffcb935 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.130035 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 421/839] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:25.131400 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405640d-a6af-404b-9594-b0024155bcc2 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.131687 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405640d-a6af-404b-9594-b0024155bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.131962 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405640d-a6af-404b-9594-b0024155bcc2 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.133207 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 422/840] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:25.133890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405640d-a6af-404b-9594-b0024155bcc2 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-ee299be5-0818-4c5a-9533-1ac8fffcb935 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:25.144066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:25.145109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:25.146119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:25.146119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:25.146119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:25.146119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:25.146119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:25.146119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:25.146119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:25.146119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:25.146119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:25.146119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:25.146119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 419/841] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:25.147289 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a67a4-7eb8-4416-8081-46714a1fe086 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.147289 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a67a4-7eb8-4416-8081-46714a1fe086 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.147445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a67a4-7eb8-4416-8081-46714a1fe086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.165562 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-da3a67a4-7eb8-4416-8081-46714a1fe086 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:25.166799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-da3a67a4-7eb8-4416-8081-46714a1fe086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:25.175818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:25.238190 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:25.255792 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 420/842] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:25.256658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a67a4-7eb8-4416-8081-46714a1fe086 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:25.259583 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405640d-a6af-404b-9594-b0024155bcc2 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.301932 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54c977-19b6-4c68-8d23-675994af0706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.302726 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54c977-19b6-4c68-8d23-675994af0706 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.303198 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54c977-19b6-4c68-8d23-675994af0706 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.303630 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54c977-19b6-4c68-8d23-675994af0706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.304996 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54c977-19b6-4c68-8d23-675994af0706 None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:25.305433 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54c977-19b6-4c68-8d23-675994af0706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.307624 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54c977-19b6-4c68-8d23-675994af0706 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.334637 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 423/843] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:25 2022] GET /identity/v3/role_assignments?user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:25.334637 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54c977-19b6-4c68-8d23-675994af0706 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:25.386788 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a67a4-7eb8-4416-8081-46714a1fe086 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.434831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131026c9-0fe7-4834-98c7-7793b5d4bdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.435642 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131026c9-0fe7-4834-98c7-7793b5d4bdca None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.436008 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131026c9-0fe7-4834-98c7-7793b5d4bdca None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.436391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131026c9-0fe7-4834-98c7-7793b5d4bdca None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.437292 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131026c9-0fe7-4834-98c7-7793b5d4bdca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:25.437608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131026c9-0fe7-4834-98c7-7793b5d4bdca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.439298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131026c9-0fe7-4834-98c7-7793b5d4bdca None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.450504 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:25.453681 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54c977-19b6-4c68-8d23-675994af0706 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.459910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 421/844] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 19:43:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:25.463110 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131026c9-0fe7-4834-98c7-7793b5d4bdca None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:25.503409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9cb3e-fa2f-4fd6-8235-e9a4795a7984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.504325 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9cb3e-fa2f-4fd6-8235-e9a4795a7984 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.505531 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9cb3e-fa2f-4fd6-8235-e9a4795a7984 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.505531 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9cb3e-fa2f-4fd6-8235-e9a4795a7984 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.505531 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9cb3e-fa2f-4fd6-8235-e9a4795a7984 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.506952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9cb3e-fa2f-4fd6-8235-e9a4795a7984 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.517813 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-15c9cb3e-fa2f-4fd6-8235-e9a4795a7984 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:25.521391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:25.523017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:25.523905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 424/845] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:43:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:25.524734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9cb3e-fa2f-4fd6-8235-e9a4795a7984 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:25.598866 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131026c9-0fe7-4834-98c7-7793b5d4bdca None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.643488 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6a436-4bc9-4b7c-a881-212596b715e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.644507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6a436-4bc9-4b7c-a881-212596b715e4 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.644976 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6a436-4bc9-4b7c-a881-212596b715e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.645331 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6a436-4bc9-4b7c-a881-212596b715e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.649106 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9cb3e-fa2f-4fd6-8235-e9a4795a7984 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.659071 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6a436-4bc9-4b7c-a881-212596b715e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-f0d6a436-4bc9-4b7c-a881-212596b715e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:25.666752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:25.671435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 422/846] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:43:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:25.672298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6a436-4bc9-4b7c-a881-212596b715e4 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:25.699782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8184bb-9c05-4dbf-85e7-85bd71419e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.700570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8184bb-9c05-4dbf-85e7-85bd71419e74 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.700914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8184bb-9c05-4dbf-85e7-85bd71419e74 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.701441 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8184bb-9c05-4dbf-85e7-85bd71419e74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.736230 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:25.786191 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8184bb-9c05-4dbf-85e7-85bd71419e74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.786615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6a436-4bc9-4b7c-a881-212596b715e4 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.787707 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8184bb-9c05-4dbf-85e7-85bd71419e74 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.789992 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:25.836604 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba60ef-bdc1-4895-93b6-b9edde9b1792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.837373 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba60ef-bdc1-4895-93b6-b9edde9b1792 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.837666 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba60ef-bdc1-4895-93b6-b9edde9b1792 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.837942 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba60ef-bdc1-4895-93b6-b9edde9b1792 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.838767 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba60ef-bdc1-4895-93b6-b9edde9b1792 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:25.839130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba60ef-bdc1-4895-93b6-b9edde9b1792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.840695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba60ef-bdc1-4895-93b6-b9edde9b1792 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.851178 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 423/847] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:43:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:25.851178 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba60ef-bdc1-4895-93b6-b9edde9b1792 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:25.934850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 425/848] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:43:25.934850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8184bb-9c05-4dbf-85e7-85bd71419e74 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.001241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.003994 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba60ef-bdc1-4895-93b6-b9edde9b1792 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.042834 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8184bb-9c05-4dbf-85e7-85bd71419e74 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.063910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49d953-dd89-4333-a017-1c80a41e172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.065037 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49d953-dd89-4333-a017-1c80a41e172c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.065554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49d953-dd89-4333-a017-1c80a41e172c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.066044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49d953-dd89-4333-a017-1c80a41e172c None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.067562 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49d953-dd89-4333-a017-1c80a41e172c None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:26.068140 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49d953-dd89-4333-a017-1c80a41e172c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.070735 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49d953-dd89-4333-a017-1c80a41e172c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.079541 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd53e3-ebc2-432b-866b-fc074403acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.080201 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd53e3-ebc2-432b-866b-fc074403acb1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.080481 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd53e3-ebc2-432b-866b-fc074403acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.080751 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd53e3-ebc2-432b-866b-fc074403acb1 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.081457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd53e3-ebc2-432b-866b-fc074403acb1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:26.081760 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd53e3-ebc2-432b-866b-fc074403acb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.083188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd53e3-ebc2-432b-866b-fc074403acb1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.097608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 424/849] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:26.097863 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 426/850] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:43:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:26.097962 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49d953-dd89-4333-a017-1c80a41e172c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.099730 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd53e3-ebc2-432b-866b-fc074403acb1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.132763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.214854 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49d953-dd89-4333-a017-1c80a41e172c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.239091 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd53e3-ebc2-432b-866b-fc074403acb1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.256943 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e24328-9bbd-472a-a05e-1ae7db17ce83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.257745 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24328-9bbd-472a-a05e-1ae7db17ce83 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.258027 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24328-9bbd-472a-a05e-1ae7db17ce83 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.258300 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24328-9bbd-472a-a05e-1ae7db17ce83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.270049 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e24328-9bbd-472a-a05e-1ae7db17ce83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.270378 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.271560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e24328-9bbd-472a-a05e-1ae7db17ce83 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.281641 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf8d4c-09b5-4393-a10f-1f07d2f5f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.285791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf8d4c-09b5-4393-a10f-1f07d2f5f8c1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.286334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf8d4c-09b5-4393-a10f-1f07d2f5f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.286984 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf8d4c-09b5-4393-a10f-1f07d2f5f8c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-43e24328-9bbd-472a-a05e-1ae7db17ce83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:26.291521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:26.293114 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:26.294102 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:26.294102 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:26.294102 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:26.294102 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:26.294102 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 425/851] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:26.299426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e24328-9bbd-472a-a05e-1ae7db17ce83 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.303626 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf8d4c-09b5-4393-a10f-1f07d2f5f8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.305603 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf8d4c-09b5-4393-a10f-1f07d2f5f8c1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-85cf8d4c-09b5-4393-a10f-1f07d2f5f8c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:26.325485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:26.326424 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:26.327411 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:26.327411 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:26.327411 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:26.327411 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:26.329786 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 427/852] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:26.335111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf8d4c-09b5-4393-a10f-1f07d2f5f8c1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.410058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.435870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e24328-9bbd-472a-a05e-1ae7db17ce83 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.446567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf8d4c-09b5-4393-a10f-1f07d2f5f8c1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.477953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a199b-29c3-454a-b236-2984c3c01049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.478683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a199b-29c3-454a-b236-2984c3c01049 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.478969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a199b-29c3-454a-b236-2984c3c01049 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.479244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a199b-29c3-454a-b236-2984c3c01049 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.480525 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a199b-29c3-454a-b236-2984c3c01049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:26.480834 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a199b-29c3-454a-b236-2984c3c01049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.482198 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a199b-29c3-454a-b236-2984c3c01049 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.485552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5ea47-83fa-4b18-9a7b-5a1f5922211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.486340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5ea47-83fa-4b18-9a7b-5a1f5922211c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.486752 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5ea47-83fa-4b18-9a7b-5a1f5922211c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.487129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5ea47-83fa-4b18-9a7b-5a1f5922211c None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.487981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5ea47-83fa-4b18-9a7b-5a1f5922211c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:26.488388 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5ea47-83fa-4b18-9a7b-5a1f5922211c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.490000 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5ea47-83fa-4b18-9a7b-5a1f5922211c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.499571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 426/853] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:26.501024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a199b-29c3-454a-b236-2984c3c01049 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.504575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 428/854] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:26.510852 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5ea47-83fa-4b18-9a7b-5a1f5922211c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.570809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.642436 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5ea47-83fa-4b18-9a7b-5a1f5922211c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.646357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a199b-29c3-454a-b236-2984c3c01049 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.686130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f7c08-63bd-4e8f-81d1-aa808870253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.687781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f7c08-63bd-4e8f-81d1-aa808870253e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.688091 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f7c08-63bd-4e8f-81d1-aa808870253e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.688366 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f7c08-63bd-4e8f-81d1-aa808870253e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.693648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fcab3-e282-422e-97b1-fe5aec107004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.694461 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fcab3-e282-422e-97b1-fe5aec107004 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.694773 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fcab3-e282-422e-97b1-fe5aec107004 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.695046 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fcab3-e282-422e-97b1-fe5aec107004 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.697356 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f7c08-63bd-4e8f-81d1-aa808870253e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.699659 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f7c08-63bd-4e8f-81d1-aa808870253e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.704399 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fcab3-e282-422e-97b1-fe5aec107004 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.705960 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fcab3-e282-422e-97b1-fe5aec107004 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-008f7c08-63bd-4e8f-81d1-aa808870253e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:26.717080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:26.718032 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:26.718991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:26.718991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:26.718991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:26.718991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:26.718991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:26.718991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:26.718991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:26.718991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-8e6fcab3-e282-422e-97b1-fe5aec107004 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:26.722700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:26.724156 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:26.725948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:26.725948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:26.725948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:26.725948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:26.725948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:26.725948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:26.725948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:26.725948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:26.725948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:43:26.725948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:26.727156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 427/855] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:26.727156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f7c08-63bd-4e8f-81d1-aa808870253e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.730677 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 429/856] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:26.730897 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.732773 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fcab3-e282-422e-97b1-fe5aec107004 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.863486 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f7c08-63bd-4e8f-81d1-aa808870253e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.869556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.873163 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fcab3-e282-422e-97b1-fe5aec107004 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.922859 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e617f83-9ecc-4053-9b64-a9b012746d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.923545 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e617f83-9ecc-4053-9b64-a9b012746d0e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.923832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e617f83-9ecc-4053-9b64-a9b012746d0e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.924107 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e617f83-9ecc-4053-9b64-a9b012746d0e None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.924955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e617f83-9ecc-4053-9b64-a9b012746d0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:26.925270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e617f83-9ecc-4053-9b64-a9b012746d0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.926769 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e617f83-9ecc-4053-9b64-a9b012746d0e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.928908 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b3a15-4980-4928-affd-ec101216e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.931449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b3a15-4980-4928-affd-ec101216e57f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.931944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b3a15-4980-4928-affd-ec101216e57f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.932438 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b3a15-4980-4928-affd-ec101216e57f None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.934005 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b3a15-4980-4928-affd-ec101216e57f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:26.934991 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b3a15-4980-4928-affd-ec101216e57f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.939476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b3a15-4980-4928-affd-ec101216e57f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.955449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 430/857] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:26.957149 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e617f83-9ecc-4053-9b64-a9b012746d0e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.965001 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 428/858] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:26.973222 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b3a15-4980-4928-affd-ec101216e57f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:27.061554 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.108090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e617f83-9ecc-4053-9b64-a9b012746d0e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.108976 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b3a15-4980-4928-affd-ec101216e57f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.145454 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345310f-6274-4c72-af6d-4bb180812d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.146053 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4994488-7e79-4a49-a118-434140ff7b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.146177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345310f-6274-4c72-af6d-4bb180812d5a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.146434 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345310f-6274-4c72-af6d-4bb180812d5a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.146780 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345310f-6274-4c72-af6d-4bb180812d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.147495 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4994488-7e79-4a49-a118-434140ff7b5c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.147977 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4994488-7e79-4a49-a118-434140ff7b5c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.148451 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4994488-7e79-4a49-a118-434140ff7b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.149490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4994488-7e79-4a49-a118-434140ff7b5c None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=4e4b9ebe2ac648558b5f0133e8af8727) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:27.150027 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4994488-7e79-4a49-a118-434140ff7b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:27.151754 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4994488-7e79-4a49-a118-434140ff7b5c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:27.165374 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 429/859] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/role_assignments?user.id=4e4b9ebe2ac648558b5f0133e8af8727&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:27.178754 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.228940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345310f-6274-4c72-af6d-4bb180812d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:27.231045 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345310f-6274-4c72-af6d-4bb180812d5a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:27.370951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 431/860] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 19:43:27.376562 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4994488-7e79-4a49-a118-434140ff7b5c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:27.505510 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4994488-7e79-4a49-a118-434140ff7b5c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.535191 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.544340 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed9280-f4eb-4d4f-ad89-4eb6f11259b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.545130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed9280-f4eb-4d4f-ad89-4eb6f11259b0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.545413 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed9280-f4eb-4d4f-ad89-4eb6f11259b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.545688 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed9280-f4eb-4d4f-ad89-4eb6f11259b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.557215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed9280-f4eb-4d4f-ad89-4eb6f11259b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:27.561919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed9280-f4eb-4d4f-ad89-4eb6f11259b0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-98ed9280-f4eb-4d4f-ad89-4eb6f11259b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:27.577720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:27.578904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:27.580472 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:27.580472 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:27.580472 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:27.580472 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:27.580472 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 430/861] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:27.584805 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345310f-6274-4c72-af6d-4bb180812d5a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:27.675243 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.695166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dab34-f3e7-4faf-9c28-618deef2c7f7 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.695598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dab34-f3e7-4faf-9c28-618deef2c7f7 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.696037 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dab34-f3e7-4faf-9c28-618deef2c7f7 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.698134 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 431/862] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:27.705617 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c04c-c097-45d9-b697-b67f94f1f801 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.705909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c04c-c097-45d9-b697-b67f94f1f801 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.706357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c04c-c097-45d9-b697-b67f94f1f801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.713311 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345310f-6274-4c72-af6d-4bb180812d5a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.733312 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-7256c04c-c097-45d9-b697-b67f94f1f801 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:27.734645 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-7256c04c-c097-45d9-b697-b67f94f1f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:27.753859 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57625f-acda-4d67-b839-463a8e7dcd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.754702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57625f-acda-4d67-b839-463a8e7dcd03 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.754996 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57625f-acda-4d67-b839-463a8e7dcd03 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.755278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57625f-acda-4d67-b839-463a8e7dcd03 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.756188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57625f-acda-4d67-b839-463a8e7dcd03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:27.756446 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57625f-acda-4d67-b839-463a8e7dcd03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:27.757845 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57625f-acda-4d67-b839-463a8e7dcd03 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:27.778494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 432/863] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:27.784716 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57625f-acda-4d67-b839-463a8e7dcd03 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:27.843171 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 432/864] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:27.864856 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256c04c-c097-45d9-b697-b67f94f1f801 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:27.911172 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57625f-acda-4d67-b839-463a8e7dcd03 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.930837 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.950001 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ed84b-96da-4863-b27b-af324f26482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.951218 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ed84b-96da-4863-b27b-af324f26482e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.951715 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ed84b-96da-4863-b27b-af324f26482e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.952193 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ed84b-96da-4863-b27b-af324f26482e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.959693 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ed84b-96da-4863-b27b-af324f26482e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:27.961442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ed84b-96da-4863-b27b-af324f26482e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:27.974849 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256c04c-c097-45d9-b697-b67f94f1f801 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-4d8ed84b-96da-4863-b27b-af324f26482e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:27.976364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:27.977665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:27.978706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:27.978706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:27.978706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:27.978706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:27.978706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:27.978706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:27.978706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:27.978706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:27.986596 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.987505 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 433/865] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:27.988631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ed84b-96da-4863-b27b-af324f26482e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.014225 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65f98b-b8a8-439a-86ec-9c5aca791497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.015123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65f98b-b8a8-439a-86ec-9c5aca791497 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.015435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65f98b-b8a8-439a-86ec-9c5aca791497 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.015714 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65f98b-b8a8-439a-86ec-9c5aca791497 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.016432 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65f98b-b8a8-439a-86ec-9c5aca791497 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:28.017884 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65f98b-b8a8-439a-86ec-9c5aca791497 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-ec65f98b-b8a8-439a-86ec-9c5aca791497 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:28.034769 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:28.036777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:28.038449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 433/866] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 19:43:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:28.051093 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65f98b-b8a8-439a-86ec-9c5aca791497 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.177681 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ed84b-96da-4863-b27b-af324f26482e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:28.179260 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65f98b-b8a8-439a-86ec-9c5aca791497 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:28.223062 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07e230-4eb4-441e-a380-16e9b5a5b771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.223778 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07e230-4eb4-441e-a380-16e9b5a5b771 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.224062 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07e230-4eb4-441e-a380-16e9b5a5b771 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.224386 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07e230-4eb4-441e-a380-16e9b5a5b771 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.225102 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07e230-4eb4-441e-a380-16e9b5a5b771 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:28.225411 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07e230-4eb4-441e-a380-16e9b5a5b771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:28.226120 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75149c3e-666f-4574-bc37-e9d9355d28aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.226806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07e230-4eb4-441e-a380-16e9b5a5b771 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:28.227255 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75149c3e-666f-4574-bc37-e9d9355d28aa None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.228011 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75149c3e-666f-4574-bc37-e9d9355d28aa None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.228890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75149c3e-666f-4574-bc37-e9d9355d28aa None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.230757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75149c3e-666f-4574-bc37-e9d9355d28aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:28.231296 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75149c3e-666f-4574-bc37-e9d9355d28aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:28.236570 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 434/867] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 19:43:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:28.236719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75149c3e-666f-4574-bc37-e9d9355d28aa None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:28.238326 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07e230-4eb4-441e-a380-16e9b5a5b771 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.257612 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 434/868] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:28.258553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75149c3e-666f-4574-bc37-e9d9355d28aa None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.291055 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:28.317928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:28.378464 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07e230-4eb4-441e-a380-16e9b5a5b771 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:28.421922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75149c3e-666f-4574-bc37-e9d9355d28aa None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:28.427883 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaef19c-9aea-4fb2-8501-5638458657f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.428560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef19c-9aea-4fb2-8501-5638458657f6 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.428845 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef19c-9aea-4fb2-8501-5638458657f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.429123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef19c-9aea-4fb2-8501-5638458657f6 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.429843 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef19c-9aea-4fb2-8501-5638458657f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:28.430153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef19c-9aea-4fb2-8501-5638458657f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:28.431833 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef19c-9aea-4fb2-8501-5638458657f6 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:28.442801 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 435/869] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 19:43:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:28.471340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b21f8-67e1-46b8-a362-886b4781b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.472024 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b21f8-67e1-46b8-a362-886b4781b78b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.472305 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b21f8-67e1-46b8-a362-886b4781b78b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.472578 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b21f8-67e1-46b8-a362-886b4781b78b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.473439 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b21f8-67e1-46b8-a362-886b4781b78b None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=4741a268ae704e9582c1bb72f9c425a9) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:28.473753 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b21f8-67e1-46b8-a362-886b4781b78b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:28.475286 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b21f8-67e1-46b8-a362-886b4781b78b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:28.483462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 435/870] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:28 2022] GET /identity/v3/role_assignments?user.id=4741a268ae704e9582c1bb72f9c425a9&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:28.582651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a26129-66d4-469e-8dde-b1815b4e0ecc None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.583171 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a26129-66d4-469e-8dde-b1815b4e0ecc None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.583171 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a26129-66d4-469e-8dde-b1815b4e0ecc None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.584742 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 436/871] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:28.590993 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9da55a-ca28-411a-9742-e5507b7aad69 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.591785 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9da55a-ca28-411a-9742-e5507b7aad69 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.592312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9da55a-ca28-411a-9742-e5507b7aad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.618983 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-4f9da55a-ca28-411a-9742-e5507b7aad69 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:28.622451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4f9da55a-ca28-411a-9742-e5507b7aad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:28.731137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 436/872] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:28.753949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a26129-66d4-469e-8dde-b1815b4e0ecc None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.861144 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:28.865495 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a26129-66d4-469e-8dde-b1815b4e0ecc None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:28.904154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb75d8c-c94f-4fd4-8a20-eebcc9dcec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.904883 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb75d8c-c94f-4fd4-8a20-eebcc9dcec03 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.905166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb75d8c-c94f-4fd4-8a20-eebcc9dcec03 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.905441 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb75d8c-c94f-4fd4-8a20-eebcc9dcec03 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.906232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb75d8c-c94f-4fd4-8a20-eebcc9dcec03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:28.907773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb75d8c-c94f-4fd4-8a20-eebcc9dcec03 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:28.976887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 437/873] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:43:28 2022] POST /identity/v3/services => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:29.632217 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ad24e-3a71-4cd2-8ed5-cc16aad6a119 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:29.632739 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ad24e-3a71-4cd2-8ed5-cc16aad6a119 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:29.632739 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ad24e-3a71-4cd2-8ed5-cc16aad6a119 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:29.642011 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 437/874] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:29.642100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45fc5-5dfe-4605-b6b3-8e5621730742 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:29.642100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45fc5-5dfe-4605-b6b3-8e5621730742 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:29.642100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45fc5-5dfe-4605-b6b3-8e5621730742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:29.659438 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-85d45fc5-5dfe-4605-b6b3-8e5621730742 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:29.660675 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-85d45fc5-5dfe-4605-b6b3-8e5621730742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:29.742306 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 438/875] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:29.763916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ad24e-3a71-4cd2-8ed5-cc16aad6a119 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:29.799258 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:29.879104 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ad24e-3a71-4cd2-8ed5-cc16aad6a119 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:29.915759 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c290f5-fb44-4347-b81a-d9101f3b9c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:29.916820 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c290f5-fb44-4347-b81a-d9101f3b9c88 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:29.917831 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c290f5-fb44-4347-b81a-d9101f3b9c88 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:29.918253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c290f5-fb44-4347-b81a-d9101f3b9c88 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:29.929327 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c290f5-fb44-4347-b81a-d9101f3b9c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-f5c290f5-fb44-4347-b81a-d9101f3b9c88 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:29.938165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:29.939348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:43:29.940383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:29.942793 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 438/876] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 19:43:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:29.950634 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d45fc5-5dfe-4605-b6b3-8e5621730742 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.039196 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:30.056485 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d45fc5-5dfe-4605-b6b3-8e5621730742 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.092357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308239ee-91f3-43bb-9ce2-5f1d73cf813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.093007 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308239ee-91f3-43bb-9ce2-5f1d73cf813c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.093285 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308239ee-91f3-43bb-9ce2-5f1d73cf813c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.093561 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308239ee-91f3-43bb-9ce2-5f1d73cf813c None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.094296 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308239ee-91f3-43bb-9ce2-5f1d73cf813c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:30.094598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308239ee-91f3-43bb-9ce2-5f1d73cf813c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:30.096018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308239ee-91f3-43bb-9ce2-5f1d73cf813c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:30.104486 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 439/877] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 19:43:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:30.110012 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c290f5-fb44-4347-b81a-d9101f3b9c88 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.209281 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:30.218977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c290f5-fb44-4347-b81a-d9101f3b9c88 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.258070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db23fc0-4e9f-4376-a2c1-9d69f7eb277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.259241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23fc0-4e9f-4376-a2c1-9d69f7eb277d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.259713 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23fc0-4e9f-4376-a2c1-9d69f7eb277d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.260208 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23fc0-4e9f-4376-a2c1-9d69f7eb277d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.272055 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db23fc0-4e9f-4376-a2c1-9d69f7eb277d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:30.273812 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db23fc0-4e9f-4376-a2c1-9d69f7eb277d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-2db23fc0-4e9f-4376-a2c1-9d69f7eb277d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:30.293111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:30.294007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:30.294955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:30.294955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:30.294955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:30.294955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:30.294955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 439/878] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:30.300169 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308239ee-91f3-43bb-9ce2-5f1d73cf813c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.417334 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308239ee-91f3-43bb-9ce2-5f1d73cf813c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.454829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb1c25-a15e-45ed-a8d0-0fa5616bfd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.455876 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb1c25-a15e-45ed-a8d0-0fa5616bfd54 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.456387 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb1c25-a15e-45ed-a8d0-0fa5616bfd54 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.456886 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb1c25-a15e-45ed-a8d0-0fa5616bfd54 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.457842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb1c25-a15e-45ed-a8d0-0fa5616bfd54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:30.458348 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb1c25-a15e-45ed-a8d0-0fa5616bfd54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:30.460036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb1c25-a15e-45ed-a8d0-0fa5616bfd54 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:30.473702 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 440/879] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:30.478838 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db23fc0-4e9f-4376-a2c1-9d69f7eb277d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.591552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db23fc0-4e9f-4376-a2c1-9d69f7eb277d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.629594 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0401c-0ae3-4366-b80d-66591e0ab8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.630419 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0401c-0ae3-4366-b80d-66591e0ab8a3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.630734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0401c-0ae3-4366-b80d-66591e0ab8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.631015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0401c-0ae3-4366-b80d-66591e0ab8a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.639289 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0401c-0ae3-4366-b80d-66591e0ab8a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:30.644224 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0401c-0ae3-4366-b80d-66591e0ab8a3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-25c0401c-0ae3-4366-b80d-66591e0ab8a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:30.656322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:30.657345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:30.658316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:30.658316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:30.658316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:30.658316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:30.658316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:30.658316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:30.658316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:30.658316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:30.658316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:30.658316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:30.658316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 440/880] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:30.663664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb1c25-a15e-45ed-a8d0-0fa5616bfd54 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.678957 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:30.786929 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb1c25-a15e-45ed-a8d0-0fa5616bfd54 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.831301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaf4ac-acf6-4f5d-925a-2c8ccfb1a472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.831988 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaf4ac-acf6-4f5d-925a-2c8ccfb1a472 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.832270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaf4ac-acf6-4f5d-925a-2c8ccfb1a472 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.832545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaf4ac-acf6-4f5d-925a-2c8ccfb1a472 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.833424 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aaf4ac-acf6-4f5d-925a-2c8ccfb1a472 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:30.833735 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aaf4ac-acf6-4f5d-925a-2c8ccfb1a472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:30.835252 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aaf4ac-acf6-4f5d-925a-2c8ccfb1a472 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:30.855879 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 441/881] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:30.861135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0401c-0ae3-4366-b80d-66591e0ab8a3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.870945 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:30.918937 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac713c50-017e-43d7-809e-f2d03ea2893e None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.919578 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac713c50-017e-43d7-809e-f2d03ea2893e None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.920121 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac713c50-017e-43d7-809e-f2d03ea2893e None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.922162 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 442/882] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:30.927663 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a099f-269c-45e5-a4cb-4e3957dc1cd5 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.928241 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a099f-269c-45e5-a4cb-4e3957dc1cd5 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.928732 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a099f-269c-45e5-a4cb-4e3957dc1cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.951568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-ea4a099f-269c-45e5-a4cb-4e3957dc1cd5 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:30.954030 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-ea4a099f-269c-45e5-a4cb-4e3957dc1cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:30.981448 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0401c-0ae3-4366-b80d-66591e0ab8a3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.022007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbc862-d281-4163-a89a-f7e597892e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.022701 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbc862-d281-4163-a89a-f7e597892e1d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.022986 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbc862-d281-4163-a89a-f7e597892e1d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.023267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbc862-d281-4163-a89a-f7e597892e1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.031771 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.045509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 443/883] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:31.045509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207160ee-b9e0-4f06-a479-b986907e62d7 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.045509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207160ee-b9e0-4f06-a479-b986907e62d7 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.045509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207160ee-b9e0-4f06-a479-b986907e62d7 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.045509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 444/884] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:31.051813 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dae71-1619-48a3-bfc6-a0a2b1d5dc92 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.052108 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dae71-1619-48a3-bfc6-a0a2b1d5dc92 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.052391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dae71-1619-48a3-bfc6-a0a2b1d5dc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.070247 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-553dae71-1619-48a3-bfc6-a0a2b1d5dc92 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:31.071515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-553dae71-1619-48a3-bfc6-a0a2b1d5dc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:31.101657 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbc862-d281-4163-a89a-f7e597892e1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.103197 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbc862-d281-4163-a89a-f7e597892e1d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.107457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.144208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 445/885] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:31.145409 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dae71-1619-48a3-bfc6-a0a2b1d5dc92 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.239052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 441/886] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:43:31.240358 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbc862-d281-4163-a89a-f7e597892e1d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.263130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dae71-1619-48a3-bfc6-a0a2b1d5dc92 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.300133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.315924 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf903e4-13cf-4077-9c6a-ebe6341ad7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.316796 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf903e4-13cf-4077-9c6a-ebe6341ad7cf None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.317077 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf903e4-13cf-4077-9c6a-ebe6341ad7cf None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.317348 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf903e4-13cf-4077-9c6a-ebe6341ad7cf None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.318075 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf903e4-13cf-4077-9c6a-ebe6341ad7cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.319485 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf903e4-13cf-4077-9c6a-ebe6341ad7cf None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.352749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbc862-d281-4163-a89a-f7e597892e1d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.355767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.388089 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610936e0-5daf-4ac8-b346-465864937e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.388900 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610936e0-5daf-4ac8-b346-465864937e56 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.389183 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610936e0-5daf-4ac8-b346-465864937e56 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.389457 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610936e0-5daf-4ac8-b346-465864937e56 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.390120 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610936e0-5daf-4ac8-b346-465864937e56 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.391552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610936e0-5daf-4ac8-b346-465864937e56 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-610936e0-5daf-4ac8-b346-465864937e56 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:31.406139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:31.409272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:31.410179 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:31.411567 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 446/887] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:43:31 2022] POST /identity/v3/services => generated 269 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:31.411567 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf903e4-13cf-4077-9c6a-ebe6341ad7cf None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.412840 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 442/888] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:31.413858 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610936e0-5daf-4ac8-b346-465864937e56 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.542040 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf903e4-13cf-4077-9c6a-ebe6341ad7cf None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.542252 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610936e0-5daf-4ac8-b346-465864937e56 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.580313 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a03ca8-e58e-4e85-86fa-c23f9cb677aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.580910 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03ca8-e58e-4e85-86fa-c23f9cb677aa None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.581194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03ca8-e58e-4e85-86fa-c23f9cb677aa None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.581476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03ca8-e58e-4e85-86fa-c23f9cb677aa None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.582202 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a03ca8-e58e-4e85-86fa-c23f9cb677aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:31.582513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a03ca8-e58e-4e85-86fa-c23f9cb677aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.583979 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a03ca8-e58e-4e85-86fa-c23f9cb677aa None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.589801 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 443/889] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:31.591267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1fe8-966b-4510-92b6-8eeec28209d6 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.591566 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1fe8-966b-4510-92b6-8eeec28209d6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.591847 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1fe8-966b-4510-92b6-8eeec28209d6 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.593289 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 444/890] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:31.595685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d1fe8-966b-4510-92b6-8eeec28209d6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.596614 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ade0-848a-46bd-a055-eaefc72d19d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.598969 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ade0-848a-46bd-a055-eaefc72d19d7 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.599499 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ade0-848a-46bd-a055-eaefc72d19d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.599778 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ade0-848a-46bd-a055-eaefc72d19d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.614117 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ade0-848a-46bd-a055-eaefc72d19d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.615827 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ade0-848a-46bd-a055-eaefc72d19d7 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-d2e8ade0-848a-46bd-a055-eaefc72d19d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:31.636156 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:31.637378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:31.638515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:31.638515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:31.638515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:31.638515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:31.638838 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.638927 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 447/891] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:31.639521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d1da2-cf05-4f68-bfc1-7e939663d0a4 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.648548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d1da2-cf05-4f68-bfc1-7e939663d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.648548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d1da2-cf05-4f68-bfc1-7e939663d0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.657820 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-778d1da2-cf05-4f68-bfc1-7e939663d0a4 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:31.659071 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-778d1da2-cf05-4f68-bfc1-7e939663d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:31.690481 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.723811 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d1fe8-966b-4510-92b6-8eeec28209d6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.738716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 448/892] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:31.743534 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d1da2-cf05-4f68-bfc1-7e939663d0a4 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.768690 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bda56-848f-4140-a3c0-0d35247112eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.769371 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bda56-848f-4140-a3c0-0d35247112eb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.769651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bda56-848f-4140-a3c0-0d35247112eb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.769925 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bda56-848f-4140-a3c0-0d35247112eb None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.773549 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bda56-848f-4140-a3c0-0d35247112eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:31.773549 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bda56-848f-4140-a3c0-0d35247112eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.773549 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bda56-848f-4140-a3c0-0d35247112eb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.786695 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 445/893] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:31.786695 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bda56-848f-4140-a3c0-0d35247112eb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.888531 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d1da2-cf05-4f68-bfc1-7e939663d0a4 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.928529 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.936116 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe42f7e-64fd-490e-911b-b5420c252b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.937044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe42f7e-64fd-490e-911b-b5420c252b99 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.937429 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe42f7e-64fd-490e-911b-b5420c252b99 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.937672 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bda56-848f-4140-a3c0-0d35247112eb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.937891 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe42f7e-64fd-490e-911b-b5420c252b99 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.938822 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe42f7e-64fd-490e-911b-b5420c252b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:31.939241 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe42f7e-64fd-490e-911b-b5420c252b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.941097 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe42f7e-64fd-490e-911b-b5420c252b99 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.956637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 449/894] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:31.962427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe42f7e-64fd-490e-911b-b5420c252b99 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.996914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5955e-904f-4db4-84ed-92708b9951e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.998161 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5955e-904f-4db4-84ed-92708b9951e2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.998706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5955e-904f-4db4-84ed-92708b9951e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.998984 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.999432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5955e-904f-4db4-84ed-92708b9951e2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:32.000337 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5955e-904f-4db4-84ed-92708b9951e2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:32.001998 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5955e-904f-4db4-84ed-92708b9951e2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-64d5955e-904f-4db4-84ed-92708b9951e2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:32.017890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:32.022791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:32.023818 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 446/895] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:32.026972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5955e-904f-4db4-84ed-92708b9951e2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:32.104551 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe42f7e-64fd-490e-911b-b5420c252b99 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:32.153494 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b360310-2ac7-4b25-8637-2088ecc04b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:32.154797 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b360310-2ac7-4b25-8637-2088ecc04b10 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:32.155479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b360310-2ac7-4b25-8637-2088ecc04b10 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:32.155993 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b360310-2ac7-4b25-8637-2088ecc04b10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:32.161793 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5955e-904f-4db4-84ed-92708b9951e2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:32.166560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b360310-2ac7-4b25-8637-2088ecc04b10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:32.169884 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b360310-2ac7-4b25-8637-2088ecc04b10 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-0b360310-2ac7-4b25-8637-2088ecc04b10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:32.195711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:32.196913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:32.198493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:32.198493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:32.198493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:32.198493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:32.198493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:32.198493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:32.198493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:32.198493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:32.201704 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 450/896] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:32.206909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20b2c-b64e-4f31-bc8c-908fc00ecc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:32.207513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b360310-2ac7-4b25-8637-2088ecc04b10 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:32.208224 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20b2c-b64e-4f31-bc8c-908fc00ecc63 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:32.208720 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20b2c-b64e-4f31-bc8c-908fc00ecc63 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:32.209198 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20b2c-b64e-4f31-bc8c-908fc00ecc63 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:32.210188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab20b2c-b64e-4f31-bc8c-908fc00ecc63 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:32.210772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab20b2c-b64e-4f31-bc8c-908fc00ecc63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:32.212460 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab20b2c-b64e-4f31-bc8c-908fc00ecc63 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:32.219215 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 447/897] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:43:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:32.226673 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20b2c-b64e-4f31-bc8c-908fc00ecc63 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:32.264648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:32.322728 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:32.350838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b360310-2ac7-4b25-8637-2088ecc04b10 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:32.368190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20b2c-b64e-4f31-bc8c-908fc00ecc63 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:32.397528 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80222cf8-e708-41e7-9c4e-5dcdb09b428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:32.398648 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80222cf8-e708-41e7-9c4e-5dcdb09b428a None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:32.399215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80222cf8-e708-41e7-9c4e-5dcdb09b428a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:32.399507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80222cf8-e708-41e7-9c4e-5dcdb09b428a None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:32.400584 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80222cf8-e708-41e7-9c4e-5dcdb09b428a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:32.400908 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80222cf8-e708-41e7-9c4e-5dcdb09b428a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:32.403809 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80222cf8-e708-41e7-9c4e-5dcdb09b428a None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:32.406959 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c7712-a74f-45f7-b483-3af664521c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:32.407715 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c7712-a74f-45f7-b483-3af664521c95 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:32.408084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c7712-a74f-45f7-b483-3af664521c95 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:32.408432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c7712-a74f-45f7-b483-3af664521c95 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:32.409220 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c7712-a74f-45f7-b483-3af664521c95 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:32.409599 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c7712-a74f-45f7-b483-3af664521c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:32.411111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c7712-a74f-45f7-b483-3af664521c95 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:32.418050 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 448/898] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:43:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:32.420018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 451/899] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:32.428377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c7712-a74f-45f7-b483-3af664521c95 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:32.428536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80222cf8-e708-41e7-9c4e-5dcdb09b428a None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:32.529319 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:32.544142 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c7712-a74f-45f7-b483-3af664521c95 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:32.581603 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80222cf8-e708-41e7-9c4e-5dcdb09b428a None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:32.582636 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d894e-b1ca-4a03-85f5-2325598df8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:32.583328 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d894e-b1ca-4a03-85f5-2325598df8e4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:32.583608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d894e-b1ca-4a03-85f5-2325598df8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:32.583883 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d894e-b1ca-4a03-85f5-2325598df8e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:32.584678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d894e-b1ca-4a03-85f5-2325598df8e4 None admin] RBAC: Adding query filter params (interface=public, service_id=5e3ab96f4fe34454baa64aba8382e1ab, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:32.584988 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d894e-b1ca-4a03-85f5-2325598df8e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:32.586485 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d894e-b1ca-4a03-85f5-2325598df8e4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:32.599001 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 449/900] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 19:43:32 2022] GET /identity/v3/endpoints?service_id=5e3ab96f4fe34454baa64aba8382e1ab&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:32.601095 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d894e-b1ca-4a03-85f5-2325598df8e4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:32.629773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdc3dd-1a7c-4ea7-82f6-afa022e7fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:32.630454 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdc3dd-1a7c-4ea7-82f6-afa022e7fb93 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:32.630761 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdc3dd-1a7c-4ea7-82f6-afa022e7fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:32.631035 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdc3dd-1a7c-4ea7-82f6-afa022e7fb93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:32.631878 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdc3dd-1a7c-4ea7-82f6-afa022e7fb93 None admin] RBAC: Adding query filter params (role.id=eef7d022d05842b7a4bc4d6b88f6d0d6, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=4e4b9ebe2ac648558b5f0133e8af8727) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:32.632186 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdc3dd-1a7c-4ea7-82f6-afa022e7fb93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:32.633826 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdc3dd-1a7c-4ea7-82f6-afa022e7fb93 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:32.641287 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 452/901] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:32 2022] GET /identity/v3/role_assignments?user.id=4e4b9ebe2ac648558b5f0133e8af8727&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=eef7d022d05842b7a4bc4d6b88f6d0d6 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:32.751640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d894e-b1ca-4a03-85f5-2325598df8e4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:32.798531 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fde4a-f1e6-40aa-89ac-0757a1a134b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:32.799248 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fde4a-f1e6-40aa-89ac-0757a1a134b2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:32.799529 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fde4a-f1e6-40aa-89ac-0757a1a134b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:32.799882 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fde4a-f1e6-40aa-89ac-0757a1a134b2 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:32.800638 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78fde4a-f1e6-40aa-89ac-0757a1a134b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:32.802191 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78fde4a-f1e6-40aa-89ac-0757a1a134b2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:32.811982 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 450/902] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 19:43:32 2022] GET /identity/v3/services => generated 1268 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 19:43:33.777792 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d10dc0-aec6-406e-9694-afd6fc45ab0a None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:33.778377 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d10dc0-aec6-406e-9694-afd6fc45ab0a None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:33.778377 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d10dc0-aec6-406e-9694-afd6fc45ab0a None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:33.780226 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 453/903] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:33.785979 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c924-41e2-436a-90d0-5083fc13b009 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:33.786452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c924-41e2-436a-90d0-5083fc13b009 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:33.786537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c924-41e2-436a-90d0-5083fc13b009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:33.803984 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e9f2c924-41e2-436a-90d0-5083fc13b009 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:33.805154 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e9f2c924-41e2-436a-90d0-5083fc13b009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:33.817382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:33.877793 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 451/904] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:33.899979 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d10dc0-aec6-406e-9694-afd6fc45ab0a None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:33.924989 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.029436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d10dc0-aec6-406e-9694-afd6fc45ab0a None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.067064 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f794ca3-19fc-4392-93b1-db8261675451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.067876 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794ca3-19fc-4392-93b1-db8261675451 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.068162 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794ca3-19fc-4392-93b1-db8261675451 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.068441 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794ca3-19fc-4392-93b1-db8261675451 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.069098 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f794ca3-19fc-4392-93b1-db8261675451 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.070479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f794ca3-19fc-4392-93b1-db8261675451 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-1f794ca3-19fc-4392-93b1-db8261675451 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:34.083443 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:34.085563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:34.087575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 454/905] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 19:43:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:34.094627 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2c924-41e2-436a-90d0-5083fc13b009 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.206249 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a101a1-cb85-4d71-bc69-d487ebab4f87 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.206536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a101a1-cb85-4d71-bc69-d487ebab4f87 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.206854 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a101a1-cb85-4d71-bc69-d487ebab4f87 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.208223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 455/906] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:34.214054 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2c924-41e2-436a-90d0-5083fc13b009 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.214630 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47c4df-550c-466c-8682-9fdb95aa34ea None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.214916 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47c4df-550c-466c-8682-9fdb95aa34ea None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.215194 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47c4df-550c-466c-8682-9fdb95aa34ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.236026 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-dd47c4df-550c-466c-8682-9fdb95aa34ea None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:34.237392 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-dd47c4df-550c-466c-8682-9fdb95aa34ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:34.256657 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fdae6-349b-482f-95d5-30f911830abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.257717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fdae6-349b-482f-95d5-30f911830abe None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.258233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fdae6-349b-482f-95d5-30f911830abe None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.258747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fdae6-349b-482f-95d5-30f911830abe None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.259808 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fdae6-349b-482f-95d5-30f911830abe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:34.260428 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fdae6-349b-482f-95d5-30f911830abe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.262174 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fdae6-349b-482f-95d5-30f911830abe None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.268532 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 452/907] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:34.276941 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fdae6-349b-482f-95d5-30f911830abe None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.291039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.347011 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 456/908] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:34.366187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47c4df-550c-466c-8682-9fdb95aa34ea None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.369079 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.402641 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fdae6-349b-482f-95d5-30f911830abe None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.452281 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185a91-bff9-4c6a-8596-5e1ce18e16ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.452961 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185a91-bff9-4c6a-8596-5e1ce18e16ce None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.453248 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185a91-bff9-4c6a-8596-5e1ce18e16ce None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.453528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185a91-bff9-4c6a-8596-5e1ce18e16ce None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.454245 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74185a91-bff9-4c6a-8596-5e1ce18e16ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:34.454842 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74185a91-bff9-4c6a-8596-5e1ce18e16ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.456751 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74185a91-bff9-4c6a-8596-5e1ce18e16ce None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.464459 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 453/909] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:34.470694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185a91-bff9-4c6a-8596-5e1ce18e16ce None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.478752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47c4df-550c-466c-8682-9fdb95aa34ea None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.516187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021edd1-3fe2-4e05-8ce9-a22956216313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.516957 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021edd1-3fe2-4e05-8ce9-a22956216313 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.517308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021edd1-3fe2-4e05-8ce9-a22956216313 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.517651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021edd1-3fe2-4e05-8ce9-a22956216313 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.518457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021edd1-3fe2-4e05-8ce9-a22956216313 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.520021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021edd1-3fe2-4e05-8ce9-a22956216313 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.561173 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.583610 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 457/910] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:43:34 2022] POST /identity/v3/services => generated 241 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:43:34.600501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185a91-bff9-4c6a-8596-5e1ce18e16ce None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.655159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be187a75-d80b-4435-a9e5-3648701df02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.655902 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187a75-d80b-4435-a9e5-3648701df02c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.656298 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187a75-d80b-4435-a9e5-3648701df02c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.656581 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187a75-d80b-4435-a9e5-3648701df02c None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.657534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be187a75-d80b-4435-a9e5-3648701df02c None admin] RBAC: Adding query filter params (interface=public, service_id=34fdfb52a52e43379484775a001da05c, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:34.657859 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be187a75-d80b-4435-a9e5-3648701df02c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.659414 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be187a75-d80b-4435-a9e5-3648701df02c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.669973 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 454/911] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/endpoints?service_id=34fdfb52a52e43379484775a001da05c&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:34.672676 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021edd1-3fe2-4e05-8ce9-a22956216313 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.750049 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.803168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021edd1-3fe2-4e05-8ce9-a22956216313 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.844341 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445dec7-0a22-4074-aaca-b9ce77f3eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.844933 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445dec7-0a22-4074-aaca-b9ce77f3eb73 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.845212 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445dec7-0a22-4074-aaca-b9ce77f3eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.845481 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445dec7-0a22-4074-aaca-b9ce77f3eb73 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.846168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445dec7-0a22-4074-aaca-b9ce77f3eb73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.847581 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445dec7-0a22-4074-aaca-b9ce77f3eb73 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.854536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 458/912] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:43:35.131280 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a44f43-0a40-404e-898a-bc44cd62bdf7 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.132305 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a44f43-0a40-404e-898a-bc44cd62bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.132838 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a44f43-0a40-404e-898a-bc44cd62bdf7 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.134830 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 455/913] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:35.140806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8ab5a-d04a-4c63-816a-ceb81b45d3c8 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.141086 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8ab5a-d04a-4c63-816a-ceb81b45d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.141370 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8ab5a-d04a-4c63-816a-ceb81b45d3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.159259 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-78c8ab5a-d04a-4c63-816a-ceb81b45d3c8 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:35.160462 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-78c8ab5a-d04a-4c63-816a-ceb81b45d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:35.239959 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 459/914] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:35.275696 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a44f43-0a40-404e-898a-bc44cd62bdf7 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:35.318885 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc676a-d183-4454-bf9a-a03b4f5113eb None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.319403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc676a-d183-4454-bf9a-a03b4f5113eb None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.319907 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc676a-d183-4454-bf9a-a03b4f5113eb None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.322707 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 460/915] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:35.338492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72092e42-070c-42fd-b344-c0ff3bf1f044 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.339571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72092e42-070c-42fd-b344-c0ff3bf1f044 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.340082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72092e42-070c-42fd-b344-c0ff3bf1f044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.368868 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-72092e42-070c-42fd-b344-c0ff3bf1f044 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:35.370928 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-72092e42-070c-42fd-b344-c0ff3bf1f044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:35.481248 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:35.489158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a44f43-0a40-404e-898a-bc44cd62bdf7 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:35.518851 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 461/916] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:35.554499 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fe0c3-edaa-4c80-9b40-a8036b386e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:35.556745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe0c3-edaa-4c80-9b40-a8036b386e1c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.558171 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe0c3-edaa-4c80-9b40-a8036b386e1c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.559010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe0c3-edaa-4c80-9b40-a8036b386e1c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.560712 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fe0c3-edaa-4c80-9b40-a8036b386e1c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:35.563796 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fe0c3-edaa-4c80-9b40-a8036b386e1c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:35.566529 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72092e42-070c-42fd-b344-c0ff3bf1f044 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:35.568695 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-549fe0c3-edaa-4c80-9b40-a8036b386e1c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:35.585813 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:35.587940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:43:35.589719 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:35.594229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 456/917] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:43:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:35.604874 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fe0c3-edaa-4c80-9b40-a8036b386e1c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:35.776280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72092e42-070c-42fd-b344-c0ff3bf1f044 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:35.832108 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fe0c3-edaa-4c80-9b40-a8036b386e1c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:35.847581 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648f625-fc3d-47d5-becc-16f205951fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:35.850751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648f625-fc3d-47d5-becc-16f205951fe3 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.851485 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648f625-fc3d-47d5-becc-16f205951fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.852166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648f625-fc3d-47d5-becc-16f205951fe3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.878144 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648f625-fc3d-47d5-becc-16f205951fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-0648f625-fc3d-47d5-becc-16f205951fe3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:35.900746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:35.902974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:43:35.904949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:35.906436 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f09cd-1598-4da3-a819-003abc3c74d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:35.907674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f09cd-1598-4da3-a819-003abc3c74d8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.908283 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f09cd-1598-4da3-a819-003abc3c74d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.908876 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f09cd-1598-4da3-a819-003abc3c74d8 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.910369 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 462/918] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 19:43:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:35.919325 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f09cd-1598-4da3-a819-003abc3c74d8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:35.919325 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f09cd-1598-4da3-a819-003abc3c74d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:35.920740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f09cd-1598-4da3-a819-003abc3c74d8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:35.921879 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648f625-fc3d-47d5-becc-16f205951fe3 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:35.945825 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 457/919] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:43:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:35.948059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f09cd-1598-4da3-a819-003abc3c74d8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:36.012545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:36.075275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:36.113913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648f625-fc3d-47d5-becc-16f205951fe3 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:36.154445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f09cd-1598-4da3-a819-003abc3c74d8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:36.175276 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c229e2-874d-40d8-9c6c-b74a587b41ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:36.176347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c229e2-874d-40d8-9c6c-b74a587b41ac None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:36.176749 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c229e2-874d-40d8-9c6c-b74a587b41ac None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:36.177194 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c229e2-874d-40d8-9c6c-b74a587b41ac None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:36.178484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c229e2-874d-40d8-9c6c-b74a587b41ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:36.179028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c229e2-874d-40d8-9c6c-b74a587b41ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:36.181627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c229e2-874d-40d8-9c6c-b74a587b41ac None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:36.202644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 463/920] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 19:43:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:36.208344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c229e2-874d-40d8-9c6c-b74a587b41ac None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:36.233082 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97650f1-3e18-45c6-8b71-b1e1cacbb61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:36.235107 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97650f1-3e18-45c6-8b71-b1e1cacbb61c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:36.235895 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97650f1-3e18-45c6-8b71-b1e1cacbb61c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:36.236667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97650f1-3e18-45c6-8b71-b1e1cacbb61c None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:36.238682 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97650f1-3e18-45c6-8b71-b1e1cacbb61c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:36.240052 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97650f1-3e18-45c6-8b71-b1e1cacbb61c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:36.243458 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97650f1-3e18-45c6-8b71-b1e1cacbb61c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:36.263108 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 458/921] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 19:43:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:36.266069 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97650f1-3e18-45c6-8b71-b1e1cacbb61c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:36.431942 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c229e2-874d-40d8-9c6c-b74a587b41ac None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:36.450708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:36.471608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97650f1-3e18-45c6-8b71-b1e1cacbb61c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:36.502227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a190765-2c9b-4e09-bd2e-3ecf47b952bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:36.503764 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a190765-2c9b-4e09-bd2e-3ecf47b952bd None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:36.504352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a190765-2c9b-4e09-bd2e-3ecf47b952bd None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:36.504944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a190765-2c9b-4e09-bd2e-3ecf47b952bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:36.527757 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a190765-2c9b-4e09-bd2e-3ecf47b952bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:36.529117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:36.530849 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a190765-2c9b-4e09-bd2e-3ecf47b952bd None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:36.547403 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7ca7a-5689-4b87-b58a-e84838ef9bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:36.549115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7ca7a-5689-4b87-b58a-e84838ef9bf4 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:36.549862 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7ca7a-5689-4b87-b58a-e84838ef9bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:36.550596 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7ca7a-5689-4b87-b58a-e84838ef9bf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:36.552442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7ca7a-5689-4b87-b58a-e84838ef9bf4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:36.555368 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7ca7a-5689-4b87-b58a-e84838ef9bf4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-8a190765-2c9b-4e09-bd2e-3ecf47b952bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:36.568579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:36.570457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:36.572353 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:36.572353 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:36.572353 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:36.572353 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:36.580111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 464/922] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:36.581835 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a190765-2c9b-4e09-bd2e-3ecf47b952bd None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:36.659062 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 459/923] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 19:43:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:36.804874 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a190765-2c9b-4e09-bd2e-3ecf47b952bd None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:36.891500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ebb6-d01a-4021-a538-ead2724804a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:36.892699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ebb6-d01a-4021-a538-ead2724804a6 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:36.893063 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ebb6-d01a-4021-a538-ead2724804a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:36.893589 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ebb6-d01a-4021-a538-ead2724804a6 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:36.895049 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543ebb6-d01a-4021-a538-ead2724804a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:36.895603 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543ebb6-d01a-4021-a538-ead2724804a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:36.898190 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543ebb6-d01a-4021-a538-ead2724804a6 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:36.925209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 465/924] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:36.935599 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7ca7a-5689-4b87-b58a-e84838ef9bf4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:37.157542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7ca7a-5689-4b87-b58a-e84838ef9bf4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:37.233367 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394b88-517a-4048-a72d-a121a95dad91 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.233647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394b88-517a-4048-a72d-a121a95dad91 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.234020 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394b88-517a-4048-a72d-a121a95dad91 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.235673 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 466/925] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:37.236291 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698073-c6d8-4727-a175-949b11ee5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:37.238106 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698073-c6d8-4727-a175-949b11ee5ece None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.238955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698073-c6d8-4727-a175-949b11ee5ece None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.239756 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698073-c6d8-4727-a175-949b11ee5ece None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.241474 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd1c4a-1095-4769-a774-99ccd4c68939 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.241875 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd1c4a-1095-4769-a774-99ccd4c68939 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.242255 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd1c4a-1095-4769-a774-99ccd4c68939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.257354 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2698073-c6d8-4727-a175-949b11ee5ece None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:37.260817 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2698073-c6d8-4727-a175-949b11ee5ece None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:37.261369 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-13dd1c4a-1095-4769-a774-99ccd4c68939 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:37.262952 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-13dd1c4a-1095-4769-a774-99ccd4c68939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:37.277668 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c2698073-c6d8-4727-a175-949b11ee5ece None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:37.293734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:37.294803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:37.296007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:37.296007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:37.296007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:37.296007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:37.296007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:37.296007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:37.296007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:37.296007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:37.296007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:37.296007 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:37.296563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 460/926] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 19:43:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:37.305368 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698073-c6d8-4727-a175-949b11ee5ece None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:37.366891 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 467/927] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:37.382885 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd1c4a-1095-4769-a774-99ccd4c68939 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:37.411125 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:37.520778 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698073-c6d8-4727-a175-949b11ee5ece None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:37.586017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b0131-0ae2-460c-9ea8-0817600d2103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:37.587280 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b0131-0ae2-460c-9ea8-0817600d2103 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.587859 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b0131-0ae2-460c-9ea8-0817600d2103 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.588306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b0131-0ae2-460c-9ea8-0817600d2103 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.590400 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b0131-0ae2-460c-9ea8-0817600d2103 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:37.591000 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b0131-0ae2-460c-9ea8-0817600d2103 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:37.591957 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd1c4a-1095-4769-a774-99ccd4c68939 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:37.593739 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b0131-0ae2-460c-9ea8-0817600d2103 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:37.627313 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 461/928] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 19:43:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:37.636350 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b0131-0ae2-460c-9ea8-0817600d2103 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:37.670253 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf4e24-b729-42b5-9376-b968f6dafbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:37.672064 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4e24-b729-42b5-9376-b968f6dafbcf None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.672548 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4e24-b729-42b5-9376-b968f6dafbcf None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.672968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4e24-b729-42b5-9376-b968f6dafbcf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.673790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf4e24-b729-42b5-9376-b968f6dafbcf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:37.675621 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf4e24-b729-42b5-9376-b968f6dafbcf None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-ecaf4e24-b729-42b5-9376-b968f6dafbcf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:37.691418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:37.694317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:37.696130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 468/929] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 19:43:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:37.699230 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed10614-602c-4272-98e0-1102952134d1 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.699230 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed10614-602c-4272-98e0-1102952134d1 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.699230 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed10614-602c-4272-98e0-1102952134d1 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.700174 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 469/930] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:37.701103 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed10614-602c-4272-98e0-1102952134d1 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:37.723310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:37.818380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:37.824757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b0131-0ae2-460c-9ea8-0817600d2103 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:37.866871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed10614-602c-4272-98e0-1102952134d1 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:37.878322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5363614-a8b1-4fe0-9476-52142597d760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:37.879173 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363614-a8b1-4fe0-9476-52142597d760 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.879455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363614-a8b1-4fe0-9476-52142597d760 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.879734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363614-a8b1-4fe0-9476-52142597d760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.892973 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5363614-a8b1-4fe0-9476-52142597d760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:37.894478 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5363614-a8b1-4fe0-9476-52142597d760 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:37.912638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab56b66-b5db-435c-8496-cb2f228b040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:37.913670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56b66-b5db-435c-8496-cb2f228b040f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.914079 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56b66-b5db-435c-8496-cb2f228b040f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.914489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56b66-b5db-435c-8496-cb2f228b040f None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-d5363614-a8b1-4fe0-9476-52142597d760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:37.915231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:37.916888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:37.918643 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:37.918643 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:37.918643 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:37.918643 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:37.919069 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab56b66-b5db-435c-8496-cb2f228b040f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:37.919069 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab56b66-b5db-435c-8496-cb2f228b040f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:37.919342 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 462/931] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:37.919342 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee963a-af3a-4de1-b81f-4096f3eb49f8 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.919342 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee963a-af3a-4de1-b81f-4096f3eb49f8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.919342 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee963a-af3a-4de1-b81f-4096f3eb49f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.924580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab56b66-b5db-435c-8496-cb2f228b040f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:37.937959 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 470/932] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 19:43:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:37.937959 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab56b66-b5db-435c-8496-cb2f228b040f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:37.945886 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-18ee963a-af3a-4de1-b81f-4096f3eb49f8 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:37.947306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-18ee963a-af3a-4de1-b81f-4096f3eb49f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:38.036210 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 463/933] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:38.037253 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.037524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee963a-af3a-4de1-b81f-4096f3eb49f8 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.093137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab56b66-b5db-435c-8496-cb2f228b040f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.159316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09233ba3-a5eb-4975-9a4f-83dea2704ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.160859 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233ba3-a5eb-4975-9a4f-83dea2704ef5 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.161730 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233ba3-a5eb-4975-9a4f-83dea2704ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.162461 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233ba3-a5eb-4975-9a4f-83dea2704ef5 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.164023 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09233ba3-a5eb-4975-9a4f-83dea2704ef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:38.165562 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09233ba3-a5eb-4975-9a4f-83dea2704ef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:38.168858 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09233ba3-a5eb-4975-9a4f-83dea2704ef5 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:38.176056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.189342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 471/934] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:38.189342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09233ba3-a5eb-4975-9a4f-83dea2704ef5 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.210998 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee963a-af3a-4de1-b81f-4096f3eb49f8 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.276359 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1afc4-ecf4-45d0-ac48-057f259c2dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.277421 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1afc4-ecf4-45d0-ac48-057f259c2dab None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.277888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1afc4-ecf4-45d0-ac48-057f259c2dab None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.278642 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1afc4-ecf4-45d0-ac48-057f259c2dab None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.279168 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1afc4-ecf4-45d0-ac48-057f259c2dab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:38.279677 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1afc4-ecf4-45d0-ac48-057f259c2dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:38.284147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1afc4-ecf4-45d0-ac48-057f259c2dab None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:38.297425 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 464/935] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:38.297425 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1afc4-ecf4-45d0-ac48-057f259c2dab None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.357523 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09233ba3-a5eb-4975-9a4f-83dea2704ef5 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.402085 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bc285-6c47-46f9-b36d-36ffde462f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.403435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bc285-6c47-46f9-b36d-36ffde462f83 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.403862 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bc285-6c47-46f9-b36d-36ffde462f83 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.404272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bc285-6c47-46f9-b36d-36ffde462f83 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.405357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bc285-6c47-46f9-b36d-36ffde462f83 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:38.407167 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bc285-6c47-46f9-b36d-36ffde462f83 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:38.410171 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-c43bc285-6c47-46f9-b36d-36ffde462f83 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:38.427799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:38.429082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:38.430125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 472/936] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:38.432716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bc285-6c47-46f9-b36d-36ffde462f83 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.437410 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1afc4-ecf4-45d0-ac48-057f259c2dab None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.484391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709a02f-0a13-4f2a-8e36-94e2307a1d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.485432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709a02f-0a13-4f2a-8e36-94e2307a1d1c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.485868 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709a02f-0a13-4f2a-8e36-94e2307a1d1c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.486280 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709a02f-0a13-4f2a-8e36-94e2307a1d1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.498211 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709a02f-0a13-4f2a-8e36-94e2307a1d1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:38.500256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709a02f-0a13-4f2a-8e36-94e2307a1d1c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a709a02f-0a13-4f2a-8e36-94e2307a1d1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:38.518937 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:38.520762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:38.522575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:38.522575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:38.522575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:38.522575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:38.522575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:38.522575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:38.522575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:38.522575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:38.522575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 465/937] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:38.522575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709a02f-0a13-4f2a-8e36-94e2307a1d1c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.535612 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.569419 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bc285-6c47-46f9-b36d-36ffde462f83 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.614696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1beee-5b51-4760-a440-c88540836d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.615859 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1beee-5b51-4760-a440-c88540836d97 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.616332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1beee-5b51-4760-a440-c88540836d97 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.616784 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1beee-5b51-4760-a440-c88540836d97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.618139 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1beee-5b51-4760-a440-c88540836d97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:38.621423 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1beee-5b51-4760-a440-c88540836d97 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:38.702497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709a02f-0a13-4f2a-8e36-94e2307a1d1c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.738721 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 473/938] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 19:43:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:38.738721 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1beee-5b51-4760-a440-c88540836d97 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.793718 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b004d-8a44-4b41-91e3-4f626d18b7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.795113 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b004d-8a44-4b41-91e3-4f626d18b7d7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.797755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b004d-8a44-4b41-91e3-4f626d18b7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.798350 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b004d-8a44-4b41-91e3-4f626d18b7d7 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.799534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b004d-8a44-4b41-91e3-4f626d18b7d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:38.800124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b004d-8a44-4b41-91e3-4f626d18b7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:38.801965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b004d-8a44-4b41-91e3-4f626d18b7d7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:38.809909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 466/939] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:38.817791 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b004d-8a44-4b41-91e3-4f626d18b7d7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.835491 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.910308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1beee-5b51-4760-a440-c88540836d97 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.938867 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.988974 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b004d-8a44-4b41-91e3-4f626d18b7d7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.995925 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ec391-f937-4f49-8a22-257f23a9ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.998030 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ec391-f937-4f49-8a22-257f23a9ef3d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.999783 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ec391-f937-4f49-8a22-257f23a9ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.000485 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ec391-f937-4f49-8a22-257f23a9ef3d None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.002892 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ec391-f937-4f49-8a22-257f23a9ef3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:39.004277 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ec391-f937-4f49-8a22-257f23a9ef3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:39.008624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ec391-f937-4f49-8a22-257f23a9ef3d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:39.035573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9f1ea-9bbb-4914-ae35-ea756afece00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:39.036263 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f1ea-9bbb-4914-ae35-ea756afece00 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.036544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f1ea-9bbb-4914-ae35-ea756afece00 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.036821 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f1ea-9bbb-4914-ae35-ea756afece00 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.037510 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 474/940] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:39.037688 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9f1ea-9bbb-4914-ae35-ea756afece00 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:39.037953 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9f1ea-9bbb-4914-ae35-ea756afece00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:39.039570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9f1ea-9bbb-4914-ae35-ea756afece00 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:39.044628 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ec391-f937-4f49-8a22-257f23a9ef3d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:39.047034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 467/941] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:39.059873 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9f1ea-9bbb-4914-ae35-ea756afece00 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:39.202802 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9f1ea-9bbb-4914-ae35-ea756afece00 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:39.234896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ec391-f937-4f49-8a22-257f23a9ef3d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:39.242263 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:39.255899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de825f2e-1c3f-437d-aee8-c525f18bc8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:39.257176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825f2e-1c3f-437d-aee8-c525f18bc8db None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.257467 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825f2e-1c3f-437d-aee8-c525f18bc8db None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.260386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825f2e-1c3f-437d-aee8-c525f18bc8db None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.260386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de825f2e-1c3f-437d-aee8-c525f18bc8db None admin] RBAC: Adding query filter params (interface=public, service_id=3e926abbc8054977b5072670b4bb1b8e, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:39.260386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de825f2e-1c3f-437d-aee8-c525f18bc8db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:39.261111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de825f2e-1c3f-437d-aee8-c525f18bc8db None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:39.268999 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:39.278652 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 468/942] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 19:43:39 2022] GET /identity/v3/endpoints?service_id=3e926abbc8054977b5072670b4bb1b8e&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:39.283642 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de825f2e-1c3f-437d-aee8-c525f18bc8db None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:39.313010 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b624c-0dd3-4ec6-b210-d7474b7c5111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:39.315408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b624c-0dd3-4ec6-b210-d7474b7c5111 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.316236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b624c-0dd3-4ec6-b210-d7474b7c5111 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.317310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b624c-0dd3-4ec6-b210-d7474b7c5111 None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/4e4b9ebe2ac648558b5f0133e8af8727/roles/eef7d022d05842b7a4bc4d6b88f6d0d6` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.322040 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b624c-0dd3-4ec6-b210-d7474b7c5111 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=4e4b9ebe2ac648558b5f0133e8af8727, role_id=eef7d022d05842b7a4bc4d6b88f6d0d6)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:39.325517 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b624c-0dd3-4ec6-b210-d7474b7c5111 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:39.418946 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de825f2e-1c3f-437d-aee8-c525f18bc8db None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:39.419791 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 475/943] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:43:39 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/4e4b9ebe2ac648558b5f0133e8af8727/roles/eef7d022d05842b7a4bc4d6b88f6d0d6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:43:39.480339 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034999d3-9d55-4d71-ad1d-8daabf4d5179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:39.481055 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034999d3-9d55-4d71-ad1d-8daabf4d5179 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.481348 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034999d3-9d55-4d71-ad1d-8daabf4d5179 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.481634 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034999d3-9d55-4d71-ad1d-8daabf4d5179 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.482413 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034999d3-9d55-4d71-ad1d-8daabf4d5179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:39.483947 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034999d3-9d55-4d71-ad1d-8daabf4d5179 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:39.491929 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 469/944] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 19:43:39 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:43:39.756013 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699613-945e-4acc-a954-85f7d1cc52b6 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.756328 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699613-945e-4acc-a954-85f7d1cc52b6 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.756711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699613-945e-4acc-a954-85f7d1cc52b6 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.758524 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 476/945] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:39.765121 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6235428-2f61-4c62-8f75-518e63b06a64 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.765453 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6235428-2f61-4c62-8f75-518e63b06a64 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.765690 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6235428-2f61-4c62-8f75-518e63b06a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.786241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c6235428-2f61-4c62-8f75-518e63b06a64 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:39.787848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c6235428-2f61-4c62-8f75-518e63b06a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:39.863317 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:39.878193 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 470/946] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:39.902760 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9699613-945e-4acc-a954-85f7d1cc52b6 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:40.032013 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9699613-945e-4acc-a954-85f7d1cc52b6 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:40.095809 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6152e1-88fd-4e7d-83f1-553e34f5cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:40.097394 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6152e1-88fd-4e7d-83f1-553e34f5cef5 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:40.098158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6152e1-88fd-4e7d-83f1-553e34f5cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:40.098934 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6152e1-88fd-4e7d-83f1-553e34f5cef5 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:40.100681 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6152e1-88fd-4e7d-83f1-553e34f5cef5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:40.103813 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6152e1-88fd-4e7d-83f1-553e34f5cef5 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:40.106795 dv-cinder-841302-4-smb devstack@keystone.service[92089]: WARNING keystone.server.flask.common [None req-7c6152e1-88fd-4e7d-83f1-553e34f5cef5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 19:43:40.185644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.sql.core [None req-7c6152e1-88fd-4e7d-83f1-553e34f5cef5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 19:43:40.185644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 19:43:40.185644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [parameters: {'id': 'a0c0b52753a9476fbc0c1b0294e93449', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 19:43:40.185644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92089) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-7c6152e1-88fd-4e7d-83f1-553e34f5cef5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0c0b52753a9476fbc0c1b0294e93449.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0c0b52753a9476fbc0c1b0294e93449. May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application conn.query(q) May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:43:40.202520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result.read() May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 19:43:40.204018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application next(self.gen) May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application yield resource May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application next(self.gen) May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.session.rollback() May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.force_reraise() May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise self.value May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application session.commit() May 19 19:43:40.205654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._prepare_impl() May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.session.flush() May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._flush(objects) May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application compat.raise_( May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application flush_context.execute() May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 19:43:40.207482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rec.execute(self) May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 19:43:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application conn.query(q) May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result.read() May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:43:40.209233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [parameters: {'id': 'a0c0b52753a9476fbc0c1b0294e93449', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:40.210130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:40.211009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:40.212223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:40.212223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 19:43:40.212223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 19:43:40.212223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:40.212223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:40.212223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 19:43:40.212223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 19:43:40.212223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0c0b52753a9476fbc0c1b0294e93449. May 19 19:43:40.212223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:40.212223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 477/947] 10.222.0.89 () {60 vars in 1140 bytes} [Thu May 19 19:43:39 2022] POST /identity/v3/projects => generated 262 bytes in 308 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:40.221702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6235428-2f61-4c62-8f75-518e63b06a64 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:40.339270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6235428-2f61-4c62-8f75-518e63b06a64 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:40.379067 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a349bc4-521c-4419-98c6-9ccd683f5469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:40.379880 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a349bc4-521c-4419-98c6-9ccd683f5469 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:40.380167 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a349bc4-521c-4419-98c6-9ccd683f5469 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:40.380447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a349bc4-521c-4419-98c6-9ccd683f5469 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:40.389039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a349bc4-521c-4419-98c6-9ccd683f5469 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:40.390542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a349bc4-521c-4419-98c6-9ccd683f5469 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7a349bc4-521c-4419-98c6-9ccd683f5469 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:40.405586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:40.407528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:40.409606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:40.409606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:40.409606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:40.409606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:40.409606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:40.409606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:40.409606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:40.409606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:40.409606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 471/948] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:40.415977 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6152e1-88fd-4e7d-83f1-553e34f5cef5 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:40.469240 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:40.569096 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6152e1-88fd-4e7d-83f1-553e34f5cef5 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:40.607863 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e487e-7349-4673-88b3-1381cd23d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:40.608705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e487e-7349-4673-88b3-1381cd23d2fa None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:40.608990 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e487e-7349-4673-88b3-1381cd23d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:40.609264 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e487e-7349-4673-88b3-1381cd23d2fa None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:40.610044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e487e-7349-4673-88b3-1381cd23d2fa None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:40.610348 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e487e-7349-4673-88b3-1381cd23d2fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:40.612065 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e487e-7349-4673-88b3-1381cd23d2fa None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:40.635067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 478/949] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:41.426405 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27aad5-b8f7-472c-86b0-73ebde8adb50 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.426405 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27aad5-b8f7-472c-86b0-73ebde8adb50 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.426405 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27aad5-b8f7-472c-86b0-73ebde8adb50 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.427637 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 472/950] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:41.433523 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb4f5d-d18a-4898-b4df-8757e4b565b2 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.434036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb4f5d-d18a-4898-b4df-8757e4b565b2 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.434190 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb4f5d-d18a-4898-b4df-8757e4b565b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.452497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-2cbb4f5d-d18a-4898-b4df-8757e4b565b2 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:41.454000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-2cbb4f5d-d18a-4898-b4df-8757e4b565b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:41.532641 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 479/951] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:41.555434 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27aad5-b8f7-472c-86b0-73ebde8adb50 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:41.613731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:41.685544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27aad5-b8f7-472c-86b0-73ebde8adb50 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:41.753322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7ea5d-31b9-42c3-a457-e4ae9af8eae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:41.755221 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ea5d-31b9-42c3-a457-e4ae9af8eae1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.756016 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ea5d-31b9-42c3-a457-e4ae9af8eae1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.756786 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ea5d-31b9-42c3-a457-e4ae9af8eae1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.758337 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7ea5d-31b9-42c3-a457-e4ae9af8eae1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:41.761750 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7ea5d-31b9-42c3-a457-e4ae9af8eae1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-cfb7ea5d-31b9-42c3-a457-e4ae9af8eae1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:41.784377 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:41.786316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:43:41.787942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:41.792860 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 473/952] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:41.801004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb4f5d-d18a-4898-b4df-8757e4b565b2 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:41.824446 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:41.881785 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e28d2-ec89-4c1e-ac0a-088680b7b41d None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.882494 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e28d2-ec89-4c1e-ac0a-088680b7b41d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.883058 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e28d2-ec89-4c1e-ac0a-088680b7b41d None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.885622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 474/953] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:41.891762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63610a5b-2258-42be-8cdc-383610ae9a06 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.892435 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63610a5b-2258-42be-8cdc-383610ae9a06 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.892914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63610a5b-2258-42be-8cdc-383610ae9a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.912477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-63610a5b-2258-42be-8cdc-383610ae9a06 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:41.914105 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-63610a5b-2258-42be-8cdc-383610ae9a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:41.915741 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb4f5d-d18a-4898-b4df-8757e4b565b2 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:41.957148 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232a402-2636-4fc1-8306-8f0ff6a492c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:41.957813 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a402-2636-4fc1-8306-8f0ff6a492c2 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.958092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a402-2636-4fc1-8306-8f0ff6a492c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.958364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a402-2636-4fc1-8306-8f0ff6a492c2 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.959105 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232a402-2636-4fc1-8306-8f0ff6a492c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:41.959408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232a402-2636-4fc1-8306-8f0ff6a492c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:41.960796 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232a402-2636-4fc1-8306-8f0ff6a492c2 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:41.970646 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 480/954] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:41.972702 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232a402-2636-4fc1-8306-8f0ff6a492c2 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:42.010738 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 475/955] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:42.040590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63610a5b-2258-42be-8cdc-383610ae9a06 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:42.090530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:42.108246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:42.137606 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232a402-2636-4fc1-8306-8f0ff6a492c2 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:42.170597 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63610a5b-2258-42be-8cdc-383610ae9a06 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:42.193108 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26b51e-faa6-4593-a58d-d434b208362f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:42.193813 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26b51e-faa6-4593-a58d-d434b208362f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.194096 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26b51e-faa6-4593-a58d-d434b208362f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.194389 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26b51e-faa6-4593-a58d-d434b208362f None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.195118 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26b51e-faa6-4593-a58d-d434b208362f None admin] RBAC: Adding query filter params (type=compute) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:42.195426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26b51e-faa6-4593-a58d-d434b208362f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:42.197201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26b51e-faa6-4593-a58d-d434b208362f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:42.211006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 481/956] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:42.252962 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f198145-2a13-430f-b628-56dffd42d7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:42.255075 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f198145-2a13-430f-b628-56dffd42d7c0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.255955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f198145-2a13-430f-b628-56dffd42d7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.256745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f198145-2a13-430f-b628-56dffd42d7c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.291270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f198145-2a13-430f-b628-56dffd42d7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5f198145-2a13-430f-b628-56dffd42d7c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:42.309288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:42.311253 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:43:42.313010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:42.318395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 476/957] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 19:43:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:42.337323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26b51e-faa6-4593-a58d-d434b208362f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:42.455845 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26b51e-faa6-4593-a58d-d434b208362f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:42.462432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc848-431a-40a1-b9bc-d6b1325380e6 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.464510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc848-431a-40a1-b9bc-d6b1325380e6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.465221 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc848-431a-40a1-b9bc-d6b1325380e6 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.467928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 477/958] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:42.478417 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad2a68-e631-4d85-a491-7e4ff75c7c28 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.479907 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad2a68-e631-4d85-a491-7e4ff75c7c28 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.480625 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad2a68-e631-4d85-a491-7e4ff75c7c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.499597 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902332bb-49eb-48ee-b837-287c263c57e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:42.500054 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902332bb-49eb-48ee-b837-287c263c57e6 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.500335 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902332bb-49eb-48ee-b837-287c263c57e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.500611 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902332bb-49eb-48ee-b837-287c263c57e6 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.501753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902332bb-49eb-48ee-b837-287c263c57e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:42.502225 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902332bb-49eb-48ee-b837-287c263c57e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:42.504493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902332bb-49eb-48ee-b837-287c263c57e6 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:42.515598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0dad2a68-e631-4d85-a491-7e4ff75c7c28 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:42.519027 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0dad2a68-e631-4d85-a491-7e4ff75c7c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:42.519884 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 482/959] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 19:43:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:42.532621 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902332bb-49eb-48ee-b837-287c263c57e6 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:42.556128 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:42.655991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 478/960] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:42.699251 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad2a68-e631-4d85-a491-7e4ff75c7c28 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:42.742004 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902332bb-49eb-48ee-b837-287c263c57e6 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:42.762122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:42.825852 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b446a05-40a0-4706-8189-a55725a20b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:42.827241 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b446a05-40a0-4706-8189-a55725a20b2d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.827702 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b446a05-40a0-4706-8189-a55725a20b2d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.828153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b446a05-40a0-4706-8189-a55725a20b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.852723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b446a05-40a0-4706-8189-a55725a20b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:42.856351 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b446a05-40a0-4706-8189-a55725a20b2d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:42.893798 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad2a68-e631-4d85-a491-7e4ff75c7c28 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-3b446a05-40a0-4706-8189-a55725a20b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:42.897919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:42.898967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:42.899910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:42.899910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:42.899910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:42.899910 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:42.902863 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 483/961] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:42.908738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b446a05-40a0-4706-8189-a55725a20b2d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:42.966069 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d914c7-b568-4ec3-b7a1-45d4cfa8adbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:42.967465 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d914c7-b568-4ec3-b7a1-45d4cfa8adbc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.967948 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d914c7-b568-4ec3-b7a1-45d4cfa8adbc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.968407 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d914c7-b568-4ec3-b7a1-45d4cfa8adbc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.969641 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d914c7-b568-4ec3-b7a1-45d4cfa8adbc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:42.972390 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d914c7-b568-4ec3-b7a1-45d4cfa8adbc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-53d914c7-b568-4ec3-b7a1-45d4cfa8adbc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:42.997853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:43.000278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:43.002334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:43.010644 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 479/962] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 19:43:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:43.011590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d914c7-b568-4ec3-b7a1-45d4cfa8adbc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:43.033305 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:43.114914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b446a05-40a0-4706-8189-a55725a20b2d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:43.183235 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c9a6d-0121-45e3-bc52-6659f7a6e78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:43.184307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9a6d-0121-45e3-bc52-6659f7a6e78a None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.184770 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9a6d-0121-45e3-bc52-6659f7a6e78a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.185225 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9a6d-0121-45e3-bc52-6659f7a6e78a None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.186714 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c9a6d-0121-45e3-bc52-6659f7a6e78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:43.187331 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c9a6d-0121-45e3-bc52-6659f7a6e78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:43.189795 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c9a6d-0121-45e3-bc52-6659f7a6e78a None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:43.192228 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:43.203900 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d914c7-b568-4ec3-b7a1-45d4cfa8adbc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:43.212430 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 484/963] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:43.215517 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cdc05-7397-4d39-983b-c5a052d0918a None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.216109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cdc05-7397-4d39-983b-c5a052d0918a None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.216675 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cdc05-7397-4d39-983b-c5a052d0918a None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.220435 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 485/964] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:43.226101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cdc05-7397-4d39-983b-c5a052d0918a None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:43.260231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8822-6987-4f44-bb0e-2d928f66d529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:43.260803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8822-6987-4f44-bb0e-2d928f66d529 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.261090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8822-6987-4f44-bb0e-2d928f66d529 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.261364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8822-6987-4f44-bb0e-2d928f66d529 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.262268 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8822-6987-4f44-bb0e-2d928f66d529 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:43.262414 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8822-6987-4f44-bb0e-2d928f66d529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:43.263849 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8822-6987-4f44-bb0e-2d928f66d529 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:43.275312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 480/965] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 19:43:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:43.275312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336388e8-e805-4a96-8567-7cfe8a2978d8 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.275312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336388e8-e805-4a96-8567-7cfe8a2978d8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.275312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336388e8-e805-4a96-8567-7cfe8a2978d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.292484 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-336388e8-e805-4a96-8567-7cfe8a2978d8 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:43.293710 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-336388e8-e805-4a96-8567-7cfe8a2978d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:43.386648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 481/966] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:43.386648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336388e8-e805-4a96-8567-7cfe8a2978d8 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:43.397062 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cdc05-7397-4d39-983b-c5a052d0918a None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:43.427502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:43.444426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdcd7c-88df-4515-85ed-15368d3db8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:43.446569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdcd7c-88df-4515-85ed-15368d3db8b7 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.446569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdcd7c-88df-4515-85ed-15368d3db8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.446569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdcd7c-88df-4515-85ed-15368d3db8b7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.456573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdcd7c-88df-4515-85ed-15368d3db8b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:43.458155 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdcd7c-88df-4515-85ed-15368d3db8b7 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-98bdcd7c-88df-4515-85ed-15368d3db8b7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:43.477092 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:43.479416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:43.484501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:43.484501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:43.484501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:43.484501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:43.484501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:43.484501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:43.484501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:43.484501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:43.484501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:43:43.484501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:43.486741 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 486/967] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 19:43:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:43.487772 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdcd7c-88df-4515-85ed-15368d3db8b7 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:43.512705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:43.527231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336388e8-e805-4a96-8567-7cfe8a2978d8 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:43.575482 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d112227-04e4-4f93-8470-8bec486a194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:43.576158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d112227-04e4-4f93-8470-8bec486a194c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.576440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d112227-04e4-4f93-8470-8bec486a194c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.576765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d112227-04e4-4f93-8470-8bec486a194c None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.577507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d112227-04e4-4f93-8470-8bec486a194c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:43.577815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d112227-04e4-4f93-8470-8bec486a194c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:43.579367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d112227-04e4-4f93-8470-8bec486a194c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:43.586027 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 482/968] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 19:43:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:43.586660 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d112227-04e4-4f93-8470-8bec486a194c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:43.656974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdcd7c-88df-4515-85ed-15368d3db8b7 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:43.699711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f8774-6b0f-4e0b-8f8b-4b9f25ab08e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:43.700405 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f8774-6b0f-4e0b-8f8b-4b9f25ab08e6 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.700692 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f8774-6b0f-4e0b-8f8b-4b9f25ab08e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.700968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f8774-6b0f-4e0b-8f8b-4b9f25ab08e6 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.701683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f8774-6b0f-4e0b-8f8b-4b9f25ab08e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:43.703272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f8774-6b0f-4e0b-8f8b-4b9f25ab08e6 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:43.724704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d112227-04e4-4f93-8470-8bec486a194c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:43.751570 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.sql.core [None req-956f8774-6b0f-4e0b-8f8b-4b9f25ab08e6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 19:43:43.751570 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 19:43:43.751570 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [parameters: {'user_id': 'cce67f7c68e44f59a1ab7cc98cafcf17', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 19:43:43.751570 dv-cinder-841302-4-smb devstack@keystone.service[92089]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92089) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 19:43:43.761272 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a11e19-8f1a-45b1-b416-63bde65775a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:43.761947 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11e19-8f1a-45b1-b416-63bde65775a3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.762223 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11e19-8f1a-45b1-b416-63bde65775a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.762490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11e19-8f1a-45b1-b416-63bde65775a3 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.763422 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a11e19-8f1a-45b1-b416-63bde65775a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:43.763684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a11e19-8f1a-45b1-b416-63bde65775a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:43.765137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a11e19-8f1a-45b1-b416-63bde65775a3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-956f8774-6b0f-4e0b-8f8b-4b9f25ab08e6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application conn.query(q) May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result.read() May 19 19:43:43.765973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:43:43.766955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application next(self.gen) May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application yield resource May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application next(self.gen) May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.session.rollback() May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.force_reraise() May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise self.value May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application session.commit() May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 19:43:43.767951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._prepare_impl() May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.session.flush() May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._flush(objects) May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application compat.raise_( May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application flush_context.execute() May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rec.execute(self) May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 19:43:43.768902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:43:43.770944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application conn.query(q) May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application result.read() May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:43:43.772913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cce67f7c68e44f59a1ab7cc98cafcf17', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:43.774242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 19:43:43.775279 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 19:43:43.779164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 19:43:43.779164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 19:43:43.779164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 19:43:43.779164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 19:43:43.779164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 19:43:43.779164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:43.779164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 487/969] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 19:43:43 2022] POST /identity/v3/users => generated 160 bytes in 281 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:43.779164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f8774-6b0f-4e0b-8f8b-4b9f25ab08e6 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:43.797371 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 483/970] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 19:43:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:43.798042 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a11e19-8f1a-45b1-b416-63bde65775a3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:43.814391 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:43.855510 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:43.914340 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f8774-6b0f-4e0b-8f8b-4b9f25ab08e6 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:43.945453 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a11e19-8f1a-45b1-b416-63bde65775a3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:43.954265 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6123a-6bbf-4884-8c9a-c40be3483ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:43.954964 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6123a-6bbf-4884-8c9a-c40be3483ad5 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.955247 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6123a-6bbf-4884-8c9a-c40be3483ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.955519 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6123a-6bbf-4884-8c9a-c40be3483ad5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.956275 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6123a-6bbf-4884-8c9a-c40be3483ad5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:43.957872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6123a-6bbf-4884-8c9a-c40be3483ad5 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:43.991675 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87f1f-7ee1-4bd0-a151-5d7b327a8ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:43.992488 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87f1f-7ee1-4bd0-a151-5d7b327a8ae1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.992771 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87f1f-7ee1-4bd0-a151-5d7b327a8ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.993046 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87f1f-7ee1-4bd0-a151-5d7b327a8ae1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.000995 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e87f1f-7ee1-4bd0-a151-5d7b327a8ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:44.002473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e87f1f-7ee1-4bd0-a151-5d7b327a8ae1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-83e87f1f-7ee1-4bd0-a151-5d7b327a8ae1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:44.018338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:44.020204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:44.022216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:44.022216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:44.022216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:44.022216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:44.022216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:44.022216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:44.022216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:44.022216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:44.022216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:43:44.022216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:44.024519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 484/971] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:43:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:44.025371 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87f1f-7ee1-4bd0-a151-5d7b327a8ae1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:44.053919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 488/972] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 19:43:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:44.053919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6123a-6bbf-4884-8c9a-c40be3483ad5 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:44.133804 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:44.189615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87f1f-7ee1-4bd0-a151-5d7b327a8ae1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:44.247497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:44.267919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6123a-6bbf-4884-8c9a-c40be3483ad5 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:44.285122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2f10c-574e-4fdf-88f6-95ed34aaedc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:44.285122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2f10c-574e-4fdf-88f6-95ed34aaedc8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.285122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2f10c-574e-4fdf-88f6-95ed34aaedc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.285122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2f10c-574e-4fdf-88f6-95ed34aaedc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.321189 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883c81-f150-40b0-830b-9a1aa2ce77b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:44.322242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883c81-f150-40b0-830b-9a1aa2ce77b8 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.323781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883c81-f150-40b0-830b-9a1aa2ce77b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.327350 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883c81-f150-40b0-830b-9a1aa2ce77b8 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.328559 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09883c81-f150-40b0-830b-9a1aa2ce77b8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:44.329070 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09883c81-f150-40b0-830b-9a1aa2ce77b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:44.330819 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09883c81-f150-40b0-830b-9a1aa2ce77b8 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:44.386695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 489/973] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 19:43:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:44.403285 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2f10c-574e-4fdf-88f6-95ed34aaedc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:44.405324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2f10c-574e-4fdf-88f6-95ed34aaedc8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:44.491364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:44.535530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 485/974] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:44 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:43:44.546452 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883c81-f150-40b0-830b-9a1aa2ce77b8 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:44.647921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07547e7-fb09-49c1-9fe8-b759f289b2f7 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.648255 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07547e7-fb09-49c1-9fe8-b759f289b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.648483 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07547e7-fb09-49c1-9fe8-b759f289b2f7 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.650148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 486/975] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:44.657158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270862d-267d-4679-91da-b7880207c2a4 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.657158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270862d-267d-4679-91da-b7880207c2a4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.657158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270862d-267d-4679-91da-b7880207c2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.688606 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-1270862d-267d-4679-91da-b7880207c2a4 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:44.690398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1270862d-267d-4679-91da-b7880207c2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:44.715813 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883c81-f150-40b0-830b-9a1aa2ce77b8 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:44.768609 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2b516-ca3c-487d-b790-f8110e9549df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:44.769416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2b516-ca3c-487d-b790-f8110e9549df None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.769698 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2b516-ca3c-487d-b790-f8110e9549df None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.769966 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2b516-ca3c-487d-b790-f8110e9549df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.782035 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2b516-ca3c-487d-b790-f8110e9549df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:44.783545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2b516-ca3c-487d-b790-f8110e9549df None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:44.798061 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 487/976] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-cbb2b516-ca3c-487d-b790-f8110e9549df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:44.802246 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:44.803821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:44.805462 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:44.805462 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:44.805462 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:44.805462 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:44.805462 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 490/977] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:44.811625 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270862d-267d-4679-91da-b7880207c2a4 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:44.824661 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2b516-ca3c-487d-b790-f8110e9549df None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:44.835731 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:44.941897 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:44.945132 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2b516-ca3c-487d-b790-f8110e9549df None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:44.946206 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270862d-267d-4679-91da-b7880207c2a4 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:44.981809 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e3c00-0a39-4d15-b46a-0b644ea25c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:44.982526 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3c00-0a39-4d15-b46a-0b644ea25c71 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.982838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3c00-0a39-4d15-b46a-0b644ea25c71 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.983120 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3c00-0a39-4d15-b46a-0b644ea25c71 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.983868 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e3c00-0a39-4d15-b46a-0b644ea25c71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:44.984101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37b08-6238-46fd-8c08-691c320fc2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:44.985159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37b08-6238-46fd-8c08-691c320fc2be None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.985266 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e3c00-0a39-4d15-b46a-0b644ea25c71 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:44.986161 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37b08-6238-46fd-8c08-691c320fc2be None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.986369 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37b08-6238-46fd-8c08-691c320fc2be None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.987204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e37b08-6238-46fd-8c08-691c320fc2be None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:44.987510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e37b08-6238-46fd-8c08-691c320fc2be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:44.988925 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e37b08-6238-46fd-8c08-691c320fc2be None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:45.002390 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 488/978] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:45.008041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37b08-6238-46fd-8c08-691c320fc2be None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.086723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 491/979] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:43:44 2022] POST /identity/v3/services => generated 242 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:43:45.128790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37b08-6238-46fd-8c08-691c320fc2be None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:45.177032 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87d74a-603e-4202-b03f-79e4d894bdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:45.177960 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87d74a-603e-4202-b03f-79e4d894bdff None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.178321 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87d74a-603e-4202-b03f-79e4d894bdff None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.178715 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87d74a-603e-4202-b03f-79e4d894bdff None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.187804 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87d74a-603e-4202-b03f-79e4d894bdff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:45.189502 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87d74a-603e-4202-b03f-79e4d894bdff None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-bb87d74a-603e-4202-b03f-79e4d894bdff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:45.205277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:45.206464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:45.207615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:45.207615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:45.207615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:45.207615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:45.207615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:45.207615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:45.207615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:45.207615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:45.213567 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 489/980] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:45.214888 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e3c00-0a39-4d15-b46a-0b644ea25c71 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.288439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:45.329373 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e3c00-0a39-4d15-b46a-0b644ea25c71 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:45.364897 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b409ea-8d3f-40fb-9aff-88b11e713a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:45.365560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b409ea-8d3f-40fb-9aff-88b11e713a86 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.365841 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b409ea-8d3f-40fb-9aff-88b11e713a86 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.366112 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b409ea-8d3f-40fb-9aff-88b11e713a86 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.366952 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b409ea-8d3f-40fb-9aff-88b11e713a86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:45.367286 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b409ea-8d3f-40fb-9aff-88b11e713a86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:45.368826 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b409ea-8d3f-40fb-9aff-88b11e713a86 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:45.382144 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 492/981] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:45.388264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87d74a-603e-4202-b03f-79e4d894bdff None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.405872 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:45.495211 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87d74a-603e-4202-b03f-79e4d894bdff None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:45.530788 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daa49d-1b41-4aa4-bd0c-5f886ece9b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:45.531448 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa49d-1b41-4aa4-bd0c-5f886ece9b3f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.531742 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa49d-1b41-4aa4-bd0c-5f886ece9b3f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.532077 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa49d-1b41-4aa4-bd0c-5f886ece9b3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.532836 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daa49d-1b41-4aa4-bd0c-5f886ece9b3f None admin] RBAC: Adding query filter params (role.id=eef7d022d05842b7a4bc4d6b88f6d0d6, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=4e4b9ebe2ac648558b5f0133e8af8727) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:45.533167 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daa49d-1b41-4aa4-bd0c-5f886ece9b3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:45.534685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daa49d-1b41-4aa4-bd0c-5f886ece9b3f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:45.541742 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 490/982] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:45 2022] GET /identity/v3/role_assignments?user.id=4e4b9ebe2ac648558b5f0133e8af8727&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=eef7d022d05842b7a4bc4d6b88f6d0d6 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:46.799031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe6080-d978-4766-959d-a5c7e6d8f4ca None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:46.799617 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe6080-d978-4766-959d-a5c7e6d8f4ca None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:46.799617 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe6080-d978-4766-959d-a5c7e6d8f4ca None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:46.801091 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 493/983] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:46.806837 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb271bb3-1fe4-4d8e-989c-467e57d050b8 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:46.807256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb271bb3-1fe4-4d8e-989c-467e57d050b8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:46.807429 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb271bb3-1fe4-4d8e-989c-467e57d050b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:46.824323 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-cb271bb3-1fe4-4d8e-989c-467e57d050b8 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:46.825557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cb271bb3-1fe4-4d8e-989c-467e57d050b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:46.897013 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 491/984] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:46.921501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe6080-d978-4766-959d-a5c7e6d8f4ca None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:47.062339 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe6080-d978-4766-959d-a5c7e6d8f4ca None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:47.090752 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:47.100580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e73e9-6c15-4ff4-8503-938f234ba8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:47.101387 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e73e9-6c15-4ff4-8503-938f234ba8a4 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.101671 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e73e9-6c15-4ff4-8503-938f234ba8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.101944 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e73e9-6c15-4ff4-8503-938f234ba8a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.102634 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e73e9-6c15-4ff4-8503-938f234ba8a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:47.104616 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e73e9-6c15-4ff4-8503-938f234ba8a4 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-5d0e73e9-6c15-4ff4-8503-938f234ba8a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:47.118439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:47.119723 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:47.120632 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:47.122683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 494/985] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 19:43:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:47.126926 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb271bb3-1fe4-4d8e-989c-467e57d050b8 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:47.145648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:47.304815 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb271bb3-1fe4-4d8e-989c-467e57d050b8 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:47.353231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f461bc7-dbb2-4d69-8992-b7e5fb6ba661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:47.354797 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461bc7-dbb2-4d69-8992-b7e5fb6ba661 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.355300 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461bc7-dbb2-4d69-8992-b7e5fb6ba661 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.355789 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461bc7-dbb2-4d69-8992-b7e5fb6ba661 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.356723 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f461bc7-dbb2-4d69-8992-b7e5fb6ba661 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:47.357229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f461bc7-dbb2-4d69-8992-b7e5fb6ba661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:47.358862 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f461bc7-dbb2-4d69-8992-b7e5fb6ba661 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:47.369142 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 492/986] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 19:43:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:47.372116 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e73e9-6c15-4ff4-8503-938f234ba8a4 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:47.387105 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3a27-fe1a-4a9e-ac7a-315e1c872784 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.388072 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3a27-fe1a-4a9e-ac7a-315e1c872784 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.388357 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3a27-fe1a-4a9e-ac7a-315e1c872784 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.389754 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 493/987] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:47.395499 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495276a-5fa5-4ff8-a94b-e848937ea349 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.395790 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495276a-5fa5-4ff8-a94b-e848937ea349 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.396071 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495276a-5fa5-4ff8-a94b-e848937ea349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.417612 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-6495276a-5fa5-4ff8-a94b-e848937ea349 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:47.419359 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6495276a-5fa5-4ff8-a94b-e848937ea349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:47.502935 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e73e9-6c15-4ff4-8503-938f234ba8a4 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:47.504555 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 494/988] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:47.527461 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495276a-5fa5-4ff8-a94b-e848937ea349 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:47.529708 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:47.541562 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39364e8-9f65-4f46-9e35-6b1a1682bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:47.542479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39364e8-9f65-4f46-9e35-6b1a1682bd8c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.544449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39364e8-9f65-4f46-9e35-6b1a1682bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.544449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39364e8-9f65-4f46-9e35-6b1a1682bd8c None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.544449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39364e8-9f65-4f46-9e35-6b1a1682bd8c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:47.544793 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39364e8-9f65-4f46-9e35-6b1a1682bd8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:47.546356 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39364e8-9f65-4f46-9e35-6b1a1682bd8c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:47.553519 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 495/989] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 19:43:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:47.559329 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39364e8-9f65-4f46-9e35-6b1a1682bd8c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:47.621208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:47.650771 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495276a-5fa5-4ff8-a94b-e848937ea349 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:47.674440 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39364e8-9f65-4f46-9e35-6b1a1682bd8c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:47.695843 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4014d-f9f4-485f-ab96-2f627a6400b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:47.696676 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4014d-f9f4-485f-ab96-2f627a6400b6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.697891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4014d-f9f4-485f-ab96-2f627a6400b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.697891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4014d-f9f4-485f-ab96-2f627a6400b6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.698522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4014d-f9f4-485f-ab96-2f627a6400b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:47.700046 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4014d-f9f4-485f-ab96-2f627a6400b6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-bdf4014d-f9f4-485f-ab96-2f627a6400b6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:47.713213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:47.719409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:47.720346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 495/990] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:47.721193 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f28c-4644-43b9-af72-acb4ee16793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:47.721193 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f28c-4644-43b9-af72-acb4ee16793d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.721193 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f28c-4644-43b9-af72-acb4ee16793d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.721193 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f28c-4644-43b9-af72-acb4ee16793d None admin] PATH_INFO: `/v3/endpoints` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.721480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f28c-4644-43b9-af72-acb4ee16793d None admin] RBAC: Adding query filter params (interface=admin, service_id=3e926abbc8054977b5072670b4bb1b8e, region_id=RegionOne) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:47.721480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f28c-4644-43b9-af72-acb4ee16793d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:47.721480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f28c-4644-43b9-af72-acb4ee16793d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:47.722819 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4014d-f9f4-485f-ab96-2f627a6400b6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:47.729704 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 496/991] 10.222.0.89 () {56 vars in 1249 bytes} [Thu May 19 19:43:47 2022] GET /identity/v3/endpoints?service_id=3e926abbc8054977b5072670b4bb1b8e&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:47.735243 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f28c-4644-43b9-af72-acb4ee16793d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:47.796530 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:47.839630 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4014d-f9f4-485f-ab96-2f627a6400b6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:47.847887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f28c-4644-43b9-af72-acb4ee16793d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:47.868639 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:47.890292 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa3338-8eea-47b3-be57-67833bbce58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:47.890803 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e01c1-ee37-4d1f-9d24-70e5613a270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:47.891008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa3338-8eea-47b3-be57-67833bbce58c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.891278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa3338-8eea-47b3-be57-67833bbce58c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.891438 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e01c1-ee37-4d1f-9d24-70e5613a270d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.891586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa3338-8eea-47b3-be57-67833bbce58c None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.891736 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e01c1-ee37-4d1f-9d24-70e5613a270d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.891869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e01c1-ee37-4d1f-9d24-70e5613a270d None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.892207 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa3338-8eea-47b3-be57-67833bbce58c None admin] RBAC: Adding query filter params (name=compute) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:47.892486 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa3338-8eea-47b3-be57-67833bbce58c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:47.892658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e01c1-ee37-4d1f-9d24-70e5613a270d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:47.893987 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e01c1-ee37-4d1f-9d24-70e5613a270d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:47.894162 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa3338-8eea-47b3-be57-67833bbce58c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:47.900951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 496/992] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:47.909562 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 497/993] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 19:43:47 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 19:43:47.909839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa3338-8eea-47b3-be57-67833bbce58c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.023674 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa3338-8eea-47b3-be57-67833bbce58c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:48.055743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:48.063589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb77d34-fc7e-46a5-85fd-5c20bdfcb99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:48.064280 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb77d34-fc7e-46a5-85fd-5c20bdfcb99e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.064566 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb77d34-fc7e-46a5-85fd-5c20bdfcb99e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.064844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb77d34-fc7e-46a5-85fd-5c20bdfcb99e None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.065577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb77d34-fc7e-46a5-85fd-5c20bdfcb99e None admin] RBAC: Adding query filter params (type=compute) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:48.065890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb77d34-fc7e-46a5-85fd-5c20bdfcb99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:48.067423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb77d34-fc7e-46a5-85fd-5c20bdfcb99e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:48.069263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dae3c-54a2-4883-906d-d4ee39cce10b None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.070664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dae3c-54a2-4883-906d-d4ee39cce10b None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.070664 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dae3c-54a2-4883-906d-d4ee39cce10b None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.072460 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 498/994] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:48.078531 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 497/995] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:48.079529 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124458a7-8666-460c-9b40-0b77bed0ece1 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.079822 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124458a7-8666-460c-9b40-0b77bed0ece1 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.088413 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124458a7-8666-460c-9b40-0b77bed0ece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.088560 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb77d34-fc7e-46a5-85fd-5c20bdfcb99e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.099181 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-124458a7-8666-460c-9b40-0b77bed0ece1 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:48.100821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-124458a7-8666-460c-9b40-0b77bed0ece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:48.178307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 499/996] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:48.201312 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124458a7-8666-460c-9b40-0b77bed0ece1 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.215884 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb77d34-fc7e-46a5-85fd-5c20bdfcb99e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:48.252166 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cb551-3c0c-4a60-8e40-74bbaec702b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:48.252850 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cb551-3c0c-4a60-8e40-74bbaec702b1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.253172 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cb551-3c0c-4a60-8e40-74bbaec702b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.253450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cb551-3c0c-4a60-8e40-74bbaec702b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.254266 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cb551-3c0c-4a60-8e40-74bbaec702b1 None admin] RBAC: Adding query filter params (interface=public, service_id=fb61294d329a480d919ad40cd01bfd3f, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:48.254588 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cb551-3c0c-4a60-8e40-74bbaec702b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:48.256035 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cb551-3c0c-4a60-8e40-74bbaec702b1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:48.261822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 498/997] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 19:43:48 2022] GET /identity/v3/endpoints?service_id=fb61294d329a480d919ad40cd01bfd3f&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:48.267221 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cb551-3c0c-4a60-8e40-74bbaec702b1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.317389 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124458a7-8666-460c-9b40-0b77bed0ece1 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:48.335138 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:48.340337 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:48.363043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408f57-70bd-48a9-8f0d-88114a6cd197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:48.364502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408f57-70bd-48a9-8f0d-88114a6cd197 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.365233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408f57-70bd-48a9-8f0d-88114a6cd197 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.365687 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408f57-70bd-48a9-8f0d-88114a6cd197 None admin] PATH_INFO: `/v3/services/image` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.366707 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408f57-70bd-48a9-8f0d-88114a6cd197 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:48.368959 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408f57-70bd-48a9-8f0d-88114a6cd197 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-aa408f57-70bd-48a9-8f0d-88114a6cd197 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:48.385244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:48.386470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:43:48.387542 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:48.388423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cb551-3c0c-4a60-8e40-74bbaec702b1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:48.391181 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 500/998] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 19:43:48 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:48.397020 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408f57-70bd-48a9-8f0d-88114a6cd197 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.425737 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541abe-9487-4080-bea0-6726cce22d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:48.426523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541abe-9487-4080-bea0-6726cce22d83 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.426835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541abe-9487-4080-bea0-6726cce22d83 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.427132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541abe-9487-4080-bea0-6726cce22d83 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.427804 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38541abe-9487-4080-bea0-6726cce22d83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:48.429394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38541abe-9487-4080-bea0-6726cce22d83 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:48.446634 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 499/999] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 19:43:48 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 19:43:48.522280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408f57-70bd-48a9-8f0d-88114a6cd197 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:48.564264 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f756b88-a2e4-49ff-9901-30e8d694a7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:48.564958 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756b88-a2e4-49ff-9901-30e8d694a7d0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.565264 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756b88-a2e4-49ff-9901-30e8d694a7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.565532 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756b88-a2e4-49ff-9901-30e8d694a7d0 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.566251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f756b88-a2e4-49ff-9901-30e8d694a7d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:48.566655 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f756b88-a2e4-49ff-9901-30e8d694a7d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:48.568118 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f756b88-a2e4-49ff-9901-30e8d694a7d0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:48.574386 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 501/1000] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:48.580599 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541abe-9487-4080-bea0-6726cce22d83 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.716775 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541abe-9487-4080-bea0-6726cce22d83 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:48.742124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:48.754580 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2573e3-31db-47dd-a28a-5d7421e4d96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:48.755292 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2573e3-31db-47dd-a28a-5d7421e4d96f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.755578 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2573e3-31db-47dd-a28a-5d7421e4d96f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.755854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2573e3-31db-47dd-a28a-5d7421e4d96f None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.756565 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2573e3-31db-47dd-a28a-5d7421e4d96f None admin] RBAC: Adding query filter params (type=image) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:48.756874 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2573e3-31db-47dd-a28a-5d7421e4d96f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:48.758277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2573e3-31db-47dd-a28a-5d7421e4d96f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:48.770646 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 500/1001] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:50.257595 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b670662-b373-4cca-9be4-b726aac3b412 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:50.258149 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b670662-b373-4cca-9be4-b726aac3b412 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:50.258149 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b670662-b373-4cca-9be4-b726aac3b412 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:50.260105 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 502/1002] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:50.265581 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ecd72-2a3b-44db-8201-fbbed142e070 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:50.265991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ecd72-2a3b-44db-8201-fbbed142e070 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:50.266180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ecd72-2a3b-44db-8201-fbbed142e070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:50.287747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0a1ecd72-2a3b-44db-8201-fbbed142e070 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:50.289127 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0a1ecd72-2a3b-44db-8201-fbbed142e070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:50.382817 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 501/1003] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:50.409127 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b670662-b373-4cca-9be4-b726aac3b412 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:50.468254 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:50.533606 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b670662-b373-4cca-9be4-b726aac3b412 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:50.574325 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b326f45-028a-4767-995c-0ee5678b62c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:50.575191 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b326f45-028a-4767-995c-0ee5678b62c6 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:50.575475 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b326f45-028a-4767-995c-0ee5678b62c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:50.575753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b326f45-028a-4767-995c-0ee5678b62c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:50.576431 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b326f45-028a-4767-995c-0ee5678b62c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:50.577844 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b326f45-028a-4767-995c-0ee5678b62c6 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-4b326f45-028a-4767-995c-0ee5678b62c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:50.590899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:50.592402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:43:50.593268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:50.594978 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 503/1004] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 19:43:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:50.598364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ecd72-2a3b-44db-8201-fbbed142e070 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:50.743757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ecd72-2a3b-44db-8201-fbbed142e070 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:50.748908 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227621fe-3106-4231-8f39-58363afd79d5 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:50.749194 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227621fe-3106-4231-8f39-58363afd79d5 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:50.749480 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227621fe-3106-4231-8f39-58363afd79d5 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:50.750918 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 504/1005] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:50.756470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92a46c-65bb-4a6c-830f-b2de776538c6 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:50.756761 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92a46c-65bb-4a6c-830f-b2de776538c6 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:50.757048 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92a46c-65bb-4a6c-830f-b2de776538c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:50.774006 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:50.776217 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-5f92a46c-65bb-4a6c-830f-b2de776538c6 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:50.777456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-5f92a46c-65bb-4a6c-830f-b2de776538c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:50.796466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0059e5-75da-4949-85a0-cc9b01fcae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:50.797473 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0059e5-75da-4949-85a0-cc9b01fcae14 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:50.797901 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0059e5-75da-4949-85a0-cc9b01fcae14 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:50.798322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0059e5-75da-4949-85a0-cc9b01fcae14 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:50.799241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0059e5-75da-4949-85a0-cc9b01fcae14 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:50.799733 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0059e5-75da-4949-85a0-cc9b01fcae14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:50.801833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0059e5-75da-4949-85a0-cc9b01fcae14 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:50.815037 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 502/1006] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 19:43:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:50.816842 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0059e5-75da-4949-85a0-cc9b01fcae14 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:50.866862 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 505/1007] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:50.887779 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92a46c-65bb-4a6c-830f-b2de776538c6 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:50.933869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:50.943321 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0059e5-75da-4949-85a0-cc9b01fcae14 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:50.984722 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50ed34-4f27-4ffc-ae20-ce31c5eb5f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:50.985403 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ed34-4f27-4ffc-ae20-ce31c5eb5f6e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:50.985683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ed34-4f27-4ffc-ae20-ce31c5eb5f6e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:50.985960 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ed34-4f27-4ffc-ae20-ce31c5eb5f6e None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:50.986713 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50ed34-4f27-4ffc-ae20-ce31c5eb5f6e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:50.987024 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50ed34-4f27-4ffc-ae20-ce31c5eb5f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:50.988422 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50ed34-4f27-4ffc-ae20-ce31c5eb5f6e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:50.999542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 503/1008] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 19:43:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:51.000381 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50ed34-4f27-4ffc-ae20-ce31c5eb5f6e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:51.013483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92a46c-65bb-4a6c-830f-b2de776538c6 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:51.047727 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:51.050714 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbdd9e-eac4-4be8-8834-87a8c41f1b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:51.051519 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbdd9e-eac4-4be8-8834-87a8c41f1b39 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.051805 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbdd9e-eac4-4be8-8834-87a8c41f1b39 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.052078 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbdd9e-eac4-4be8-8834-87a8c41f1b39 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.052733 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbdd9e-eac4-4be8-8834-87a8c41f1b39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:51.054142 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbdd9e-eac4-4be8-8834-87a8c41f1b39 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-e4cbdd9e-eac4-4be8-8834-87a8c41f1b39 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:51.067239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:51.068489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:51.069881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 506/1009] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:51.070750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c105b-96fa-4239-b443-657fde212cf1 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.070750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c105b-96fa-4239-b443-657fde212cf1 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.070750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c105b-96fa-4239-b443-657fde212cf1 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.071802 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 507/1010] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:51.075514 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c105b-96fa-4239-b443-657fde212cf1 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:51.107869 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50ed34-4f27-4ffc-ae20-ce31c5eb5f6e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:51.143953 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9576-7597-4925-9fc1-7999f856b1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:51.144622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9576-7597-4925-9fc1-7999f856b1ea None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.144907 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9576-7597-4925-9fc1-7999f856b1ea None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.145208 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9576-7597-4925-9fc1-7999f856b1ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.145956 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e9576-7597-4925-9fc1-7999f856b1ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:51.147445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e9576-7597-4925-9fc1-7999f856b1ea None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:51.176243 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:51.181221 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c105b-96fa-4239-b443-657fde212cf1 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:51.215584 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5fe0-8d04-46af-bcc5-f4c2ebb7d381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:51.216275 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5fe0-8d04-46af-bcc5-f4c2ebb7d381 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.216536 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5fe0-8d04-46af-bcc5-f4c2ebb7d381 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.216807 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5fe0-8d04-46af-bcc5-f4c2ebb7d381 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.217572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5fe0-8d04-46af-bcc5-f4c2ebb7d381 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:51.217887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5fe0-8d04-46af-bcc5-f4c2ebb7d381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:51.219278 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5fe0-8d04-46af-bcc5-f4c2ebb7d381 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:51.224425 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 508/1011] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:51.235479 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 504/1012] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 19:43:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:51.235643 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5695aaf-227f-4a42-89df-13163122e42a None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.235643 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5695aaf-227f-4a42-89df-13163122e42a None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.235643 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5695aaf-227f-4a42-89df-13163122e42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.235863 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9576-7597-4925-9fc1-7999f856b1ea None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:51.253347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-e5695aaf-227f-4a42-89df-13163122e42a None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:51.254579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-e5695aaf-227f-4a42-89df-13163122e42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:51.365228 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:51.365911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 509/1013] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:51.379712 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9576-7597-4925-9fc1-7999f856b1ea None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:51.389082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5695aaf-227f-4a42-89df-13163122e42a None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:51.432319 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a315483-ada7-4958-ad61-4ed969341d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:51.433011 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a315483-ada7-4958-ad61-4ed969341d06 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.433293 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a315483-ada7-4958-ad61-4ed969341d06 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.433570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a315483-ada7-4958-ad61-4ed969341d06 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.434705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a315483-ada7-4958-ad61-4ed969341d06 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:51.434832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a315483-ada7-4958-ad61-4ed969341d06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:51.436708 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a315483-ada7-4958-ad61-4ed969341d06 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:51.444018 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 505/1014] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 19:43:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:51.449437 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a315483-ada7-4958-ad61-4ed969341d06 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:51.512815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:51.528163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5695aaf-227f-4a42-89df-13163122e42a None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:51.564009 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a315483-ada7-4958-ad61-4ed969341d06 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:51.565894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ac8d-f3e2-494e-9acc-481b8bd7ebf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:51.566580 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ac8d-f3e2-494e-9acc-481b8bd7ebf5 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.566894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ac8d-f3e2-494e-9acc-481b8bd7ebf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.567921 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ac8d-f3e2-494e-9acc-481b8bd7ebf5 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.567921 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237ac8d-f3e2-494e-9acc-481b8bd7ebf5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:51.569308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237ac8d-f3e2-494e-9acc-481b8bd7ebf5 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:51.601428 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a349-fb84-40ad-a59a-1c29939eb2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:51.602222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a349-fb84-40ad-a59a-1c29939eb2a8 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.602502 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a349-fb84-40ad-a59a-1c29939eb2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.602806 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a349-fb84-40ad-a59a-1c29939eb2a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.604136 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a349-fb84-40ad-a59a-1c29939eb2a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:51.605520 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a349-fb84-40ad-a59a-1c29939eb2a8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:51.671815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 510/1015] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:43:51 2022] POST /identity/v3/services => generated 242 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:43:51.701276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 506/1016] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 19:43:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:53.556790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630815ab-5145-4d35-9ad1-1c523f9020f9 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.557297 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630815ab-5145-4d35-9ad1-1c523f9020f9 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.557297 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630815ab-5145-4d35-9ad1-1c523f9020f9 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.558789 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 511/1017] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:53.564907 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c5c8b-ab38-4723-aeed-db77bdbb5369 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.565444 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c5c8b-ab38-4723-aeed-db77bdbb5369 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.565444 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c5c8b-ab38-4723-aeed-db77bdbb5369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.584003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-6d8c5c8b-ab38-4723-aeed-db77bdbb5369 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:53.585219 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6d8c5c8b-ab38-4723-aeed-db77bdbb5369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:53.602894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:53.695089 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 507/1018] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:53.719744 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630815ab-5145-4d35-9ad1-1c523f9020f9 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:53.833008 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630815ab-5145-4d35-9ad1-1c523f9020f9 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:53.868521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae2a85-2b62-4d2f-8421-eb988c3f9bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:53.869349 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae2a85-2b62-4d2f-8421-eb988c3f9bcf None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.869636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae2a85-2b62-4d2f-8421-eb988c3f9bcf None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.869909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae2a85-2b62-4d2f-8421-eb988c3f9bcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.871128 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae2a85-2b62-4d2f-8421-eb988c3f9bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:53.872585 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae2a85-2b62-4d2f-8421-eb988c3f9bcf None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:53.879100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 512/1019] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:53.880224 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c5c8b-ab38-4723-aeed-db77bdbb5369 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:53.971012 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429984e-72a7-4e7a-83d6-bd064b8c92ae None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.971336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429984e-72a7-4e7a-83d6-bd064b8c92ae None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.971597 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429984e-72a7-4e7a-83d6-bd064b8c92ae None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.973258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 513/1020] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:53.977886 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851166cf-a10b-424b-b55e-3aa18bcae8d8 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.978203 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851166cf-a10b-424b-b55e-3aa18bcae8d8 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.978473 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851166cf-a10b-424b-b55e-3aa18bcae8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.991690 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c5c8b-ab38-4723-aeed-db77bdbb5369 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:53.995219 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-851166cf-a10b-424b-b55e-3aa18bcae8d8 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:53.996359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-851166cf-a10b-424b-b55e-3aa18bcae8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:54.007680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.030433 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061a457-ffde-4582-a240-6b6c131876bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.031123 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061a457-ffde-4582-a240-6b6c131876bd None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.031404 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061a457-ffde-4582-a240-6b6c131876bd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.031684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061a457-ffde-4582-a240-6b6c131876bd None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.032402 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061a457-ffde-4582-a240-6b6c131876bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:54.034552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061a457-ffde-4582-a240-6b6c131876bd None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:54.065964 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 514/1021] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:54.089483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851166cf-a10b-424b-b55e-3aa18bcae8d8 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.105399 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.112819 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 508/1022] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:43:53 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:54.114112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19141d0-86d7-46c8-a467-23179b22fb92 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.118780 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19141d0-86d7-46c8-a467-23179b22fb92 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.118780 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19141d0-86d7-46c8-a467-23179b22fb92 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.118780 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 509/1023] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:54.122228 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7ad7c-98fe-42e8-9f79-820b598174c9 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.122523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7ad7c-98fe-42e8-9f79-820b598174c9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.122842 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7ad7c-98fe-42e8-9f79-820b598174c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.144058 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-aaa7ad7c-98fe-42e8-9f79-820b598174c9 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:54.145350 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-aaa7ad7c-98fe-42e8-9f79-820b598174c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:54.239907 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851166cf-a10b-424b-b55e-3aa18bcae8d8 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.266774 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 510/1024] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:54.288975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7ad7c-98fe-42e8-9f79-820b598174c9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.308425 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbbf70-8a8e-4b86-9631-9ecddb2ec3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.309518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbbf70-8a8e-4b86-9631-9ecddb2ec3e4 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.309806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbbf70-8a8e-4b86-9631-9ecddb2ec3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.310169 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbbf70-8a8e-4b86-9631-9ecddb2ec3e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.311000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbbf70-8a8e-4b86-9631-9ecddb2ec3e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:54.312445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbbf70-8a8e-4b86-9631-9ecddb2ec3e4 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-f1bbbf70-8a8e-4b86-9631-9ecddb2ec3e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:54.327154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:54.328357 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:54.329256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 515/1025] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/services/image => generated 86 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:54.339856 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbbf70-8a8e-4b86-9631-9ecddb2ec3e4 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.358893 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.448986 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7ad7c-98fe-42e8-9f79-820b598174c9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.493005 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.495643 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbbf70-8a8e-4b86-9631-9ecddb2ec3e4 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.505595 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3594d-d8b8-4e58-a252-da445da70b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.506939 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3594d-d8b8-4e58-a252-da445da70b5f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.507405 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3594d-d8b8-4e58-a252-da445da70b5f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.507861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3594d-d8b8-4e58-a252-da445da70b5f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.526546 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3594d-d8b8-4e58-a252-da445da70b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:54.542757 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804de20-ba6e-46bc-9fc5-73882fe305c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.543426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804de20-ba6e-46bc-9fc5-73882fe305c8 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-3ff3594d-d8b8-4e58-a252-da445da70b5f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:54.543667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:54.544622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:43:54.545496 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:54.546236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804de20-ba6e-46bc-9fc5-73882fe305c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.546236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804de20-ba6e-46bc-9fc5-73882fe305c8 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.546236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804de20-ba6e-46bc-9fc5-73882fe305c8 None admin] RBAC: Adding query filter params (name=image) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:54.546236 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804de20-ba6e-46bc-9fc5-73882fe305c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:54.546479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804de20-ba6e-46bc-9fc5-73882fe305c8 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:54.557207 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 516/1026] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:54.557914 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 511/1027] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:54.558272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804de20-ba6e-46bc-9fc5-73882fe305c8 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.558733 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3594d-d8b8-4e58-a252-da445da70b5f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.656717 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.687413 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3594d-d8b8-4e58-a252-da445da70b5f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.700785 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804de20-ba6e-46bc-9fc5-73882fe305c8 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.726364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38d1b-980b-4f19-aa0d-22d54ec32a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.727063 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38d1b-980b-4f19-aa0d-22d54ec32a49 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.727514 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38d1b-980b-4f19-aa0d-22d54ec32a49 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.727787 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38d1b-980b-4f19-aa0d-22d54ec32a49 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.728534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38d1b-980b-4f19-aa0d-22d54ec32a49 None admin] RBAC: Adding query filter params (type=image) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:54.728845 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38d1b-980b-4f19-aa0d-22d54ec32a49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:54.730237 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38d1b-980b-4f19-aa0d-22d54ec32a49 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:54.739995 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 512/1028] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:54.742172 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38d1b-980b-4f19-aa0d-22d54ec32a49 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.756832 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddb9be-6f4f-4ea8-877c-09f5cab85575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.757507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddb9be-6f4f-4ea8-877c-09f5cab85575 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.757791 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddb9be-6f4f-4ea8-877c-09f5cab85575 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.758066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddb9be-6f4f-4ea8-877c-09f5cab85575 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.758847 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddb9be-6f4f-4ea8-877c-09f5cab85575 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:54.759158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddb9be-6f4f-4ea8-877c-09f5cab85575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:54.761085 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddb9be-6f4f-4ea8-877c-09f5cab85575 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:54.770002 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 517/1029] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:54.779036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddb9be-6f4f-4ea8-877c-09f5cab85575 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.814648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.877379 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38d1b-980b-4f19-aa0d-22d54ec32a49 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.925195 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddb9be-6f4f-4ea8-877c-09f5cab85575 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.932778 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995bb27-223a-41ae-8e33-cfb9f77076c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.933892 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995bb27-223a-41ae-8e33-cfb9f77076c1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.934360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995bb27-223a-41ae-8e33-cfb9f77076c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.934893 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995bb27-223a-41ae-8e33-cfb9f77076c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.936346 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995bb27-223a-41ae-8e33-cfb9f77076c1 None admin] RBAC: Adding query filter params (interface=public, service_id=166149fc09524e5883e3559868c4cf5a, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:54.936888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995bb27-223a-41ae-8e33-cfb9f77076c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:54.939542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995bb27-223a-41ae-8e33-cfb9f77076c1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:54.953823 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 513/1030] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/endpoints?service_id=166149fc09524e5883e3559868c4cf5a&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:54.955382 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995bb27-223a-41ae-8e33-cfb9f77076c1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.973630 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe6dd8-62b3-4832-88d7-d89556e9e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.974927 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6dd8-62b3-4832-88d7-d89556e9e686 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.975386 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6dd8-62b3-4832-88d7-d89556e9e686 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.975673 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6dd8-62b3-4832-88d7-d89556e9e686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.981816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.995879 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe6dd8-62b3-4832-88d7-d89556e9e686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:54.998336 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe6dd8-62b3-4832-88d7-d89556e9e686 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-16fe6dd8-62b3-4832-88d7-d89556e9e686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:55.030036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:55.032006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:55.033094 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:55.033094 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:55.033094 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:55.033094 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:55.033094 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 518/1031] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:55.038240 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe6dd8-62b3-4832-88d7-d89556e9e686 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.100638 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995bb27-223a-41ae-8e33-cfb9f77076c1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.121838 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:55.140319 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b248477-b38b-480a-a83d-891822d77410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.140991 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b248477-b38b-480a-a83d-891822d77410 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.141279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b248477-b38b-480a-a83d-891822d77410 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.141551 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b248477-b38b-480a-a83d-891822d77410 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.142764 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b248477-b38b-480a-a83d-891822d77410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.144193 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b248477-b38b-480a-a83d-891822d77410 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.162645 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 514/1032] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/services => generated 1957 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:43:55.162870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe6dd8-62b3-4832-88d7-d89556e9e686 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.199467 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0d130-5db9-48da-8ef8-d1750caceb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.200045 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0d130-5db9-48da-8ef8-d1750caceb50 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.200331 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0d130-5db9-48da-8ef8-d1750caceb50 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.200613 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0d130-5db9-48da-8ef8-d1750caceb50 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.201379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0d130-5db9-48da-8ef8-d1750caceb50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:55.201687 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0d130-5db9-48da-8ef8-d1750caceb50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.203133 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0d130-5db9-48da-8ef8-d1750caceb50 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.218208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 519/1033] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:55.223934 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b248477-b38b-480a-a83d-891822d77410 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.356575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b248477-b38b-480a-a83d-891822d77410 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.395430 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947e202-e381-4f87-b64f-7fbbbc858a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.396233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947e202-e381-4f87-b64f-7fbbbc858a06 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.396513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947e202-e381-4f87-b64f-7fbbbc858a06 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.396792 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947e202-e381-4f87-b64f-7fbbbc858a06 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.405955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947e202-e381-4f87-b64f-7fbbbc858a06 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.407466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947e202-e381-4f87-b64f-7fbbbc858a06 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-1947e202-e381-4f87-b64f-7fbbbc858a06 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:43:55.422563 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:55.423601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:55.424608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:55.424608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:55.424608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:43:55.424608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:43:55.424608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:43:55.424608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:43:55.424608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:43:55.424608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:43:55.424608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:43:55.424608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:55.424608 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 515/1034] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:55.429933 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0d130-5db9-48da-8ef8-d1750caceb50 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.483731 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:55.540292 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0d130-5db9-48da-8ef8-d1750caceb50 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.576139 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515fdd-a6d8-4969-a943-5fc934491d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.576795 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515fdd-a6d8-4969-a943-5fc934491d94 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.577087 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515fdd-a6d8-4969-a943-5fc934491d94 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.577365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515fdd-a6d8-4969-a943-5fc934491d94 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.578210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2515fdd-a6d8-4969-a943-5fc934491d94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:55.578524 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2515fdd-a6d8-4969-a943-5fc934491d94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.579984 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2515fdd-a6d8-4969-a943-5fc934491d94 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.603625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 520/1035] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:55.605110 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947e202-e381-4f87-b64f-7fbbbc858a06 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.650556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:55.720329 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947e202-e381-4f87-b64f-7fbbbc858a06 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.781487 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7e58a-6220-486b-bfd7-1682d2f02fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.782045 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7e58a-6220-486b-bfd7-1682d2f02fde None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.782327 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7e58a-6220-486b-bfd7-1682d2f02fde None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.782577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7e58a-6220-486b-bfd7-1682d2f02fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.861386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7e58a-6220-486b-bfd7-1682d2f02fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.862889 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7e58a-6220-486b-bfd7-1682d2f02fde None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.908169 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:55.974685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 516/1036] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:43:55.975878 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515fdd-a6d8-4969-a943-5fc934491d94 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.079552 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515fdd-a6d8-4969-a943-5fc934491d94 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.088858 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.118559 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a4995-f061-4404-9415-9e47e3b801d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.119376 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a4995-f061-4404-9415-9e47e3b801d9 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.119659 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a4995-f061-4404-9415-9e47e3b801d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.119932 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a4995-f061-4404-9415-9e47e3b801d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.130777 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a4995-f061-4404-9415-9e47e3b801d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.132239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a4995-f061-4404-9415-9e47e3b801d9 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-aa9a4995-f061-4404-9415-9e47e3b801d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:56.151280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:56.152327 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:56.157988 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:56.157988 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:56.157988 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:56.157988 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:56.157988 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 521/1037] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:56.158284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7e58a-6220-486b-bfd7-1682d2f02fde None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.275367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7e58a-6220-486b-bfd7-1682d2f02fde None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.311305 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91790027-7177-4399-aee0-f4d90256bfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.311976 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91790027-7177-4399-aee0-f4d90256bfd3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.312258 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91790027-7177-4399-aee0-f4d90256bfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.312535 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91790027-7177-4399-aee0-f4d90256bfd3 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.313256 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91790027-7177-4399-aee0-f4d90256bfd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:56.313561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91790027-7177-4399-aee0-f4d90256bfd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.314972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91790027-7177-4399-aee0-f4d90256bfd3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.326965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.331493 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 517/1038] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:56.337844 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a4995-f061-4404-9415-9e47e3b801d9 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.487988 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a4995-f061-4404-9415-9e47e3b801d9 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.550381 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ad884-b5ba-4064-ba75-d95668fd5813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.551717 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ad884-b5ba-4064-ba75-d95668fd5813 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.552194 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ad884-b5ba-4064-ba75-d95668fd5813 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.552665 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ad884-b5ba-4064-ba75-d95668fd5813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.565693 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ad884-b5ba-4064-ba75-d95668fd5813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.568329 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ad884-b5ba-4064-ba75-d95668fd5813 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-208ad884-b5ba-4064-ba75-d95668fd5813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:43:56.597111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:56.598507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:56.599476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:43:56.599476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:43:56.599476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:43:56.599476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:43:56.599476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:43:56.599476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:43:56.599476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:43:56.599476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:43:56.600222 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 522/1039] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:56.608380 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91790027-7177-4399-aee0-f4d90256bfd3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.628241 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30475430-f17e-4c8b-a778-1093f17ea476 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.628602 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30475430-f17e-4c8b-a778-1093f17ea476 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.628940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30475430-f17e-4c8b-a778-1093f17ea476 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.630744 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 523/1040] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:56.637104 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8cda-5f83-4c1f-a30b-87b508166dcf None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.637452 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8cda-5f83-4c1f-a30b-87b508166dcf None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.645697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8cda-5f83-4c1f-a30b-87b508166dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.658545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-f46a8cda-5f83-4c1f-a30b-87b508166dcf None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:56.660385 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-f46a8cda-5f83-4c1f-a30b-87b508166dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:56.677980 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.725280 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91790027-7177-4399-aee0-f4d90256bfd3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.739196 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 524/1041] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:43:56.764037 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a8cda-5f83-4c1f-a30b-87b508166dcf None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.768295 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b727ec-f0e9-4c77-abd3-327887fdb68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.769080 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b727ec-f0e9-4c77-abd3-327887fdb68d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.769364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b727ec-f0e9-4c77-abd3-327887fdb68d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.769641 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b727ec-f0e9-4c77-abd3-327887fdb68d None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.770442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b727ec-f0e9-4c77-abd3-327887fdb68d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:56.770796 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b727ec-f0e9-4c77-abd3-327887fdb68d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.772387 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b727ec-f0e9-4c77-abd3-327887fdb68d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.790779 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 518/1042] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:56.792497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b727ec-f0e9-4c77-abd3-327887fdb68d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.862415 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.877913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a8cda-5f83-4c1f-a30b-87b508166dcf None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.905650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b727ec-f0e9-4c77-abd3-327887fdb68d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.921711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac437fca-6e2e-474e-b36f-9773b9f368d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.922841 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac437fca-6e2e-474e-b36f-9773b9f368d8 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.923119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac437fca-6e2e-474e-b36f-9773b9f368d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.923393 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac437fca-6e2e-474e-b36f-9773b9f368d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.924896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac437fca-6e2e-474e-b36f-9773b9f368d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.926647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac437fca-6e2e-474e-b36f-9773b9f368d8 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.935048 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 525/1043] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:56.937433 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac437fca-6e2e-474e-b36f-9773b9f368d8 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.951370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012c983-8e4b-4861-b8e4-4e118ec52086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.952315 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c983-8e4b-4861-b8e4-4e118ec52086 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.952315 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c983-8e4b-4861-b8e4-4e118ec52086 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.952590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c983-8e4b-4861-b8e4-4e118ec52086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.953405 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012c983-8e4b-4861-b8e4-4e118ec52086 None admin] RBAC: Adding query filter params (role.id=eef7d022d05842b7a4bc4d6b88f6d0d6, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:56.953722 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012c983-8e4b-4861-b8e4-4e118ec52086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.955227 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012c983-8e4b-4861-b8e4-4e118ec52086 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.959537 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.962573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 519/1044] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/role_assignments?user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=eef7d022d05842b7a4bc4d6b88f6d0d6 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:57.069836 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac437fca-6e2e-474e-b36f-9773b9f368d8 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:57.114013 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd197b88-b156-49ba-a929-19d645aaa56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:57.115312 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd197b88-b156-49ba-a929-19d645aaa56b None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:57.115818 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd197b88-b156-49ba-a929-19d645aaa56b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:57.116400 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd197b88-b156-49ba-a929-19d645aaa56b None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:57.117793 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd197b88-b156-49ba-a929-19d645aaa56b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:57.124042 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd197b88-b156-49ba-a929-19d645aaa56b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:57.242035 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 526/1045] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:43:56 2022] POST /identity/v3/users => generated 285 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:43:57.502267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af07e-dce4-4163-867c-6736e00c2552 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:57.502477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af07e-dce4-4163-867c-6736e00c2552 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:57.502825 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af07e-dce4-4163-867c-6736e00c2552 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:57.504193 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 520/1046] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:57.509786 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc35f-bfaa-456f-b9f2-41aa20315649 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:57.510080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc35f-bfaa-456f-b9f2-41aa20315649 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:57.510367 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc35f-bfaa-456f-b9f2-41aa20315649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:57.528488 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-0d4bc35f-bfaa-456f-b9f2-41aa20315649 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:57.529663 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-0d4bc35f-bfaa-456f-b9f2-41aa20315649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:57.599373 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 527/1047] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:57.622296 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079af07e-dce4-4163-867c-6736e00c2552 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:57.727218 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079af07e-dce4-4163-867c-6736e00c2552 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:57.751277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:57.763040 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7e9d-491e-47f8-b9af-8c1ef37da40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:57.763755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7e9d-491e-47f8-b9af-8c1ef37da40e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:57.764034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7e9d-491e-47f8-b9af-8c1ef37da40e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:57.764304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7e9d-491e-47f8-b9af-8c1ef37da40e None admin] PATH_INFO: `/v3/services/image` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:57.764961 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7e9d-491e-47f8-b9af-8c1ef37da40e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:57.766431 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7e9d-491e-47f8-b9af-8c1ef37da40e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5a9f7e9d-491e-47f8-b9af-8c1ef37da40e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:57.779464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:57.780572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:43:57.781450 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:57.785950 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 521/1048] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 19:43:57 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:57.787058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bc35f-bfaa-456f-b9f2-41aa20315649 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:57.789424 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:57.893183 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bc35f-bfaa-456f-b9f2-41aa20315649 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:57.927985 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c4a9c-13e9-4635-b705-1f509519be10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:57.928653 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4a9c-13e9-4635-b705-1f509519be10 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:57.928932 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4a9c-13e9-4635-b705-1f509519be10 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:57.929199 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4a9c-13e9-4635-b705-1f509519be10 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:57.929900 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c4a9c-13e9-4635-b705-1f509519be10 None admin] RBAC: Adding query filter params (name=image) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:57.930201 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c4a9c-13e9-4635-b705-1f509519be10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:57.931886 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c4a9c-13e9-4635-b705-1f509519be10 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:57.941720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 528/1049] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:57.943029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7e9d-491e-47f8-b9af-8c1ef37da40e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:58.049561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7e9d-491e-47f8-b9af-8c1ef37da40e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:58.085927 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f0c2e-dc36-4c91-8863-66040547419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:58.086628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f0c2e-dc36-4c91-8863-66040547419f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:58.086915 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f0c2e-dc36-4c91-8863-66040547419f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:58.087220 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f0c2e-dc36-4c91-8863-66040547419f None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:58.087942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f0c2e-dc36-4c91-8863-66040547419f None admin] RBAC: Adding query filter params (type=image) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:58.088245 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f0c2e-dc36-4c91-8863-66040547419f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:58.089628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f0c2e-dc36-4c91-8863-66040547419f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:58.100145 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 522/1050] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:58.101356 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c4a9c-13e9-4635-b705-1f509519be10 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:58.170567 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:58.206634 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c4a9c-13e9-4635-b705-1f509519be10 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:58.240880 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f57e51-d268-4057-954d-7c53388ff34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:58.241539 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57e51-d268-4057-954d-7c53388ff34d None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:58.241820 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57e51-d268-4057-954d-7c53388ff34d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:58.242094 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57e51-d268-4057-954d-7c53388ff34d None admin] PATH_INFO: `/v3/endpoints` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:58.242885 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f57e51-d268-4057-954d-7c53388ff34d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:58.244789 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f57e51-d268-4057-954d-7c53388ff34d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:58.362705 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 529/1051] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 19:43:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:59.236259 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b28b02-0803-4c54-8c39-360f5899360a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.236891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b28b02-0803-4c54-8c39-360f5899360a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.236891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b28b02-0803-4c54-8c39-360f5899360a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.238449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 523/1052] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:59.244192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0175eb-e54d-4972-9c9f-6aebed0944ef None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.244651 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0175eb-e54d-4972-9c9f-6aebed0944ef None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.244744 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0175eb-e54d-4972-9c9f-6aebed0944ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.261414 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-6c0175eb-e54d-4972-9c9f-6aebed0944ef None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:59.262627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-6c0175eb-e54d-4972-9c9f-6aebed0944ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:59.346647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 530/1053] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:43:59.369143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b28b02-0803-4c54-8c39-360f5899360a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:59.429960 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:59.479720 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b28b02-0803-4c54-8c39-360f5899360a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:59.513628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084fbd9-3800-417f-aaeb-2cbcf4c1337f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:59.514355 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084fbd9-3800-417f-aaeb-2cbcf4c1337f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.514653 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084fbd9-3800-417f-aaeb-2cbcf4c1337f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.514933 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084fbd9-3800-417f-aaeb-2cbcf4c1337f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.525585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084fbd9-3800-417f-aaeb-2cbcf4c1337f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c084fbd9-3800-417f-aaeb-2cbcf4c1337f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:59.533891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:59.535020 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:59.541870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 524/1054] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 19:43:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:59.542691 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0175eb-e54d-4972-9c9f-6aebed0944ef None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:59.591420 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:59.643863 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0175eb-e54d-4972-9c9f-6aebed0944ef None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:59.679640 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596aafa-e08a-45bf-b609-7081477eaad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:59.680315 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596aafa-e08a-45bf-b609-7081477eaad9 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.680892 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596aafa-e08a-45bf-b609-7081477eaad9 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.681172 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596aafa-e08a-45bf-b609-7081477eaad9 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.681923 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596aafa-e08a-45bf-b609-7081477eaad9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:59.682232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596aafa-e08a-45bf-b609-7081477eaad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:59.683758 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596aafa-e08a-45bf-b609-7081477eaad9 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:59.696708 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 531/1055] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 19:43:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:59.697979 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084fbd9-3800-417f-aaeb-2cbcf4c1337f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:59.809977 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084fbd9-3800-417f-aaeb-2cbcf4c1337f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:59.824827 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:59.846537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8707cfa-9eb5-4ac0-b166-86b2821b2416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:59.847367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707cfa-9eb5-4ac0-b166-86b2821b2416 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.847651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707cfa-9eb5-4ac0-b166-86b2821b2416 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.847922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707cfa-9eb5-4ac0-b166-86b2821b2416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.860678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8707cfa-9eb5-4ac0-b166-86b2821b2416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:59.862164 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8707cfa-9eb5-4ac0-b166-86b2821b2416 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b8707cfa-9eb5-4ac0-b166-86b2821b2416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:59.879928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:59.880964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:59.882233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:59.882233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:59.882233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:59.882233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:43:59.882233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 525/1056] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:59.886937 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596aafa-e08a-45bf-b609-7081477eaad9 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:59.978300 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7052b3-4ed8-4e43-a756-c1c9050c236a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.978664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7052b3-4ed8-4e43-a756-c1c9050c236a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.978885 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7052b3-4ed8-4e43-a756-c1c9050c236a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.982653 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 526/1057] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:59.985429 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89bcd4-31f1-4d07-8dd9-896fcb238e26 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.985728 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89bcd4-31f1-4d07-8dd9-896fcb238e26 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.986012 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89bcd4-31f1-4d07-8dd9-896fcb238e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.989765 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596aafa-e08a-45bf-b609-7081477eaad9 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.000746 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.003940 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ee89bcd4-31f1-4d07-8dd9-896fcb238e26 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:00.005123 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ee89bcd4-31f1-4d07-8dd9-896fcb238e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:00.024142 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16090504-002c-4284-a4ec-d44d3b82668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.025407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16090504-002c-4284-a4ec-d44d3b82668d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.025685 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16090504-002c-4284-a4ec-d44d3b82668d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.025955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16090504-002c-4284-a4ec-d44d3b82668d None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.026703 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16090504-002c-4284-a4ec-d44d3b82668d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:00.027009 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16090504-002c-4284-a4ec-d44d3b82668d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.028401 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16090504-002c-4284-a4ec-d44d3b82668d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.041231 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 532/1058] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:00.046916 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16090504-002c-4284-a4ec-d44d3b82668d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.086740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 527/1059] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:43:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:00.109298 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89bcd4-31f1-4d07-8dd9-896fcb238e26 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.156851 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16090504-002c-4284-a4ec-d44d3b82668d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.194490 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752e09-82df-4022-9878-cbad0adecd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.195323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752e09-82df-4022-9878-cbad0adecd7a None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.195593 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752e09-82df-4022-9878-cbad0adecd7a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.195869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752e09-82df-4022-9878-cbad0adecd7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.204396 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a752e09-82df-4022-9878-cbad0adecd7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.205855 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a752e09-82df-4022-9878-cbad0adecd7a None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.211203 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.218384 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89bcd4-31f1-4d07-8dd9-896fcb238e26 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-7a752e09-82df-4022-9878-cbad0adecd7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:00.222437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:00.223560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:00.224540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:00.224540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:00.224540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:00.224540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:00.224540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:00.224540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:00.224540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:00.224540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:00.224540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:00.224540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:44:00.226938 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 533/1060] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:00.229408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752e09-82df-4022-9878-cbad0adecd7a None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.253117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe1724-30a9-4da7-b87e-670c12d6dee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.254278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe1724-30a9-4da7-b87e-670c12d6dee5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.254558 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe1724-30a9-4da7-b87e-670c12d6dee5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.255022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe1724-30a9-4da7-b87e-670c12d6dee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.261927 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.267125 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe1724-30a9-4da7-b87e-670c12d6dee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-91fe1724-30a9-4da7-b87e-670c12d6dee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:00.275469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:00.276462 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:44:00.277449 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 528/1061] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:00.291999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe1724-30a9-4da7-b87e-670c12d6dee5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.347993 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752e09-82df-4022-9878-cbad0adecd7a None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.383375 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6e30f-d5f5-4161-8522-d60ea5143e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.384619 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6e30f-d5f5-4161-8522-d60ea5143e03 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.384908 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6e30f-d5f5-4161-8522-d60ea5143e03 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.385182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6e30f-d5f5-4161-8522-d60ea5143e03 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.386034 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6e30f-d5f5-4161-8522-d60ea5143e03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:00.386346 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6e30f-d5f5-4161-8522-d60ea5143e03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.387897 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6e30f-d5f5-4161-8522-d60ea5143e03 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.403543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe1724-30a9-4da7-b87e-670c12d6dee5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.406788 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 534/1062] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:00.411498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6e30f-d5f5-4161-8522-d60ea5143e03 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.446352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb165c7-b8f1-429a-a06b-99d3682e4c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.447735 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb165c7-b8f1-429a-a06b-99d3682e4c05 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.447922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb165c7-b8f1-429a-a06b-99d3682e4c05 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.448187 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb165c7-b8f1-429a-a06b-99d3682e4c05 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.449566 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb165c7-b8f1-429a-a06b-99d3682e4c05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:00.449566 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb165c7-b8f1-429a-a06b-99d3682e4c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.450591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb165c7-b8f1-429a-a06b-99d3682e4c05 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.463846 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 529/1063] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:00.464902 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb165c7-b8f1-429a-a06b-99d3682e4c05 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.484836 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.512271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.525960 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6e30f-d5f5-4161-8522-d60ea5143e03 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.561511 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a7547-8c35-4c0e-89e2-b0889e9e346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.562420 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a7547-8c35-4c0e-89e2-b0889e9e346c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.562763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a7547-8c35-4c0e-89e2-b0889e9e346c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.563045 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a7547-8c35-4c0e-89e2-b0889e9e346c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.575008 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a7547-8c35-4c0e-89e2-b0889e9e346c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.576453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a7547-8c35-4c0e-89e2-b0889e9e346c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.576629 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb165c7-b8f1-429a-a06b-99d3682e4c05 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-585a7547-8c35-4c0e-89e2-b0889e9e346c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:00.594145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:00.595355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:00.596274 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:00.596274 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:00.596274 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:00.596274 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:44:00.600390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 535/1064] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:00.601230 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a7547-8c35-4c0e-89e2-b0889e9e346c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.616455 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e0f20-36c9-4c7f-ac45-cc5ff2a71205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.617436 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e0f20-36c9-4c7f-ac45-cc5ff2a71205 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.617718 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e0f20-36c9-4c7f-ac45-cc5ff2a71205 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.618011 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e0f20-36c9-4c7f-ac45-cc5ff2a71205 None admin] PATH_INFO: `/v3/users/7c9741bb85e34767a0ca2eb7971ab954` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.633953 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e0f20-36c9-4c7f-ac45-cc5ff2a71205 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9741bb85e34767a0ca2eb7971ab954)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.635954 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e0f20-36c9-4c7f-ac45-cc5ff2a71205 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.642557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 530/1065] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/users/7c9741bb85e34767a0ca2eb7971ab954 => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:00.643562 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e0f20-36c9-4c7f-ac45-cc5ff2a71205 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.721267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a7547-8c35-4c0e-89e2-b0889e9e346c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.725326 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.756041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e0f20-36c9-4c7f-ac45-cc5ff2a71205 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.763465 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df405827-4f36-4aef-96cd-e80e1a33f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.764180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df405827-4f36-4aef-96cd-e80e1a33f462 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.764466 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df405827-4f36-4aef-96cd-e80e1a33f462 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.764742 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df405827-4f36-4aef-96cd-e80e1a33f462 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.765497 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df405827-4f36-4aef-96cd-e80e1a33f462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:00.765811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df405827-4f36-4aef-96cd-e80e1a33f462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.768008 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df405827-4f36-4aef-96cd-e80e1a33f462 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.778597 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.782021 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 536/1066] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:00.787592 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df405827-4f36-4aef-96cd-e80e1a33f462 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.802366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25848fc2-6ec2-4eb2-ad2e-1d437a41ded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.803057 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25848fc2-6ec2-4eb2-ad2e-1d437a41ded3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.803350 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25848fc2-6ec2-4eb2-ad2e-1d437a41ded3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.803694 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25848fc2-6ec2-4eb2-ad2e-1d437a41ded3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.879345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25848fc2-6ec2-4eb2-ad2e-1d437a41ded3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.880816 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25848fc2-6ec2-4eb2-ad2e-1d437a41ded3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.896401 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df405827-4f36-4aef-96cd-e80e1a33f462 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.930216 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34988c9-5509-486f-af1b-830e6cdf9b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.931883 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34988c9-5509-486f-af1b-830e6cdf9b45 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.932163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34988c9-5509-486f-af1b-830e6cdf9b45 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.932439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34988c9-5509-486f-af1b-830e6cdf9b45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.939385 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34988c9-5509-486f-af1b-830e6cdf9b45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.940848 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34988c9-5509-486f-af1b-830e6cdf9b45 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-b34988c9-5509-486f-af1b-830e6cdf9b45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:00.955468 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:00.956521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:00.957456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:00.957456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:00.957456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:00.957456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:00.957456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:00.957456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:00.957456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:00.957456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:44:00.957456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 537/1067] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:00.958085 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341be527-a3e7-42c8-beed-38871beca43e None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.958372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341be527-a3e7-42c8-beed-38871beca43e None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.958680 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341be527-a3e7-42c8-beed-38871beca43e None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.960108 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 538/1068] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:00.963697 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341be527-a3e7-42c8-beed-38871beca43e None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.976085 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.006967 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 531/1069] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:01.006967 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a503-0c65-4b81-bd39-7f4ca7ac769f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.006967 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a503-0c65-4b81-bd39-7f4ca7ac769f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.006967 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a503-0c65-4b81-bd39-7f4ca7ac769f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.021483 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ae09a503-0c65-4b81-bd39-7f4ca7ac769f None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:01.022737 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ae09a503-0c65-4b81-bd39-7f4ca7ac769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:01.027517 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.069871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341be527-a3e7-42c8-beed-38871beca43e None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.092461 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 532/1070] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:01.093315 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a503-0c65-4b81-bd39-7f4ca7ac769f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.104773 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c50f7-754d-424f-9dde-9ccab04b762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.105465 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c50f7-754d-424f-9dde-9ccab04b762d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.105750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c50f7-754d-424f-9dde-9ccab04b762d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.106027 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c50f7-754d-424f-9dde-9ccab04b762d None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.106871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c50f7-754d-424f-9dde-9ccab04b762d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:01.107182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c50f7-754d-424f-9dde-9ccab04b762d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:01.108624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c50f7-754d-424f-9dde-9ccab04b762d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:01.121358 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 539/1071] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:01.122204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c50f7-754d-424f-9dde-9ccab04b762d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.210681 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a503-0c65-4b81-bd39-7f4ca7ac769f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.213931 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.226996 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c50f7-754d-424f-9dde-9ccab04b762d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.247481 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1bfd-3d82-40ed-89d8-95d694186451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.248453 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1bfd-3d82-40ed-89d8-95d694186451 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.248742 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1bfd-3d82-40ed-89d8-95d694186451 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.249021 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1bfd-3d82-40ed-89d8-95d694186451 None admin] PATH_INFO: `/v3/projects/5cc85bc03e95432d909d55dbc2b23728` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.249329 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.250231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b1bfd-3d82-40ed-89d8-95d694186451 None admin] RBAC: Authorizing `identity:get_project(project_id=5cc85bc03e95432d909d55dbc2b23728)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:01.251724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b1bfd-3d82-40ed-89d8-95d694186451 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:01.253498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 533/1072] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:01 2022] GET /identity/v3/projects/5cc85bc03e95432d909d55dbc2b23728 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:01.254240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1bfd-3d82-40ed-89d8-95d694186451 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.265301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb9684-16b6-470d-8dab-4e6488ebec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.265946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb9684-16b6-470d-8dab-4e6488ebec8f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.266230 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb9684-16b6-470d-8dab-4e6488ebec8f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.266505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb9684-16b6-470d-8dab-4e6488ebec8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.340269 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb9684-16b6-470d-8dab-4e6488ebec8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:01.341788 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb9684-16b6-470d-8dab-4e6488ebec8f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:01.358539 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1bfd-3d82-40ed-89d8-95d694186451 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.392758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c079914-777b-42ae-82af-260bacae3ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.393633 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c079914-777b-42ae-82af-260bacae3ce5 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.393907 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c079914-777b-42ae-82af-260bacae3ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.394177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c079914-777b-42ae-82af-260bacae3ce5 None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/84b4164dd21a4ec0bd3d50cd46d7d5e8/roles/eef7d022d05842b7a4bc4d6b88f6d0d6` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.396444 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c079914-777b-42ae-82af-260bacae3ce5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=84b4164dd21a4ec0bd3d50cd46d7d5e8, role_id=eef7d022d05842b7a4bc4d6b88f6d0d6)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:01.397883 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c079914-777b-42ae-82af-260bacae3ce5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:01.442904 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 540/1073] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:44:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:01.443753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb9684-16b6-470d-8dab-4e6488ebec8f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.466036 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.476002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 534/1074] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:44:01 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/84b4164dd21a4ec0bd3d50cd46d7d5e8/roles/eef7d022d05842b7a4bc4d6b88f6d0d6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:01.476916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c079914-777b-42ae-82af-260bacae3ce5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.520066 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.559082 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb9684-16b6-470d-8dab-4e6488ebec8f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.604141 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7421e2-9f96-4fea-945c-dc7da7bdaa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.604805 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7421e2-9f96-4fea-945c-dc7da7bdaa3e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.605084 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7421e2-9f96-4fea-945c-dc7da7bdaa3e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.605359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7421e2-9f96-4fea-945c-dc7da7bdaa3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.605466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c079914-777b-42ae-82af-260bacae3ce5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.606207 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7421e2-9f96-4fea-945c-dc7da7bdaa3e None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=5cc85bc03e95432d909d55dbc2b23728, user.id=7c9741bb85e34767a0ca2eb7971ab954) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:01.606515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7421e2-9f96-4fea-945c-dc7da7bdaa3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:01.608054 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7421e2-9f96-4fea-945c-dc7da7bdaa3e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:01.614849 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 541/1075] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:44:01 2022] GET /identity/v3/role_assignments?user.id=7c9741bb85e34767a0ca2eb7971ab954&scope.project.id=5cc85bc03e95432d909d55dbc2b23728&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:01.648158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e6448-c775-4bcf-924a-f640937dc6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.649017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e6448-c775-4bcf-924a-f640937dc6a7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.649283 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e6448-c775-4bcf-924a-f640937dc6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.650131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e6448-c775-4bcf-924a-f640937dc6a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.662785 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e6448-c775-4bcf-924a-f640937dc6a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:01.664334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e6448-c775-4bcf-924a-f640937dc6a7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-253e6448-c775-4bcf-924a-f640937dc6a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:01.686590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:01.687684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:01.688927 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:01.688927 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:01.688927 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:01.688927 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:44:01.688927 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 535/1076] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:01.696033 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7421e2-9f96-4fea-945c-dc7da7bdaa3e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.795153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.814377 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7421e2-9f96-4fea-945c-dc7da7bdaa3e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.850687 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90519ce4-028b-4453-9c52-fa7f60c35820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.851623 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90519ce4-028b-4453-9c52-fa7f60c35820 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.852054 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90519ce4-028b-4453-9c52-fa7f60c35820 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.852470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90519ce4-028b-4453-9c52-fa7f60c35820 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.853372 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90519ce4-028b-4453-9c52-fa7f60c35820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:01.853847 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90519ce4-028b-4453-9c52-fa7f60c35820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:01.855395 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90519ce4-028b-4453-9c52-fa7f60c35820 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:01.869589 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 542/1077] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:03.784601 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43938ba-ea3c-4570-a308-0969996d743d None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.785172 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43938ba-ea3c-4570-a308-0969996d743d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.785172 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43938ba-ea3c-4570-a308-0969996d743d None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.786522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 536/1078] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:03.791821 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee978a8-76f1-4c77-8722-b83a2f2d9725 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.792259 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee978a8-76f1-4c77-8722-b83a2f2d9725 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.792376 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee978a8-76f1-4c77-8722-b83a2f2d9725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.808986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-9ee978a8-76f1-4c77-8722-b83a2f2d9725 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:03.810229 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-9ee978a8-76f1-4c77-8722-b83a2f2d9725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:03.875731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf727e-23ea-4ba3-b9b3-935fcae539ed None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.876056 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf727e-23ea-4ba3-b9b3-935fcae539ed None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.876292 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 543/1079] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:03.876442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf727e-23ea-4ba3-b9b3-935fcae539ed None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.877664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 537/1080] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:03.883041 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09744-6036-4b81-b395-c9887975bebe None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.883331 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09744-6036-4b81-b395-c9887975bebe None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.884144 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09744-6036-4b81-b395-c9887975bebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.901696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-5fb09744-6036-4b81-b395-c9887975bebe None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:03.901881 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf727e-23ea-4ba3-b9b3-935fcae539ed None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:03.902903 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-5fb09744-6036-4b81-b395-c9887975bebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:03.968379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 544/1081] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:03.985670 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:03.990451 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb09744-6036-4b81-b395-c9887975bebe None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:03.993552 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.001841 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf727e-23ea-4ba3-b9b3-935fcae539ed None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.036803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b849e-374c-482c-9022-03a785d90c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.037525 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b849e-374c-482c-9022-03a785d90c91 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.037808 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b849e-374c-482c-9022-03a785d90c91 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.038087 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b849e-374c-482c-9022-03a785d90c91 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.048881 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b849e-374c-482c-9022-03a785d90c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-9e9b849e-374c-482c-9022-03a785d90c91 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:04.057809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:04.058848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:44:04.059839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 538/1082] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 19:44:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:04.064944 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b849e-374c-482c-9022-03a785d90c91 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.090955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb09744-6036-4b81-b395-c9887975bebe None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.125220 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16cc1-c890-4bd2-b07a-9f1dad25f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.125996 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16cc1-c890-4bd2-b07a-9f1dad25f586 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.126276 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16cc1-c890-4bd2-b07a-9f1dad25f586 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.126545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16cc1-c890-4bd2-b07a-9f1dad25f586 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.137376 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b16cc1-c890-4bd2-b07a-9f1dad25f586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-e6b16cc1-c890-4bd2-b07a-9f1dad25f586 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:04.144981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:04.146000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:44:04.146909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 545/1083] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:44:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:04.152127 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16cc1-c890-4bd2-b07a-9f1dad25f586 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.166419 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b849e-374c-482c-9022-03a785d90c91 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.201255 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a9611-2e06-4204-9f04-2e98cb7d5192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.201922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a9611-2e06-4204-9f04-2e98cb7d5192 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.202205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a9611-2e06-4204-9f04-2e98cb7d5192 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.202481 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a9611-2e06-4204-9f04-2e98cb7d5192 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.203260 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a9611-2e06-4204-9f04-2e98cb7d5192 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:04.203569 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a9611-2e06-4204-9f04-2e98cb7d5192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.204953 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a9611-2e06-4204-9f04-2e98cb7d5192 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.213088 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 539/1084] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:04.213221 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.218468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a9611-2e06-4204-9f04-2e98cb7d5192 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.227447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.253590 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16cc1-c890-4bd2-b07a-9f1dad25f586 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.291243 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da52830-f5aa-4909-8389-5bb5e7f8e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.291851 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52830-f5aa-4909-8389-5bb5e7f8e88f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.292140 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52830-f5aa-4909-8389-5bb5e7f8e88f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.292414 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52830-f5aa-4909-8389-5bb5e7f8e88f None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.293168 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da52830-f5aa-4909-8389-5bb5e7f8e88f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:04.293506 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da52830-f5aa-4909-8389-5bb5e7f8e88f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.294895 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da52830-f5aa-4909-8389-5bb5e7f8e88f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.303347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 546/1085] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:04.309873 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da52830-f5aa-4909-8389-5bb5e7f8e88f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.324862 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a9611-2e06-4204-9f04-2e98cb7d5192 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.361300 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb159e11-b538-4e23-a79d-9dff7cf92821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.362088 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159e11-b538-4e23-a79d-9dff7cf92821 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.362370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159e11-b538-4e23-a79d-9dff7cf92821 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.362683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159e11-b538-4e23-a79d-9dff7cf92821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.373905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb159e11-b538-4e23-a79d-9dff7cf92821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.375389 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb159e11-b538-4e23-a79d-9dff7cf92821 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-bb159e11-b538-4e23-a79d-9dff7cf92821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:04.392631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:04.393700 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:04.394649 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:04.394649 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:04.394649 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:04.394649 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:44:04.394649 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 540/1086] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:04.399652 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb159e11-b538-4e23-a79d-9dff7cf92821 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.416885 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da52830-f5aa-4909-8389-5bb5e7f8e88f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.442387 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.451126 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd7d9b-458f-45f6-9359-fb7b643d2c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.451983 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd7d9b-458f-45f6-9359-fb7b643d2c8e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.452261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd7d9b-458f-45f6-9359-fb7b643d2c8e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.452527 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd7d9b-458f-45f6-9359-fb7b643d2c8e None admin] PATH_INFO: `/v3/users/7c9741bb85e34767a0ca2eb7971ab954` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.453716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd7d9b-458f-45f6-9359-fb7b643d2c8e None admin] RBAC: Authorizing `identity:get_user(user_id=7c9741bb85e34767a0ca2eb7971ab954)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.455182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd7d9b-458f-45f6-9359-fb7b643d2c8e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.456806 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 547/1087] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/users/7c9741bb85e34767a0ca2eb7971ab954 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:04.461721 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.462345 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd7d9b-458f-45f6-9359-fb7b643d2c8e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.502782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb159e11-b538-4e23-a79d-9dff7cf92821 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.537079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a290e-4ee4-49e6-8566-17f2edcf1f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.537741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a290e-4ee4-49e6-8566-17f2edcf1f72 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.538015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a290e-4ee4-49e6-8566-17f2edcf1f72 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.538493 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a290e-4ee4-49e6-8566-17f2edcf1f72 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.539245 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a290e-4ee4-49e6-8566-17f2edcf1f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:04.539550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a290e-4ee4-49e6-8566-17f2edcf1f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.541537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a290e-4ee4-49e6-8566-17f2edcf1f72 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.554768 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 541/1088] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:04.561221 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a290e-4ee4-49e6-8566-17f2edcf1f72 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.566994 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd7d9b-458f-45f6-9359-fb7b643d2c8e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.600470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54554756-4daa-4d5c-a7ef-c215bb3ae4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.601342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554756-4daa-4d5c-a7ef-c215bb3ae4fb None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.601622 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554756-4daa-4d5c-a7ef-c215bb3ae4fb None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.601896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554756-4daa-4d5c-a7ef-c215bb3ae4fb None admin] PATH_INFO: `/v3/projects/5cc85bc03e95432d909d55dbc2b23728` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.603606 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54554756-4daa-4d5c-a7ef-c215bb3ae4fb None admin] RBAC: Authorizing `identity:get_project(project_id=5cc85bc03e95432d909d55dbc2b23728)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.605042 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54554756-4daa-4d5c-a7ef-c215bb3ae4fb None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.606868 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 548/1089] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/projects/5cc85bc03e95432d909d55dbc2b23728 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:04.612890 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54554756-4daa-4d5c-a7ef-c215bb3ae4fb None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.674994 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.675925 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a290e-4ee4-49e6-8566-17f2edcf1f72 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.699356 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.715570 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54554756-4daa-4d5c-a7ef-c215bb3ae4fb None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.720444 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa8f38-bc8a-4b06-a65e-8c253bc1ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.721667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa8f38-bc8a-4b06-a65e-8c253bc1ff9b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.722166 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa8f38-bc8a-4b06-a65e-8c253bc1ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.723095 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa8f38-bc8a-4b06-a65e-8c253bc1ff9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.730969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa8f38-bc8a-4b06-a65e-8c253bc1ff9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.736846 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa8f38-bc8a-4b06-a65e-8c253bc1ff9b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.751739 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e470f3-f6a2-40ed-9b06-af0417141d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-42aa8f38-bc8a-4b06-a65e-8c253bc1ff9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:04.752176 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:04.757553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:04.758540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:04.758540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:04.758540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:04.758540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:04.758540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:04.758540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:04.758540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:04.758540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:04.758540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:04.758540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:44:04.760237 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e470f3-f6a2-40ed-9b06-af0417141d4e None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.760237 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e470f3-f6a2-40ed-9b06-af0417141d4e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.760237 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e470f3-f6a2-40ed-9b06-af0417141d4e None admin] PATH_INFO: `/v3/projects/5cc85bc03e95432d909d55dbc2b23728/users/7c9741bb85e34767a0ca2eb7971ab954/roles/4f7e6c1b02094f72ae978c3558b530a9` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.760537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 542/1090] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:04.760622 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e470f3-f6a2-40ed-9b06-af0417141d4e None admin] RBAC: Authorizing `identity:create_grant(project_id=5cc85bc03e95432d909d55dbc2b23728, user_id=7c9741bb85e34767a0ca2eb7971ab954, role_id=4f7e6c1b02094f72ae978c3558b530a9)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.760622 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e470f3-f6a2-40ed-9b06-af0417141d4e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.760789 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa8f38-bc8a-4b06-a65e-8c253bc1ff9b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.829865 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 549/1091] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:44:04 2022] PUT /identity/v3/projects/5cc85bc03e95432d909d55dbc2b23728/users/7c9741bb85e34767a0ca2eb7971ab954/roles/4f7e6c1b02094f72ae978c3558b530a9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:04.942122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa8f38-bc8a-4b06-a65e-8c253bc1ff9b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.982637 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080888a-4494-4531-b778-51a60288bd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.983786 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080888a-4494-4531-b778-51a60288bd55 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.984294 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080888a-4494-4531-b778-51a60288bd55 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.984801 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080888a-4494-4531-b778-51a60288bd55 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.986420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080888a-4494-4531-b778-51a60288bd55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:04.987030 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080888a-4494-4531-b778-51a60288bd55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.989266 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080888a-4494-4531-b778-51a60288bd55 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:05.016281 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 543/1092] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:05.017957 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e470f3-f6a2-40ed-9b06-af0417141d4e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:05.125538 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e470f3-f6a2-40ed-9b06-af0417141d4e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:05.149695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:05.162377 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dbbde-c9ac-4b2c-ace0-7d88afccd15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:05.163086 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dbbde-c9ac-4b2c-ace0-7d88afccd15b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:05.163364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dbbde-c9ac-4b2c-ace0-7d88afccd15b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:05.163635 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dbbde-c9ac-4b2c-ace0-7d88afccd15b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:05.238077 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dbbde-c9ac-4b2c-ace0-7d88afccd15b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:05.239605 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dbbde-c9ac-4b2c-ace0-7d88afccd15b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:05.352109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 550/1093] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:44:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:05.357888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080888a-4494-4531-b778-51a60288bd55 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:05.393190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:05.459357 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080888a-4494-4531-b778-51a60288bd55 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:05.493912 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d44e3-14ac-496a-ad8b-2745cc296c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:05.494721 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d44e3-14ac-496a-ad8b-2745cc296c90 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:05.495000 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d44e3-14ac-496a-ad8b-2745cc296c90 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:05.495271 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d44e3-14ac-496a-ad8b-2745cc296c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:05.505313 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d44e3-14ac-496a-ad8b-2745cc296c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:05.506799 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d44e3-14ac-496a-ad8b-2745cc296c90 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-2b2d44e3-14ac-496a-ad8b-2745cc296c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:05.525205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:05.526229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:05.527522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:05.527522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:05.527522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:05.527522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:44:05.527522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 544/1094] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:05.532136 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dbbde-c9ac-4b2c-ace0-7d88afccd15b None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:05.555316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:05.630079 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dbbde-c9ac-4b2c-ace0-7d88afccd15b None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:05.665276 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e39db-53ad-4d75-84da-245a99319876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:05.665869 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e39db-53ad-4d75-84da-245a99319876 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:05.666154 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e39db-53ad-4d75-84da-245a99319876 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:05.666433 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e39db-53ad-4d75-84da-245a99319876 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:05.667204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e39db-53ad-4d75-84da-245a99319876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:05.667516 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e39db-53ad-4d75-84da-245a99319876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:05.669120 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e39db-53ad-4d75-84da-245a99319876 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:05.681878 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 551/1095] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:05.687839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d44e3-14ac-496a-ad8b-2745cc296c90 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:05.776175 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:05.788147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d44e3-14ac-496a-ad8b-2745cc296c90 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:05.822869 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59824d7-f955-4811-ab1c-f86b7a7cea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:05.823680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59824d7-f955-4811-ab1c-f86b7a7cea58 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:05.823961 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59824d7-f955-4811-ab1c-f86b7a7cea58 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:05.824234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59824d7-f955-4811-ab1c-f86b7a7cea58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:05.830853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59824d7-f955-4811-ab1c-f86b7a7cea58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:05.832298 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59824d7-f955-4811-ab1c-f86b7a7cea58 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-d59824d7-f955-4811-ab1c-f86b7a7cea58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:05.845666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:05.846573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:05.847548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:05.847548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:05.847548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:05.847548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:05.847548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:05.847548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:05.847548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:05.847548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:44:05.847548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 545/1096] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:05.852850 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e39db-53ad-4d75-84da-245a99319876 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:05.935816 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:05.957532 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e39db-53ad-4d75-84da-245a99319876 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:05.995006 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48927784-c0f9-42d7-b384-52366530253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:05.995660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48927784-c0f9-42d7-b384-52366530253e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:05.995950 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48927784-c0f9-42d7-b384-52366530253e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:05.996222 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48927784-c0f9-42d7-b384-52366530253e None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:05.997019 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48927784-c0f9-42d7-b384-52366530253e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:05.997335 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48927784-c0f9-42d7-b384-52366530253e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:05.998779 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48927784-c0f9-42d7-b384-52366530253e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:06.010263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 552/1097] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:44:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:06.016221 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59824d7-f955-4811-ab1c-f86b7a7cea58 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:06.117265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59824d7-f955-4811-ab1c-f86b7a7cea58 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:06.151043 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f706e8-1792-4a6a-848a-945c90644823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:06.151696 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f706e8-1792-4a6a-848a-945c90644823 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:06.151981 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f706e8-1792-4a6a-848a-945c90644823 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:06.152258 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f706e8-1792-4a6a-848a-945c90644823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:06.153088 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f706e8-1792-4a6a-848a-945c90644823 None admin] RBAC: Adding query filter params (role.id=eef7d022d05842b7a4bc4d6b88f6d0d6, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:06.153552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f706e8-1792-4a6a-848a-945c90644823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:06.155029 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f706e8-1792-4a6a-848a-945c90644823 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:06.160859 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 546/1098] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:44:06 2022] GET /identity/v3/role_assignments?user.id=84b4164dd21a4ec0bd3d50cd46d7d5e8&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=eef7d022d05842b7a4bc4d6b88f6d0d6 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:07.133825 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f52b0-286e-41b4-9b2f-b8eea13c0c55 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:07.134403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f52b0-286e-41b4-9b2f-b8eea13c0c55 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:07.134403 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f52b0-286e-41b4-9b2f-b8eea13c0c55 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:07.135790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 553/1099] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:07.140902 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bca33-daf6-45b4-b350-21d12eadea0c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:07.141337 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bca33-daf6-45b4-b350-21d12eadea0c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:07.141453 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bca33-daf6-45b4-b350-21d12eadea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:07.158527 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-308bca33-daf6-45b4-b350-21d12eadea0c None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:07.160276 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-308bca33-daf6-45b4-b350-21d12eadea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:07.168702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:07.230008 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 547/1100] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:07.253120 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f52b0-286e-41b4-9b2f-b8eea13c0c55 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:07.354047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f52b0-286e-41b4-9b2f-b8eea13c0c55 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:07.386164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e32f1-5fb9-45f8-a843-256f51edbeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:07.386892 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e32f1-5fb9-45f8-a843-256f51edbeeb None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:07.387173 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e32f1-5fb9-45f8-a843-256f51edbeeb None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:07.387445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e32f1-5fb9-45f8-a843-256f51edbeeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:07.398748 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e32f1-5fb9-45f8-a843-256f51edbeeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-3b0e32f1-5fb9-45f8-a843-256f51edbeeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:07.406872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:07.408003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:44:07.409137 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 554/1101] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:07.414250 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bca33-daf6-45b4-b350-21d12eadea0c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:07.509993 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bca33-daf6-45b4-b350-21d12eadea0c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:07.543607 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc8317-6b82-4a9f-b58e-9e270c3fc87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:07.544274 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc8317-6b82-4a9f-b58e-9e270c3fc87b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:07.544559 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc8317-6b82-4a9f-b58e-9e270c3fc87b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:07.544837 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc8317-6b82-4a9f-b58e-9e270c3fc87b None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:07.545585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc8317-6b82-4a9f-b58e-9e270c3fc87b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:07.545896 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc8317-6b82-4a9f-b58e-9e270c3fc87b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:07.547310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc8317-6b82-4a9f-b58e-9e270c3fc87b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:07.555744 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 548/1102] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:07.561540 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e32f1-5fb9-45f8-a843-256f51edbeeb None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:07.564430 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:07.659659 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e32f1-5fb9-45f8-a843-256f51edbeeb None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:07.691491 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40ab17-fd3c-492d-8b15-4086c368dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:07.692347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40ab17-fd3c-492d-8b15-4086c368dd76 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:07.692625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40ab17-fd3c-492d-8b15-4086c368dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:07.692896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40ab17-fd3c-492d-8b15-4086c368dd76 None admin] PATH_INFO: `/v3/users/7c9741bb85e34767a0ca2eb7971ab954` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:07.694064 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40ab17-fd3c-492d-8b15-4086c368dd76 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9741bb85e34767a0ca2eb7971ab954)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:07.695515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40ab17-fd3c-492d-8b15-4086c368dd76 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:07.697638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 555/1103] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:07 2022] GET /identity/v3/users/7c9741bb85e34767a0ca2eb7971ab954 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:07.703314 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc8317-6b82-4a9f-b58e-9e270c3fc87b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:07.707083 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:07.805984 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc8317-6b82-4a9f-b58e-9e270c3fc87b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:07.840312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fea3e-653c-4db5-a595-74a4a32b0bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:07.840955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fea3e-653c-4db5-a595-74a4a32b0bb9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:07.841240 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fea3e-653c-4db5-a595-74a4a32b0bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:07.841517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fea3e-653c-4db5-a595-74a4a32b0bb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:07.908890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fea3e-653c-4db5-a595-74a4a32b0bb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:07.910436 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fea3e-653c-4db5-a595-74a4a32b0bb9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:07.913103 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:08.010301 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 549/1104] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:44:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:08.017190 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40ab17-fd3c-492d-8b15-4086c368dd76 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:08.086923 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:08.115608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40ab17-fd3c-492d-8b15-4086c368dd76 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:08.148818 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f2016-398a-4fce-bd84-67f69495ca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:08.149685 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f2016-398a-4fce-bd84-67f69495ca50 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.149961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f2016-398a-4fce-bd84-67f69495ca50 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.150231 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f2016-398a-4fce-bd84-67f69495ca50 None admin] PATH_INFO: `/v3/projects/5cc85bc03e95432d909d55dbc2b23728` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.151422 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f2016-398a-4fce-bd84-67f69495ca50 None admin] RBAC: Authorizing `identity:get_project(project_id=5cc85bc03e95432d909d55dbc2b23728)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:08.152840 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f2016-398a-4fce-bd84-67f69495ca50 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:08.154519 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 556/1105] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:08 2022] GET /identity/v3/projects/5cc85bc03e95432d909d55dbc2b23728 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:08.160638 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fea3e-653c-4db5-a595-74a4a32b0bb9 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:08.256015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fea3e-653c-4db5-a595-74a4a32b0bb9 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:08.258273 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:08.288317 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d2c4c-15c5-47f6-8a80-fd6a55dcf5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:08.288967 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d2c4c-15c5-47f6-8a80-fd6a55dcf5a1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.289247 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d2c4c-15c5-47f6-8a80-fd6a55dcf5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.289522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d2c4c-15c5-47f6-8a80-fd6a55dcf5a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.290918 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d2c4c-15c5-47f6-8a80-fd6a55dcf5a1 None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=5cc85bc03e95432d909d55dbc2b23728, user.id=7c9741bb85e34767a0ca2eb7971ab954) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:08.291445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d2c4c-15c5-47f6-8a80-fd6a55dcf5a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:08.293221 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d2c4c-15c5-47f6-8a80-fd6a55dcf5a1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:08.299118 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 550/1106] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:44:08 2022] GET /identity/v3/role_assignments?user.id=7c9741bb85e34767a0ca2eb7971ab954&scope.project.id=5cc85bc03e95432d909d55dbc2b23728&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:10.544233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30132792-7817-4eb4-8994-ebf31b054130 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:10.544740 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30132792-7817-4eb4-8994-ebf31b054130 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:10.544740 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30132792-7817-4eb4-8994-ebf31b054130 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:10.546065 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 557/1107] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:10.551573 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f31c-c2cd-4fbd-95f5-aeee67c11a7c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:10.552015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f31c-c2cd-4fbd-95f5-aeee67c11a7c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:10.552117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f31c-c2cd-4fbd-95f5-aeee67c11a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:10.570009 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7679f31c-c2cd-4fbd-95f5-aeee67c11a7c None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:10.571356 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7679f31c-c2cd-4fbd-95f5-aeee67c11a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:10.637169 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 551/1108] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:10.661441 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30132792-7817-4eb4-8994-ebf31b054130 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:10.761648 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30132792-7817-4eb4-8994-ebf31b054130 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:10.795571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93366df-8af5-4ae8-83a2-3713593ca5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:10.796385 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93366df-8af5-4ae8-83a2-3713593ca5b7 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:10.796717 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93366df-8af5-4ae8-83a2-3713593ca5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:10.797042 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93366df-8af5-4ae8-83a2-3713593ca5b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:10.798300 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93366df-8af5-4ae8-83a2-3713593ca5b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:10.799817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93366df-8af5-4ae8-83a2-3713593ca5b7 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:10.801433 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 558/1109] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:44:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:10.807451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679f31c-c2cd-4fbd-95f5-aeee67c11a7c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:10.899912 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:10.903626 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679f31c-c2cd-4fbd-95f5-aeee67c11a7c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:10.937250 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de061841-3ad6-4034-9427-fd6f9fa36bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:10.937906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061841-3ad6-4034-9427-fd6f9fa36bb3 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:10.938190 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061841-3ad6-4034-9427-fd6f9fa36bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:10.938470 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061841-3ad6-4034-9427-fd6f9fa36bb3 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:10.939205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de061841-3ad6-4034-9427-fd6f9fa36bb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:10.940647 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de061841-3ad6-4034-9427-fd6f9fa36bb3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:11.041453 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 552/1110] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:44:10 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:13.310145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7ce01-5eda-4906-896e-a20dd17eee1f None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.310725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7ce01-5eda-4906-896e-a20dd17eee1f None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.310725 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7ce01-5eda-4906-896e-a20dd17eee1f None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.312101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 559/1111] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:13.317569 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c43e-96fd-4df0-8d95-8bc7fc6cb332 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.317990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c43e-96fd-4df0-8d95-8bc7fc6cb332 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.318386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c43e-96fd-4df0-8d95-8bc7fc6cb332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.335649 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7116c43e-96fd-4df0-8d95-8bc7fc6cb332 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:13.336851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7116c43e-96fd-4df0-8d95-8bc7fc6cb332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:13.402842 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 553/1112] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:13.426398 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7ce01-5eda-4906-896e-a20dd17eee1f None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.436117 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.527002 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7ce01-5eda-4906-896e-a20dd17eee1f None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.560919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d9f31-b15f-47a9-8f1f-e551f16d378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.561691 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d9f31-b15f-47a9-8f1f-e551f16d378a None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.561977 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d9f31-b15f-47a9-8f1f-e551f16d378a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.562253 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d9f31-b15f-47a9-8f1f-e551f16d378a None admin] PATH_INFO: `/v3/roles/963eb8fa7a2943569e51dc5310a46baa` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.563748 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d9f31-b15f-47a9-8f1f-e551f16d378a None admin] RBAC: Authorizing `identity:get_role(role_id=963eb8fa7a2943569e51dc5310a46baa)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.565110 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d9f31-b15f-47a9-8f1f-e551f16d378a None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:13.566493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 560/1113] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/roles/963eb8fa7a2943569e51dc5310a46baa => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:13.572284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116c43e-96fd-4df0-8d95-8bc7fc6cb332 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.673519 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.689330 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116c43e-96fd-4df0-8d95-8bc7fc6cb332 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.723498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7159b80-519e-4f47-8d37-0fe3496d4707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.724367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7159b80-519e-4f47-8d37-0fe3496d4707 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.724651 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7159b80-519e-4f47-8d37-0fe3496d4707 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.724930 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7159b80-519e-4f47-8d37-0fe3496d4707 None admin] PATH_INFO: `/v3/users/0d831afda7b84c168c10defe2f577109` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.739332 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7159b80-519e-4f47-8d37-0fe3496d4707 None admin] RBAC: Authorizing `identity:get_user(user_id=0d831afda7b84c168c10defe2f577109)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.740799 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7159b80-519e-4f47-8d37-0fe3496d4707 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:13.743146 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 554/1114] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/users/0d831afda7b84c168c10defe2f577109 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:13.748813 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d9f31-b15f-47a9-8f1f-e551f16d378a None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.824386 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.849053 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d9f31-b15f-47a9-8f1f-e551f16d378a None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.882109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c8f4a-97a8-48e0-bdf4-ddd5dfcadac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.882789 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c8f4a-97a8-48e0-bdf4-ddd5dfcadac7 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.883080 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c8f4a-97a8-48e0-bdf4-ddd5dfcadac7 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.883355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c8f4a-97a8-48e0-bdf4-ddd5dfcadac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.983390 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c8f4a-97a8-48e0-bdf4-ddd5dfcadac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.986018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c8f4a-97a8-48e0-bdf4-ddd5dfcadac7 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.104442 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:14.128605 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 561/1115] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:14.134446 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7159b80-519e-4f47-8d37-0fe3496d4707 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:14.236743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7159b80-519e-4f47-8d37-0fe3496d4707 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:14.272376 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88982ae3-47a0-4046-9944-18a7dcdf7f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:14.273231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88982ae3-47a0-4046-9944-18a7dcdf7f16 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.273512 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88982ae3-47a0-4046-9944-18a7dcdf7f16 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.274446 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88982ae3-47a0-4046-9944-18a7dcdf7f16 None admin] PATH_INFO: `/v3/projects/5cc85bc03e95432d909d55dbc2b23728` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.275696 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88982ae3-47a0-4046-9944-18a7dcdf7f16 None admin] RBAC: Authorizing `identity:get_project(project_id=5cc85bc03e95432d909d55dbc2b23728)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:14.277161 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88982ae3-47a0-4046-9944-18a7dcdf7f16 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.279038 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 555/1116] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/projects/5cc85bc03e95432d909d55dbc2b23728 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:14.285341 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c8f4a-97a8-48e0-bdf4-ddd5dfcadac7 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:14.386862 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c8f4a-97a8-48e0-bdf4-ddd5dfcadac7 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:14.421553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8739962-079c-4a6a-9a9d-698c32b41440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:14.422204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8739962-079c-4a6a-9a9d-698c32b41440 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.422484 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8739962-079c-4a6a-9a9d-698c32b41440 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.422790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8739962-079c-4a6a-9a9d-698c32b41440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.423634 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8739962-079c-4a6a-9a9d-698c32b41440 None admin] RBAC: Adding query filter params (role.id=963eb8fa7a2943569e51dc5310a46baa, scope.project.id=5cc85bc03e95432d909d55dbc2b23728, user.id=0d831afda7b84c168c10defe2f577109) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:14.423970 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8739962-079c-4a6a-9a9d-698c32b41440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:14.425406 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8739962-079c-4a6a-9a9d-698c32b41440 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.431908 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 562/1117] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/role_assignments?user.id=0d831afda7b84c168c10defe2f577109&scope.project.id=5cc85bc03e95432d909d55dbc2b23728&role.id=963eb8fa7a2943569e51dc5310a46baa => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:16.644352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b546-6d2e-45fd-8412-35a8820a25c7 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:16.644895 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b546-6d2e-45fd-8412-35a8820a25c7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:16.644895 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b546-6d2e-45fd-8412-35a8820a25c7 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.646237 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 556/1118] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:16.652549 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50d279-c921-41d5-8f4b-daab5a0d4dc0 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:16.653029 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50d279-c921-41d5-8f4b-daab5a0d4dc0 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:16.653122 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50d279-c921-41d5-8f4b-daab5a0d4dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.670449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-2e50d279-c921-41d5-8f4b-daab5a0d4dc0 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:16.671663 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-2e50d279-c921-41d5-8f4b-daab5a0d4dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:16.701271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:16.738728 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 563/1119] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:16.761548 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726b546-6d2e-45fd-8412-35a8820a25c7 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:16.774447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:16.861488 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726b546-6d2e-45fd-8412-35a8820a25c7 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:16.895594 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef257-29f0-4093-98c4-288de49bca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:16.896356 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef257-29f0-4093-98c4-288de49bca53 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:16.896634 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef257-29f0-4093-98c4-288de49bca53 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:16.896906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef257-29f0-4093-98c4-288de49bca53 None admin] PATH_INFO: `/v3/roles/963eb8fa7a2943569e51dc5310a46baa` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.898360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ef257-29f0-4093-98c4-288de49bca53 None admin] RBAC: Authorizing `identity:get_role(role_id=963eb8fa7a2943569e51dc5310a46baa)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:16.899767 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ef257-29f0-4093-98c4-288de49bca53 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:16.901122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 557/1120] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:16 2022] GET /identity/v3/roles/963eb8fa7a2943569e51dc5310a46baa => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:16.907104 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50d279-c921-41d5-8f4b-daab5a0d4dc0 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:17.021582 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50d279-c921-41d5-8f4b-daab5a0d4dc0 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:17.057418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df950f9f-bf9e-4fcd-9597-65b7cd1ebb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:17.058298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df950f9f-bf9e-4fcd-9597-65b7cd1ebb19 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:17.058578 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df950f9f-bf9e-4fcd-9597-65b7cd1ebb19 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:17.058883 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df950f9f-bf9e-4fcd-9597-65b7cd1ebb19 None admin] PATH_INFO: `/v3/users/0d831afda7b84c168c10defe2f577109` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:17.060143 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df950f9f-bf9e-4fcd-9597-65b7cd1ebb19 None admin] RBAC: Authorizing `identity:get_user(user_id=0d831afda7b84c168c10defe2f577109)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:17.061612 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df950f9f-bf9e-4fcd-9597-65b7cd1ebb19 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:17.063341 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 564/1121] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:16 2022] GET /identity/v3/users/0d831afda7b84c168c10defe2f577109 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:17.069274 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef257-29f0-4093-98c4-288de49bca53 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:17.152816 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:17.181135 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef257-29f0-4093-98c4-288de49bca53 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:17.242143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd74ac-bba2-4733-9e7a-c732da9b0404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:17.244273 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd74ac-bba2-4733-9e7a-c732da9b0404 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:17.244786 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd74ac-bba2-4733-9e7a-c732da9b0404 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:17.245264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd74ac-bba2-4733-9e7a-c732da9b0404 None admin] PATH_INFO: `/v3/projects/5cc85bc03e95432d909d55dbc2b23728` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:17.247528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd74ac-bba2-4733-9e7a-c732da9b0404 None admin] RBAC: Authorizing `identity:get_project(project_id=5cc85bc03e95432d909d55dbc2b23728)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:17.250335 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd74ac-bba2-4733-9e7a-c732da9b0404 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:17.254976 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 558/1122] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:17 2022] GET /identity/v3/projects/5cc85bc03e95432d909d55dbc2b23728 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:17.261290 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df950f9f-bf9e-4fcd-9597-65b7cd1ebb19 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:17.298305 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:17.366414 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df950f9f-bf9e-4fcd-9597-65b7cd1ebb19 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:17.404871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9f1b3-ed0f-4033-9f62-b724f83e7c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:17.405671 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9f1b3-ed0f-4033-9f62-b724f83e7c4a None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:17.405955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9f1b3-ed0f-4033-9f62-b724f83e7c4a None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:17.406231 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9f1b3-ed0f-4033-9f62-b724f83e7c4a None admin] PATH_INFO: `/v3/projects/5cc85bc03e95432d909d55dbc2b23728/users/0d831afda7b84c168c10defe2f577109/roles/963eb8fa7a2943569e51dc5310a46baa` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:17.408477 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9f1b3-ed0f-4033-9f62-b724f83e7c4a None admin] RBAC: Authorizing `identity:create_grant(project_id=5cc85bc03e95432d909d55dbc2b23728, user_id=0d831afda7b84c168c10defe2f577109, role_id=963eb8fa7a2943569e51dc5310a46baa)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:17.409909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9f1b3-ed0f-4033-9f62-b724f83e7c4a None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:17.498737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 565/1123] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:44:17 2022] PUT /identity/v3/projects/5cc85bc03e95432d909d55dbc2b23728/users/0d831afda7b84c168c10defe2f577109/roles/963eb8fa7a2943569e51dc5310a46baa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:44:19.725612 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854838cd-d92d-4f77-a028-37c8bed0efc1 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.726139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854838cd-d92d-4f77-a028-37c8bed0efc1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.726139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854838cd-d92d-4f77-a028-37c8bed0efc1 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.727569 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 559/1124] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:19.732671 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf175a3c-7ceb-4285-864d-b8d6376ddbed None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.733042 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf175a3c-7ceb-4285-864d-b8d6376ddbed None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.733230 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf175a3c-7ceb-4285-864d-b8d6376ddbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.749644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-cf175a3c-7ceb-4285-864d-b8d6376ddbed None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:19.750846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-cf175a3c-7ceb-4285-864d-b8d6376ddbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:19.814896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 566/1125] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:19.837930 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854838cd-d92d-4f77-a028-37c8bed0efc1 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:19.934345 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854838cd-d92d-4f77-a028-37c8bed0efc1 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:19.966860 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a699b-baed-4799-b639-ffdd9045ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:19.967696 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a699b-baed-4799-b639-ffdd9045ab60 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.967975 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a699b-baed-4799-b639-ffdd9045ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.968246 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a699b-baed-4799-b639-ffdd9045ab60 None admin] PATH_INFO: `/v3/roles/963eb8fa7a2943569e51dc5310a46baa` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.969707 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a699b-baed-4799-b639-ffdd9045ab60 None admin] RBAC: Authorizing `identity:get_role(role_id=963eb8fa7a2943569e51dc5310a46baa)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:19.971105 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a699b-baed-4799-b639-ffdd9045ab60 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:19.972451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 560/1126] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:19 2022] GET /identity/v3/roles/963eb8fa7a2943569e51dc5310a46baa => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:19.978301 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf175a3c-7ceb-4285-864d-b8d6376ddbed None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.004704 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.078116 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf175a3c-7ceb-4285-864d-b8d6376ddbed None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.111153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da180b4-cca1-447c-b27b-cced7cd5adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.112016 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da180b4-cca1-447c-b27b-cced7cd5adcd None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.112297 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da180b4-cca1-447c-b27b-cced7cd5adcd None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.112573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da180b4-cca1-447c-b27b-cced7cd5adcd None admin] PATH_INFO: `/v3/users/0d831afda7b84c168c10defe2f577109` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.113765 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da180b4-cca1-447c-b27b-cced7cd5adcd None admin] RBAC: Authorizing `identity:get_user(user_id=0d831afda7b84c168c10defe2f577109)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.115240 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da180b4-cca1-447c-b27b-cced7cd5adcd None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.116870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 567/1127] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:19 2022] GET /identity/v3/users/0d831afda7b84c168c10defe2f577109 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:20.123174 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a699b-baed-4799-b639-ffdd9045ab60 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.139500 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.220949 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a699b-baed-4799-b639-ffdd9045ab60 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.255309 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af374828-4045-4238-8821-b3f4941c845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.255871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af374828-4045-4238-8821-b3f4941c845d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.256155 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af374828-4045-4238-8821-b3f4941c845d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.256431 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af374828-4045-4238-8821-b3f4941c845d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.329765 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af374828-4045-4238-8821-b3f4941c845d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.331292 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af374828-4045-4238-8821-b3f4941c845d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.348949 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.432669 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 561/1128] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:20.438553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da180b4-cca1-447c-b27b-cced7cd5adcd None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.530180 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.541567 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da180b4-cca1-447c-b27b-cced7cd5adcd None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.579812 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bca730-780c-4905-bd17-cd1385124b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.580658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bca730-780c-4905-bd17-cd1385124b12 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.580936 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bca730-780c-4905-bd17-cd1385124b12 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.581208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bca730-780c-4905-bd17-cd1385124b12 None admin] PATH_INFO: `/v3/projects/5cc85bc03e95432d909d55dbc2b23728` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.582364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bca730-780c-4905-bd17-cd1385124b12 None admin] RBAC: Authorizing `identity:get_project(project_id=5cc85bc03e95432d909d55dbc2b23728)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.583810 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bca730-780c-4905-bd17-cd1385124b12 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.585489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 568/1129] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/projects/5cc85bc03e95432d909d55dbc2b23728 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:20.592157 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af374828-4045-4238-8821-b3f4941c845d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.690961 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af374828-4045-4238-8821-b3f4941c845d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.704113 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.724023 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f8d20-2034-460f-bb0c-cf4a0f9aaa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.724677 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f8d20-2034-460f-bb0c-cf4a0f9aaa3a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.724959 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f8d20-2034-460f-bb0c-cf4a0f9aaa3a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.725235 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f8d20-2034-460f-bb0c-cf4a0f9aaa3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.726071 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f8d20-2034-460f-bb0c-cf4a0f9aaa3a None admin] RBAC: Adding query filter params (role.id=963eb8fa7a2943569e51dc5310a46baa, scope.project.id=5cc85bc03e95432d909d55dbc2b23728, user.id=0d831afda7b84c168c10defe2f577109) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:20.727180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f8d20-2034-460f-bb0c-cf4a0f9aaa3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.728426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f8d20-2034-460f-bb0c-cf4a0f9aaa3a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.735005 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 562/1130] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/role_assignments?user.id=0d831afda7b84c168c10defe2f577109&scope.project.id=5cc85bc03e95432d909d55dbc2b23728&role.id=963eb8fa7a2943569e51dc5310a46baa => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:22.997620 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cc41-b195-42c3-8c43-0cd820ff26c2 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:22.998186 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cc41-b195-42c3-8c43-0cd820ff26c2 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:22.998186 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cc41-b195-42c3-8c43-0cd820ff26c2 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:22.999570 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 569/1131] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:23.005041 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ec04f-9631-4ae6-9ef9-6cddab879fdb None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.005493 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ec04f-9631-4ae6-9ef9-6cddab879fdb None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.005588 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ec04f-9631-4ae6-9ef9-6cddab879fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.022848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ef5ec04f-9631-4ae6-9ef9-6cddab879fdb None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:23.024036 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ef5ec04f-9631-4ae6-9ef9-6cddab879fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:23.091423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 563/1132] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:23.114515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024cc41-b195-42c3-8c43-0cd820ff26c2 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:23.218014 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024cc41-b195-42c3-8c43-0cd820ff26c2 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.253606 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542302e-18ee-4ecb-b2ca-5dbddd680b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:23.254323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542302e-18ee-4ecb-b2ca-5dbddd680b96 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.254624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542302e-18ee-4ecb-b2ca-5dbddd680b96 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.254918 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542302e-18ee-4ecb-b2ca-5dbddd680b96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.256100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542302e-18ee-4ecb-b2ca-5dbddd680b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:23.257538 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542302e-18ee-4ecb-b2ca-5dbddd680b96 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:23.259196 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 570/1133] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:44:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:23.265057 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ec04f-9631-4ae6-9ef9-6cddab879fdb None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:23.365571 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ec04f-9631-4ae6-9ef9-6cddab879fdb None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.375148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:23.400138 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abfad1-3023-49d2-bb7f-dffff3650542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:23.400805 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfad1-3023-49d2-bb7f-dffff3650542 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.401084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfad1-3023-49d2-bb7f-dffff3650542 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.401357 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfad1-3023-49d2-bb7f-dffff3650542 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.402077 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abfad1-3023-49d2-bb7f-dffff3650542 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:23.403557 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abfad1-3023-49d2-bb7f-dffff3650542 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:23.487941 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 564/1134] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:44:23 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:25.763957 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f053342-99f0-4b4a-861c-7cff04692c61 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:25.764523 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f053342-99f0-4b4a-861c-7cff04692c61 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:25.764523 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f053342-99f0-4b4a-861c-7cff04692c61 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:25.765887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 571/1135] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:25.771223 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7df73-782d-437c-b9d4-f6f6bbecc2a8 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:25.771622 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7df73-782d-437c-b9d4-f6f6bbecc2a8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:25.771781 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7df73-782d-437c-b9d4-f6f6bbecc2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:25.789048 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-38b7df73-782d-437c-b9d4-f6f6bbecc2a8 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:25.790259 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-38b7df73-782d-437c-b9d4-f6f6bbecc2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:25.856203 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 565/1136] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:25.881151 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f053342-99f0-4b4a-861c-7cff04692c61 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:25.912013 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:25.982379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f053342-99f0-4b4a-861c-7cff04692c61 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:26.015843 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8ec48-d201-4c7f-95d5-4606b4b9552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:26.016545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ec48-d201-4c7f-95d5-4606b4b9552c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.016830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ec48-d201-4c7f-95d5-4606b4b9552c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.017104 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ec48-d201-4c7f-95d5-4606b4b9552c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.018307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8ec48-d201-4c7f-95d5-4606b4b9552c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:26.019849 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8ec48-d201-4c7f-95d5-4606b4b9552c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:26.021495 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 572/1137] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:44:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:26.027178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7df73-782d-437c-b9d4-f6f6bbecc2a8 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:26.114132 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:26.124434 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7df73-782d-437c-b9d4-f6f6bbecc2a8 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:26.159079 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345feff6-28fa-4794-a049-cd225283420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:26.159740 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345feff6-28fa-4794-a049-cd225283420e None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.160019 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345feff6-28fa-4794-a049-cd225283420e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.160290 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345feff6-28fa-4794-a049-cd225283420e None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.161006 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345feff6-28fa-4794-a049-cd225283420e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:26.162445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345feff6-28fa-4794-a049-cd225283420e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:26.257784 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 566/1138] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:44:26 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:28.539024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4ce71-4077-424c-834a-255f5566181f None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.539706 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4ce71-4077-424c-834a-255f5566181f None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.539706 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4ce71-4077-424c-834a-255f5566181f None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.540891 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 573/1139] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:28.546269 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2292-2a72-475c-9ba2-f1187e077477 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.546697 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2292-2a72-475c-9ba2-f1187e077477 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.546931 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2292-2a72-475c-9ba2-f1187e077477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.564498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-753d2292-2a72-475c-9ba2-f1187e077477 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:28.565678 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-753d2292-2a72-475c-9ba2-f1187e077477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:28.630875 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 567/1140] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:28.654974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4ce71-4077-424c-834a-255f5566181f None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.752123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:28.756560 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4ce71-4077-424c-834a-255f5566181f None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.790964 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e4b6f-abba-4c0d-ba45-030d0b2fc294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.791659 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e4b6f-abba-4c0d-ba45-030d0b2fc294 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.791943 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e4b6f-abba-4c0d-ba45-030d0b2fc294 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.792215 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e4b6f-abba-4c0d-ba45-030d0b2fc294 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.802227 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e4b6f-abba-4c0d-ba45-030d0b2fc294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-af8e4b6f-abba-4c0d-ba45-030d0b2fc294 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:28.810115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:28.811188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:44:28.812311 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 574/1141] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:28.817390 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d2292-2a72-475c-9ba2-f1187e077477 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.893151 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:28.915747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d2292-2a72-475c-9ba2-f1187e077477 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.948908 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bec4d-e11e-4df8-9629-933a29ae8c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.949569 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bec4d-e11e-4df8-9629-933a29ae8c5e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.949852 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bec4d-e11e-4df8-9629-933a29ae8c5e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.950126 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bec4d-e11e-4df8-9629-933a29ae8c5e None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.950902 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bec4d-e11e-4df8-9629-933a29ae8c5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:28.951207 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bec4d-e11e-4df8-9629-933a29ae8c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:28.952591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bec4d-e11e-4df8-9629-933a29ae8c5e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:28.961180 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 568/1142] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:28.966990 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e4b6f-abba-4c0d-ba45-030d0b2fc294 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.067177 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e4b6f-abba-4c0d-ba45-030d0b2fc294 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.101757 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94ae18-7d75-4e33-8031-d1533b3f196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.102636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ae18-7d75-4e33-8031-d1533b3f196e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.102931 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ae18-7d75-4e33-8031-d1533b3f196e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.103210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ae18-7d75-4e33-8031-d1533b3f196e None admin] PATH_INFO: `/v3/users/e39db86ac3d645bb917e1a1701daa63c` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.116125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94ae18-7d75-4e33-8031-d1533b3f196e None admin] RBAC: Authorizing `identity:get_user(user_id=e39db86ac3d645bb917e1a1701daa63c)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.117698 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94ae18-7d75-4e33-8031-d1533b3f196e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.119369 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 575/1143] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/users/e39db86ac3d645bb917e1a1701daa63c => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:29.125277 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bec4d-e11e-4df8-9629-933a29ae8c5e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.225098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bec4d-e11e-4df8-9629-933a29ae8c5e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.257874 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085e63c-ab45-44cf-b404-7e83bc49f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.258513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085e63c-ab45-44cf-b404-7e83bc49f037 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.258819 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085e63c-ab45-44cf-b404-7e83bc49f037 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.259095 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085e63c-ab45-44cf-b404-7e83bc49f037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.267734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:29.329872 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085e63c-ab45-44cf-b404-7e83bc49f037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.331299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085e63c-ab45-44cf-b404-7e83bc49f037 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.430339 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 569/1144] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:29.436291 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94ae18-7d75-4e33-8031-d1533b3f196e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.454684 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:29.535564 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94ae18-7d75-4e33-8031-d1533b3f196e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.569059 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaecd2f-1a2a-4204-8bba-c514e75bf87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.570471 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaecd2f-1a2a-4204-8bba-c514e75bf87e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.570830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaecd2f-1a2a-4204-8bba-c514e75bf87e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.571103 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaecd2f-1a2a-4204-8bba-c514e75bf87e None admin] PATH_INFO: `/v3/projects/aabba682011a4559b7e21ffddd3a326d` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.572272 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaecd2f-1a2a-4204-8bba-c514e75bf87e None admin] RBAC: Authorizing `identity:get_project(project_id=aabba682011a4559b7e21ffddd3a326d)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.573682 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaecd2f-1a2a-4204-8bba-c514e75bf87e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.575396 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 576/1145] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/projects/aabba682011a4559b7e21ffddd3a326d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:29.581535 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085e63c-ab45-44cf-b404-7e83bc49f037 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.620459 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:29.681140 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085e63c-ab45-44cf-b404-7e83bc49f037 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.714823 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7b704-35ea-4901-982a-808c25d779f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.715474 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b704-35ea-4901-982a-808c25d779f7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.715763 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b704-35ea-4901-982a-808c25d779f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.716044 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b704-35ea-4901-982a-808c25d779f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.716886 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7b704-35ea-4901-982a-808c25d779f7 None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=aabba682011a4559b7e21ffddd3a326d, user.id=e39db86ac3d645bb917e1a1701daa63c) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:29.717204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7b704-35ea-4901-982a-808c25d779f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.718731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7b704-35ea-4901-982a-808c25d779f7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.724385 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 570/1146] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/role_assignments?user.id=e39db86ac3d645bb917e1a1701daa63c&scope.project.id=aabba682011a4559b7e21ffddd3a326d&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:31.949602 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22ac57-f69a-4819-aee7-7c1f6bc7d958 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.950161 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22ac57-f69a-4819-aee7-7c1f6bc7d958 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.950161 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22ac57-f69a-4819-aee7-7c1f6bc7d958 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.951553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 577/1147] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:31.956781 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee439c8-933c-46af-bf05-f149a92a0b95 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.957204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee439c8-933c-46af-bf05-f149a92a0b95 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.957333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee439c8-933c-46af-bf05-f149a92a0b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.976728 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5ee439c8-933c-46af-bf05-f149a92a0b95 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:31.977967 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5ee439c8-933c-46af-bf05-f149a92a0b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:32.045833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 571/1148] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:32.067981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22ac57-f69a-4819-aee7-7c1f6bc7d958 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:32.151348 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:32.167874 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22ac57-f69a-4819-aee7-7c1f6bc7d958 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:32.202598 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b19e7-d468-4d2a-b309-5e9f85e61c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:32.203337 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b19e7-d468-4d2a-b309-5e9f85e61c46 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:32.203617 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b19e7-d468-4d2a-b309-5e9f85e61c46 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:32.203890 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b19e7-d468-4d2a-b309-5e9f85e61c46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:32.214537 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b19e7-d468-4d2a-b309-5e9f85e61c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-c37b19e7-d468-4d2a-b309-5e9f85e61c46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:32.222238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:32.223455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:44:32.224737 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 578/1149] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:32.229560 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee439c8-933c-46af-bf05-f149a92a0b95 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:32.259820 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:32.330148 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee439c8-933c-46af-bf05-f149a92a0b95 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:32.364480 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f9fdb-07f5-4548-8ff9-916cf4a5b153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:32.365150 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9fdb-07f5-4548-8ff9-916cf4a5b153 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:32.365432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9fdb-07f5-4548-8ff9-916cf4a5b153 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:32.365710 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9fdb-07f5-4548-8ff9-916cf4a5b153 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:32.366507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f9fdb-07f5-4548-8ff9-916cf4a5b153 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:32.366856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f9fdb-07f5-4548-8ff9-916cf4a5b153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:32.368245 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f9fdb-07f5-4548-8ff9-916cf4a5b153 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:32.376777 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 572/1150] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:32.389510 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b19e7-d468-4d2a-b309-5e9f85e61c46 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:32.489721 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b19e7-d468-4d2a-b309-5e9f85e61c46 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:32.523509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab99074-54c2-4749-abbe-b06ffb2d9903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:32.524367 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab99074-54c2-4749-abbe-b06ffb2d9903 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:32.524653 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab99074-54c2-4749-abbe-b06ffb2d9903 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:32.524929 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab99074-54c2-4749-abbe-b06ffb2d9903 None admin] PATH_INFO: `/v3/users/e39db86ac3d645bb917e1a1701daa63c` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:32.526127 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab99074-54c2-4749-abbe-b06ffb2d9903 None admin] RBAC: Authorizing `identity:get_user(user_id=e39db86ac3d645bb917e1a1701daa63c)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:32.527638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab99074-54c2-4749-abbe-b06ffb2d9903 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:32.529267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 579/1151] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:32 2022] GET /identity/v3/users/e39db86ac3d645bb917e1a1701daa63c => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:32.535105 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f9fdb-07f5-4548-8ff9-916cf4a5b153 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:32.627682 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:32.635402 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f9fdb-07f5-4548-8ff9-916cf4a5b153 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:32.668900 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efae22a-8106-4c2c-848d-097f4aa92fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:32.669982 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae22a-8106-4c2c-848d-097f4aa92fb2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:32.681308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae22a-8106-4c2c-848d-097f4aa92fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:32.681841 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae22a-8106-4c2c-848d-097f4aa92fb2 None admin] PATH_INFO: `/v3/projects/aabba682011a4559b7e21ffddd3a326d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:32.683535 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efae22a-8106-4c2c-848d-097f4aa92fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=aabba682011a4559b7e21ffddd3a326d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:32.684999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efae22a-8106-4c2c-848d-097f4aa92fb2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:32.686902 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 573/1152] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:32 2022] GET /identity/v3/projects/aabba682011a4559b7e21ffddd3a326d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:32.692886 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab99074-54c2-4749-abbe-b06ffb2d9903 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:32.711641 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:32.796054 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab99074-54c2-4749-abbe-b06ffb2d9903 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:32.830683 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc446fc4-e2fd-4f3c-b0e5-6eb0da3579ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:32.831561 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc446fc4-e2fd-4f3c-b0e5-6eb0da3579ab None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:32.831841 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc446fc4-e2fd-4f3c-b0e5-6eb0da3579ab None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:32.832115 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc446fc4-e2fd-4f3c-b0e5-6eb0da3579ab None admin] PATH_INFO: `/v3/projects/aabba682011a4559b7e21ffddd3a326d/users/e39db86ac3d645bb917e1a1701daa63c/roles/4f7e6c1b02094f72ae978c3558b530a9` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:32.834088 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc446fc4-e2fd-4f3c-b0e5-6eb0da3579ab None admin] RBAC: Authorizing `identity:create_grant(project_id=aabba682011a4559b7e21ffddd3a326d, user_id=e39db86ac3d645bb917e1a1701daa63c, role_id=4f7e6c1b02094f72ae978c3558b530a9)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:32.835572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc446fc4-e2fd-4f3c-b0e5-6eb0da3579ab None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:32.954401 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 580/1153] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:44:32 2022] PUT /identity/v3/projects/aabba682011a4559b7e21ffddd3a326d/users/e39db86ac3d645bb917e1a1701daa63c/roles/4f7e6c1b02094f72ae978c3558b530a9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:35.154621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511757cf-dd37-4952-addd-8f800b03d041 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.155183 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511757cf-dd37-4952-addd-8f800b03d041 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.155183 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511757cf-dd37-4952-addd-8f800b03d041 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.156524 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 574/1154] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:35.161937 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b5a58-5484-439b-85af-1c6d15d80352 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.162358 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b5a58-5484-439b-85af-1c6d15d80352 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.162488 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b5a58-5484-439b-85af-1c6d15d80352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.180672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-6d5b5a58-5484-439b-85af-1c6d15d80352 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:35.181863 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-6d5b5a58-5484-439b-85af-1c6d15d80352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:35.248019 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 581/1155] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:35.271045 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511757cf-dd37-4952-addd-8f800b03d041 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:35.375186 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511757cf-dd37-4952-addd-8f800b03d041 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:35.408736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a601b66-2d25-49a9-9693-2d444ea41e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:35.409444 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601b66-2d25-49a9-9693-2d444ea41e37 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.409725 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601b66-2d25-49a9-9693-2d444ea41e37 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.409997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601b66-2d25-49a9-9693-2d444ea41e37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.421241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a601b66-2d25-49a9-9693-2d444ea41e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-2a601b66-2d25-49a9-9693-2d444ea41e37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:35.431851 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:35.433003 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:44:35.434014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 575/1156] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:44:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:35.439601 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b5a58-5484-439b-85af-1c6d15d80352 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:35.441826 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:35.542631 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b5a58-5484-439b-85af-1c6d15d80352 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:35.576239 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580acbf-9caf-4dcb-a404-3cece50fb1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:35.576887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580acbf-9caf-4dcb-a404-3cece50fb1cf None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.577172 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580acbf-9caf-4dcb-a404-3cece50fb1cf None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.577444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580acbf-9caf-4dcb-a404-3cece50fb1cf None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.578189 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580acbf-9caf-4dcb-a404-3cece50fb1cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:35.578495 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580acbf-9caf-4dcb-a404-3cece50fb1cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:35.579992 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580acbf-9caf-4dcb-a404-3cece50fb1cf None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:35.588606 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 582/1157] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:35.594476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a601b66-2d25-49a9-9693-2d444ea41e37 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:35.619300 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:35.692795 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a601b66-2d25-49a9-9693-2d444ea41e37 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:35.726561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bea30-51de-46cd-80c2-265f9ddd89e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:35.727437 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bea30-51de-46cd-80c2-265f9ddd89e8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.727715 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bea30-51de-46cd-80c2-265f9ddd89e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.727985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bea30-51de-46cd-80c2-265f9ddd89e8 None admin] PATH_INFO: `/v3/users/e39db86ac3d645bb917e1a1701daa63c` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.729192 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bea30-51de-46cd-80c2-265f9ddd89e8 None admin] RBAC: Authorizing `identity:get_user(user_id=e39db86ac3d645bb917e1a1701daa63c)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:35.730705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bea30-51de-46cd-80c2-265f9ddd89e8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:35.732615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 576/1158] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:35 2022] GET /identity/v3/users/e39db86ac3d645bb917e1a1701daa63c => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:35.738622 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580acbf-9caf-4dcb-a404-3cece50fb1cf None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:35.799444 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:35.837522 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580acbf-9caf-4dcb-a404-3cece50fb1cf None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:35.870524 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771812a-18d4-4d5f-ad84-a6c57ea52445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:35.871187 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771812a-18d4-4d5f-ad84-a6c57ea52445 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.871474 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771812a-18d4-4d5f-ad84-a6c57ea52445 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.871755 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771812a-18d4-4d5f-ad84-a6c57ea52445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.938419 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771812a-18d4-4d5f-ad84-a6c57ea52445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:35.939859 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771812a-18d4-4d5f-ad84-a6c57ea52445 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:35.998797 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:36.036421 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 583/1159] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:44:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:36.042510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bea30-51de-46cd-80c2-265f9ddd89e8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:36.130447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:36.140016 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bea30-51de-46cd-80c2-265f9ddd89e8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:36.174047 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c022b3d-821b-4154-8d7a-3db95dbd72a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:36.174921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022b3d-821b-4154-8d7a-3db95dbd72a6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:36.175197 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022b3d-821b-4154-8d7a-3db95dbd72a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:36.175466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022b3d-821b-4154-8d7a-3db95dbd72a6 None admin] PATH_INFO: `/v3/projects/aabba682011a4559b7e21ffddd3a326d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:36.176638 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c022b3d-821b-4154-8d7a-3db95dbd72a6 None admin] RBAC: Authorizing `identity:get_project(project_id=aabba682011a4559b7e21ffddd3a326d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:36.178128 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c022b3d-821b-4154-8d7a-3db95dbd72a6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:36.180076 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 577/1160] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:36 2022] GET /identity/v3/projects/aabba682011a4559b7e21ffddd3a326d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:36.186329 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771812a-18d4-4d5f-ad84-a6c57ea52445 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:36.283267 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771812a-18d4-4d5f-ad84-a6c57ea52445 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:36.317268 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a5bb3-7b8b-44b1-b8f6-ca2b87ca9634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:36.317902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a5bb3-7b8b-44b1-b8f6-ca2b87ca9634 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:36.318181 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a5bb3-7b8b-44b1-b8f6-ca2b87ca9634 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:36.318456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a5bb3-7b8b-44b1-b8f6-ca2b87ca9634 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:36.319940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a5bb3-7b8b-44b1-b8f6-ca2b87ca9634 None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=aabba682011a4559b7e21ffddd3a326d, user.id=e39db86ac3d645bb917e1a1701daa63c) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:36.320258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a5bb3-7b8b-44b1-b8f6-ca2b87ca9634 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:36.321676 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a5bb3-7b8b-44b1-b8f6-ca2b87ca9634 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:36.327840 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 584/1161] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:44:36 2022] GET /identity/v3/role_assignments?user.id=e39db86ac3d645bb917e1a1701daa63c&scope.project.id=aabba682011a4559b7e21ffddd3a326d&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:38.552370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651040cd-b9bb-4410-ab44-f23ace0f4fd9 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.552883 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651040cd-b9bb-4410-ab44-f23ace0f4fd9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.552883 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651040cd-b9bb-4410-ab44-f23ace0f4fd9 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.555164 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 578/1162] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:38.560426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc9890-d115-40ef-995e-1e960f15801e None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.560906 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc9890-d115-40ef-995e-1e960f15801e None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.561015 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc9890-d115-40ef-995e-1e960f15801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.578371 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-5cbc9890-d115-40ef-995e-1e960f15801e None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:38.579601 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-5cbc9890-d115-40ef-995e-1e960f15801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:38.601387 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:38.644281 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 585/1163] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:38.666490 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651040cd-b9bb-4410-ab44-f23ace0f4fd9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:38.775366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651040cd-b9bb-4410-ab44-f23ace0f4fd9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:38.810986 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f8445-fe45-427c-bbb1-d8fd0254d659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:38.811544 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8445-fe45-427c-bbb1-d8fd0254d659 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.811821 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8445-fe45-427c-bbb1-d8fd0254d659 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.812091 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8445-fe45-427c-bbb1-d8fd0254d659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.841511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:38.881432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f8445-fe45-427c-bbb1-d8fd0254d659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:38.883476 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f8445-fe45-427c-bbb1-d8fd0254d659 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:38.978962 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 579/1164] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:44:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:38.985043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc9890-d115-40ef-995e-1e960f15801e None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:39.082152 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc9890-d115-40ef-995e-1e960f15801e None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:39.115731 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ed925-5ad6-4d6c-be12-0a0b2de52aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:39.116559 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed925-5ad6-4d6c-be12-0a0b2de52aa6 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.116844 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed925-5ad6-4d6c-be12-0a0b2de52aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.117120 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed925-5ad6-4d6c-be12-0a0b2de52aa6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.124280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ed925-5ad6-4d6c-be12-0a0b2de52aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:39.125726 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ed925-5ad6-4d6c-be12-0a0b2de52aa6 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-f19ed925-5ad6-4d6c-be12-0a0b2de52aa6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:39.140166 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:39.141427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:44:39.142504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 586/1165] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 19:44:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:39.148174 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f8445-fe45-427c-bbb1-d8fd0254d659 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:39.206934 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:39.248310 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f8445-fe45-427c-bbb1-d8fd0254d659 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:39.282058 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3baae-48b2-4242-83c2-05b776c44be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:39.282733 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3baae-48b2-4242-83c2-05b776c44be9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.283015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3baae-48b2-4242-83c2-05b776c44be9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.283288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3baae-48b2-4242-83c2-05b776c44be9 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.284004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3baae-48b2-4242-83c2-05b776c44be9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:39.284302 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3baae-48b2-4242-83c2-05b776c44be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:39.285683 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3baae-48b2-4242-83c2-05b776c44be9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:39.293082 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 580/1166] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 19:44:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:41.530792 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e28ba-a4df-4bca-8968-0569a0f407da None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.531352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e28ba-a4df-4bca-8968-0569a0f407da None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.531352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e28ba-a4df-4bca-8968-0569a0f407da None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.532749 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 587/1167] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:41.538906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3668fd8-a99d-43c0-b6ea-b0075f6afe0f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.539334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3668fd8-a99d-43c0-b6ea-b0075f6afe0f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.539440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3668fd8-a99d-43c0-b6ea-b0075f6afe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.556821 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c3668fd8-a99d-43c0-b6ea-b0075f6afe0f None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:41.557994 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c3668fd8-a99d-43c0-b6ea-b0075f6afe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:41.622714 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 581/1168] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:41.645462 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e28ba-a4df-4bca-8968-0569a0f407da None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:41.665681 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:41.745513 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e28ba-a4df-4bca-8968-0569a0f407da None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:41.779189 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfae23d-8795-44bc-92ce-784cacfa6271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:41.779830 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae23d-8795-44bc-92ce-784cacfa6271 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.780110 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae23d-8795-44bc-92ce-784cacfa6271 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.780386 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae23d-8795-44bc-92ce-784cacfa6271 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.781130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfae23d-8795-44bc-92ce-784cacfa6271 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:41.782533 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfae23d-8795-44bc-92ce-784cacfa6271 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:41.874966 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 588/1169] 10.222.0.89 () {60 vars in 1138 bytes} [Thu May 19 19:44:41 2022] POST /identity/v3/domains => generated 267 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:44.113263 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4922cf-45cc-4acc-9356-7a716f0a6da6 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.113824 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4922cf-45cc-4acc-9356-7a716f0a6da6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.113824 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4922cf-45cc-4acc-9356-7a716f0a6da6 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.115315 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 582/1170] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:44.120837 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f1655-d152-4566-8a51-d9cc77bd2ee0 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.121278 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f1655-d152-4566-8a51-d9cc77bd2ee0 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.121378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f1655-d152-4566-8a51-d9cc77bd2ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.137846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-8a2f1655-d152-4566-8a51-d9cc77bd2ee0 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:44.139072 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-8a2f1655-d152-4566-8a51-d9cc77bd2ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:44.205181 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 589/1171] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:44.229071 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4922cf-45cc-4acc-9356-7a716f0a6da6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:44.284363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:44.332731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4922cf-45cc-4acc-9356-7a716f0a6da6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:44.367480 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bae80b-7769-4f23-b177-421985941613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:44.368252 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae80b-7769-4f23-b177-421985941613 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.368536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae80b-7769-4f23-b177-421985941613 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.368810 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae80b-7769-4f23-b177-421985941613 None admin] PATH_INFO: `/v3/domains/9f39f54dad7748358f758da9282d6a02` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.379168 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bae80b-7769-4f23-b177-421985941613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9f39f54dad7748358f758da9282d6a02)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:44.380631 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bae80b-7769-4f23-b177-421985941613 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:44.382832 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 583/1172] 10.222.0.89 () {56 vars in 1183 bytes} [Thu May 19 19:44:44 2022] GET /identity/v3/domains/9f39f54dad7748358f758da9282d6a02 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:44.388675 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f1655-d152-4566-8a51-d9cc77bd2ee0 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:44.399295 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:44.485294 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f1655-d152-4566-8a51-d9cc77bd2ee0 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:44.519308 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92746718-5f7a-40d4-b223-f6931b43f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:44.519960 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92746718-5f7a-40d4-b223-f6931b43f250 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.520244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92746718-5f7a-40d4-b223-f6931b43f250 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.520522 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92746718-5f7a-40d4-b223-f6931b43f250 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.521243 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92746718-5f7a-40d4-b223-f6931b43f250 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:44.523271 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92746718-5f7a-40d4-b223-f6931b43f250 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:44.640946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 590/1173] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:44:44 2022] POST /identity/v3/projects => generated 361 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:46.913588 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdb787-d592-4f1e-b796-3f04f4875e2d None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.914117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdb787-d592-4f1e-b796-3f04f4875e2d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.914117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdb787-d592-4f1e-b796-3f04f4875e2d None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.915497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 584/1174] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:46.920895 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e9905-6287-4b23-878c-6f8a670b1f8c None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.921329 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e9905-6287-4b23-878c-6f8a670b1f8c None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.921445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e9905-6287-4b23-878c-6f8a670b1f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.938929 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-5c1e9905-6287-4b23-878c-6f8a670b1f8c None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:46.940119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-5c1e9905-6287-4b23-878c-6f8a670b1f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:46.995766 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:47.007370 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 591/1175] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:47.032098 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdb787-d592-4f1e-b796-3f04f4875e2d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:47.135872 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdb787-d592-4f1e-b796-3f04f4875e2d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:47.148663 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:47.169170 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f19e4-cae0-43dc-9bc2-c6c8abc27e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:47.169996 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f19e4-cae0-43dc-9bc2-c6c8abc27e89 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:47.170267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f19e4-cae0-43dc-9bc2-c6c8abc27e89 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:47.170536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f19e4-cae0-43dc-9bc2-c6c8abc27e89 None admin] PATH_INFO: `/v3/domains/9f39f54dad7748358f758da9282d6a02` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:47.171816 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f19e4-cae0-43dc-9bc2-c6c8abc27e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9f39f54dad7748358f758da9282d6a02)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:47.173252 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f19e4-cae0-43dc-9bc2-c6c8abc27e89 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:47.174872 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 585/1176] 10.222.0.89 () {56 vars in 1183 bytes} [Thu May 19 19:44:47 2022] GET /identity/v3/domains/9f39f54dad7748358f758da9282d6a02 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:47.181504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e9905-6287-4b23-878c-6f8a670b1f8c None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:47.277401 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e9905-6287-4b23-878c-6f8a670b1f8c None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:47.312753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a3afc-bb2b-418c-aef6-f7428103e211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:47.313413 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a3afc-bb2b-418c-aef6-f7428103e211 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:47.313699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a3afc-bb2b-418c-aef6-f7428103e211 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:47.313977 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a3afc-bb2b-418c-aef6-f7428103e211 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:47.314722 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a3afc-bb2b-418c-aef6-f7428103e211 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:47.316153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a3afc-bb2b-418c-aef6-f7428103e211 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:47.405305 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 592/1177] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:44:47 2022] POST /identity/v3/users => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:49.667761 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c0256-45ac-4795-a59a-3e34cb304859 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:49.668334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c0256-45ac-4795-a59a-3e34cb304859 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:49.668334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c0256-45ac-4795-a59a-3e34cb304859 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:49.669718 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 586/1178] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:49.675107 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847bec9-5e53-43c0-8ad8-69e8cd9e0a7d None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:49.677912 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847bec9-5e53-43c0-8ad8-69e8cd9e0a7d None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:49.677912 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847bec9-5e53-43c0-8ad8-69e8cd9e0a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:49.692573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-b847bec9-5e53-43c0-8ad8-69e8cd9e0a7d None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:49.694352 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-b847bec9-5e53-43c0-8ad8-69e8cd9e0a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:49.735717 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:49.759659 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 593/1179] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:49.783157 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c0256-45ac-4795-a59a-3e34cb304859 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:49.882280 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c0256-45ac-4795-a59a-3e34cb304859 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:49.925529 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae68771-eaed-4764-b629-a78a3efd21b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:49.926246 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae68771-eaed-4764-b629-a78a3efd21b7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:49.926528 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae68771-eaed-4764-b629-a78a3efd21b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:49.926836 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae68771-eaed-4764-b629-a78a3efd21b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:49.942611 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae68771-eaed-4764-b629-a78a3efd21b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0ae68771-eaed-4764-b629-a78a3efd21b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:49.951147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:49.952352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:44:49.953278 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 587/1180] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:44:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:49.958504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847bec9-5e53-43c0-8ad8-69e8cd9e0a7d None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.053812 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847bec9-5e53-43c0-8ad8-69e8cd9e0a7d None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.087262 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b22ac-6ed8-40b7-8097-205618e6aa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.087907 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b22ac-6ed8-40b7-8097-205618e6aa68 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.088263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b22ac-6ed8-40b7-8097-205618e6aa68 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.088454 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b22ac-6ed8-40b7-8097-205618e6aa68 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.089203 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b22ac-6ed8-40b7-8097-205618e6aa68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:50.089551 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b22ac-6ed8-40b7-8097-205618e6aa68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.090926 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b22ac-6ed8-40b7-8097-205618e6aa68 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.098711 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 594/1181] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:44:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:50.104440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae68771-eaed-4764-b629-a78a3efd21b7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.146235 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:50.203312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae68771-eaed-4764-b629-a78a3efd21b7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.235737 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc0700-d21a-44e7-b928-5045143847ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.236597 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0700-d21a-44e7-b928-5045143847ae None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.236880 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0700-d21a-44e7-b928-5045143847ae None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.237155 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0700-d21a-44e7-b928-5045143847ae None admin] PATH_INFO: `/v3/users/225ec83d5f5c4fabbfeb6b138206c73f` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.250402 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc0700-d21a-44e7-b928-5045143847ae None admin] RBAC: Authorizing `identity:get_user(user_id=225ec83d5f5c4fabbfeb6b138206c73f)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.251871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc0700-d21a-44e7-b928-5045143847ae None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.253495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 588/1182] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/users/225ec83d5f5c4fabbfeb6b138206c73f => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:50.259230 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b22ac-6ed8-40b7-8097-205618e6aa68 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.298530 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:50.363379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b22ac-6ed8-40b7-8097-205618e6aa68 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.396319 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3839-9b59-4cd4-bafa-e2134a8648a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.396974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3839-9b59-4cd4-bafa-e2134a8648a9 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.397256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3839-9b59-4cd4-bafa-e2134a8648a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.397534 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3839-9b59-4cd4-bafa-e2134a8648a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.463248 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e3839-9b59-4cd4-bafa-e2134a8648a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.464608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e3839-9b59-4cd4-bafa-e2134a8648a9 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.501901 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:50.561703 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 595/1183] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:50.567555 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc0700-d21a-44e7-b928-5045143847ae None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.660966 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:50.664748 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc0700-d21a-44e7-b928-5045143847ae None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.698575 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce9df9-84ea-4193-b257-5c5b8003846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.699438 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce9df9-84ea-4193-b257-5c5b8003846b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.699716 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce9df9-84ea-4193-b257-5c5b8003846b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.699985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce9df9-84ea-4193-b257-5c5b8003846b None admin] PATH_INFO: `/v3/projects/155baedc6bc844d49983440a2953d81a` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.701144 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce9df9-84ea-4193-b257-5c5b8003846b None admin] RBAC: Authorizing `identity:get_project(project_id=155baedc6bc844d49983440a2953d81a)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.702664 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce9df9-84ea-4193-b257-5c5b8003846b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.704386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 589/1184] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/projects/155baedc6bc844d49983440a2953d81a => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:50.710457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3839-9b59-4cd4-bafa-e2134a8648a9 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.806673 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3839-9b59-4cd4-bafa-e2134a8648a9 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.839034 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62473d8e-6898-4cd7-893f-0908df452233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.839672 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62473d8e-6898-4cd7-893f-0908df452233 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.839956 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62473d8e-6898-4cd7-893f-0908df452233 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.840233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62473d8e-6898-4cd7-893f-0908df452233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.841067 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62473d8e-6898-4cd7-893f-0908df452233 None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=155baedc6bc844d49983440a2953d81a, user.id=225ec83d5f5c4fabbfeb6b138206c73f) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:50.841378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62473d8e-6898-4cd7-893f-0908df452233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.842826 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62473d8e-6898-4cd7-893f-0908df452233 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.848358 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 596/1185] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/role_assignments?user.id=225ec83d5f5c4fabbfeb6b138206c73f&scope.project.id=155baedc6bc844d49983440a2953d81a&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:53.018414 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41921f10-64f5-4c3a-9f15-f30bffcc9b46 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.018972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41921f10-64f5-4c3a-9f15-f30bffcc9b46 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.018972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41921f10-64f5-4c3a-9f15-f30bffcc9b46 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.020445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 590/1186] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:53.025658 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412509-66f3-4640-8e91-b37ba1ef780b None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.026056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412509-66f3-4640-8e91-b37ba1ef780b None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.026214 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412509-66f3-4640-8e91-b37ba1ef780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.031283 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:53.043148 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-2b412509-66f3-4640-8e91-b37ba1ef780b None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:53.044320 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-2b412509-66f3-4640-8e91-b37ba1ef780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:53.109855 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 597/1187] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:53.132662 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41921f10-64f5-4c3a-9f15-f30bffcc9b46 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:53.233126 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41921f10-64f5-4c3a-9f15-f30bffcc9b46 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:53.266730 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e62dd-062c-45b0-a63b-58e4307ddd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:53.268312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e62dd-062c-45b0-a63b-58e4307ddd42 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.268656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e62dd-062c-45b0-a63b-58e4307ddd42 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.268885 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e62dd-062c-45b0-a63b-58e4307ddd42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.279317 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e62dd-062c-45b0-a63b-58e4307ddd42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-f00e62dd-062c-45b0-a63b-58e4307ddd42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:53.287537 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:53.288667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:44:53.294363 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 591/1188] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:44:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:53.295378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b412509-66f3-4640-8e91-b37ba1ef780b None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:53.397523 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b412509-66f3-4640-8e91-b37ba1ef780b None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:53.426576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:53.432436 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a53d9-96c5-423b-a6ab-db86b8a8745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:53.436973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a53d9-96c5-423b-a6ab-db86b8a8745f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.436973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a53d9-96c5-423b-a6ab-db86b8a8745f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.436973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a53d9-96c5-423b-a6ab-db86b8a8745f None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.436973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a53d9-96c5-423b-a6ab-db86b8a8745f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:53.436973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a53d9-96c5-423b-a6ab-db86b8a8745f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:53.436973 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a53d9-96c5-423b-a6ab-db86b8a8745f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:53.444086 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 598/1189] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:44:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:53.450353 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e62dd-062c-45b0-a63b-58e4307ddd42 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:53.478244 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:53.549004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e62dd-062c-45b0-a63b-58e4307ddd42 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:53.582985 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672b2b9-fd07-4786-a222-da933aebf7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:53.583831 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672b2b9-fd07-4786-a222-da933aebf7dc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.584106 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672b2b9-fd07-4786-a222-da933aebf7dc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.584405 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672b2b9-fd07-4786-a222-da933aebf7dc None admin] PATH_INFO: `/v3/users/225ec83d5f5c4fabbfeb6b138206c73f` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.585598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672b2b9-fd07-4786-a222-da933aebf7dc None admin] RBAC: Authorizing `identity:get_user(user_id=225ec83d5f5c4fabbfeb6b138206c73f)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:53.587062 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672b2b9-fd07-4786-a222-da933aebf7dc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:53.588658 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 592/1190] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:53 2022] GET /identity/v3/users/225ec83d5f5c4fabbfeb6b138206c73f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:53.594427 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a53d9-96c5-423b-a6ab-db86b8a8745f None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:53.690348 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a53d9-96c5-423b-a6ab-db86b8a8745f None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:53.722406 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ffdbb-65dc-40ef-a9d5-ccc58de91e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:53.723287 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ffdbb-65dc-40ef-a9d5-ccc58de91e53 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.723573 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ffdbb-65dc-40ef-a9d5-ccc58de91e53 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.723837 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ffdbb-65dc-40ef-a9d5-ccc58de91e53 None admin] PATH_INFO: `/v3/projects/155baedc6bc844d49983440a2953d81a` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.725025 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ffdbb-65dc-40ef-a9d5-ccc58de91e53 None admin] RBAC: Authorizing `identity:get_project(project_id=155baedc6bc844d49983440a2953d81a)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:53.726422 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ffdbb-65dc-40ef-a9d5-ccc58de91e53 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:53.728107 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 599/1191] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:53 2022] GET /identity/v3/projects/155baedc6bc844d49983440a2953d81a => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:53.734138 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672b2b9-fd07-4786-a222-da933aebf7dc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:53.826177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:53.832843 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672b2b9-fd07-4786-a222-da933aebf7dc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:53.866558 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c6dee-d7ca-4f5d-8718-17a7befb7e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:53.867452 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6dee-d7ca-4f5d-8718-17a7befb7e62 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.867730 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6dee-d7ca-4f5d-8718-17a7befb7e62 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.867999 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6dee-d7ca-4f5d-8718-17a7befb7e62 None admin] PATH_INFO: `/v3/projects/155baedc6bc844d49983440a2953d81a/users/225ec83d5f5c4fabbfeb6b138206c73f/roles/4f7e6c1b02094f72ae978c3558b530a9` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.869952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c6dee-d7ca-4f5d-8718-17a7befb7e62 None admin] RBAC: Authorizing `identity:create_grant(project_id=155baedc6bc844d49983440a2953d81a, user_id=225ec83d5f5c4fabbfeb6b138206c73f, role_id=4f7e6c1b02094f72ae978c3558b530a9)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:53.871408 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c6dee-d7ca-4f5d-8718-17a7befb7e62 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:53.935354 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 593/1192] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:44:53 2022] PUT /identity/v3/projects/155baedc6bc844d49983440a2953d81a/users/225ec83d5f5c4fabbfeb6b138206c73f/roles/4f7e6c1b02094f72ae978c3558b530a9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:56.131825 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08d80-ebbc-4255-add5-44cd74284f4e None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.132362 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08d80-ebbc-4255-add5-44cd74284f4e None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.132362 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08d80-ebbc-4255-add5-44cd74284f4e None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.133721 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 600/1193] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:56.139068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36b69-58b5-441b-b38d-eb652d55d92a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.139445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36b69-58b5-441b-b38d-eb652d55d92a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.139623 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36b69-58b5-441b-b38d-eb652d55d92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.156330 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c4f36b69-58b5-441b-b38d-eb652d55d92a None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:56.157521 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c4f36b69-58b5-441b-b38d-eb652d55d92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:56.222728 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 594/1194] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:44:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:56.247184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08d80-ebbc-4255-add5-44cd74284f4e None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:56.309903 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:56.350836 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08d80-ebbc-4255-add5-44cd74284f4e None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:56.384120 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05ccaf-c46b-40be-a14e-ad7165ae5e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:56.384874 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05ccaf-c46b-40be-a14e-ad7165ae5e60 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.385159 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05ccaf-c46b-40be-a14e-ad7165ae5e60 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.385440 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05ccaf-c46b-40be-a14e-ad7165ae5e60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.395887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05ccaf-c46b-40be-a14e-ad7165ae5e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-8a05ccaf-c46b-40be-a14e-ad7165ae5e60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:56.403483 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:56.404633 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:44:56.405638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 601/1195] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:56.410697 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f36b69-58b5-441b-b38d-eb652d55d92a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:56.491505 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:56.506669 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f36b69-58b5-441b-b38d-eb652d55d92a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:56.540889 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc167491-bf1f-49aa-a447-9c5cf14b8d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:56.541541 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167491-bf1f-49aa-a447-9c5cf14b8d00 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.541822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167491-bf1f-49aa-a447-9c5cf14b8d00 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.542094 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167491-bf1f-49aa-a447-9c5cf14b8d00 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.542866 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc167491-bf1f-49aa-a447-9c5cf14b8d00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:56.543171 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc167491-bf1f-49aa-a447-9c5cf14b8d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:56.544547 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc167491-bf1f-49aa-a447-9c5cf14b8d00 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:56.552689 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 595/1196] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:56.571423 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05ccaf-c46b-40be-a14e-ad7165ae5e60 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:56.673610 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05ccaf-c46b-40be-a14e-ad7165ae5e60 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:56.695118 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:56.706145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d774cb-08a0-4713-aa67-c01aff3bb940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:56.707034 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d774cb-08a0-4713-aa67-c01aff3bb940 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.707314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d774cb-08a0-4713-aa67-c01aff3bb940 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.707584 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d774cb-08a0-4713-aa67-c01aff3bb940 None admin] PATH_INFO: `/v3/users/225ec83d5f5c4fabbfeb6b138206c73f` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.709290 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d774cb-08a0-4713-aa67-c01aff3bb940 None admin] RBAC: Authorizing `identity:get_user(user_id=225ec83d5f5c4fabbfeb6b138206c73f)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:56.710772 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d774cb-08a0-4713-aa67-c01aff3bb940 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:56.712410 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 602/1197] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 19:44:56 2022] GET /identity/v3/users/225ec83d5f5c4fabbfeb6b138206c73f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:56.718187 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc167491-bf1f-49aa-a447-9c5cf14b8d00 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:56.817553 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc167491-bf1f-49aa-a447-9c5cf14b8d00 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:56.850281 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735143ef-c8b2-438c-a3b7-c825ab1cfa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:56.850947 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735143ef-c8b2-438c-a3b7-c825ab1cfa14 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.851226 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735143ef-c8b2-438c-a3b7-c825ab1cfa14 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.851503 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735143ef-c8b2-438c-a3b7-c825ab1cfa14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.866833 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:56.917213 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735143ef-c8b2-438c-a3b7-c825ab1cfa14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:56.918729 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735143ef-c8b2-438c-a3b7-c825ab1cfa14 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.022489 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 596/1198] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:44:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:57.028406 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d774cb-08a0-4713-aa67-c01aff3bb940 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.126064 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d774cb-08a0-4713-aa67-c01aff3bb940 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.157923 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f91c88-376f-46e0-af75-035d3067dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.158853 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91c88-376f-46e0-af75-035d3067dfc3 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.159136 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91c88-376f-46e0-af75-035d3067dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.159412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91c88-376f-46e0-af75-035d3067dfc3 None admin] PATH_INFO: `/v3/projects/155baedc6bc844d49983440a2953d81a` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.160576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f91c88-376f-46e0-af75-035d3067dfc3 None admin] RBAC: Authorizing `identity:get_project(project_id=155baedc6bc844d49983440a2953d81a)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.162515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f91c88-376f-46e0-af75-035d3067dfc3 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.164243 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 603/1199] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 19:44:57 2022] GET /identity/v3/projects/155baedc6bc844d49983440a2953d81a => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:57.170390 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735143ef-c8b2-438c-a3b7-c825ab1cfa14 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.215594 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:57.267758 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735143ef-c8b2-438c-a3b7-c825ab1cfa14 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.301293 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a3442-7d1f-4d0e-bb53-c23600dcb559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.301946 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a3442-7d1f-4d0e-bb53-c23600dcb559 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.302222 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a3442-7d1f-4d0e-bb53-c23600dcb559 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.302526 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a3442-7d1f-4d0e-bb53-c23600dcb559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.303384 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a3442-7d1f-4d0e-bb53-c23600dcb559 None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=155baedc6bc844d49983440a2953d81a, user.id=225ec83d5f5c4fabbfeb6b138206c73f) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:57.303698 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a3442-7d1f-4d0e-bb53-c23600dcb559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.305418 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a3442-7d1f-4d0e-bb53-c23600dcb559 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.311306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 597/1200] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:44:57 2022] GET /identity/v3/role_assignments?user.id=225ec83d5f5c4fabbfeb6b138206c73f&scope.project.id=155baedc6bc844d49983440a2953d81a&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:07.153817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=71 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:07.308644 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=45 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:15.468591 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912178f-d5d7-4400-84f6-028833c7478f None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:15.469188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912178f-d5d7-4400-84f6-028833c7478f None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:15.469288 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912178f-d5d7-4400-84f6-028833c7478f None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:15.470831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 604/1201] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:15.480101 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5d49c-e2ae-429e-aac2-e721c2afd7ec None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:15.490143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5d49c-e2ae-429e-aac2-e721c2afd7ec None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:15.490143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5d49c-e2ae-429e-aac2-e721c2afd7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:15.511734 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-89b5d49c-e2ae-429e-aac2-e721c2afd7ec None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:15.514080 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-89b5d49c-e2ae-429e-aac2-e721c2afd7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:15.635587 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 598/1202] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:46:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:46:15.660903 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912178f-d5d7-4400-84f6-028833c7478f None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:15.774763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912178f-d5d7-4400-84f6-028833c7478f None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:15.813496 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a1cba-3d6b-4098-aef4-d6b1c5e5e3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:15.814332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a1cba-3d6b-4098-aef4-d6b1c5e5e3d3 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:15.814581 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a1cba-3d6b-4098-aef4-d6b1c5e5e3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:15.814886 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a1cba-3d6b-4098-aef4-d6b1c5e5e3d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:15.825961 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a1cba-3d6b-4098-aef4-d6b1c5e5e3d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:15.827475 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a1cba-3d6b-4098-aef4-d6b1c5e5e3d3 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-6c4a1cba-3d6b-4098-aef4-d6b1c5e5e3d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:15.846800 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:15.848986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:15.851078 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:15.851078 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:15.851078 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:15.851078 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:15.851078 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 605/1203] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:15.856047 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5d49c-e2ae-429e-aac2-e721c2afd7ec None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:15.965891 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5d49c-e2ae-429e-aac2-e721c2afd7ec None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:15.998599 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:16.005279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19070c-8177-444b-8428-7b2d09886723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:16.005954 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19070c-8177-444b-8428-7b2d09886723 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:16.006233 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19070c-8177-444b-8428-7b2d09886723 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:16.006507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19070c-8177-444b-8428-7b2d09886723 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:16.007283 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19070c-8177-444b-8428-7b2d09886723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:16.007590 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19070c-8177-444b-8428-7b2d09886723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:16.008989 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19070c-8177-444b-8428-7b2d09886723 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:16.021856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 599/1204] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:16.028087 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a1cba-3d6b-4098-aef4-d6b1c5e5e3d3 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:16.104620 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:16.160505 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a1cba-3d6b-4098-aef4-d6b1c5e5e3d3 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:16.205210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46dd2d-ce87-4a36-b0a7-516cb575bd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:16.205879 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46dd2d-ce87-4a36-b0a7-516cb575bd76 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:16.206164 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46dd2d-ce87-4a36-b0a7-516cb575bd76 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:16.206437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46dd2d-ce87-4a36-b0a7-516cb575bd76 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:16.207771 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46dd2d-ce87-4a36-b0a7-516cb575bd76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:16.209276 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46dd2d-ce87-4a36-b0a7-516cb575bd76 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:16.292005 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 606/1205] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 19:46:16 2022] POST /identity/v3/users => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:46:18.663214 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519dd2-ccac-4ef6-bdbf-32662261153a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:18.664279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519dd2-ccac-4ef6-bdbf-32662261153a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:18.664279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519dd2-ccac-4ef6-bdbf-32662261153a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:18.666210 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 600/1206] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:46:18.674441 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0257e-6b2b-459f-8826-a346d1577228 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:18.675987 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0257e-6b2b-459f-8826-a346d1577228 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:18.675987 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0257e-6b2b-459f-8826-a346d1577228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:18.698043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-0fa0257e-6b2b-459f-8826-a346d1577228 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:18.701339 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-0fa0257e-6b2b-459f-8826-a346d1577228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:18.803859 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 607/1207] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:46:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:46:18.835531 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519dd2-ccac-4ef6-bdbf-32662261153a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:18.950667 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519dd2-ccac-4ef6-bdbf-32662261153a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:18.991988 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef01d0b-92d8-4b5b-8b19-8b197c2d10d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:18.992884 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef01d0b-92d8-4b5b-8b19-8b197c2d10d6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:18.993163 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef01d0b-92d8-4b5b-8b19-8b197c2d10d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:18.993331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef01d0b-92d8-4b5b-8b19-8b197c2d10d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:19.004909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef01d0b-92d8-4b5b-8b19-8b197c2d10d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7ef01d0b-92d8-4b5b-8b19-8b197c2d10d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:46:19.012782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:19.014022 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:46:19.015100 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:19.018865 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 601/1208] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:46:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:19.021145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0257e-6b2b-459f-8826-a346d1577228 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:19.079925 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:19.167315 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0257e-6b2b-459f-8826-a346d1577228 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:19.212871 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b334c-fc93-42bd-b1cc-6ee6c65321ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:19.213879 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b334c-fc93-42bd-b1cc-6ee6c65321ce None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:19.214373 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b334c-fc93-42bd-b1cc-6ee6c65321ce None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:19.214964 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b334c-fc93-42bd-b1cc-6ee6c65321ce None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:19.216317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b334c-fc93-42bd-b1cc-6ee6c65321ce None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:19.216860 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b334c-fc93-42bd-b1cc-6ee6c65321ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:19.219504 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b334c-fc93-42bd-b1cc-6ee6c65321ce None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:19.235541 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 608/1209] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:19.241360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef01d0b-92d8-4b5b-8b19-8b197c2d10d6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:19.300319 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:19.391067 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef01d0b-92d8-4b5b-8b19-8b197c2d10d6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:19.452279 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3782de1-76c6-49df-94ed-07b805771f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:19.453638 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782de1-76c6-49df-94ed-07b805771f71 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:19.454142 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782de1-76c6-49df-94ed-07b805771f71 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:19.454652 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782de1-76c6-49df-94ed-07b805771f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:19.474883 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3782de1-76c6-49df-94ed-07b805771f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:19.477615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3782de1-76c6-49df-94ed-07b805771f71 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-f3782de1-76c6-49df-94ed-07b805771f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:19.511420 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:19.512517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:19.513440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:19.513440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:19.513440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:19.513440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:19.513775 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 602/1210] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:19.520485 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b334c-fc93-42bd-b1cc-6ee6c65321ce None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:19.629914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:19.634841 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b334c-fc93-42bd-b1cc-6ee6c65321ce None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:19.678460 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f8b9a-c1eb-4ed0-bb41-805870e7bc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:19.679569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f8b9a-c1eb-4ed0-bb41-805870e7bc85 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:19.679569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f8b9a-c1eb-4ed0-bb41-805870e7bc85 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:19.679881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f8b9a-c1eb-4ed0-bb41-805870e7bc85 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:19.680701 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f8b9a-c1eb-4ed0-bb41-805870e7bc85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:19.681057 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f8b9a-c1eb-4ed0-bb41-805870e7bc85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:19.682450 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f8b9a-c1eb-4ed0-bb41-805870e7bc85 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:19.695851 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 609/1211] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:19.701888 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3782de1-76c6-49df-94ed-07b805771f71 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:19.814789 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3782de1-76c6-49df-94ed-07b805771f71 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:19.817042 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:19.851953 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621857ff-af79-4fd4-b85c-ea088ffdae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:19.852916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621857ff-af79-4fd4-b85c-ea088ffdae90 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:19.853288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621857ff-af79-4fd4-b85c-ea088ffdae90 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:19.853680 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621857ff-af79-4fd4-b85c-ea088ffdae90 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:19.862238 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621857ff-af79-4fd4-b85c-ea088ffdae90 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:19.864285 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621857ff-af79-4fd4-b85c-ea088ffdae90 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-621857ff-af79-4fd4-b85c-ea088ffdae90 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:46:19.881065 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:19.883010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:19.884919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:19.884919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:19.884919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:46:19.884919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:46:19.884919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:46:19.884919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:46:19.884919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:46:19.884919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:46:19.884919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:19.884919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:19.884919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 603/1212] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:19.890515 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f8b9a-c1eb-4ed0-bb41-805870e7bc85 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:20.009508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f8b9a-c1eb-4ed0-bb41-805870e7bc85 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:20.046459 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc01cf-db26-49b8-9031-8712c13ca9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:20.047263 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc01cf-db26-49b8-9031-8712c13ca9f9 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:20.047549 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc01cf-db26-49b8-9031-8712c13ca9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:20.047826 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc01cf-db26-49b8-9031-8712c13ca9f9 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:20.048676 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc01cf-db26-49b8-9031-8712c13ca9f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:20.048987 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc01cf-db26-49b8-9031-8712c13ca9f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:20.051041 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc01cf-db26-49b8-9031-8712c13ca9f9 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:20.085599 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 610/1213] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 19:46:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:20.091409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621857ff-af79-4fd4-b85c-ea088ffdae90 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:20.209994 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621857ff-af79-4fd4-b85c-ea088ffdae90 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:20.248171 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a08875-858f-48cc-80e3-1db9c0b059ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:20.248830 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a08875-858f-48cc-80e3-1db9c0b059ec None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:20.249114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a08875-858f-48cc-80e3-1db9c0b059ec None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:20.249386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a08875-858f-48cc-80e3-1db9c0b059ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:20.285288 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:20.329745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a08875-858f-48cc-80e3-1db9c0b059ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:20.331316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a08875-858f-48cc-80e3-1db9c0b059ec None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:20.440510 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 604/1214] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:46:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:46:20.447310 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc01cf-db26-49b8-9031-8712c13ca9f9 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:20.469412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:20.569597 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc01cf-db26-49b8-9031-8712c13ca9f9 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:20.623473 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dedd6-4bd6-4746-94f2-4e48e2981837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:20.624297 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dedd6-4bd6-4746-94f2-4e48e2981837 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:20.624579 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dedd6-4bd6-4746-94f2-4e48e2981837 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:20.624855 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dedd6-4bd6-4746-94f2-4e48e2981837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:20.636188 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dedd6-4bd6-4746-94f2-4e48e2981837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:20.637699 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dedd6-4bd6-4746-94f2-4e48e2981837 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-a35dedd6-4bd6-4746-94f2-4e48e2981837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:20.657365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:20.659039 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:20.661543 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:20.661543 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:20.661543 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:20.661543 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:20.661543 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 611/1215] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:20.666598 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a08875-858f-48cc-80e3-1db9c0b059ec None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:20.734070 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:20.788966 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a08875-858f-48cc-80e3-1db9c0b059ec None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:20.841838 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee498424-7fd8-4f16-8873-e269e0d9c152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:20.842522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498424-7fd8-4f16-8873-e269e0d9c152 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:20.842853 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498424-7fd8-4f16-8873-e269e0d9c152 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:20.843177 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498424-7fd8-4f16-8873-e269e0d9c152 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:20.843909 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee498424-7fd8-4f16-8873-e269e0d9c152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:20.844221 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee498424-7fd8-4f16-8873-e269e0d9c152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:20.845782 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee498424-7fd8-4f16-8873-e269e0d9c152 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:20.860742 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 605/1216] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:20.869382 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dedd6-4bd6-4746-94f2-4e48e2981837 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:20.949735 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:21.008256 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dedd6-4bd6-4746-94f2-4e48e2981837 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:21.068738 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c989e-aa9f-4388-a344-d20f501998d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:21.070020 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c989e-aa9f-4388-a344-d20f501998d6 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:21.070486 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c989e-aa9f-4388-a344-d20f501998d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:21.070986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c989e-aa9f-4388-a344-d20f501998d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:21.089208 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c989e-aa9f-4388-a344-d20f501998d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:21.092325 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c989e-aa9f-4388-a344-d20f501998d6 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-1f6c989e-aa9f-4388-a344-d20f501998d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:46:21.120089 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:21.121790 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:21.123763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:46:21.123763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:46:21.123763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:46:21.123763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:46:21.123763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:46:21.123763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:46:21.123763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:21.123763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:21.123763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 612/1217] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:21.132304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee498424-7fd8-4f16-8873-e269e0d9c152 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:21.241820 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee498424-7fd8-4f16-8873-e269e0d9c152 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:21.267876 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:21.281471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d21ff-a234-49b2-a442-77b49038ef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:21.282257 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d21ff-a234-49b2-a442-77b49038ef0d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:21.282716 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d21ff-a234-49b2-a442-77b49038ef0d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:21.283091 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d21ff-a234-49b2-a442-77b49038ef0d None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:21.284083 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d21ff-a234-49b2-a442-77b49038ef0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:21.284512 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d21ff-a234-49b2-a442-77b49038ef0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:21.286468 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d21ff-a234-49b2-a442-77b49038ef0d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:21.301351 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 606/1218] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:21.308454 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c989e-aa9f-4388-a344-d20f501998d6 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:21.446426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c989e-aa9f-4388-a344-d20f501998d6 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:21.477954 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:21.484284 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75005631-9314-45df-be8d-8f3d09ce6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:21.484939 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005631-9314-45df-be8d-8f3d09ce6513 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:21.485223 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005631-9314-45df-be8d-8f3d09ce6513 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:21.485498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005631-9314-45df-be8d-8f3d09ce6513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:21.486342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75005631-9314-45df-be8d-8f3d09ce6513 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=c6b72e01aa994693afe5d7199a799162) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:21.486687 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75005631-9314-45df-be8d-8f3d09ce6513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:21.488645 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75005631-9314-45df-be8d-8f3d09ce6513 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:21.495008 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 613/1219] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:46:21 2022] GET /identity/v3/role_assignments?user.id=c6b72e01aa994693afe5d7199a799162&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:23.983370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ce7c9-5179-40c7-9711-b553ad78a63a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:23.984214 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ce7c9-5179-40c7-9711-b553ad78a63a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:23.984431 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ce7c9-5179-40c7-9711-b553ad78a63a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:23.985886 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 607/1220] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:46:23.992356 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5517a-92c0-4ece-9e57-36a431eb8864 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:23.992898 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5517a-92c0-4ece-9e57-36a431eb8864 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:23.992998 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5517a-92c0-4ece-9e57-36a431eb8864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:24.010571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-21e5517a-92c0-4ece-9e57-36a431eb8864 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:24.011818 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-21e5517a-92c0-4ece-9e57-36a431eb8864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:24.085867 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 614/1221] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:46:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:46:24.109705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ce7c9-5179-40c7-9711-b553ad78a63a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:24.239107 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ce7c9-5179-40c7-9711-b553ad78a63a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:24.283459 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6388b3-9467-43ff-81bd-388ce6394c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:24.284383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6388b3-9467-43ff-81bd-388ce6394c23 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:24.285349 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6388b3-9467-43ff-81bd-388ce6394c23 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:24.285738 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6388b3-9467-43ff-81bd-388ce6394c23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:24.299192 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6388b3-9467-43ff-81bd-388ce6394c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-dc6388b3-9467-43ff-81bd-388ce6394c23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:46:24.307306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:24.308965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:24.309844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 608/1222] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:46:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:24.318251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5517a-92c0-4ece-9e57-36a431eb8864 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:24.427276 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5517a-92c0-4ece-9e57-36a431eb8864 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:24.455234 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:24.467674 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a9b5d-baa6-4050-b0c1-a1de49df48e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:24.468356 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a9b5d-baa6-4050-b0c1-a1de49df48e3 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:24.468638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a9b5d-baa6-4050-b0c1-a1de49df48e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:24.468909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a9b5d-baa6-4050-b0c1-a1de49df48e3 None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:24.469654 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a9b5d-baa6-4050-b0c1-a1de49df48e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:24.470055 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a9b5d-baa6-4050-b0c1-a1de49df48e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:24.471508 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a9b5d-baa6-4050-b0c1-a1de49df48e3 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:24.480638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 615/1223] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:46:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:24.490968 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6388b3-9467-43ff-81bd-388ce6394c23 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:24.551837 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:24.616472 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6388b3-9467-43ff-81bd-388ce6394c23 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:24.653181 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee147cf5-0f92-4fe8-8700-81a41f12c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:24.654038 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee147cf5-0f92-4fe8-8700-81a41f12c812 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:24.654266 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee147cf5-0f92-4fe8-8700-81a41f12c812 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:24.654540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee147cf5-0f92-4fe8-8700-81a41f12c812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:24.667503 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee147cf5-0f92-4fe8-8700-81a41f12c812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:24.668980 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee147cf5-0f92-4fe8-8700-81a41f12c812 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ee147cf5-0f92-4fe8-8700-81a41f12c812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:24.688188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:24.689854 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:24.692497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:24.692497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:24.692497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:24.692497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:24.692497 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 609/1224] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:24.697120 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a9b5d-baa6-4050-b0c1-a1de49df48e3 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:24.810728 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a9b5d-baa6-4050-b0c1-a1de49df48e3 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:24.848530 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a62cf3-88c5-45eb-b74a-8ca30e8a1ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:24.849381 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a62cf3-88c5-45eb-b74a-8ca30e8a1ad2 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:24.849674 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a62cf3-88c5-45eb-b74a-8ca30e8a1ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:24.849950 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a62cf3-88c5-45eb-b74a-8ca30e8a1ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:24.850718 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a62cf3-88c5-45eb-b74a-8ca30e8a1ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:24.851031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a62cf3-88c5-45eb-b74a-8ca30e8a1ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:24.852401 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a62cf3-88c5-45eb-b74a-8ca30e8a1ad2 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:24.866117 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 616/1225] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:24.872775 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee147cf5-0f92-4fe8-8700-81a41f12c812 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:24.987406 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:24.995440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee147cf5-0f92-4fe8-8700-81a41f12c812 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:25.039764 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4223961-7f9d-47af-8d2d-c5de52e7ee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:25.040737 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4223961-7f9d-47af-8d2d-c5de52e7ee7a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:25.041122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4223961-7f9d-47af-8d2d-c5de52e7ee7a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:25.041484 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4223961-7f9d-47af-8d2d-c5de52e7ee7a None admin] PATH_INFO: `/v3/users/placement` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:25.051585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4223961-7f9d-47af-8d2d-c5de52e7ee7a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:25.053188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4223961-7f9d-47af-8d2d-c5de52e7ee7a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-e4223961-7f9d-47af-8d2d-c5de52e7ee7a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:46:25.071261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:25.072572 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:25.073952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:25.073952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:25.073952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:46:25.073952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:46:25.073952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:46:25.073952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:46:25.073952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:46:25.073952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:46:25.073952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:25.073952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:25.073952 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 610/1226] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:25.079976 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a62cf3-88c5-45eb-b74a-8ca30e8a1ad2 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:25.134799 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:25.199044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a62cf3-88c5-45eb-b74a-8ca30e8a1ad2 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:25.236250 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9ca27-ecfc-4dd2-8be9-77cf6deb4c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:25.236923 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9ca27-ecfc-4dd2-8be9-77cf6deb4c72 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:25.237203 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9ca27-ecfc-4dd2-8be9-77cf6deb4c72 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:25.238109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9ca27-ecfc-4dd2-8be9-77cf6deb4c72 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:25.238642 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9ca27-ecfc-4dd2-8be9-77cf6deb4c72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:25.238846 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9ca27-ecfc-4dd2-8be9-77cf6deb4c72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:25.240178 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9ca27-ecfc-4dd2-8be9-77cf6deb4c72 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:25.261031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 617/1227] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 19:46:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:25.267123 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4223961-7f9d-47af-8d2d-c5de52e7ee7a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:25.385381 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4223961-7f9d-47af-8d2d-c5de52e7ee7a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:25.423010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee67e3-f37e-482b-9b95-bb82a3310c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:25.423810 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee67e3-f37e-482b-9b95-bb82a3310c1a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:25.424093 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee67e3-f37e-482b-9b95-bb82a3310c1a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:25.424364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee67e3-f37e-482b-9b95-bb82a3310c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:25.436370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee67e3-f37e-482b-9b95-bb82a3310c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:25.437874 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee67e3-f37e-482b-9b95-bb82a3310c1a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a2ee67e3-f37e-482b-9b95-bb82a3310c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:25.456333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:25.457564 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:25.458712 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:25.458712 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:25.458712 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:25.458712 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:25.458712 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 611/1228] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:25.464269 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9ca27-ecfc-4dd2-8be9-77cf6deb4c72 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:25.574340 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9ca27-ecfc-4dd2-8be9-77cf6deb4c72 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:25.576792 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:25.610815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d2b25-9fc8-4f3f-a3f4-8edaa529eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:25.611487 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2b25-9fc8-4f3f-a3f4-8edaa529eec6 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:25.611915 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2b25-9fc8-4f3f-a3f4-8edaa529eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:25.612162 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2b25-9fc8-4f3f-a3f4-8edaa529eec6 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:25.612817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d2b25-9fc8-4f3f-a3f4-8edaa529eec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:25.613056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d2b25-9fc8-4f3f-a3f4-8edaa529eec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:25.614423 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d2b25-9fc8-4f3f-a3f4-8edaa529eec6 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:25.626544 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 618/1229] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:25.632559 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee67e3-f37e-482b-9b95-bb82a3310c1a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:25.642880 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:25.744004 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee67e3-f37e-482b-9b95-bb82a3310c1a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:25.780106 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aaed7f-c809-4991-a45f-bfe36083bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:25.780904 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aaed7f-c809-4991-a45f-bfe36083bb50 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:25.781188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aaed7f-c809-4991-a45f-bfe36083bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:25.781466 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aaed7f-c809-4991-a45f-bfe36083bb50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:25.788819 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aaed7f-c809-4991-a45f-bfe36083bb50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:25.790333 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aaed7f-c809-4991-a45f-bfe36083bb50 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a7aaed7f-c809-4991-a45f-bfe36083bb50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:46:25.805942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:25.807068 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:25.808131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:46:25.808131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:46:25.808131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:46:25.808131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:46:25.808131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:46:25.808131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:46:25.808131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:25.808131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:25.808131 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 612/1230] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:25.813305 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d2b25-9fc8-4f3f-a3f4-8edaa529eec6 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:25.931145 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d2b25-9fc8-4f3f-a3f4-8edaa529eec6 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:25.978392 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d448ef0-b105-4292-803b-d5699e27e640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:25.979318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d448ef0-b105-4292-803b-d5699e27e640 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:25.979877 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d448ef0-b105-4292-803b-d5699e27e640 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:25.980292 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d448ef0-b105-4292-803b-d5699e27e640 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:25.981630 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d448ef0-b105-4292-803b-d5699e27e640 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:25.981951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d448ef0-b105-4292-803b-d5699e27e640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:25.983494 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d448ef0-b105-4292-803b-d5699e27e640 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:25.998476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 619/1231] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:26.005583 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aaed7f-c809-4991-a45f-bfe36083bb50 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:26.081330 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:26.122311 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aaed7f-c809-4991-a45f-bfe36083bb50 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:26.166714 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a39e0-956d-4377-8baf-6edfa4d0bad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:26.167786 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a39e0-956d-4377-8baf-6edfa4d0bad9 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:26.168159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a39e0-956d-4377-8baf-6edfa4d0bad9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:26.168585 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a39e0-956d-4377-8baf-6edfa4d0bad9 None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/c6b72e01aa994693afe5d7199a799162/roles/6832675179fb4d0894f7273b883164b1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:26.188731 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a39e0-956d-4377-8baf-6edfa4d0bad9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=c6b72e01aa994693afe5d7199a799162, role_id=6832675179fb4d0894f7273b883164b1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:26.190188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a39e0-956d-4377-8baf-6edfa4d0bad9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:26.261602 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 613/1232] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:46:26 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/c6b72e01aa994693afe5d7199a799162/roles/6832675179fb4d0894f7273b883164b1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:46:28.555941 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf239a1-8504-4d17-8ef9-a9ed02a19849 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:28.556566 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf239a1-8504-4d17-8ef9-a9ed02a19849 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:28.556566 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf239a1-8504-4d17-8ef9-a9ed02a19849 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:28.558054 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 620/1233] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:28.564367 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e14f0-2c67-40cc-b49d-49dfe7d5022c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:28.564957 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e14f0-2c67-40cc-b49d-49dfe7d5022c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:28.564957 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e14f0-2c67-40cc-b49d-49dfe7d5022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:28.585374 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b51e14f0-2c67-40cc-b49d-49dfe7d5022c None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:28.586712 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b51e14f0-2c67-40cc-b49d-49dfe7d5022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:28.665159 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 614/1234] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:46:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:46:28.690010 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf239a1-8504-4d17-8ef9-a9ed02a19849 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:28.719619 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:28.815221 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf239a1-8504-4d17-8ef9-a9ed02a19849 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:28.857273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552183d9-1c7c-49e3-a21c-c47cec237c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:28.858639 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552183d9-1c7c-49e3-a21c-c47cec237c07 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:28.859153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552183d9-1c7c-49e3-a21c-c47cec237c07 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:28.859634 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552183d9-1c7c-49e3-a21c-c47cec237c07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:28.878244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552183d9-1c7c-49e3-a21c-c47cec237c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-552183d9-1c7c-49e3-a21c-c47cec237c07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:46:28.894509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:28.895817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:28.896981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 621/1235] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 19:46:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:28.903607 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e14f0-2c67-40cc-b49d-49dfe7d5022c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:28.955374 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:29.025842 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e14f0-2c67-40cc-b49d-49dfe7d5022c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:29.068049 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a876a1b-0924-40ed-a5b2-e0b295550ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:29.068798 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a876a1b-0924-40ed-a5b2-e0b295550ae7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:29.069166 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a876a1b-0924-40ed-a5b2-e0b295550ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:29.069538 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a876a1b-0924-40ed-a5b2-e0b295550ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:29.070513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a876a1b-0924-40ed-a5b2-e0b295550ae7 None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:29.070938 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a876a1b-0924-40ed-a5b2-e0b295550ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:29.072460 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a876a1b-0924-40ed-a5b2-e0b295550ae7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:29.082017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 615/1236] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 19:46:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:29.091019 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552183d9-1c7c-49e3-a21c-c47cec237c07 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:29.220102 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:29.238625 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552183d9-1c7c-49e3-a21c-c47cec237c07 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:29.274962 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c6fc9-4b32-4a4d-a1c0-ce6eb55666ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:29.275768 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c6fc9-4b32-4a4d-a1c0-ce6eb55666ee None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:29.276047 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c6fc9-4b32-4a4d-a1c0-ce6eb55666ee None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:29.276321 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c6fc9-4b32-4a4d-a1c0-ce6eb55666ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:29.290068 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c6fc9-4b32-4a4d-a1c0-ce6eb55666ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:29.291901 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c6fc9-4b32-4a4d-a1c0-ce6eb55666ee None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-ec6c6fc9-4b32-4a4d-a1c0-ce6eb55666ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:29.312165 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:29.313817 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:29.314822 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:29.314822 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:29.314822 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:29.314822 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:29.314822 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 622/1237] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:29.322802 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a876a1b-0924-40ed-a5b2-e0b295550ae7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:29.435440 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a876a1b-0924-40ed-a5b2-e0b295550ae7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:29.445921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:29.472930 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf978b-0913-431d-8b76-add1d1391d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:29.473747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf978b-0913-431d-8b76-add1d1391d55 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:29.474123 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf978b-0913-431d-8b76-add1d1391d55 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:29.474508 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf978b-0913-431d-8b76-add1d1391d55 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:29.475518 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf978b-0913-431d-8b76-add1d1391d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:29.475941 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf978b-0913-431d-8b76-add1d1391d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:29.477517 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf978b-0913-431d-8b76-add1d1391d55 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:29.491122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 616/1238] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:29.499839 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c6fc9-4b32-4a4d-a1c0-ce6eb55666ee None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:29.609244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c6fc9-4b32-4a4d-a1c0-ce6eb55666ee None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:29.651416 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848967a6-27af-48b6-94ba-5cd13d3ecb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:29.652244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848967a6-27af-48b6-94ba-5cd13d3ecb3e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:29.652530 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848967a6-27af-48b6-94ba-5cd13d3ecb3e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:29.652811 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848967a6-27af-48b6-94ba-5cd13d3ecb3e None admin] PATH_INFO: `/v3/users/placement` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:29.656407 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:29.662112 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848967a6-27af-48b6-94ba-5cd13d3ecb3e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:29.663624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848967a6-27af-48b6-94ba-5cd13d3ecb3e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-848967a6-27af-48b6-94ba-5cd13d3ecb3e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:46:29.680829 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:29.682453 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:29.683716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:29.683716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:29.683716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:46:29.683716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:46:29.683716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:46:29.683716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:46:29.683716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:46:29.683716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:46:29.683716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:29.683716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:29.683716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 623/1239] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:29.688126 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf978b-0913-431d-8b76-add1d1391d55 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:29.836010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf978b-0913-431d-8b76-add1d1391d55 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:29.875273 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2dd1-3434-474d-937c-059f9678f93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:29.875956 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2dd1-3434-474d-937c-059f9678f93b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:29.876234 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2dd1-3434-474d-937c-059f9678f93b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:29.876507 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2dd1-3434-474d-937c-059f9678f93b None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:29.877359 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd2dd1-3434-474d-937c-059f9678f93b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:29.877669 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd2dd1-3434-474d-937c-059f9678f93b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:29.879954 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd2dd1-3434-474d-937c-059f9678f93b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:29.900741 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 617/1240] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 19:46:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:29.908217 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848967a6-27af-48b6-94ba-5cd13d3ecb3e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:30.021342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848967a6-27af-48b6-94ba-5cd13d3ecb3e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:30.060219 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba6f3e-2402-46a3-a1ec-d2e5fba4d31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:30.060978 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6f3e-2402-46a3-a1ec-d2e5fba4d31c None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:30.061344 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6f3e-2402-46a3-a1ec-d2e5fba4d31c None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:30.061676 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6f3e-2402-46a3-a1ec-d2e5fba4d31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:30.130479 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:30.137822 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba6f3e-2402-46a3-a1ec-d2e5fba4d31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:30.139365 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba6f3e-2402-46a3-a1ec-d2e5fba4d31c None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:30.254988 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 624/1241] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:46:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:46:30.264788 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2dd1-3434-474d-937c-059f9678f93b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:30.299418 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:30.388743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2dd1-3434-474d-937c-059f9678f93b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:30.427835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8731d4-f555-4543-834b-af659f6dff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:30.428724 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8731d4-f555-4543-834b-af659f6dff86 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:30.429061 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8731d4-f555-4543-834b-af659f6dff86 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:30.429394 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8731d4-f555-4543-834b-af659f6dff86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:30.441324 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8731d4-f555-4543-834b-af659f6dff86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:30.442980 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8731d4-f555-4543-834b-af659f6dff86 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5d8731d4-f555-4543-834b-af659f6dff86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:30.463340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:30.465165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:30.466284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:30.466284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:30.466284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:30.466284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:30.466284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 618/1242] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:30.474391 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba6f3e-2402-46a3-a1ec-d2e5fba4d31c None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:30.579492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:30.586184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba6f3e-2402-46a3-a1ec-d2e5fba4d31c None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:30.623043 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7c915-f294-4c03-a19a-dbc69f32a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:30.623722 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c915-f294-4c03-a19a-dbc69f32a0ec None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:30.623980 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c915-f294-4c03-a19a-dbc69f32a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:30.624262 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c915-f294-4c03-a19a-dbc69f32a0ec None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:30.625003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7c915-f294-4c03-a19a-dbc69f32a0ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:30.625317 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7c915-f294-4c03-a19a-dbc69f32a0ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:30.626756 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7c915-f294-4c03-a19a-dbc69f32a0ec None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:30.639660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 625/1243] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:30.648861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8731d4-f555-4543-834b-af659f6dff86 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:30.759926 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:30.784308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8731d4-f555-4543-834b-af659f6dff86 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:30.821469 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f16224-f83f-49f2-a7bd-1d03c63dea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:30.822283 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f16224-f83f-49f2-a7bd-1d03c63dea13 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:30.822561 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f16224-f83f-49f2-a7bd-1d03c63dea13 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:30.822871 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f16224-f83f-49f2-a7bd-1d03c63dea13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:30.830684 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f16224-f83f-49f2-a7bd-1d03c63dea13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:30.832783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f16224-f83f-49f2-a7bd-1d03c63dea13 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a9f16224-f83f-49f2-a7bd-1d03c63dea13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:46:30.847568 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:30.848579 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:30.849511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:46:30.849511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:46:30.849511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:46:30.849511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:46:30.849511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:46:30.849511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:46:30.849511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:30.849511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:30.849511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 619/1244] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:30.855501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7c915-f294-4c03-a19a-dbc69f32a0ec None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:30.974191 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7c915-f294-4c03-a19a-dbc69f32a0ec None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:31.011056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc76bd-232f-4a53-8ce9-e45c2c997f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:31.011721 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc76bd-232f-4a53-8ce9-e45c2c997f66 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:31.012001 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc76bd-232f-4a53-8ce9-e45c2c997f66 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:31.012273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc76bd-232f-4a53-8ce9-e45c2c997f66 None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:31.013066 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc76bd-232f-4a53-8ce9-e45c2c997f66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:31.013377 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc76bd-232f-4a53-8ce9-e45c2c997f66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:31.014883 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc76bd-232f-4a53-8ce9-e45c2c997f66 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:31.029481 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 626/1245] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:31.036137 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f16224-f83f-49f2-a7bd-1d03c63dea13 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:31.156378 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f16224-f83f-49f2-a7bd-1d03c63dea13 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:31.200626 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d3c32-bbb4-4872-9552-25a724181f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:31.201296 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d3c32-bbb4-4872-9552-25a724181f69 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:31.201576 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d3c32-bbb4-4872-9552-25a724181f69 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:31.201849 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d3c32-bbb4-4872-9552-25a724181f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:31.202804 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d3c32-bbb4-4872-9552-25a724181f69 None admin] RBAC: Adding query filter params (role.id=6832675179fb4d0894f7273b883164b1, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=c6b72e01aa994693afe5d7199a799162) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:31.203122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d3c32-bbb4-4872-9552-25a724181f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:31.204662 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d3c32-bbb4-4872-9552-25a724181f69 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:31.212144 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 620/1246] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:46:31 2022] GET /identity/v3/role_assignments?user.id=c6b72e01aa994693afe5d7199a799162&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=6832675179fb4d0894f7273b883164b1 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:33.686488 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d5d56-039b-490f-9435-0f47bdaa9140 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:33.687233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d5d56-039b-490f-9435-0f47bdaa9140 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:33.687233 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d5d56-039b-490f-9435-0f47bdaa9140 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:33.688900 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 627/1247] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:33.695640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998ffcb-e064-4c34-b8ae-fc71f586dc8e None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:33.696536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998ffcb-e064-4c34-b8ae-fc71f586dc8e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:33.696536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998ffcb-e064-4c34-b8ae-fc71f586dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:33.702034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:33.715955 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c998ffcb-e064-4c34-b8ae-fc71f586dc8e None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:33.717306 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c998ffcb-e064-4c34-b8ae-fc71f586dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:33.793090 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 621/1248] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:46:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:46:33.818278 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d5d56-039b-490f-9435-0f47bdaa9140 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:33.838886 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:33.946414 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d5d56-039b-490f-9435-0f47bdaa9140 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:34.003096 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9921f-4b65-4a63-9f18-6006d29a4926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:34.004965 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9921f-4b65-4a63-9f18-6006d29a4926 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:34.005448 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9921f-4b65-4a63-9f18-6006d29a4926 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:34.005946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9921f-4b65-4a63-9f18-6006d29a4926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:34.026455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9921f-4b65-4a63-9f18-6006d29a4926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-bbf9921f-4b65-4a63-9f18-6006d29a4926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:46:34.041457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:34.042872 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:34.043814 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 628/1249] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:34.051188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998ffcb-e064-4c34-b8ae-fc71f586dc8e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:34.160206 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998ffcb-e064-4c34-b8ae-fc71f586dc8e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:34.193463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:34.199017 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83986894-66e6-4b88-9d02-bf00f89042cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:34.199621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986894-66e6-4b88-9d02-bf00f89042cf None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:34.199902 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986894-66e6-4b88-9d02-bf00f89042cf None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:34.200175 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986894-66e6-4b88-9d02-bf00f89042cf None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:34.200939 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83986894-66e6-4b88-9d02-bf00f89042cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:34.201244 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83986894-66e6-4b88-9d02-bf00f89042cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:34.202726 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83986894-66e6-4b88-9d02-bf00f89042cf None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:34.212067 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 622/1250] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:46:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:34.221093 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9921f-4b65-4a63-9f18-6006d29a4926 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:34.310274 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:34.342953 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9921f-4b65-4a63-9f18-6006d29a4926 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:34.383063 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ddb81-140d-41aa-af89-07b2d52370c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:34.383997 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ddb81-140d-41aa-af89-07b2d52370c0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:34.384292 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ddb81-140d-41aa-af89-07b2d52370c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:34.384565 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ddb81-140d-41aa-af89-07b2d52370c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:34.396493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ddb81-140d-41aa-af89-07b2d52370c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:34.398142 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ddb81-140d-41aa-af89-07b2d52370c0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-db3ddb81-140d-41aa-af89-07b2d52370c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:34.417074 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:34.418338 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:34.427561 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:34.427561 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:34.427561 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:34.427561 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:34.427561 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 629/1251] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:34.428114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83986894-66e6-4b88-9d02-bf00f89042cf None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:34.542712 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83986894-66e6-4b88-9d02-bf00f89042cf None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:34.581811 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14df6-1e03-446a-85f8-fe6f19dfdee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:34.582554 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14df6-1e03-446a-85f8-fe6f19dfdee8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:34.582900 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14df6-1e03-446a-85f8-fe6f19dfdee8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:34.583216 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14df6-1e03-446a-85f8-fe6f19dfdee8 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:34.584096 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd14df6-1e03-446a-85f8-fe6f19dfdee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:34.584445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd14df6-1e03-446a-85f8-fe6f19dfdee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:34.586102 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd14df6-1e03-446a-85f8-fe6f19dfdee8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:34.600550 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 623/1252] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:34.609328 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ddb81-140d-41aa-af89-07b2d52370c0 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:34.719196 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ddb81-140d-41aa-af89-07b2d52370c0 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:34.752230 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:34.760947 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf9002-11f3-4f77-8cb6-938e41a58d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:34.761771 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf9002-11f3-4f77-8cb6-938e41a58d8b None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:34.762056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf9002-11f3-4f77-8cb6-938e41a58d8b None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:34.762332 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf9002-11f3-4f77-8cb6-938e41a58d8b None admin] PATH_INFO: `/v3/users/placement` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:34.772519 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf9002-11f3-4f77-8cb6-938e41a58d8b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:34.778293 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf9002-11f3-4f77-8cb6-938e41a58d8b None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-30cf9002-11f3-4f77-8cb6-938e41a58d8b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:46:34.793660 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:34.795545 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:34.797492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:34.797492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:34.797492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:46:34.797492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:46:34.797492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:46:34.797492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:46:34.797492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:46:34.797492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:46:34.797492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:34.797492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:34.797492 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 630/1253] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:34.800848 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14df6-1e03-446a-85f8-fe6f19dfdee8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:34.861395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:34.914370 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14df6-1e03-446a-85f8-fe6f19dfdee8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:34.952870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894a661-180d-433a-931b-34728db76380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:34.953543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894a661-180d-433a-931b-34728db76380 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:34.953817 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894a661-180d-433a-931b-34728db76380 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:34.954087 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894a661-180d-433a-931b-34728db76380 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:34.954963 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894a661-180d-433a-931b-34728db76380 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:34.955270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894a661-180d-433a-931b-34728db76380 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:34.957471 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894a661-180d-433a-931b-34728db76380 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:34.978127 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 624/1254] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 19:46:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:34.987172 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf9002-11f3-4f77-8cb6-938e41a58d8b None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:35.147729 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf9002-11f3-4f77-8cb6-938e41a58d8b None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:35.206238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c324d-56e9-411c-a245-fdbc2f50fa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:35.207395 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c324d-56e9-411c-a245-fdbc2f50fa08 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:35.207911 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c324d-56e9-411c-a245-fdbc2f50fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:35.208419 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c324d-56e9-411c-a245-fdbc2f50fa08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:35.273609 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:35.287995 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c324d-56e9-411c-a245-fdbc2f50fa08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:35.289634 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c324d-56e9-411c-a245-fdbc2f50fa08 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:35.399170 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 631/1255] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:46:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:46:35.406894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894a661-180d-433a-931b-34728db76380 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:35.527317 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894a661-180d-433a-931b-34728db76380 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:35.545063 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:35.571313 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb3139-fcba-4493-be18-05cc6b2c91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:35.572141 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb3139-fcba-4493-be18-05cc6b2c91cb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:35.572428 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb3139-fcba-4493-be18-05cc6b2c91cb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:35.572704 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb3139-fcba-4493-be18-05cc6b2c91cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:35.584922 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb3139-fcba-4493-be18-05cc6b2c91cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:35.586552 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb3139-fcba-4493-be18-05cc6b2c91cb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-15bb3139-fcba-4493-be18-05cc6b2c91cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:35.606971 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:35.608178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:35.610059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:35.610059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:35.610059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:35.610059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:35.610059 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 625/1256] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:35.615307 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c324d-56e9-411c-a245-fdbc2f50fa08 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:35.713499 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:35.727028 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c324d-56e9-411c-a245-fdbc2f50fa08 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:35.772606 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf9fb1-4e49-48ce-a1eb-faa0a02488bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:35.773753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf9fb1-4e49-48ce-a1eb-faa0a02488bd None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:35.774397 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf9fb1-4e49-48ce-a1eb-faa0a02488bd None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:35.774959 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf9fb1-4e49-48ce-a1eb-faa0a02488bd None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:35.776954 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf9fb1-4e49-48ce-a1eb-faa0a02488bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:35.777537 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf9fb1-4e49-48ce-a1eb-faa0a02488bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:35.780264 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf9fb1-4e49-48ce-a1eb-faa0a02488bd None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:35.803445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 632/1257] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:35.809621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb3139-fcba-4493-be18-05cc6b2c91cb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:35.932311 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb3139-fcba-4493-be18-05cc6b2c91cb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:35.984340 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4dd01-6759-4290-9642-8609619122c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:35.985632 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4dd01-6759-4290-9642-8609619122c4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:35.986260 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4dd01-6759-4290-9642-8609619122c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:35.986798 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4dd01-6759-4290-9642-8609619122c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:36.000096 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4dd01-6759-4290-9642-8609619122c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:36.003025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4dd01-6759-4290-9642-8609619122c4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-bfc4dd01-6759-4290-9642-8609619122c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:46:36.030589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:36.032570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:36.034921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:46:36.034921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:46:36.034921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:46:36.034921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:46:36.034921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:46:36.034921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:46:36.034921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:36.034921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:36.034921 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 626/1258] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:46:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:36.039854 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf9fb1-4e49-48ce-a1eb-faa0a02488bd None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:36.179757 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf9fb1-4e49-48ce-a1eb-faa0a02488bd None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:36.241703 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e617a8-2887-4f6e-8e49-70e4774c5ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:36.242804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e617a8-2887-4f6e-8e49-70e4774c5ddd None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:36.243320 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e617a8-2887-4f6e-8e49-70e4774c5ddd None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:36.243815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e617a8-2887-4f6e-8e49-70e4774c5ddd None admin] PATH_INFO: `/v3/projects` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:36.245300 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e617a8-2887-4f6e-8e49-70e4774c5ddd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:36.245873 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e617a8-2887-4f6e-8e49-70e4774c5ddd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:36.248716 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e617a8-2887-4f6e-8e49-70e4774c5ddd None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:36.273361 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 633/1259] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:36.280292 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4dd01-6759-4290-9642-8609619122c4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:36.309447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:36.396581 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4dd01-6759-4290-9642-8609619122c4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:36.435241 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56133bc6-bff5-42d1-b62a-ed39bf62fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:36.435906 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56133bc6-bff5-42d1-b62a-ed39bf62fb9f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:36.436188 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56133bc6-bff5-42d1-b62a-ed39bf62fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:36.436464 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56133bc6-bff5-42d1-b62a-ed39bf62fb9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:36.437312 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56133bc6-bff5-42d1-b62a-ed39bf62fb9f None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=c6b72e01aa994693afe5d7199a799162) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:36.437628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56133bc6-bff5-42d1-b62a-ed39bf62fb9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:36.439141 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56133bc6-bff5-42d1-b62a-ed39bf62fb9f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:36.445966 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 627/1260] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:46:36 2022] GET /identity/v3/role_assignments?user.id=c6b72e01aa994693afe5d7199a799162&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:38.889701 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89dd1c-4013-4912-b752-3e59a6e91c23 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:38.890576 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89dd1c-4013-4912-b752-3e59a6e91c23 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:38.890804 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89dd1c-4013-4912-b752-3e59a6e91c23 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:38.892277 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 634/1261] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:46:38.898781 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997318ec-3e10-4368-a6f4-684f21c2a560 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:38.899566 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997318ec-3e10-4368-a6f4-684f21c2a560 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:38.899566 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997318ec-3e10-4368-a6f4-684f21c2a560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:38.918498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-997318ec-3e10-4368-a6f4-684f21c2a560 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:38.919822 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-997318ec-3e10-4368-a6f4-684f21c2a560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:38.996536 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 628/1262] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:46:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:46:39.037419 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89dd1c-4013-4912-b752-3e59a6e91c23 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:39.049193 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:39.155883 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89dd1c-4013-4912-b752-3e59a6e91c23 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:39.200244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542a43-1717-4296-a28f-99480e4fbac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:39.201059 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542a43-1717-4296-a28f-99480e4fbac1 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:39.201347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542a43-1717-4296-a28f-99480e4fbac1 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:39.201669 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542a43-1717-4296-a28f-99480e4fbac1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:39.216378 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8542a43-1717-4296-a28f-99480e4fbac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-a8542a43-1717-4296-a28f-99480e4fbac1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:46:39.225192 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:39.231568 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:39.233258 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 635/1263] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:39.236194 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997318ec-3e10-4368-a6f4-684f21c2a560 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:39.261736 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:39.358322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997318ec-3e10-4368-a6f4-684f21c2a560 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:39.396878 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ed120-43c5-4ac5-bbf2-a26fbfc1f8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:39.397627 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ed120-43c5-4ac5-bbf2-a26fbfc1f8e2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:39.397980 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ed120-43c5-4ac5-bbf2-a26fbfc1f8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:39.398308 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ed120-43c5-4ac5-bbf2-a26fbfc1f8e2 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:39.399158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ed120-43c5-4ac5-bbf2-a26fbfc1f8e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:39.399514 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ed120-43c5-4ac5-bbf2-a26fbfc1f8e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:39.401039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ed120-43c5-4ac5-bbf2-a26fbfc1f8e2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:39.411174 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 629/1264] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:46:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:39.418132 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542a43-1717-4296-a28f-99480e4fbac1 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:39.494128 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:39.547757 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542a43-1717-4296-a28f-99480e4fbac1 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:39.590572 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5e5f9-f9d4-402c-96d8-83fa026f8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:39.591543 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e5f9-f9d4-402c-96d8-83fa026f8338 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:39.591899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e5f9-f9d4-402c-96d8-83fa026f8338 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:39.592280 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e5f9-f9d4-402c-96d8-83fa026f8338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:39.604630 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5e5f9-f9d4-402c-96d8-83fa026f8338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:39.606107 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5e5f9-f9d4-402c-96d8-83fa026f8338 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-9fa5e5f9-f9d4-402c-96d8-83fa026f8338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:39.625163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:39.633024 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:39.634808 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:39.634808 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:39.634808 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:39.634808 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:39.634808 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 636/1265] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:39.635917 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ed120-43c5-4ac5-bbf2-a26fbfc1f8e2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:39.738949 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:39.759113 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ed120-43c5-4ac5-bbf2-a26fbfc1f8e2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:39.795534 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabaab4-7eff-44d7-957c-8a38d1f5fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:39.796211 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabaab4-7eff-44d7-957c-8a38d1f5fc6e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:39.796495 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabaab4-7eff-44d7-957c-8a38d1f5fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:39.796769 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabaab4-7eff-44d7-957c-8a38d1f5fc6e None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:39.797597 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabaab4-7eff-44d7-957c-8a38d1f5fc6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:39.797899 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabaab4-7eff-44d7-957c-8a38d1f5fc6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:39.799409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabaab4-7eff-44d7-957c-8a38d1f5fc6e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:39.814018 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 630/1266] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:39.820251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5e5f9-f9d4-402c-96d8-83fa026f8338 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:39.955753 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5e5f9-f9d4-402c-96d8-83fa026f8338 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:39.981638 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:40.000731 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631be44e-443d-4637-8b9f-b84267108707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:40.001739 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be44e-443d-4637-8b9f-b84267108707 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:40.002109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be44e-443d-4637-8b9f-b84267108707 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:40.002500 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be44e-443d-4637-8b9f-b84267108707 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:40.011909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631be44e-443d-4637-8b9f-b84267108707 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:40.013402 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631be44e-443d-4637-8b9f-b84267108707 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-631be44e-443d-4637-8b9f-b84267108707 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:46:40.030445 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:40.032273 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:40.035251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:40.035251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:40.035251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:46:40.035251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:46:40.035251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:46:40.035251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:46:40.035251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:46:40.035251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:46:40.035251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:40.035251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:40.035251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 637/1267] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:40.040039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabaab4-7eff-44d7-957c-8a38d1f5fc6e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:40.151908 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabaab4-7eff-44d7-957c-8a38d1f5fc6e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:40.192916 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc8daa-3a64-42f0-9921-6e0de407d892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:40.193711 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc8daa-3a64-42f0-9921-6e0de407d892 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:40.194040 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc8daa-3a64-42f0-9921-6e0de407d892 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:40.194378 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc8daa-3a64-42f0-9921-6e0de407d892 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:40.195412 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc8daa-3a64-42f0-9921-6e0de407d892 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:40.195761 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc8daa-3a64-42f0-9921-6e0de407d892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:40.197267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc8daa-3a64-42f0-9921-6e0de407d892 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:40.208426 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:40.217671 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 631/1268] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 19:46:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:40.224909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631be44e-443d-4637-8b9f-b84267108707 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:40.364061 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631be44e-443d-4637-8b9f-b84267108707 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:40.423364 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4068d0-3c68-43f4-a933-19e7b4c81f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:40.424169 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4068d0-3c68-43f4-a933-19e7b4c81f3e None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:40.424456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4068d0-3c68-43f4-a933-19e7b4c81f3e None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:40.424734 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4068d0-3c68-43f4-a933-19e7b4c81f3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:40.437040 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4068d0-3c68-43f4-a933-19e7b4c81f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:40.438583 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4068d0-3c68-43f4-a933-19e7b4c81f3e None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-1d4068d0-3c68-43f4-a933-19e7b4c81f3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:40.459204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:40.461044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:40.462828 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:40.462828 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:40.462828 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:40.462828 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:40.462828 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 638/1269] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:40.466644 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc8daa-3a64-42f0-9921-6e0de407d892 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:40.579444 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc8daa-3a64-42f0-9921-6e0de407d892 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:40.640675 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0b71b-f33a-48bb-950f-0507f20e3542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:40.641809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b71b-f33a-48bb-950f-0507f20e3542 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:40.642323 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b71b-f33a-48bb-950f-0507f20e3542 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:40.642917 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b71b-f33a-48bb-950f-0507f20e3542 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:40.644896 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0b71b-f33a-48bb-950f-0507f20e3542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:40.645392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0b71b-f33a-48bb-950f-0507f20e3542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:40.648049 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0b71b-f33a-48bb-950f-0507f20e3542 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:40.669542 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 632/1270] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:40.675553 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4068d0-3c68-43f4-a933-19e7b4c81f3e None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:40.712883 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:40.788509 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4068d0-3c68-43f4-a933-19e7b4c81f3e None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:40.828489 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99114594-d651-4fe0-b1e9-9a8177af09d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:40.829309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99114594-d651-4fe0-b1e9-9a8177af09d5 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:40.829655 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99114594-d651-4fe0-b1e9-9a8177af09d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:40.829879 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99114594-d651-4fe0-b1e9-9a8177af09d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:40.838323 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99114594-d651-4fe0-b1e9-9a8177af09d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:40.840064 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99114594-d651-4fe0-b1e9-9a8177af09d5 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-99114594-d651-4fe0-b1e9-9a8177af09d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:46:40.855946 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:40.857627 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:40.859316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:46:40.859316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:46:40.859316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:46:40.859316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:46:40.859316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:46:40.859316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:46:40.859316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:40.859316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:40.859316 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 639/1271] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:40.865242 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0b71b-f33a-48bb-950f-0507f20e3542 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:40.932824 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:40.978640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0b71b-f33a-48bb-950f-0507f20e3542 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:41.017013 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716cbc6-b038-46af-970d-557d46d6c82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:41.017710 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716cbc6-b038-46af-970d-557d46d6c82c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:41.017964 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716cbc6-b038-46af-970d-557d46d6c82c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:41.018244 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716cbc6-b038-46af-970d-557d46d6c82c None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:41.019127 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716cbc6-b038-46af-970d-557d46d6c82c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:41.019438 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716cbc6-b038-46af-970d-557d46d6c82c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:41.020950 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716cbc6-b038-46af-970d-557d46d6c82c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:41.035341 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 633/1272] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:41.044439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99114594-d651-4fe0-b1e9-9a8177af09d5 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:41.159949 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:41.168974 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99114594-d651-4fe0-b1e9-9a8177af09d5 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:41.204608 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe1ca7-dd54-4fc4-b611-939a8d64e1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:41.205498 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe1ca7-dd54-4fc4-b611-939a8d64e1f5 None admin] REQUEST_METHOD: `PUT` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:41.205782 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe1ca7-dd54-4fc4-b611-939a8d64e1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:41.206058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe1ca7-dd54-4fc4-b611-939a8d64e1f5 None admin] PATH_INFO: `/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/c6b72e01aa994693afe5d7199a799162/roles/4f7e6c1b02094f72ae978c3558b530a9` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:41.208199 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe1ca7-dd54-4fc4-b611-939a8d64e1f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f01cea6d6914f42a832ed81a6fe94e1, user_id=c6b72e01aa994693afe5d7199a799162, role_id=4f7e6c1b02094f72ae978c3558b530a9)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:41.209652 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe1ca7-dd54-4fc4-b611-939a8d64e1f5 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:41.296448 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 640/1273] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 19:46:41 2022] PUT /identity/v3/projects/5f01cea6d6914f42a832ed81a6fe94e1/users/c6b72e01aa994693afe5d7199a799162/roles/4f7e6c1b02094f72ae978c3558b530a9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:46:43.602570 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afbbbb-970d-4f5e-9986-4879bf8566f1 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:43.603111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afbbbb-970d-4f5e-9986-4879bf8566f1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:43.603111 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afbbbb-970d-4f5e-9986-4879bf8566f1 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:43.604451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 634/1274] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:43.609913 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731972fc-243e-4dc0-9fe1-5e45d3658e55 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:43.610349 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731972fc-243e-4dc0-9fe1-5e45d3658e55 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:43.610473 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731972fc-243e-4dc0-9fe1-5e45d3658e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:43.628182 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-731972fc-243e-4dc0-9fe1-5e45d3658e55 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:43.629379 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-731972fc-243e-4dc0-9fe1-5e45d3658e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:43.703056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 641/1275] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:46:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:46:43.727081 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afbbbb-970d-4f5e-9986-4879bf8566f1 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:43.835632 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afbbbb-970d-4f5e-9986-4879bf8566f1 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:43.855347 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:43.877121 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f586df4-b28b-497c-86e4-8f882b06c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:43.878342 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f586df4-b28b-497c-86e4-8f882b06c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:43.878685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f586df4-b28b-497c-86e4-8f882b06c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:43.879124 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f586df4-b28b-497c-86e4-8f882b06c7b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:43.890411 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f586df4-b28b-497c-86e4-8f882b06c7b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-1f586df4-b28b-497c-86e4-8f882b06c7b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:46:43.898990 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:43.901965 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:43.902870 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 635/1276] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 19:46:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:43.906955 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731972fc-243e-4dc0-9fe1-5e45d3658e55 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:43.995941 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:44.021143 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731972fc-243e-4dc0-9fe1-5e45d3658e55 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:44.082945 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbcb98-622f-405b-b635-c425f011ea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:44.084244 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbcb98-622f-405b-b635-c425f011ea1d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:44.084687 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbcb98-622f-405b-b635-c425f011ea1d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:44.085210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbcb98-622f-405b-b635-c425f011ea1d None admin] PATH_INFO: `/v3/roles` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:44.086674 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbcb98-622f-405b-b635-c425f011ea1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:44.087242 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbcb98-622f-405b-b635-c425f011ea1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:44.089793 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbcb98-622f-405b-b635-c425f011ea1d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:44.106184 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 642/1277] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 19:46:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:44.112122 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f586df4-b28b-497c-86e4-8f882b06c7b6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:44.235409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f586df4-b28b-497c-86e4-8f882b06c7b6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:44.273204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906be661-f083-44fb-836c-d1a46dfaf55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:44.274061 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be661-f083-44fb-836c-d1a46dfaf55c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:44.274386 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be661-f083-44fb-836c-d1a46dfaf55c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:44.274763 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be661-f083-44fb-836c-d1a46dfaf55c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:44.287371 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906be661-f083-44fb-836c-d1a46dfaf55c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:44.288873 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906be661-f083-44fb-836c-d1a46dfaf55c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-906be661-f083-44fb-836c-d1a46dfaf55c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:44.307275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:44.308997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:44.310753 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:44.310753 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:44.310753 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:44.310753 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:44.310753 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 636/1278] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:44.318072 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbcb98-622f-405b-b635-c425f011ea1d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:44.477951 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbcb98-622f-405b-b635-c425f011ea1d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:44.515476 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390363c2-d937-4252-b843-6b1944ad6062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:44.516134 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390363c2-d937-4252-b843-6b1944ad6062 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:44.516417 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390363c2-d937-4252-b843-6b1944ad6062 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:44.516694 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390363c2-d937-4252-b843-6b1944ad6062 None admin] PATH_INFO: `/v3/domains` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:44.517426 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390363c2-d937-4252-b843-6b1944ad6062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:44.517735 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390363c2-d937-4252-b843-6b1944ad6062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:44.519720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390363c2-d937-4252-b843-6b1944ad6062 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:44.533247 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 643/1279] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:44.539319 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906be661-f083-44fb-836c-d1a46dfaf55c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:44.573364 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:44.650270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906be661-f083-44fb-836c-d1a46dfaf55c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:44.687448 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10de67-42ce-47ad-a9c4-2fbfd7c0e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:44.688321 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10de67-42ce-47ad-a9c4-2fbfd7c0e2e2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:44.688647 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10de67-42ce-47ad-a9c4-2fbfd7c0e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:44.688970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10de67-42ce-47ad-a9c4-2fbfd7c0e2e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:44.697803 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10de67-42ce-47ad-a9c4-2fbfd7c0e2e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:44.699387 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10de67-42ce-47ad-a9c4-2fbfd7c0e2e2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-fe10de67-42ce-47ad-a9c4-2fbfd7c0e2e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:46:44.715265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:44.716451 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:44.717903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:44.717903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:44.717903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:46:44.717903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:46:44.717903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:46:44.717903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:46:44.717903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:46:44.717903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:46:44.717903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:46:44.717903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:44.717903 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 637/1280] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:44.723450 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390363c2-d937-4252-b843-6b1944ad6062 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:44.727739 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:44.835618 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390363c2-d937-4252-b843-6b1944ad6062 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:44.874303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecf617-1a2b-41ea-a84c-9f6744f10d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:44.875076 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecf617-1a2b-41ea-a84c-9f6744f10d71 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:44.875358 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecf617-1a2b-41ea-a84c-9f6744f10d71 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:44.875636 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecf617-1a2b-41ea-a84c-9f6744f10d71 None admin] PATH_INFO: `/v3/users` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:44.876520 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecf617-1a2b-41ea-a84c-9f6744f10d71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:44.876832 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecf617-1a2b-41ea-a84c-9f6744f10d71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:44.878861 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecf617-1a2b-41ea-a84c-9f6744f10d71 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:44.897918 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 644/1281] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 19:46:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:44.907618 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10de67-42ce-47ad-a9c4-2fbfd7c0e2e2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:45.062209 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:45.078128 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10de67-42ce-47ad-a9c4-2fbfd7c0e2e2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:45.148901 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b636c76-391b-4868-8cd1-68c0d3840491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:45.149576 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b636c76-391b-4868-8cd1-68c0d3840491 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:45.149861 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b636c76-391b-4868-8cd1-68c0d3840491 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:45.150138 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b636c76-391b-4868-8cd1-68c0d3840491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:45.250444 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b636c76-391b-4868-8cd1-68c0d3840491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:45.251980 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b636c76-391b-4868-8cd1-68c0d3840491 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:45.353442 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:45.365109 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 638/1282] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 19:46:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:46:45.371274 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecf617-1a2b-41ea-a84c-9f6744f10d71 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:45.436158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:45.475864 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecf617-1a2b-41ea-a84c-9f6744f10d71 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:45.533566 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56419f8f-7751-4b33-8a62-6c27e64965d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:45.534584 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419f8f-7751-4b33-8a62-6c27e64965d3 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:45.535010 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419f8f-7751-4b33-8a62-6c27e64965d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:45.535381 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419f8f-7751-4b33-8a62-6c27e64965d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:45.551494 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56419f8f-7751-4b33-8a62-6c27e64965d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:45.553058 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56419f8f-7751-4b33-8a62-6c27e64965d3 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-56419f8f-7751-4b33-8a62-6c27e64965d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:46:45.572940 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:45.574781 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:45.576626 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:46:45.576626 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:46:45.576626 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:46:45.576626 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:45.576626 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 645/1283] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 19:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:45.580969 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b636c76-391b-4868-8cd1-68c0d3840491 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:45.753395 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b636c76-391b-4868-8cd1-68c0d3840491 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:45.813500 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e28dd-aa9d-47b5-b4f8-97fb51dc8a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:45.814685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e28dd-aa9d-47b5-b4f8-97fb51dc8a04 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:45.815206 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e28dd-aa9d-47b5-b4f8-97fb51dc8a04 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:45.815747 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e28dd-aa9d-47b5-b4f8-97fb51dc8a04 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:45.822372 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e28dd-aa9d-47b5-b4f8-97fb51dc8a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:45.822372 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e28dd-aa9d-47b5-b4f8-97fb51dc8a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:45.822372 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e28dd-aa9d-47b5-b4f8-97fb51dc8a04 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:45.833785 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 639/1284] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 19:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:45.843100 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56419f8f-7751-4b33-8a62-6c27e64965d3 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:46.022507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56419f8f-7751-4b33-8a62-6c27e64965d3 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:46.048424 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:46.074459 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78fe57-718a-4c53-a10f-44f807bfcf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:46.075342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78fe57-718a-4c53-a10f-44f807bfcf0d None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:46.075622 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78fe57-718a-4c53-a10f-44f807bfcf0d None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:46.075894 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78fe57-718a-4c53-a10f-44f807bfcf0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:46.084072 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78fe57-718a-4c53-a10f-44f807bfcf0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:46.088287 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78fe57-718a-4c53-a10f-44f807bfcf0d None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application [None req-ba78fe57-718a-4c53-a10f-44f807bfcf0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:46:46.101615 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application with Lock( May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:46.103493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:46.105550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:46:46.105550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:46:46.105550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:46:46.105550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:46:46.105550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:46:46.105550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:46:46.105550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:46:46.105550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: ERROR keystone.server.flask.application May 19 19:46:46.105550 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 646/1285] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 19:46:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:46.110511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e28dd-aa9d-47b5-b4f8-97fb51dc8a04 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:46.164006 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:46.217617 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e28dd-aa9d-47b5-b4f8-97fb51dc8a04 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:46.253535 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21016c-d13c-4821-aa5d-a2f5ce4cb59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:46.254204 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21016c-d13c-4821-aa5d-a2f5ce4cb59c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:46.254486 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21016c-d13c-4821-aa5d-a2f5ce4cb59c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:46.254795 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21016c-d13c-4821-aa5d-a2f5ce4cb59c None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:46.255596 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21016c-d13c-4821-aa5d-a2f5ce4cb59c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:46.255905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21016c-d13c-4821-aa5d-a2f5ce4cb59c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:46.257439 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21016c-d13c-4821-aa5d-a2f5ce4cb59c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:46.271556 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 640/1286] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 19:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:46.278595 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78fe57-718a-4c53-a10f-44f807bfcf0d None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:46.394815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78fe57-718a-4c53-a10f-44f807bfcf0d None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:46.431457 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375d1d2-274f-4292-9ba9-7d1697c5890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:46.432195 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d1d2-274f-4292-9ba9-7d1697c5890f None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:46.432519 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d1d2-274f-4292-9ba9-7d1697c5890f None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:46.432853 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d1d2-274f-4292-9ba9-7d1697c5890f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:46.433749 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375d1d2-274f-4292-9ba9-7d1697c5890f None admin] RBAC: Adding query filter params (role.id=4f7e6c1b02094f72ae978c3558b530a9, scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1, user.id=c6b72e01aa994693afe5d7199a799162) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:46.434119 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375d1d2-274f-4292-9ba9-7d1697c5890f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:46.435715 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375d1d2-274f-4292-9ba9-7d1697c5890f None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:46.443347 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 647/1287] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 19:46:46 2022] GET /identity/v3/role_assignments?user.id=c6b72e01aa994693afe5d7199a799162&scope.project.id=5f01cea6d6914f42a832ed81a6fe94e1&role.id=4f7e6c1b02094f72ae978c3558b530a9 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:48.881435 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78afb4-9d81-4504-ab08-8055e9ff2ba2 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:48.882015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78afb4-9d81-4504-ab08-8055e9ff2ba2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:48.882015 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78afb4-9d81-4504-ab08-8055e9ff2ba2 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:48.883753 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 641/1288] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:48.890259 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700bb02-03a3-42e9-9104-f8b1fe77f2e1 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:48.891123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700bb02-03a3-42e9-9104-f8b1fe77f2e1 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:48.891123 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700bb02-03a3-42e9-9104-f8b1fe77f2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:48.911813 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-0700bb02-03a3-42e9-9104-f8b1fe77f2e1 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:48.913319 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-0700bb02-03a3-42e9-9104-f8b1fe77f2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:48.949412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:48.990868 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 648/1289] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:46:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:46:49.015192 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78afb4-9d81-4504-ab08-8055e9ff2ba2 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:49.126160 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78afb4-9d81-4504-ab08-8055e9ff2ba2 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:49.138229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:49.165976 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b857f3c-5d86-41e9-bb63-bd281a015f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:49.166881 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b857f3c-5d86-41e9-bb63-bd281a015f64 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:49.167210 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b857f3c-5d86-41e9-bb63-bd281a015f64 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:49.167522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b857f3c-5d86-41e9-bb63-bd281a015f64 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:49.168229 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b857f3c-5d86-41e9-bb63-bd281a015f64 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:49.169699 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b857f3c-5d86-41e9-bb63-bd281a015f64 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-6b857f3c-5d86-41e9-bb63-bd281a015f64 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:49.182757 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:49.184887 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:49.186692 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 642/1290] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 19:46:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:49.191663 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700bb02-03a3-42e9-9104-f8b1fe77f2e1 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:49.320982 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700bb02-03a3-42e9-9104-f8b1fe77f2e1 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:49.358196 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb0587-977a-4cd9-9a38-45f82187d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:49.358993 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb0587-977a-4cd9-9a38-45f82187d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:49.359318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb0587-977a-4cd9-9a38-45f82187d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:49.359637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb0587-977a-4cd9-9a38-45f82187d9b0 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:49.360401 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb0587-977a-4cd9-9a38-45f82187d9b0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:49.360747 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb0587-977a-4cd9-9a38-45f82187d9b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:49.362185 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb0587-977a-4cd9-9a38-45f82187d9b0 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:49.367663 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 649/1291] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 19:46:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:49.373997 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b857f3c-5d86-41e9-bb63-bd281a015f64 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:49.488458 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b857f3c-5d86-41e9-bb63-bd281a015f64 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:49.526205 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af470d-d2d2-41ee-8226-9e8724ec4d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:49.526959 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af470d-d2d2-41ee-8226-9e8724ec4d63 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:49.527304 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af470d-d2d2-41ee-8226-9e8724ec4d63 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:49.527621 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af470d-d2d2-41ee-8226-9e8724ec4d63 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:49.528419 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af470d-d2d2-41ee-8226-9e8724ec4d63 None admin] RBAC: Adding query filter params (type=placement) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:49.528762 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af470d-d2d2-41ee-8226-9e8724ec4d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:49.530269 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af470d-d2d2-41ee-8226-9e8724ec4d63 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:49.535275 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 643/1292] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 19:46:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:51.913861 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbaa13-291d-4ed0-8cb4-170523654a74 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:51.914393 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbaa13-291d-4ed0-8cb4-170523654a74 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:51.914393 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbaa13-291d-4ed0-8cb4-170523654a74 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:51.915850 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 650/1293] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:51.921547 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3769c-355d-4785-b6a6-68519cb51c38 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:51.922021 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3769c-355d-4785-b6a6-68519cb51c38 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:51.925839 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3769c-355d-4785-b6a6-68519cb51c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:51.941187 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-dee3769c-355d-4785-b6a6-68519cb51c38 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:51.942432 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dee3769c-355d-4785-b6a6-68519cb51c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:51.974463 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:52.027197 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 644/1294] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:46:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:46:52.050318 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbaa13-291d-4ed0-8cb4-170523654a74 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:52.086399 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:52.165449 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbaa13-291d-4ed0-8cb4-170523654a74 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:52.204197 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411301ea-b355-42bc-8d0b-e26b45e03921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:52.204863 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411301ea-b355-42bc-8d0b-e26b45e03921 None admin] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:52.205147 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411301ea-b355-42bc-8d0b-e26b45e03921 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:52.205424 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411301ea-b355-42bc-8d0b-e26b45e03921 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:52.206285 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411301ea-b355-42bc-8d0b-e26b45e03921 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:52.207733 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411301ea-b355-42bc-8d0b-e26b45e03921 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:52.283853 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 651/1295] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 19:46:52 2022] POST /identity/v3/services => generated 246 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:46:54.584014 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfd17e-46e1-4400-809c-9d103d9a031c None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:54.584532 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfd17e-46e1-4400-809c-9d103d9a031c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:54.584532 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfd17e-46e1-4400-809c-9d103d9a031c None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:54.585919 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 645/1296] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:54.592329 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292cd38-739a-40ac-b898-1888ffe5b5e1 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:54.593117 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292cd38-739a-40ac-b898-1888ffe5b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:54.593270 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292cd38-739a-40ac-b898-1888ffe5b5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:54.613930 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-3292cd38-739a-40ac-b898-1888ffe5b5e1 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:54.615408 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-3292cd38-739a-40ac-b898-1888ffe5b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:54.697200 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 652/1297] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:46:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:46:54.721772 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfd17e-46e1-4400-809c-9d103d9a031c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:54.864630 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfd17e-46e1-4400-809c-9d103d9a031c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:54.915247 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff10c0d-0dc1-4d6b-a8a6-446482f2ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:54.916209 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff10c0d-0dc1-4d6b-a8a6-446482f2ed1b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:54.916645 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff10c0d-0dc1-4d6b-a8a6-446482f2ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:54.917035 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff10c0d-0dc1-4d6b-a8a6-446482f2ed1b None admin] PATH_INFO: `/v3/services/placement` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:54.917894 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff10c0d-0dc1-4d6b-a8a6-446482f2ed1b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:54.919513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff10c0d-0dc1-4d6b-a8a6-446482f2ed1b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-bff10c0d-0dc1-4d6b-a8a6-446482f2ed1b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:54.933628 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:54.935129 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:54.936582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 646/1298] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 19:46:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:54.942891 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292cd38-739a-40ac-b898-1888ffe5b5e1 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:54.965232 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:55.078518 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292cd38-739a-40ac-b898-1888ffe5b5e1 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:55.131919 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df447600-865d-492d-888d-623b105f5654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:55.132587 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df447600-865d-492d-888d-623b105f5654 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:55.132914 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df447600-865d-492d-888d-623b105f5654 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:55.133230 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df447600-865d-492d-888d-623b105f5654 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:55.134169 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df447600-865d-492d-888d-623b105f5654 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:55.134529 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df447600-865d-492d-888d-623b105f5654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:55.136090 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df447600-865d-492d-888d-623b105f5654 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:55.142306 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 653/1299] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 19:46:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:55.149231 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff10c0d-0dc1-4d6b-a8a6-446482f2ed1b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:55.185144 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:55.269447 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff10c0d-0dc1-4d6b-a8a6-446482f2ed1b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:55.320096 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a218d5a-2584-4863-8195-7075f0f06f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:55.320846 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a218d5a-2584-4863-8195-7075f0f06f74 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:55.321172 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a218d5a-2584-4863-8195-7075f0f06f74 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:55.321492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a218d5a-2584-4863-8195-7075f0f06f74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:55.322366 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a218d5a-2584-4863-8195-7075f0f06f74 None admin] RBAC: Adding query filter params (interface=public, service_id=c2a91dbf7e4b4040a31ec8756b44b007, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:55.323423 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a218d5a-2584-4863-8195-7075f0f06f74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:55.325943 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a218d5a-2584-4863-8195-7075f0f06f74 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:55.335629 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 647/1300] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 19:46:55 2022] GET /identity/v3/endpoints?service_id=c2a91dbf7e4b4040a31ec8756b44b007&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:55.342356 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df447600-865d-492d-888d-623b105f5654 None admin] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:55.448068 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:55.468044 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df447600-865d-492d-888d-623b105f5654 None admin] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:55.506501 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2edfac-135c-46cf-a63c-9aaa01623321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:55.507190 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2edfac-135c-46cf-a63c-9aaa01623321 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:55.507475 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2edfac-135c-46cf-a63c-9aaa01623321 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:55.507750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2edfac-135c-46cf-a63c-9aaa01623321 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:55.508439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2edfac-135c-46cf-a63c-9aaa01623321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:55.509880 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2edfac-135c-46cf-a63c-9aaa01623321 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:55.517314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 654/1301] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 19:46:55 2022] GET /identity/v3/services => generated 2191 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:46:57.954511 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0f851-032f-40d4-8062-052c4f57f8f0 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:57.955169 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0f851-032f-40d4-8062-052c4f57f8f0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:57.955169 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0f851-032f-40d4-8062-052c4f57f8f0 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:57.957178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 648/1302] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:57.963153 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f1b5-3830-4f92-8f9c-bdad9a0eeefd None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:57.963720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f1b5-3830-4f92-8f9c-bdad9a0eeefd None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:57.963720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f1b5-3830-4f92-8f9c-bdad9a0eeefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:57.981703 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-c2a0f1b5-3830-4f92-8f9c-bdad9a0eeefd None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:57.982937 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-c2a0f1b5-3830-4f92-8f9c-bdad9a0eeefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:58.055467 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 655/1303] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:46:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:46:58.078749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0f851-032f-40d4-8062-052c4f57f8f0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:58.212254 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:58.219873 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0f851-032f-40d4-8062-052c4f57f8f0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:58.255733 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223fcf-e121-4556-b479-76515d65019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:58.256594 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223fcf-e121-4556-b479-76515d65019c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:58.256932 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223fcf-e121-4556-b479-76515d65019c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:58.257264 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223fcf-e121-4556-b479-76515d65019c None admin] PATH_INFO: `/v3/services/placement` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:58.257978 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db223fcf-e121-4556-b479-76515d65019c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:58.259521 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db223fcf-e121-4556-b479-76515d65019c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-db223fcf-e121-4556-b479-76515d65019c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:58.273398 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:58.274835 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application May 19 19:46:58.276615 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 649/1304] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 19:46:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:46:58.281314 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0f1b5-3830-4f92-8f9c-bdad9a0eeefd None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:58.419312 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:58.461510 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0f1b5-3830-4f92-8f9c-bdad9a0eeefd None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:58.514008 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683229f-9d36-4832-aa1e-f1373e81af22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:58.514587 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683229f-9d36-4832-aa1e-f1373e81af22 None admin] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:58.514898 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683229f-9d36-4832-aa1e-f1373e81af22 None admin] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:58.515196 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683229f-9d36-4832-aa1e-f1373e81af22 None admin] PATH_INFO: `/v3/services` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:58.515902 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683229f-9d36-4832-aa1e-f1373e81af22 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92089) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:58.516214 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683229f-9d36-4832-aa1e-f1373e81af22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:58.517653 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683229f-9d36-4832-aa1e-f1373e81af22 None admin] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:58.523704 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 656/1305] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 19:46:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:58.529745 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223fcf-e121-4556-b479-76515d65019c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:58.651171 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223fcf-e121-4556-b479-76515d65019c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:58.713702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715a956-815a-4a77-bae8-6df2de440eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64713eb0c74847f6b1357f2125edd3b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:58.714885 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a956-815a-4a77-bae8-6df2de440eca None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:58.715393 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a956-815a-4a77-bae8-6df2de440eca None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:58.715898 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a956-815a-4a77-bae8-6df2de440eca None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:58.717555 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715a956-815a-4a77-bae8-6df2de440eca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:58.720378 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715a956-815a-4a77-bae8-6df2de440eca None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:58.835840 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 650/1306] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 19:46:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:47:08.520456 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=30 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:08.829307 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:53:50.358507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e6a9-25f8-40b0-9228-8a309816b37a None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:53:50.359464 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e6a9-25f8-40b0-9228-8a309816b37a None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:53:50.359895 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e6a9-25f8-40b0-9228-8a309816b37a None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:53:50.367596 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0519b-33e5-4e49-9752-f1a6defb4e83 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:53:50.368489 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0519b-33e5-4e49-9752-f1a6defb4e83 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:53:50.368942 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0519b-33e5-4e49-9752-f1a6defb4e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:53:50.372563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 657/1307] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:53:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:53:50.446953 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-9df0519b-33e5-4e49-9752-f1a6defb4e83 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:53:50.448399 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9df0519b-33e5-4e49-9752-f1a6defb4e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:53:50.583656 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 651/1308] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 19:53:50.616720 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e860a3-8169-4805-8fbd-c0177b78171e None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:53:50.617007 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e860a3-8169-4805-8fbd-c0177b78171e None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:53:50.617277 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e860a3-8169-4805-8fbd-c0177b78171e None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:53:50.618965 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 658/1309] 10.222.0.89 () {54 vars in 964 bytes} [Thu May 19 19:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:53:50.626669 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafff24-d972-4864-b01b-a90fb7057c71 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:53:50.627749 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafff24-d972-4864-b01b-a90fb7057c71 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:53:50.628637 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafff24-d972-4864-b01b-a90fb7057c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:53:50.723983 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ceafff24-d972-4864-b01b-a90fb7057c71 None None] MFA Rules not processed for user `096d4037981e4bd488e30d43485579bb`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:53:50.725153 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ceafff24-d972-4864-b01b-a90fb7057c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:53:50.747515 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:53:50.827770 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 652/1310] 10.222.0.89 () {58 vars in 1061 bytes} [Thu May 19 19:53:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:53:50.837040 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e860a3-8169-4805-8fbd-c0177b78171e None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:53:50.838820 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-73e860a3-8169-4805-8fbd-c0177b78171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:53:50.985238 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e860a3-8169-4805-8fbd-c0177b78171e None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:53:51.065972 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca00002-390e-41ae-bc16-c23a063d1390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:53:51.066571 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca00002-390e-41ae-bc16-c23a063d1390 service neutron] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:53:51.066899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca00002-390e-41ae-bc16-c23a063d1390 service neutron] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:53:51.067183 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca00002-390e-41ae-bc16-c23a063d1390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:53:51.069401 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-eca00002-390e-41ae-bc16-c23a063d1390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:53:51.128534 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:53:51.188488 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca00002-390e-41ae-bc16-c23a063d1390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:53:51.189962 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca00002-390e-41ae-bc16-c23a063d1390 service neutron] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:53:51.211507 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 659/1311] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:53:53.742716 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252528f-9975-472b-90a6-303f4e06203b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:53:53.743650 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252528f-9975-472b-90a6-303f4e06203b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:53:53.744112 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252528f-9975-472b-90a6-303f4e06203b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:53:53.745923 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 653/1312] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:53:53.751216 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e8215-098b-4fbf-b82f-d913caf16e4e None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:53:53.751759 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e8215-098b-4fbf-b82f-d913caf16e4e None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:53:53.751924 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e8215-098b-4fbf-b82f-d913caf16e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:53:53.865010 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-4a9e8215-098b-4fbf-b82f-d913caf16e4e None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:53:53.866887 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-4a9e8215-098b-4fbf-b82f-d913caf16e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:53:53.972226 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 660/1313] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:53:54.011498 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252528f-9975-472b-90a6-303f4e06203b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:53:54.013097 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8252528f-9975-472b-90a6-303f4e06203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:53:54.128582 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252528f-9975-472b-90a6-303f4e06203b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:53:54.205027 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:53:54.207640 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b46f0-4ec0-4516-ba63-259795cbfb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:53:54.208491 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b46f0-4ec0-4516-ba63-259795cbfb69 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:53:54.209316 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b46f0-4ec0-4516-ba63-259795cbfb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:53:54.209591 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b46f0-4ec0-4516-ba63-259795cbfb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:53:54.211369 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a95b46f0-4ec0-4516-ba63-259795cbfb69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:53:54.335918 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b46f0-4ec0-4516-ba63-259795cbfb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:53:54.337545 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b46f0-4ec0-4516-ba63-259795cbfb69 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:53:54.359566 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 654/1314] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:53:57.252107 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf233f9-a41a-4556-8e9c-e1ae53f76443 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:53:57.252643 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf233f9-a41a-4556-8e9c-e1ae53f76443 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:53:57.252740 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf233f9-a41a-4556-8e9c-e1ae53f76443 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:53:57.254109 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 661/1315] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:53:57.259751 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6298-1097-4058-9d4e-3312bcd850e6 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:53:57.260172 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6298-1097-4058-9d4e-3312bcd850e6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:53:57.260315 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6298-1097-4058-9d4e-3312bcd850e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:53:57.325323 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-bb8a6298-1097-4058-9d4e-3312bcd850e6 None None] MFA Rules not processed for user `21eb078de33942d0b8933741472428d0`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:53:57.326532 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-bb8a6298-1097-4058-9d4e-3312bcd850e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:53:57.379613 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:53:57.424422 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 655/1316] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:53:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:53:57.464423 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf233f9-a41a-4556-8e9c-e1ae53f76443 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:53:57.465967 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-daf233f9-a41a-4556-8e9c-e1ae53f76443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:53:57.475796 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:53:57.569017 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf233f9-a41a-4556-8e9c-e1ae53f76443 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:53:57.645768 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47eedc-c2ee-4be4-81f1-1536644b3864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:53:57.646968 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47eedc-c2ee-4be4-81f1-1536644b3864 service neutron] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:53:57.647482 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47eedc-c2ee-4be4-81f1-1536644b3864 service neutron] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:53:57.647998 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47eedc-c2ee-4be4-81f1-1536644b3864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:53:57.651300 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-7d47eedc-c2ee-4be4-81f1-1536644b3864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:53:57.717355 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:53:57.764371 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47eedc-c2ee-4be4-81f1-1536644b3864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:53:57.765815 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47eedc-c2ee-4be4-81f1-1536644b3864 service neutron] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:53:57.783735 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 662/1317] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:53:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:00.918834 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963b289-1802-4318-8d0c-946ad89b2cb4 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:00.919439 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963b289-1802-4318-8d0c-946ad89b2cb4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:00.919439 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963b289-1802-4318-8d0c-946ad89b2cb4 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:00.920755 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 656/1318] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:00.926018 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be36c20-2b70-40ec-bf45-1b338ddd02b9 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:00.926464 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be36c20-2b70-40ec-bf45-1b338ddd02b9 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:00.926587 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be36c20-2b70-40ec-bf45-1b338ddd02b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:00.992055 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-1be36c20-2b70-40ec-bf45-1b338ddd02b9 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:00.993257 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-1be36c20-2b70-40ec-bf45-1b338ddd02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:01.088668 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 663/1319] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:01.127733 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963b289-1802-4318-8d0c-946ad89b2cb4 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:01.129270 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3963b289-1802-4318-8d0c-946ad89b2cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:01.231798 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963b289-1802-4318-8d0c-946ad89b2cb4 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:01.306045 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4d84f-cf4e-404f-ab62-4ab1ac7058f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:01.306980 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d84f-cf4e-404f-ab62-4ab1ac7058f1 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:01.307265 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d84f-cf4e-404f-ab62-4ab1ac7058f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:01.307540 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d84f-cf4e-404f-ab62-4ab1ac7058f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:01.309267 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-52c4d84f-cf4e-404f-ab62-4ab1ac7058f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:01.316702 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:01.416347 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4d84f-cf4e-404f-ab62-4ab1ac7058f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:01.417794 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4d84f-cf4e-404f-ab62-4ab1ac7058f1 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:01.435860 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 657/1320] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 19:54:04.673899 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b432-6c5a-4eb8-b78d-02ee2da948d1 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:04.674439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b432-6c5a-4eb8-b78d-02ee2da948d1 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:04.674439 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b432-6c5a-4eb8-b78d-02ee2da948d1 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:04.675937 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 664/1321] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:04.681338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189d9b1-cc9f-43bd-ad63-39d05938a456 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:04.682023 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189d9b1-cc9f-43bd-ad63-39d05938a456 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:04.682162 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189d9b1-cc9f-43bd-ad63-39d05938a456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:04.749262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3189d9b1-cc9f-43bd-ad63-39d05938a456 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:04.750477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3189d9b1-cc9f-43bd-ad63-39d05938a456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:04.808804 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:04.847709 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 658/1322] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:04.883930 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8b432-6c5a-4eb8-b78d-02ee2da948d1 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:04.885849 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-95a8b432-6c5a-4eb8-b78d-02ee2da948d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:04.905511 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:04.990438 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8b432-6c5a-4eb8-b78d-02ee2da948d1 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:05.064030 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfa60e-555c-4bab-8bc0-5fe9c70c7735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:05.064695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfa60e-555c-4bab-8bc0-5fe9c70c7735 service neutron] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:05.064981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfa60e-555c-4bab-8bc0-5fe9c70c7735 service neutron] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:05.065261 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfa60e-555c-4bab-8bc0-5fe9c70c7735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:05.066965 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-02dfa60e-555c-4bab-8bc0-5fe9c70c7735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:05.139880 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:05.179172 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfa60e-555c-4bab-8bc0-5fe9c70c7735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:05.180611 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfa60e-555c-4bab-8bc0-5fe9c70c7735 service neutron] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:05.199158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 665/1323] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:07.510011 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e28e83-610b-4976-af51-0157dbf9dc35 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:07.510685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e28e83-610b-4976-af51-0157dbf9dc35 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:07.510685 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e28e83-610b-4976-af51-0157dbf9dc35 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:07.511972 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 659/1324] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:07.517601 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7b75-fd80-485d-9d1f-da8d9655e99a None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:07.518056 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7b75-fd80-485d-9d1f-da8d9655e99a None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:07.518163 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7b75-fd80-485d-9d1f-da8d9655e99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:07.709922 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-6edb7b75-fd80-485d-9d1f-da8d9655e99a None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:07.711117 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-6edb7b75-fd80-485d-9d1f-da8d9655e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:07.816859 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 666/1325] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:07.853597 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e28e83-610b-4976-af51-0157dbf9dc35 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:07.855165 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c3e28e83-610b-4976-af51-0157dbf9dc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:07.962109 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e28e83-610b-4976-af51-0157dbf9dc35 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:08.039491 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc4378-a44a-4b81-af29-14524b8bf1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:08.040035 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc4378-a44a-4b81-af29-14524b8bf1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:08.040299 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc4378-a44a-4b81-af29-14524b8bf1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:08.040717 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc4378-a44a-4b81-af29-14524b8bf1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:08.042504 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-91bc4378-a44a-4b81-af29-14524b8bf1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:08.059501 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:08.152953 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc4378-a44a-4b81-af29-14524b8bf1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:08.154454 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc4378-a44a-4b81-af29-14524b8bf1b6 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:08.173543 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 660/1326] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:10.472012 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28532d-693a-4fbe-9929-dfc7a28ba602 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:10.472558 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28532d-693a-4fbe-9929-dfc7a28ba602 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:10.472558 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28532d-693a-4fbe-9929-dfc7a28ba602 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:10.474595 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 667/1327] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:10.480010 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836ce59-253d-48c4-8ff7-6ad281726f35 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:10.480445 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836ce59-253d-48c4-8ff7-6ad281726f35 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:10.480578 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836ce59-253d-48c4-8ff7-6ad281726f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:10.547759 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-8836ce59-253d-48c4-8ff7-6ad281726f35 None None] MFA Rules not processed for user `21eb078de33942d0b8933741472428d0`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:10.548890 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8836ce59-253d-48c4-8ff7-6ad281726f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:10.613184 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:10.644419 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 661/1328] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:10.681981 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28532d-693a-4fbe-9929-dfc7a28ba602 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:10.683521 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-6b28532d-693a-4fbe-9929-dfc7a28ba602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:10.720674 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:10.793701 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28532d-693a-4fbe-9929-dfc7a28ba602 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:10.867881 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5714a1-35a0-4395-8616-5ba12bb943bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:10.868530 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5714a1-35a0-4395-8616-5ba12bb943bf service neutron] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:10.868812 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5714a1-35a0-4395-8616-5ba12bb943bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:10.869088 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5714a1-35a0-4395-8616-5ba12bb943bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:10.870750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-7b5714a1-35a0-4395-8616-5ba12bb943bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:10.948768 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:10.982140 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5714a1-35a0-4395-8616-5ba12bb943bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:10.983605 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5714a1-35a0-4395-8616-5ba12bb943bf service neutron] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:11.001647 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 668/1329] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:13.687578 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb592-8cee-4dc8-b449-d225ca14affb None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:13.688150 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb592-8cee-4dc8-b449-d225ca14affb None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:13.688263 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb592-8cee-4dc8-b449-d225ca14affb None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:13.689648 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 662/1330] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:13.695003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eecee-2130-4786-90e9-f43d21d27c64 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:13.695464 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eecee-2130-4786-90e9-f43d21d27c64 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:13.695569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eecee-2130-4786-90e9-f43d21d27c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:13.762170 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-223eecee-2130-4786-90e9-f43d21d27c64 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:13.763415 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-223eecee-2130-4786-90e9-f43d21d27c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:13.867945 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 669/1331] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:13.904303 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bb592-8cee-4dc8-b449-d225ca14affb None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:13.905826 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-933bb592-8cee-4dc8-b449-d225ca14affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:14.013809 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bb592-8cee-4dc8-b449-d225ca14affb None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:14.092927 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2ff3a-e8e3-4416-aff5-b53ed7d5f03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:14.093584 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2ff3a-e8e3-4416-aff5-b53ed7d5f03c service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:14.093868 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2ff3a-e8e3-4416-aff5-b53ed7d5f03c service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:14.094143 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2ff3a-e8e3-4416-aff5-b53ed7d5f03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:14.095844 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ecf2ff3a-e8e3-4416-aff5-b53ed7d5f03c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:14.125589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:14.213152 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2ff3a-e8e3-4416-aff5-b53ed7d5f03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:14.214705 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2ff3a-e8e3-4416-aff5-b53ed7d5f03c service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:14.234002 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 663/1332] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:16.560359 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e1462-1e51-4a2c-acb6-4a22459ad53f None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:16.560905 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e1462-1e51-4a2c-acb6-4a22459ad53f None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:16.560905 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e1462-1e51-4a2c-acb6-4a22459ad53f None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:16.562209 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 670/1333] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:16.567687 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e63350-caa8-4d87-b9ec-d5e4454d1d0f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:16.568109 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e63350-caa8-4d87-b9ec-d5e4454d1d0f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:16.568268 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e63350-caa8-4d87-b9ec-d5e4454d1d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:16.634764 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-57e63350-caa8-4d87-b9ec-d5e4454d1d0f None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:16.635987 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-57e63350-caa8-4d87-b9ec-d5e4454d1d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:16.710771 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:16.735053 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 664/1334] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:16.791144 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716111a1-a3f8-4bab-8cb0-1bb18828b0a3 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:16.791428 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716111a1-a3f8-4bab-8cb0-1bb18828b0a3 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:16.791700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716111a1-a3f8-4bab-8cb0-1bb18828b0a3 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:16.793101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 671/1335] 10.222.0.89 () {54 vars in 964 bytes} [Thu May 19 19:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:16.799311 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce92a-5d79-4f18-8851-6c43806fcedc None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:16.799675 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce92a-5d79-4f18-8851-6c43806fcedc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:16.799958 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce92a-5d79-4f18-8851-6c43806fcedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:16.876147 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c14ce92a-5d79-4f18-8851-6c43806fcedc None None] MFA Rules not processed for user `096d4037981e4bd488e30d43485579bb`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:16.877352 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c14ce92a-5d79-4f18-8851-6c43806fcedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:16.955522 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 665/1336] 10.222.0.89 () {58 vars in 1061 bytes} [Thu May 19 19:54:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:16.965395 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716111a1-a3f8-4bab-8cb0-1bb18828b0a3 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:16.966983 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-716111a1-a3f8-4bab-8cb0-1bb18828b0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:17.011415 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:17.074563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716111a1-a3f8-4bab-8cb0-1bb18828b0a3 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:17.146695 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa879d5-0bc0-4cc4-80dd-8252df740126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:17.147281 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa879d5-0bc0-4cc4-80dd-8252df740126 service neutron] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:17.147563 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa879d5-0bc0-4cc4-80dd-8252df740126 service neutron] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:17.147838 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa879d5-0bc0-4cc4-80dd-8252df740126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:17.149475 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-5aa879d5-0bc0-4cc4-80dd-8252df740126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:17.231979 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:17.258240 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa879d5-0bc0-4cc4-80dd-8252df740126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:17.259700 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa879d5-0bc0-4cc4-80dd-8252df740126 service neutron] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:17.281534 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 672/1337] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:20.632951 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c48e2-a4b3-47d3-9179-3d094e351ef5 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:20.633506 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c48e2-a4b3-47d3-9179-3d094e351ef5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:20.633506 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c48e2-a4b3-47d3-9179-3d094e351ef5 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:20.635087 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 666/1338] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:20.640333 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ec5a5-d568-44c2-aa76-b31e42c1b5b0 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:20.640930 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ec5a5-d568-44c2-aa76-b31e42c1b5b0 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:20.640930 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ec5a5-d568-44c2-aa76-b31e42c1b5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:20.712298 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-566ec5a5-d568-44c2-aa76-b31e42c1b5b0 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:20.713485 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-566ec5a5-d568-44c2-aa76-b31e42c1b5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:20.807130 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 673/1339] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:20.844069 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c48e2-a4b3-47d3-9179-3d094e351ef5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:20.847645 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b72c48e2-a4b3-47d3-9179-3d094e351ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:20.929949 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:20.962513 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c48e2-a4b3-47d3-9179-3d094e351ef5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:20.966273 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c479a-ff30-4606-9dae-fddff3fea85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:20.966958 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c479a-ff30-4606-9dae-fddff3fea85a service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:20.967245 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c479a-ff30-4606-9dae-fddff3fea85a service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:20.967523 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c479a-ff30-4606-9dae-fddff3fea85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:20.969294 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-756c479a-ff30-4606-9dae-fddff3fea85a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:21.072178 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c479a-ff30-4606-9dae-fddff3fea85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:21.073634 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c479a-ff30-4606-9dae-fddff3fea85a service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:21.092798 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 667/1340] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:25.859406 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04864a07-d1d0-482f-9502-76c2afcab566 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:25.859912 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04864a07-d1d0-482f-9502-76c2afcab566 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:25.860003 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04864a07-d1d0-482f-9502-76c2afcab566 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:25.861313 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 674/1341] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:25.867228 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c91d23-d500-4386-874d-97e258cd06f1 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:25.867666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c91d23-d500-4386-874d-97e258cd06f1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:25.867761 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c91d23-d500-4386-874d-97e258cd06f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:25.915139 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-50c91d23-d500-4386-874d-97e258cd06f1 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:25.916331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-50c91d23-d500-4386-874d-97e258cd06f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:25.981960 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:26.002859 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 668/1342] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:26.041502 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04864a07-d1d0-482f-9502-76c2afcab566 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:26.056870 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04864a07-d1d0-482f-9502-76c2afcab566 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:26.061210 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e913e3d-d31c-4a23-88c0-9405f71a65be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:26.062071 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913e3d-d31c-4a23-88c0-9405f71a65be service neutron] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:26.062493 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913e3d-d31c-4a23-88c0-9405f71a65be service neutron] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:26.062896 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913e3d-d31c-4a23-88c0-9405f71a65be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:26.074204 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e913e3d-d31c-4a23-88c0-9405f71a65be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:26.076101 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e913e3d-d31c-4a23-88c0-9405f71a65be service neutron] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:26.089111 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 675/1343] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:29.386743 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bae10-ed52-420a-9d71-3f9d21c0b4b5 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:29.387291 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bae10-ed52-420a-9d71-3f9d21c0b4b5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:29.387291 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bae10-ed52-420a-9d71-3f9d21c0b4b5 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:29.388706 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 669/1344] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:29.394125 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a9c06-c294-483e-8cfe-87bc76950e03 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:29.394541 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a9c06-c294-483e-8cfe-87bc76950e03 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:29.394751 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a9c06-c294-483e-8cfe-87bc76950e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:29.422854 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-832a9c06-c294-483e-8cfe-87bc76950e03 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:29.424031 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-832a9c06-c294-483e-8cfe-87bc76950e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:29.432624 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 676/1345] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:29.470492 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bae10-ed52-420a-9d71-3f9d21c0b4b5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:29.481625 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bae10-ed52-420a-9d71-3f9d21c0b4b5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:29.485153 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94992d56-5b71-464a-b123-6e324f4277d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:29.485783 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992d56-5b71-464a-b123-6e324f4277d5 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:29.486062 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992d56-5b71-464a-b123-6e324f4277d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:29.486334 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992d56-5b71-464a-b123-6e324f4277d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:29.496589 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94992d56-5b71-464a-b123-6e324f4277d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:29.498025 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94992d56-5b71-464a-b123-6e324f4277d5 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:29.508284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 670/1346] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:33.997437 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22f2b7-79a6-45b8-93e7-e94d1589614b None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:33.997986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22f2b7-79a6-45b8-93e7-e94d1589614b None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:33.997986 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22f2b7-79a6-45b8-93e7-e94d1589614b None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:33.999406 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 677/1347] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:34.004856 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf5cd-87ee-4b87-af6b-3b5149530764 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:34.005289 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf5cd-87ee-4b87-af6b-3b5149530764 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:34.005477 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf5cd-87ee-4b87-af6b-3b5149530764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:34.024383 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c8daf5cd-87ee-4b87-af6b-3b5149530764 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:34.025727 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c8daf5cd-87ee-4b87-af6b-3b5149530764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:34.034184 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 671/1348] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:34.072907 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22f2b7-79a6-45b8-93e7-e94d1589614b None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:34.083779 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22f2b7-79a6-45b8-93e7-e94d1589614b None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:34.087383 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eab21-438b-4764-bb74-c13a6e77341c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d4037981e4bd488e30d43485579bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:34.087959 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eab21-438b-4764-bb74-c13a6e77341c service neutron] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:34.088251 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eab21-438b-4764-bb74-c13a6e77341c service neutron] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:34.088516 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eab21-438b-4764-bb74-c13a6e77341c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:34.098108 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eab21-438b-4764-bb74-c13a6e77341c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:34.099646 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eab21-438b-4764-bb74-c13a6e77341c service neutron] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:34.109368 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 678/1349] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:39.445639 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c43f8d-6cc1-4970-b154-165a450888ab None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:39.446108 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c43f8d-6cc1-4970-b154-165a450888ab None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:39.446191 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c43f8d-6cc1-4970-b154-165a450888ab None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:39.447928 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 672/1350] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 19:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:39.453034 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbafb3-ca58-4894-9f56-bb99a0117660 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:39.453831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbafb3-ca58-4894-9f56-bb99a0117660 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:39.454309 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbafb3-ca58-4894-9f56-bb99a0117660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:39.458313 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:39.583842 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-42fbafb3-ca58-4894-9f56-bb99a0117660 None None] MFA Rules not processed for user `c6b72e01aa994693afe5d7199a799162`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:39.585146 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-42fbafb3-ca58-4894-9f56-bb99a0117660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:39.675266 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 679/1351] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 19:54:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:43.975409 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8226c-7950-4ab1-a40f-695118126616 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:43.976284 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8226c-7950-4ab1-a40f-695118126616 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:43.976545 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8226c-7950-4ab1-a40f-695118126616 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:43.978117 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 673/1352] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 19:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:43.983202 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22d7d-be7b-41b4-85d2-47409668fa98 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:43.984053 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22d7d-be7b-41b4-85d2-47409668fa98 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:43.984546 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22d7d-be7b-41b4-85d2-47409668fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:44.006038 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-57a22d7d-be7b-41b4-85d2-47409668fa98 None None] MFA Rules not processed for user `c6b72e01aa994693afe5d7199a799162`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:44.007909 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-57a22d7d-be7b-41b4-85d2-47409668fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:44.018412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 680/1353] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 19:54:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:44.019820 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=15 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:45.833261 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a179a0-ef9f-40e7-a3b5-63d80f7a5cf9 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:45.833949 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a179a0-ef9f-40e7-a3b5-63d80f7a5cf9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:45.834035 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a179a0-ef9f-40e7-a3b5-63d80f7a5cf9 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:45.836039 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 674/1354] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 19:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:45.841569 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af7860-6a10-462e-b662-34d75b15b235 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:45.842061 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af7860-6a10-462e-b662-34d75b15b235 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:45.842144 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af7860-6a10-462e-b662-34d75b15b235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:45.862019 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-94af7860-6a10-462e-b662-34d75b15b235 None None] MFA Rules not processed for user `c6b72e01aa994693afe5d7199a799162`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:45.863772 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-94af7860-6a10-462e-b662-34d75b15b235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:45.873511 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 681/1355] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 19:54:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 19:54:49.898484 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b479-a19e-48ee-9126-a92a04d75004 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:49.899287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b479-a19e-48ee-9126-a92a04d75004 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:49.899287 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b479-a19e-48ee-9126-a92a04d75004 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:49.900595 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 675/1356] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:49.909762 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bef4e-2ac1-431f-b2bb-3042997d66bc None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:49.914591 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bef4e-2ac1-431f-b2bb-3042997d66bc None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:49.914591 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bef4e-2ac1-431f-b2bb-3042997d66bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:49.950455 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-385bef4e-2ac1-431f-b2bb-3042997d66bc None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:49.952575 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-385bef4e-2ac1-431f-b2bb-3042997d66bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:49.966556 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 682/1357] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:50.039392 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5dba5-dec1-4ca2-9ee5-292cbacdd3f6 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:50.040074 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5dba5-dec1-4ca2-9ee5-292cbacdd3f6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:50.040878 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5dba5-dec1-4ca2-9ee5-292cbacdd3f6 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:50.042998 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 676/1358] 10.222.0.89 () {54 vars in 961 bytes} [Thu May 19 19:54:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:50.056831 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8b0af-f3f7-421a-b8f6-c4878be50a55 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:50.057631 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8b0af-f3f7-421a-b8f6-c4878be50a55 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:50.058342 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8b0af-f3f7-421a-b8f6-c4878be50a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:50.127592 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-3ca8b0af-f3f7-421a-b8f6-c4878be50a55 None None] MFA Rules not processed for user `84b4164dd21a4ec0bd3d50cd46d7d5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:50.129763 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-3ca8b0af-f3f7-421a-b8f6-c4878be50a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:50.205965 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=100 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:54:50.248470 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 683/1359] 10.222.0.89 () {58 vars in 1058 bytes} [Thu May 19 19:54:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:50.263926 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5dba5-dec1-4ca2-9ee5-292cbacdd3f6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:50.286388 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5dba5-dec1-4ca2-9ee5-292cbacdd3f6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:50.296084 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae6a2a-17fa-431e-856e-57fe9b3fa1fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b4164dd21a4ec0bd3d50cd46d7d5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:50.297114 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae6a2a-17fa-431e-856e-57fe9b3fa1fe service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:50.297577 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae6a2a-17fa-431e-856e-57fe9b3fa1fe service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:50.298034 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae6a2a-17fa-431e-856e-57fe9b3fa1fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:50.311115 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae6a2a-17fa-431e-856e-57fe9b3fa1fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:50.317788 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae6a2a-17fa-431e-856e-57fe9b3fa1fe service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:50.336987 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 677/1360] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 19:54:52.856674 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6f290-33e8-44ea-a1d6-f88a68c5b24e None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:52.857158 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6f290-33e8-44ea-a1d6-f88a68c5b24e None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:52.857329 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6f290-33e8-44ea-a1d6-f88a68c5b24e None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:52.858688 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 684/1361] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:52.864662 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13b5c2-5dbc-4cdf-bc81-30a120ef155d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:52.865086 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13b5c2-5dbc-4cdf-bc81-30a120ef155d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:52.865227 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13b5c2-5dbc-4cdf-bc81-30a120ef155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:52.884226 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-af13b5c2-5dbc-4cdf-bc81-30a120ef155d None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:52.885422 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-af13b5c2-5dbc-4cdf-bc81-30a120ef155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:52.893338 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 678/1362] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:52.938972 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6f290-33e8-44ea-a1d6-f88a68c5b24e None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:52.955202 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6f290-33e8-44ea-a1d6-f88a68c5b24e None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:52.961611 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83671962-baec-447c-a7e7-02b8e777ff2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b4164dd21a4ec0bd3d50cd46d7d5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:52.962266 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83671962-baec-447c-a7e7-02b8e777ff2c service nova] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:52.962552 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83671962-baec-447c-a7e7-02b8e777ff2c service nova] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:52.962867 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83671962-baec-447c-a7e7-02b8e777ff2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:52.972329 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83671962-baec-447c-a7e7-02b8e777ff2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:52.974532 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83671962-baec-447c-a7e7-02b8e777ff2c service nova] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:52.984565 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 685/1363] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:55.749627 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883565be-bf6b-4ce0-b50b-8e8d8717378f None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:55.751718 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883565be-bf6b-4ce0-b50b-8e8d8717378f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:55.752224 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883565be-bf6b-4ce0-b50b-8e8d8717378f None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:55.754300 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 679/1364] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:55.759730 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14994b-9c23-46a4-9a4d-c1f689bc1c72 None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:55.760644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14994b-9c23-46a4-9a4d-c1f689bc1c72 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:55.761303 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14994b-9c23-46a4-9a4d-c1f689bc1c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:55.780005 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-fc14994b-9c23-46a4-9a4d-c1f689bc1c72 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:55.781195 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-fc14994b-9c23-46a4-9a4d-c1f689bc1c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:55.789885 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 686/1365] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:55.838555 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b779-69b5-459b-80ba-e9aab558f222 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:55.839158 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b779-69b5-459b-80ba-e9aab558f222 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:55.839665 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b779-69b5-459b-80ba-e9aab558f222 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:55.841592 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 680/1366] 10.222.0.89 () {54 vars in 961 bytes} [Thu May 19 19:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:55.849670 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c098d-052b-41dd-9346-4ec134b8106f None None] REQUEST_METHOD: `POST` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:55.850000 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c098d-052b-41dd-9346-4ec134b8106f None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:55.850220 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c098d-052b-41dd-9346-4ec134b8106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:55.870418 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.auth.core [None req-944c098d-052b-41dd-9346-4ec134b8106f None None] MFA Rules not processed for user `84b4164dd21a4ec0bd3d50cd46d7d5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=92089) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:55.871644 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.fernet_utils [None req-944c098d-052b-41dd-9346-4ec134b8106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92089) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:55.881172 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 687/1367] 10.222.0.89 () {58 vars in 1058 bytes} [Thu May 19 19:54:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:55.893262 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60b779-69b5-459b-80ba-e9aab558f222 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:55.907586 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60b779-69b5-459b-80ba-e9aab558f222 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:55.913671 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759a87f-0fc9-4af0-8ef6-f45e8a1d8cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b4164dd21a4ec0bd3d50cd46d7d5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:55.914319 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759a87f-0fc9-4af0-8ef6-f45e8a1d8cba service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:55.914639 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759a87f-0fc9-4af0-8ef6-f45e8a1d8cba service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:55.914905 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759a87f-0fc9-4af0-8ef6-f45e8a1d8cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:55.923789 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759a87f-0fc9-4af0-8ef6-f45e8a1d8cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:55.926057 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759a87f-0fc9-4af0-8ef6-f45e8a1d8cba service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:55.936514 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 681/1368] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:54:56.584850 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fbba3-ea11-4c04-b650-a8ca524439a7 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:56.585176 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fbba3-ea11-4c04-b650-a8ca524439a7 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:56.585425 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fbba3-ea11-4c04-b650-a8ca524439a7 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:56.586819 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 688/1369] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:56.592976 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35428357-da51-465c-9963-b9cd5c3da959 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:56.593331 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35428357-da51-465c-9963-b9cd5c3da959 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:56.593666 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35428357-da51-465c-9963-b9cd5c3da959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:56.613970 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-35428357-da51-465c-9963-b9cd5c3da959 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:56.616174 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-35428357-da51-465c-9963-b9cd5c3da959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:56.629173 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 682/1370] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:54:58.452796 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dbb38-2b0f-45f9-9f38-c0431a43c469 None None] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:58.453240 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dbb38-2b0f-45f9-9f38-c0431a43c469 None None] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:58.453335 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dbb38-2b0f-45f9-9f38-c0431a43c469 None None] PATH_INFO: `/` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:58.454774 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 689/1371] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 19:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:54:58.461322 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894233a-24af-421a-96d9-762df15dbfa9 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:58.461808 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894233a-24af-421a-96d9-762df15dbfa9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:58.461907 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894233a-24af-421a-96d9-762df15dbfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:58.481161 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c894233a-24af-421a-96d9-762df15dbfa9 None None] MFA Rules not processed for user `64713eb0c74847f6b1357f2125edd3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:54:58.482360 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c894233a-24af-421a-96d9-762df15dbfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:54:58.491285 dv-cinder-841302-4-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 683/1372] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 19:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 19:54:58.535033 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dbb38-2b0f-45f9-9f38-c0431a43c469 None None] Authenticating user token {{(pid=92089) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:54:58.550454 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dbb38-2b0f-45f9-9f38-c0431a43c469 None None] Validating token access rules against request {{(pid=92089) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:54:58.556517 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be80fc3-223d-48c1-9a6c-80ff0188a406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b4164dd21a4ec0bd3d50cd46d7d5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f01cea6d6914f42a832ed81a6fe94e1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92089) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:54:58.557177 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80fc3-223d-48c1-9a6c-80ff0188a406 service nova] REQUEST_METHOD: `GET` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:54:58.557750 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80fc3-223d-48c1-9a6c-80ff0188a406 service nova] SCRIPT_NAME: `/identity` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:54:58.558026 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80fc3-223d-48c1-9a6c-80ff0188a406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92089) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:54:58.567778 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be80fc3-223d-48c1-9a6c-80ff0188a406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:54:58.569412 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be80fc3-223d-48c1-9a6c-80ff0188a406 service nova] RBAC: Authorization granted {{(pid=92089) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:54:58.579637 dv-cinder-841302-4-smb devstack@keystone.service[92089]: [pid: 92089|app: 0|req: 690/1373] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 19:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:55:08.475375 dv-cinder-841302-4-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=21 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:55:08.575162 dv-cinder-841302-4-smb devstack@keystone.service[92089]: DEBUG dbcounter [-] [92089] Writing DB stats keystone:SELECT=27 {{(pid=92089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:55:20.166706 dv-cinder-841302-4-smb devstack@keystone.service[92077]: Thu May 19 19:55:20 2022 - graceful shutdown triggered... May 19 19:55:20.167184 dv-cinder-841302-4-smb devstack@keystone.service[92088]: Gracefully killing worker 1 (pid: 92088)... May 19 19:55:20.166832 dv-cinder-841302-4-smb systemd[1]: Stopping Devstack devstack@keystone.service... May 19 19:55:20.167696 dv-cinder-841302-4-smb devstack@keystone.service[92089]: Gracefully killing worker 2 (pid: 92089)... May 19 19:55:21.167851 dv-cinder-841302-4-smb devstack@keystone.service[92077]: worker 1 buried after 1 seconds May 19 19:55:21.167851 dv-cinder-841302-4-smb devstack@keystone.service[92077]: worker 2 buried after 1 seconds May 19 19:55:21.167851 dv-cinder-841302-4-smb devstack@keystone.service[92077]: goodbye to uWSGI. May 19 19:55:21.169452 dv-cinder-841302-4-smb systemd[1]: devstack@keystone.service: Succeeded. May 19 19:55:21.170008 dv-cinder-841302-4-smb systemd[1]: Stopped Devstack devstack@keystone.service. May 19 20:02:00.936690 dv-cinder-841302-4-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 20:02:00.944178 dv-cinder-841302-4-smb devstack@keystone.service[156411]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 20:02:00.946175 dv-cinder-841302-4-smb devstack@keystone.service[156411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 20:02:00 2022] *** May 19 20:02:00.946175 dv-cinder-841302-4-smb devstack@keystone.service[156411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 20:02:00.946175 dv-cinder-841302-4-smb devstack@keystone.service[156411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 20:02:00.946175 dv-cinder-841302-4-smb devstack@keystone.service[156411]: nodename: dv-cinder-841302-4-smb May 19 20:02:00.946175 dv-cinder-841302-4-smb devstack@keystone.service[156411]: machine: x86_64 May 19 20:02:00.946175 dv-cinder-841302-4-smb devstack@keystone.service[156411]: clock source: unix May 19 20:02:00.946175 dv-cinder-841302-4-smb devstack@keystone.service[156411]: pcre jit disabled May 19 20:02:00.946739 dv-cinder-841302-4-smb devstack@keystone.service[156411]: detected number of CPU cores: 4 May 19 20:02:00.946739 dv-cinder-841302-4-smb devstack@keystone.service[156411]: current working directory: / May 19 20:02:00.946739 dv-cinder-841302-4-smb devstack@keystone.service[156411]: detected binary path: /usr/bin/uwsgi-core May 19 20:02:00.946739 dv-cinder-841302-4-smb devstack@keystone.service[156411]: your processes number limit is 47680 May 19 20:02:00.946739 dv-cinder-841302-4-smb devstack@keystone.service[156411]: your memory page size is 4096 bytes May 19 20:02:00.946739 dv-cinder-841302-4-smb devstack@keystone.service[156411]: detected max file descriptor number: 2048 May 19 20:02:00.946739 dv-cinder-841302-4-smb devstack@keystone.service[156411]: lock engine: pthread robust mutexes May 19 20:02:00.946739 dv-cinder-841302-4-smb devstack@keystone.service[156411]: thunder lock: enabled May 19 20:02:00.946739 dv-cinder-841302-4-smb devstack@keystone.service[156411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 20:02:00.946739 dv-cinder-841302-4-smb devstack@keystone.service[156411]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 20:02:00.993613 dv-cinder-841302-4-smb devstack@keystone.service[156411]: Python main interpreter initialized at 0x55d5092959c0 May 19 20:02:00.993613 dv-cinder-841302-4-smb devstack@keystone.service[156411]: python threads support enabled May 19 20:02:00.993613 dv-cinder-841302-4-smb devstack@keystone.service[156411]: your server socket listen backlog is limited to 100 connections May 19 20:02:00.993613 dv-cinder-841302-4-smb devstack@keystone.service[156411]: your mercy for graceful operations on workers is 90 seconds May 19 20:02:00.994063 dv-cinder-841302-4-smb devstack@keystone.service[156411]: mapped 403077 bytes (393 KB) for 2 cores May 19 20:02:00.994063 dv-cinder-841302-4-smb devstack@keystone.service[156411]: *** Operational MODE: preforking *** May 19 20:02:00.994346 dv-cinder-841302-4-smb devstack@keystone.service[156411]: *** uWSGI is running in multiple interpreter mode *** May 19 20:02:00.994346 dv-cinder-841302-4-smb devstack@keystone.service[156411]: spawned uWSGI master process (pid: 156411) May 19 20:02:00.994554 dv-cinder-841302-4-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 20:02:00.995734 dv-cinder-841302-4-smb devstack@keystone.service[156411]: spawned uWSGI worker 1 (pid: 156425, cores: 1) May 19 20:02:00.995734 dv-cinder-841302-4-smb devstack@keystone.service[156411]: spawned uWSGI worker 2 (pid: 156426, cores: 1) May 19 20:02:00.995734 dv-cinder-841302-4-smb devstack@keystone.service[156411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 20:02:06.783140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:02:06.783140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: from cryptography.utils import int_from_bytes May 19 20:02:06.784070 dv-cinder-841302-4-smb devstack@keystone.service[156426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:02:06.784070 dv-cinder-841302-4-smb devstack@keystone.service[156426]: from cryptography.utils import int_from_bytes May 19 20:02:06.784587 dv-cinder-841302-4-smb devstack@keystone.service[156425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:02:06.784587 dv-cinder-841302-4-smb devstack@keystone.service[156425]: from cryptography.utils import int_from_bytes May 19 20:02:06.784741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:02:06.784741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: from cryptography.utils import int_from_bytes May 19 20:02:06.834420 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 20:02:06.834687 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 20:02:06.834813 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] command line args: [] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 20:02:06.835071 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 20:02:06.835248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ================================================================================ {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 20:02:06.835505 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] admin_token = **** {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.835753 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] config_dir = [] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.835943 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.836125 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] config_source = [] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.836308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] debug = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.836511 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.837014 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.837133 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] insecure_debug = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.837312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.837562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.837796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] list_limit = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.837977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] log_config_append = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.838154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.838332 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] log_dir = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.838511 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] log_file = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.838777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.839028 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.839276 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.839527 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.839706 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.839884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.840132 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.840363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 20:02:06.840467 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.840597 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 20:02:06.840692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.840792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] command line args: [] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 20:02:06.840882 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.840982 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 20:02:06.841086 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.841189 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ================================================================================ {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 20:02:06.841280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.841378 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] admin_token = **** {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.841498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.841619 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] config_dir = [] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.841748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] notification_format = cadf {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.841889 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.842524 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] config_source = [] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.842668 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.842814 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] debug = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.842952 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.843143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.843241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.843332 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] publish_errors = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.843415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] insecure_debug = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.843507 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.843598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.843711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.843834 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.843932 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.844065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] list_limit = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.844169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.844254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] log_config_append = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.844343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.844432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.844559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] log_dir = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.844650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] standard_threads = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.844762 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] log_file = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.844849 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] strict_password_check = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.844938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.845042 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.845188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] use_eventlog = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.845303 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.845402 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] use_journal = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.845493 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.845588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] use_json = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.845679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.845770 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] use_stderr = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.845869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.845967 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] use_syslog = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.846078 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.846165 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] watch_log_file = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.846255 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.846364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.846467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.846559 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.846689 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.846815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.846917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.847058 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.847163 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.847311 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.847413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.847551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.847649 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.847802 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.847902 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] notification_format = cadf {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.848040 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.848150 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.848291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.848540 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.848634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.848750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] publish_errors = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.848850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.848942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.849033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.849160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.849272 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.849364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.849468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.849558 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.849702 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.849794 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.849952 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.850051 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] standard_threads = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.850189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.850290 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] strict_password_check = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.850448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.850538 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.850791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] use_eventlog = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.850878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.850968 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] use_journal = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.851053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.851142 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] use_json = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.851142 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] use_stderr = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.851310 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.851400 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] use_syslog = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.851502 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.851600 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] watch_log_file = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:02:06.851703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.851800 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.851928 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.852020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.852180 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.852290 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.852412 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.852542 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.852649 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.852734 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.852861 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.852960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.853097 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.853190 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.853347 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.853439 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.853597 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.853688 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.853828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.853920 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.854060 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.854166 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.854303 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.854406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.854549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.854690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.854817 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.854923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.855062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.855164 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.855294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.855409 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.855530 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.855620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.855764 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.855868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.855996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.856101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.856228 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.856322 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.856462 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.856556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.856694 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.856795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.856931 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.857037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.857180 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.857270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.857412 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.857530 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.857693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.857820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.857958 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.858058 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.859886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.860021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.860118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.860204 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.860305 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.860305 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.860460 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.860614 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.860614 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.860785 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.860876 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.860960 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.861049 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.861157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.861253 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.861338 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.861426 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.861516 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.861606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.861702 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.861798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.861903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.861986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.862075 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.862158 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.862253 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.862338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.862338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.862502 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.862585 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.862681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.862781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.862873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.862957 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.863049 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.863147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.863232 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.863336 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.863421 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.863504 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.863596 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.863727 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.863829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.863960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.864059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.864209 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.864311 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.864440 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.864576 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.864673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.864774 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.864895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.865007 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.865129 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.865220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.865363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.865463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.enabled = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.865597 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.865697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.865825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.865917 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.866074 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.866172 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.866307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.866405 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.866542 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.866730 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.866819 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.866920 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.867043 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.867146 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.867279 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.867388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.867508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.867605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.867741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.867832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.867977 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.868087 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.868231 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.868329 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.868474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.868594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.868719 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.868828 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.868955 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.869061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.869188 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.869295 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.869417 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.869525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.869647 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.869750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.869879 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.869976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.enabled = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.870115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.870219 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.870348 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.870439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.870589 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.870712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.870846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.870954 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.871081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.871181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.871315 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.871407 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.871552 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.871711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.871804 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.871985 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.872083 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.872232 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.872335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.872469 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] auth.external = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.872565 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.872704 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] auth.mapped = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.872796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.872951 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.873042 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.873188 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.873299 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.873988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] auth.password = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.874086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.874222 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] auth.token = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.874329 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.874466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.874558 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.874740 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] catalog.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.874833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.874971 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.875081 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.875209 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.875315 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.875440 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.875532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.875678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.875781 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.875912 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.876181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.876181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] credential.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.876365 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.876451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] credential.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.876541 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.876626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.876718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.876889 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.877003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.877129 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.877233 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.877376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.877486 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] auth.external = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.877614 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.877726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] auth.mapped = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.877885 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.877977 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.878143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.878246 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.878382 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.878492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] auth.password = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.878674 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] auth.token = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.878770 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.878875 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.878989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.879173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] catalog.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.879280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.879364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.879447 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.879564 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.879674 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.879813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.879906 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.880060 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.880160 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] federation.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.880290 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.880391 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.880525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] credential.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.880644 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] federation.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.880772 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] credential.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.880871 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.881021 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.881126 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.881268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.881366 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.881502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.881609 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.881773 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.881867 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.881952 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.882042 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.882210 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.882303 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.882460 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.882553 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.882715 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.882796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.882957 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.883057 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.883205 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.883299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.883459 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.883603 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.883760 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.883926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.884078 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.884215 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.884359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.884496 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.884634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.884771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] federation.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.884916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.885088 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.885221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.885326 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] federation.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.885415 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.885496 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.885596 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.885681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.885752 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.885839 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.885923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.886006 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.886093 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.886178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.886255 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.886332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.886415 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.886486 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.886702 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.886800 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.886952 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.887057 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.887186 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.887278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.887429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.887525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.887667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.887774 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.887896 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.887999 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.888127 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.888226 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.888356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.888459 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.888591 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.888673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.888863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.888992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.889650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.889751 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.889883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.889982 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.890117 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.890223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.890369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.890467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.890599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.890767 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.890857 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.890928 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.891107 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.891199 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.891355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.891464 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.891628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.891791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.891960 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.892109 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.892247 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.password = **** {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.892394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.892537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.892675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.892812 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.892965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.893117 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.893264 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.893401 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.893539 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.893683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.893821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.893821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.894105 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.894261 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.894417 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.894566 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.894766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.894766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.895046 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.895046 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.895336 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.895481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.895617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.895762 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.895931 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.896083 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.896223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.896360 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.896511 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.896648 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.896794 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.896932 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.897077 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.897215 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.897365 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.897502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.password = **** {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.897647 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.897786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.897933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.898072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.898208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.898346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.898507 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.898741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.898877 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.899024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.899173 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.899311 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.899459 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.899609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.899747 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.899912 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.900051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.900188 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.900335 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.900473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.900610 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.900760 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.900900 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.901061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.901208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.901346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.901495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.901633 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.901794 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.901952 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.902100 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.902246 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.902397 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.902550 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.902662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.902844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.903003 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.903115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.903249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.903382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.903528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.903677 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.903826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.903963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.904099 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.904243 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.904388 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.905070 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.905182 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] policy.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.905257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.905448 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.905638 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.905638 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.905921 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.905921 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.906178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.906327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] receipt.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.906479 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.906658 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.906808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.906961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.907108 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.907262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.907408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.907561 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.907726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.907872 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.908016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.908161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] resource.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.908306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.908465 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.908612 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.908762 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] resource.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.908900 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.909045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.909189 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.909327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.909477 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.909615 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.909764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.909916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] revoke.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.910068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.910206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.910365 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] policy.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.910504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.910739 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.910880 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] role.cache_time = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.911040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.911188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] role.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.911335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.911482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] role.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.911636 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] receipt.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.911777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] role.list_limit = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.911936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.912077 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.912232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.912385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.912541 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.912698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.912855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.913012 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.913160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.913300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.913446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] resource.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.913598 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.913743 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.913889 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.914062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] resource.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.914208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.914345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.914504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.914669 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.914807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.914959 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.915108 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.915246 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] revoke.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.915402 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.915539 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.915677 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.915907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.915907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] role.cache_time = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.916204 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.916351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] role.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.916504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.916650 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] role.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.916807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.916955 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] role.list_limit = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.917110 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.917250 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.917387 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.917541 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.917698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.917857 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.918002 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.918147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.918293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.918440 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.918440 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.918771 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.918920 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.919072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.919072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.919343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.919481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.919618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.919712 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.919800 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.919872 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.919951 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.920077 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.920213 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.920819 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.921088 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.921238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.921392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.921536 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.921693 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.921843 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] token.cache_time = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.921992 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.922132 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] token.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.922291 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.922431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.922570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.922750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] token.provider = fernet {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.922750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.923026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.923026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.923311 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.923459 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.923627 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.923808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.923951 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.924101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.924264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.924419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.924562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.924701 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.924858 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] trust.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.925013 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.925412 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.925567 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.925715 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.925870 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.926029 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.926179 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.926320 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.926459 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.926599 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.926817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.926966 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.927124 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] token.cache_time = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.927264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.927405 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] token.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.927544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.927691 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.927846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.connection = **** {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.927988 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] token.provider = fernet {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.928135 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.928284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.928432 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.928432 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.928698 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.928873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.929013 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.929169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.929283 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.929369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.929459 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.929556 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.929653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.929739 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.929831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] trust.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.929927 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930011 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930094 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930176 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930441 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930524 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930709 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930899 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.930985 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931174 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931259 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.connection = **** {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931615 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931761 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=156425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 20:02:06.931873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.931873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.932712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.932712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.932712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.932712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.932712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.932712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.932712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.932712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:02:06.932712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=156426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 20:02:06.957466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:06.957736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:06.957883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:06.960138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:06.960370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:06.960592 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:06.967706 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:06.970476 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:06.996795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:06.997085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:06.997612 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:06.997845 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.052125 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.052717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.105040 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.105313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.106023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.106262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.172711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.172927 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.173140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.173241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.173367 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.173463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.173588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.173695 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.173798 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.173895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.174056 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.174276 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.197279 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.197518 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.197695 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.197812 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.197930 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.198024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.198202 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.198293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.198377 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.198474 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.198560 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.198681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.198781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.198996 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.210742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.211140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.226030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.226263 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.226369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.226487 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.226580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.226803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.226893 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.226976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.227073 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.227166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.227260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.227353 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=156425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.227448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.227623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=156426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:02:07.244669 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.244876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:02:07.245216 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.245309 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.245418 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:02:07.245510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:02:07.245687 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.245788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.245950 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:02:07.246042 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.246207 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.246299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.246464 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.246565 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.246753 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.247014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.257572 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.257853 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.258124 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.258233 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.258407 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.258515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.258725 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.259013 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.267141 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.267767 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.270434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.270747 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.271032 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.271142 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.271365 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.271468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.271650 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.271754 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.271947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.272053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.272220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.272314 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.272497 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.272626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.272767 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.272872 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.273040 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.273132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.273310 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.273411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.273618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.273889 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.301016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.301679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.302711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.302950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.303384 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.303680 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.308244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.308537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.308809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.309059 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.309344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.309630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.316692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.316974 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.317670 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.317955 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.321608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.321898 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.322179 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.322460 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.322665 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.322763 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.322960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.323068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.323245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.323350 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.323527 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.323634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.323802 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.324080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.324352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.324626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.342771 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.343052 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.344025 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.344310 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.347604 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.348895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.351243 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.351540 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.352564 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.352861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.356523 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.357912 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.360218 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.361542 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.364036 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.364375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.364697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.365018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.365334 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.365436 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.365638 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.365733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.365929 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.366219 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.366497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.366842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.385251 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.385630 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.385901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.386175 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.386641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.387032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.387308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.387592 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.394818 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.396219 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.396550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.396827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.397950 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.398228 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.399900 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.400193 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.400486 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.400781 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.401061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.401327 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.401609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.401900 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.402185 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.402468 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.414515 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.414821 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.415106 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.415396 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.415678 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.415956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.416062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.416234 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.416336 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.416576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.416861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.417144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.417433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.417728 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.434763 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.436864 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.438583 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.440191 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.441920 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.443552 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.443671 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.445180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.445275 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.445476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.445762 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.446873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.447166 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.447453 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.453780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.455446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.455554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.457139 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.458785 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.459079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.459367 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.459645 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.460459 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.460753 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.461053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.461336 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.469070 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.469411 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.469695 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.470704 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.471004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.471287 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.477625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=156425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.477907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.478196 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.478475 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.478785 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.479070 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.479349 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.479534 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=156426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:02:07.479630 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.479824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.479927 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.480111 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.480222 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.480392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.480486 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.480653 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.480747 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.480937 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.481044 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.481197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=156425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.481292 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.481479 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.481763 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.482036 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.482329 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.482637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.482925 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.483190 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=156426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:02:07.521174 dv-cinder-841302-4-smb devstack@keystone.service[156425]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5092959c0 pid: 156425 (default app) May 19 20:02:07.523413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d5092959c0 pid: 156426 (default app) May 19 20:02:07.524582 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd587284-e03a-48b8-b4f5-29637be4f0b2 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:07.524883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd587284-e03a-48b8-b4f5-29637be4f0b2 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:07.525164 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd587284-e03a-48b8-b4f5-29637be4f0b2 None None] PATH_INFO: `/v3` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:07.529425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 1/1] 10.222.0.89 () {50 vars in 791 bytes} [Thu May 19 20:02:07 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:16.694005 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f13b2-4633-42d6-8fbc-48aaf6555f7a None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:16.694545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f13b2-4633-42d6-8fbc-48aaf6555f7a None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:16.694545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f13b2-4633-42d6-8fbc-48aaf6555f7a None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:16.698911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 1/2] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:02:16.705037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591d45-6b71-494e-a5ac-593536c5a059 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:16.705456 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591d45-6b71-494e-a5ac-593536c5a059 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:16.710820 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591d45-6b71-494e-a5ac-593536c5a059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:16.777000 dv-cinder-841302-4-smb devstack@keystone.service[156425]: INFO dbcounter [None req-d0591d45-6b71-494e-a5ac-593536c5a059 None None] Registered counter for database keystone May 19 20:02:16.800544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG oslo_db.sqlalchemy.engines [None req-d0591d45-6b71-494e-a5ac-593536c5a059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=156425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 20:02:16.807027 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writer thread running {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 20:02:16.986114 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG passlib.handlers.bcrypt [None req-d0591d45-6b71-494e-a5ac-593536c5a059 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=156425) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 20:02:16.986445 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG passlib.handlers.bcrypt [None req-d0591d45-6b71-494e-a5ac-593536c5a059 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=156425) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 20:02:17.042272 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-d0591d45-6b71-494e-a5ac-593536c5a059 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:17.043896 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-d0591d45-6b71-494e-a5ac-593536c5a059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:17.170481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 2/3] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 20:02:17.193923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f13b2-4633-42d6-8fbc-48aaf6555f7a None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:17.264575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: INFO dbcounter [None req-ac1f13b2-4633-42d6-8fbc-48aaf6555f7a None None] Registered counter for database keystone May 19 20:02:17.284546 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG oslo_db.sqlalchemy.engines [None req-ac1f13b2-4633-42d6-8fbc-48aaf6555f7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=156426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 20:02:17.291016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writer thread running {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 20:02:17.412361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f13b2-4633-42d6-8fbc-48aaf6555f7a None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:17.416658 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656e73a-a8b2-49d5-bea9-0626db2f156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e10dfaa67a4db08ea8ec190c3b285d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:17.417321 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656e73a-a8b2-49d5-bea9-0626db2f156c admin admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:17.417611 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656e73a-a8b2-49d5-bea9-0626db2f156c admin admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:17.417888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656e73a-a8b2-49d5-bea9-0626db2f156c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:17.426400 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656e73a-a8b2-49d5-bea9-0626db2f156c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:17.477851 dv-cinder-841302-4-smb devstack@keystone.service[156426]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3656e73a-a8b2-49d5-bea9-0626db2f156c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 20:02:17.478192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656e73a-a8b2-49d5-bea9-0626db2f156c admin admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:17.488658 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 2/4] 10.222.0.89 () {58 vars in 1324 bytes} [Thu May 19 20:02:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 20:02:17.494743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0591d45-6b71-494e-a5ac-593536c5a059 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:17.509927 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0591d45-6b71-494e-a5ac-593536c5a059 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:17.514544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d266ff2-2395-41ed-8a96-f6f8372c0aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e10dfaa67a4db08ea8ec190c3b285d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:17.515745 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266ff2-2395-41ed-8a96-f6f8372c0aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:17.515981 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266ff2-2395-41ed-8a96-f6f8372c0aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:17.516256 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266ff2-2395-41ed-8a96-f6f8372c0aa1 admin admin] PATH_INFO: `/v3/projects/40e10dfaa67a4db08ea8ec190c3b285d` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:17.517806 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d266ff2-2395-41ed-8a96-f6f8372c0aa1 admin admin] RBAC: Authorizing `identity:get_project(project_id=40e10dfaa67a4db08ea8ec190c3b285d)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:17.676711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6d266ff2-2395-41ed-8a96-f6f8372c0aa1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 20:02:17.677054 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d266ff2-2395-41ed-8a96-f6f8372c0aa1 admin admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:17.681812 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 3/5] 10.222.0.89 () {56 vars in 1207 bytes} [Thu May 19 20:02:17 2022] GET /identity/v3/projects/40e10dfaa67a4db08ea8ec190c3b285d => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:19.900771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266dda5-1074-4a16-91d0-87725ed2ea66 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:19.901359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266dda5-1074-4a16-91d0-87725ed2ea66 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:19.901359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266dda5-1074-4a16-91d0-87725ed2ea66 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:19.906212 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 3/6] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:19.911758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925bb6-83d6-4323-ae9b-e71485cdbecd None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:19.912162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925bb6-83d6-4323-ae9b-e71485cdbecd None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:19.912324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd925bb6-83d6-4323-ae9b-e71485cdbecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:19.932144 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-dd925bb6-83d6-4323-ae9b-e71485cdbecd None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:19.933675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-dd925bb6-83d6-4323-ae9b-e71485cdbecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:19.941710 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 4/7] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 20:02:19.963849 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266dda5-1074-4a16-91d0-87725ed2ea66 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:19.976702 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266dda5-1074-4a16-91d0-87725ed2ea66 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:19.980971 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c27a88-adfd-4d14-a0f1-ce9ec351bd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e10dfaa67a4db08ea8ec190c3b285d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:19.981680 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c27a88-adfd-4d14-a0f1-ce9ec351bd23 admin admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:19.981964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c27a88-adfd-4d14-a0f1-ce9ec351bd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:19.982238 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c27a88-adfd-4d14-a0f1-ce9ec351bd23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:19.989968 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c27a88-adfd-4d14-a0f1-ce9ec351bd23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:19.991765 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c27a88-adfd-4d14-a0f1-ce9ec351bd23 admin admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:20.000630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 4/8] 10.222.0.89 () {58 vars in 1324 bytes} [Thu May 19 20:02:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 20:02:20.006129 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd925bb6-83d6-4323-ae9b-e71485cdbecd None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:20.015905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd925bb6-83d6-4323-ae9b-e71485cdbecd None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:20.020477 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07ffc7-ab39-422c-b277-73721ad4b73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e10dfaa67a4db08ea8ec190c3b285d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:20.021348 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ffc7-ab39-422c-b277-73721ad4b73d admin admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:20.021630 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ffc7-ab39-422c-b277-73721ad4b73d admin admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:20.021902 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ffc7-ab39-422c-b277-73721ad4b73d admin admin] PATH_INFO: `/v3/users/d596087257d3471085b47d30599a9a82` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:20.023343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07ffc7-ab39-422c-b277-73721ad4b73d admin admin] RBAC: Authorizing `identity:get_user(user_id=d596087257d3471085b47d30599a9a82)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:20.025188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07ffc7-ab39-422c-b277-73721ad4b73d admin admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:20.026788 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 5/9] 10.222.0.89 () {56 vars in 1198 bytes} [Thu May 19 20:02:20 2022] GET /identity/v3/users/d596087257d3471085b47d30599a9a82 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:22.311989 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef742c53-fa06-4753-8ae4-9807630eabb2 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:22.312560 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef742c53-fa06-4753-8ae4-9807630eabb2 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:22.312560 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef742c53-fa06-4753-8ae4-9807630eabb2 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:22.313958 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 5/10] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:22.319330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c656bf-74c2-4d30-9a43-8fff8ba00aef None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:22.319744 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c656bf-74c2-4d30-9a43-8fff8ba00aef None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:22.319893 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c656bf-74c2-4d30-9a43-8fff8ba00aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:22.337070 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-69c656bf-74c2-4d30-9a43-8fff8ba00aef None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:22.338253 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-69c656bf-74c2-4d30-9a43-8fff8ba00aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:22.373598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351456a-9108-44aa-a34f-01e38f62b080 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:22.374011 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351456a-9108-44aa-a34f-01e38f62b080 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:22.374357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351456a-9108-44aa-a34f-01e38f62b080 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:22.375897 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 6/11] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:02:22.381065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038634a-9b25-4a82-8431-a52b579d5f52 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:22.381429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038634a-9b25-4a82-8431-a52b579d5f52 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:22.381778 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038634a-9b25-4a82-8431-a52b579d5f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:22.418519 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 6/12] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:22.422131 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG passlib.handlers.bcrypt [None req-e038634a-9b25-4a82-8431-a52b579d5f52 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=156426) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 20:02:22.422592 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG passlib.handlers.bcrypt [None req-e038634a-9b25-4a82-8431-a52b579d5f52 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=156426) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 20:02:22.442156 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c656bf-74c2-4d30-9a43-8fff8ba00aef None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:22.465809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:22.470237 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-e038634a-9b25-4a82-8431-a52b579d5f52 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:22.471950 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-e038634a-9b25-4a82-8431-a52b579d5f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:22.559439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c656bf-74c2-4d30-9a43-8fff8ba00aef None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:22.583619 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 7/13] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:02:22.596499 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293abd23-a480-480b-902b-bc5de9bd0b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:22.597302 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293abd23-a480-480b-902b-bc5de9bd0b2c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:22.597586 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293abd23-a480-480b-902b-bc5de9bd0b2c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:22.597934 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293abd23-a480-480b-902b-bc5de9bd0b2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:22.606289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038634a-9b25-4a82-8431-a52b579d5f52 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:22.617737 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293abd23-a480-480b-902b-bc5de9bd0b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-293abd23-a480-480b-902b-bc5de9bd0b2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:22.629158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:22.630306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:22.631431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 7/14] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:02:22.636563 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293abd23-a480-480b-902b-bc5de9bd0b2c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:22.731167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:22.751636 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293abd23-a480-480b-902b-bc5de9bd0b2c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:22.793945 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd06c5d-4ee3-4e7c-b42a-22273ebc0354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:22.795215 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd06c5d-4ee3-4e7c-b42a-22273ebc0354 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:22.795642 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd06c5d-4ee3-4e7c-b42a-22273ebc0354 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:22.795754 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd06c5d-4ee3-4e7c-b42a-22273ebc0354 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:22.796547 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd06c5d-4ee3-4e7c-b42a-22273ebc0354 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:22.796857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd06c5d-4ee3-4e7c-b42a-22273ebc0354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:22.798440 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd06c5d-4ee3-4e7c-b42a-22273ebc0354 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:22.813194 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 8/15] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:22.820991 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd06c5d-4ee3-4e7c-b42a-22273ebc0354 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:22.839787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038634a-9b25-4a82-8431-a52b579d5f52 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:22.842772 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:22.878212 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8b277-67d7-43be-be21-051fc30f7b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:22.879150 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8b277-67d7-43be-be21-051fc30f7b08 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:22.879434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8b277-67d7-43be-be21-051fc30f7b08 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:22.879708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8b277-67d7-43be-be21-051fc30f7b08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:22.923262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd06c5d-4ee3-4e7c-b42a-22273ebc0354 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:22.949476 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8b277-67d7-43be-be21-051fc30f7b08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:22.951570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8b277-67d7-43be-be21-051fc30f7b08 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:22.959288 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74aea2-d264-4dd1-a29d-69309bda4732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:22.960169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74aea2-d264-4dd1-a29d-69309bda4732 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:22.960458 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74aea2-d264-4dd1-a29d-69309bda4732 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:22.960737 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74aea2-d264-4dd1-a29d-69309bda4732 None admin] PATH_INFO: `/v3/users/d596087257d3471085b47d30599a9a82` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:22.961973 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74aea2-d264-4dd1-a29d-69309bda4732 None admin] RBAC: Authorizing `identity:get_user(user_id=d596087257d3471085b47d30599a9a82)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:22.963479 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74aea2-d264-4dd1-a29d-69309bda4732 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:22.965126 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 9/16] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:22 2022] GET /identity/v3/users/d596087257d3471085b47d30599a9a82 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:22.971092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74aea2-d264-4dd1-a29d-69309bda4732 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:22.985915 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:23.052132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 8/17] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:02:23.057667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8b277-67d7-43be-be21-051fc30f7b08 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:23.060987 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:23.074439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74aea2-d264-4dd1-a29d-69309bda4732 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:23.111252 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2f354-d29e-4879-85eb-543367766e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:23.112052 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2f354-d29e-4879-85eb-543367766e01 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:23.112340 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2f354-d29e-4879-85eb-543367766e01 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:23.112720 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2f354-d29e-4879-85eb-543367766e01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:23.113852 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2f354-d29e-4879-85eb-543367766e01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:23.115361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2f354-d29e-4879-85eb-543367766e01 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:23.116976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 10/18] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:23.123417 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2f354-d29e-4879-85eb-543367766e01 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:23.158119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8b277-67d7-43be-be21-051fc30f7b08 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:23.191740 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ac801-0825-49ba-bd35-85d36271bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:23.192541 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ac801-0825-49ba-bd35-85d36271bb56 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:23.192828 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ac801-0825-49ba-bd35-85d36271bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:23.193110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ac801-0825-49ba-bd35-85d36271bb56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:23.206762 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:23.226171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ac801-0825-49ba-bd35-85d36271bb56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:23.226171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ac801-0825-49ba-bd35-85d36271bb56 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:23.236999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2f354-d29e-4879-85eb-543367766e01 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-436ac801-0825-49ba-bd35-85d36271bb56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:02:23.246830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:23.248798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:23.249783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:02:23.249783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:02:23.249783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:02:23.249783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:23.249783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 9/19] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:02:23.254710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ac801-0825-49ba-bd35-85d36271bb56 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:23.276161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef719f-50c3-471b-9397-a4df444697bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:23.276833 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef719f-50c3-471b-9397-a4df444697bd None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:23.277120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef719f-50c3-471b-9397-a4df444697bd None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:23.277393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef719f-50c3-471b-9397-a4df444697bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:23.278251 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef719f-50c3-471b-9397-a4df444697bd None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.domain.id=default, user.id=d596087257d3471085b47d30599a9a82) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:23.278567 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef719f-50c3-471b-9397-a4df444697bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:23.280085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef719f-50c3-471b-9397-a4df444697bd None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:23.287406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 11/20] 10.222.0.89 () {56 vars in 1322 bytes} [Thu May 19 20:02:23 2022] GET /identity/v3/role_assignments?user.id=d596087257d3471085b47d30599a9a82&scope.domain.id=default&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:23.318688 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:23.365939 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ac801-0825-49ba-bd35-85d36271bb56 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:23.404344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e84e5c-8a51-4cf0-9032-98de7c40cef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:23.405035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e84e5c-8a51-4cf0-9032-98de7c40cef0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:23.405322 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e84e5c-8a51-4cf0-9032-98de7c40cef0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:23.405601 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e84e5c-8a51-4cf0-9032-98de7c40cef0 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:23.406355 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e84e5c-8a51-4cf0-9032-98de7c40cef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:23.406700 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e84e5c-8a51-4cf0-9032-98de7c40cef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:23.408134 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e84e5c-8a51-4cf0-9032-98de7c40cef0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:23.428005 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 10/21] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:25.747687 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ea447-9844-48b2-890a-b3a228805e6f None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:25.748739 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ea447-9844-48b2-890a-b3a228805e6f None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:25.749258 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ea447-9844-48b2-890a-b3a228805e6f None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:25.750905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 12/22] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:25.756225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbac00e-4fe9-4803-b0f6-a16226a715a2 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:25.756654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbac00e-4fe9-4803-b0f6-a16226a715a2 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:25.756758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbac00e-4fe9-4803-b0f6-a16226a715a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:25.783638 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-3dbac00e-4fe9-4803-b0f6-a16226a715a2 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:25.784853 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-3dbac00e-4fe9-4803-b0f6-a16226a715a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:25.869306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 11/23] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:25.905467 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ea447-9844-48b2-890a-b3a228805e6f None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:26.031239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ea447-9844-48b2-890a-b3a228805e6f None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:26.071928 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b61c-7b7d-4a9e-a2fb-d141280e744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:26.072739 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b61c-7b7d-4a9e-a2fb-d141280e744d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:26.073018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b61c-7b7d-4a9e-a2fb-d141280e744d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:26.073293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b61c-7b7d-4a9e-a2fb-d141280e744d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:26.089157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53b61c-7b7d-4a9e-a2fb-d141280e744d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-1d53b61c-7b7d-4a9e-a2fb-d141280e744d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:26.097822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:26.098975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:26.099887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 13/24] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:02:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:26.108354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbac00e-4fe9-4803-b0f6-a16226a715a2 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:26.190129 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:26.263730 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbac00e-4fe9-4803-b0f6-a16226a715a2 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:26.314174 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836e975-f0c0-4e89-90f9-88dc2fdf9951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:26.314808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836e975-f0c0-4e89-90f9-88dc2fdf9951 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:26.315087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836e975-f0c0-4e89-90f9-88dc2fdf9951 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:26.315361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836e975-f0c0-4e89-90f9-88dc2fdf9951 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:26.316118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836e975-f0c0-4e89-90f9-88dc2fdf9951 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:26.316422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836e975-f0c0-4e89-90f9-88dc2fdf9951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:26.317988 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836e975-f0c0-4e89-90f9-88dc2fdf9951 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:26.338760 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 12/25] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:26.344818 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b61c-7b7d-4a9e-a2fb-d141280e744d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:26.349104 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:26.359723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c0579-1364-4ede-9851-1d7fa5f3cbe4 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:26.368846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c0579-1364-4ede-9851-1d7fa5f3cbe4 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:26.368846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c0579-1364-4ede-9851-1d7fa5f3cbe4 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:26.368846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 13/26] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:26.368846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2655-4525-4020-9fa3-4916009f8ddd None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:26.368846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2655-4525-4020-9fa3-4916009f8ddd None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:26.368846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2655-4525-4020-9fa3-4916009f8ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:26.392655 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-462f2655-4525-4020-9fa3-4916009f8ddd None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:26.393854 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-462f2655-4525-4020-9fa3-4916009f8ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:26.524236 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 14/27] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:02:26.566560 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b61c-7b7d-4a9e-a2fb-d141280e744d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:26.573267 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f2655-4525-4020-9fa3-4916009f8ddd None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:26.639383 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e68158-7f85-45bb-9544-302a91eea194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:26.640281 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e68158-7f85-45bb-9544-302a91eea194 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:26.640561 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e68158-7f85-45bb-9544-302a91eea194 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:26.640842 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e68158-7f85-45bb-9544-302a91eea194 None admin] PATH_INFO: `/v3/users/d596087257d3471085b47d30599a9a82` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:26.642161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e68158-7f85-45bb-9544-302a91eea194 None admin] RBAC: Authorizing `identity:get_user(user_id=d596087257d3471085b47d30599a9a82)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:26.643675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e68158-7f85-45bb-9544-302a91eea194 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:26.645667 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 14/28] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:26 2022] GET /identity/v3/users/d596087257d3471085b47d30599a9a82 => generated 247 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:26.649696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:26.649839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee448a-d858-41f6-bd7d-f70b768fcb5e None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:26.649839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee448a-d858-41f6-bd7d-f70b768fcb5e None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:26.649839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee448a-d858-41f6-bd7d-f70b768fcb5e None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:26.649839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 15/29] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:26.652464 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee448a-d858-41f6-bd7d-f70b768fcb5e None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:26.764851 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f2655-4525-4020-9fa3-4916009f8ddd None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:26.783522 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:26.830579 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee448a-d858-41f6-bd7d-f70b768fcb5e None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:26.835560 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae606-f0eb-4caa-8e1e-a1c3c8cc18de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:26.843785 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae606-f0eb-4caa-8e1e-a1c3c8cc18de None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:26.843998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae606-f0eb-4caa-8e1e-a1c3c8cc18de None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:26.844286 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae606-f0eb-4caa-8e1e-a1c3c8cc18de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:26.864866 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae606-f0eb-4caa-8e1e-a1c3c8cc18de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:26.866423 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae606-f0eb-4caa-8e1e-a1c3c8cc18de None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:26.882220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32843b6-2680-4551-ac4b-48ab4f00cd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:26.883321 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32843b6-2680-4551-ac4b-48ab4f00cd06 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:26.883789 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32843b6-2680-4551-ac4b-48ab4f00cd06 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:26.884223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32843b6-2680-4551-ac4b-48ab4f00cd06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:26.886944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32843b6-2680-4551-ac4b-48ab4f00cd06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:26.890009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32843b6-2680-4551-ac4b-48ab4f00cd06 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:26.898978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 16/30] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:26.900105 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb871c54-3dc8-4278-b24e-eb1fbfefc4e0 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:26.905193 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb871c54-3dc8-4278-b24e-eb1fbfefc4e0 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:26.905193 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb871c54-3dc8-4278-b24e-eb1fbfefc4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-457ae606-f0eb-4caa-8e1e-a1c3c8cc18de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:02:26.911478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:26.912478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:26.913438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:02:26.913438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:02:26.913438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:02:26.913438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:26.915746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 15/31] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:02:26.916998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae606-f0eb-4caa-8e1e-a1c3c8cc18de None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:26.939129 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-fb871c54-3dc8-4278-b24e-eb1fbfefc4e0 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:26.940443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-fb871c54-3dc8-4278-b24e-eb1fbfefc4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:27.054993 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:27.068580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae606-f0eb-4caa-8e1e-a1c3c8cc18de None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:27.073105 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 17/32] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:27.073903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb871c54-3dc8-4278-b24e-eb1fbfefc4e0 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:27.107198 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f15d-d42d-4b1d-86c8-a2282f4cb801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:27.108106 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f15d-d42d-4b1d-86c8-a2282f4cb801 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:27.108394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f15d-d42d-4b1d-86c8-a2282f4cb801 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:27.108677 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f15d-d42d-4b1d-86c8-a2282f4cb801 None admin] PATH_INFO: `/v3/domains/default/users/d596087257d3471085b47d30599a9a82/roles/38e07a16dc8b4306be7688b9d5cd626b` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:27.111983 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0f15d-d42d-4b1d-86c8-a2282f4cb801 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d596087257d3471085b47d30599a9a82, role_id=38e07a16dc8b4306be7688b9d5cd626b)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:27.113663 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0f15d-d42d-4b1d-86c8-a2282f4cb801 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:27.165118 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:27.197484 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb871c54-3dc8-4278-b24e-eb1fbfefc4e0 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:27.243120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143519fa-60c1-46c5-9dd9-baa170684f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:27.243681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143519fa-60c1-46c5-9dd9-baa170684f1f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:27.244405 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143519fa-60c1-46c5-9dd9-baa170684f1f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:27.245077 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143519fa-60c1-46c5-9dd9-baa170684f1f None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:27.246490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143519fa-60c1-46c5-9dd9-baa170684f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:27.246940 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143519fa-60c1-46c5-9dd9-baa170684f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:27.249183 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143519fa-60c1-46c5-9dd9-baa170684f1f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:27.270332 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 18/33] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:27.271852 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbee03e-7fdf-41c9-9157-dd45163e7cc3 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:27.272259 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbee03e-7fdf-41c9-9157-dd45163e7cc3 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:27.272655 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbee03e-7fdf-41c9-9157-dd45163e7cc3 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:27.274119 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 19/34] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:27.278197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbee03e-7fdf-41c9-9157-dd45163e7cc3 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:27.356027 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 16/35] 10.222.0.89 () {58 vars in 1361 bytes} [Thu May 19 20:02:26 2022] PUT /identity/v3/domains/default/users/d596087257d3471085b47d30599a9a82/roles/38e07a16dc8b4306be7688b9d5cd626b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:02:27.358729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f15d-d42d-4b1d-86c8-a2282f4cb801 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:27.429848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbee03e-7fdf-41c9-9157-dd45163e7cc3 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:27.468378 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:27.476347 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea060b-b8e8-48c0-8ab4-0bc91af0ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:27.477650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea060b-b8e8-48c0-8ab4-0bc91af0ac69 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:27.478127 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea060b-b8e8-48c0-8ab4-0bc91af0ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:27.478593 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea060b-b8e8-48c0-8ab4-0bc91af0ac69 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:27.483963 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea060b-b8e8-48c0-8ab4-0bc91af0ac69 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:27.483963 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea060b-b8e8-48c0-8ab4-0bc91af0ac69 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:27.567205 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f15d-d42d-4b1d-86c8-a2282f4cb801 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:27.614752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c931d-3bf9-4559-adab-a8697f5b1b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:27.614752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c931d-3bf9-4559-adab-a8697f5b1b1d None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:27.614752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c931d-3bf9-4559-adab-a8697f5b1b1d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:27.614752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c931d-3bf9-4559-adab-a8697f5b1b1d None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:27.615247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c931d-3bf9-4559-adab-a8697f5b1b1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:27.615247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c931d-3bf9-4559-adab-a8697f5b1b1d None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:27.728447 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 20/36] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:02:27 2022] POST /identity/v3/roles => generated 225 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:02:27.730417 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40d9b-bc1c-4479-80e0-22dd4976ae44 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:27.730955 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40d9b-bc1c-4479-80e0-22dd4976ae44 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:27.731605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40d9b-bc1c-4479-80e0-22dd4976ae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:27.751773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-a4d40d9b-bc1c-4479-80e0-22dd4976ae44 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:27.753842 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-a4d40d9b-bc1c-4479-80e0-22dd4976ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:27.758924 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 17/37] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:02:27 2022] POST /identity/v3/projects => generated 301 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:02:27.760577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16108acb-73b4-4f32-9ea9-e1fb1409b3a3 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:27.760928 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16108acb-73b4-4f32-9ea9-e1fb1409b3a3 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:27.761217 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16108acb-73b4-4f32-9ea9-e1fb1409b3a3 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:27.762825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 18/38] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:27.764379 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303b8c1-17ee-4aa3-ad0d-9ca5c8f5f8e3 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:27.764642 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303b8c1-17ee-4aa3-ad0d-9ca5c8f5f8e3 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:27.764934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303b8c1-17ee-4aa3-ad0d-9ca5c8f5f8e3 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:27.766394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 19/39] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:27.772724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a962f5-c9ab-4312-b9b3-f9a25a08259c None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:27.773173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a962f5-c9ab-4312-b9b3-f9a25a08259c None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:27.773556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a962f5-c9ab-4312-b9b3-f9a25a08259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:27.783006 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:27.802666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-d7a962f5-c9ab-4312-b9b3-f9a25a08259c None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:27.804959 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-d7a962f5-c9ab-4312-b9b3-f9a25a08259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:27.851301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 21/40] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:27.853337 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8f446-6e75-4843-87c7-336ef450902e None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:27.853829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8f446-6e75-4843-87c7-336ef450902e None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:27.854339 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8f446-6e75-4843-87c7-336ef450902e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:27.874834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-27d8f446-6e75-4843-87c7-336ef450902e None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:27.876467 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-27d8f446-6e75-4843-87c7-336ef450902e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:27.944802 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 20/41] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:27.945761 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a962f5-c9ab-4312-b9b3-f9a25a08259c None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:27.968582 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 22/42] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:27.983831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8f446-6e75-4843-87c7-336ef450902e None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:28.083563 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:28.139605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a962f5-c9ab-4312-b9b3-f9a25a08259c None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:28.150887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8f446-6e75-4843-87c7-336ef450902e None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:28.181632 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:28.187335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfed8b-2701-4a32-be78-bdadabf6000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:28.188004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfed8b-2701-4a32-be78-bdadabf6000e None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:28.188288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfed8b-2701-4a32-be78-bdadabf6000e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:28.188567 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfed8b-2701-4a32-be78-bdadabf6000e None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:28.189329 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfed8b-2701-4a32-be78-bdadabf6000e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:28.190877 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfed8b-2701-4a32-be78-bdadabf6000e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:28.198470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126860c-a777-484b-808a-be7d573fad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:28.199721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126860c-a777-484b-808a-be7d573fad69 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:28.200018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126860c-a777-484b-808a-be7d573fad69 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:28.200331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126860c-a777-484b-808a-be7d573fad69 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:28.201178 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126860c-a777-484b-808a-be7d573fad69 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:28.202815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126860c-a777-484b-808a-be7d573fad69 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:28.261186 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 21/43] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:02:27 2022] POST /identity/v3/roles => generated 219 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:02:28.263765 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfed8b-2701-4a32-be78-bdadabf6000e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:28.284878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 23/44] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:02:27 2022] POST /identity/v3/roles => generated 223 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:02:28.411277 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfed8b-2701-4a32-be78-bdadabf6000e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:28.454577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffe267-8291-4579-b4de-34abcfccd0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:28.455451 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffe267-8291-4579-b4de-34abcfccd0a1 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:28.455744 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffe267-8291-4579-b4de-34abcfccd0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:28.456032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffe267-8291-4579-b4de-34abcfccd0a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:28.457429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffe267-8291-4579-b4de-34abcfccd0a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:28.458963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffe267-8291-4579-b4de-34abcfccd0a1 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:28.460742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 22/45] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:28.467608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126860c-a777-484b-808a-be7d573fad69 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:28.587875 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126860c-a777-484b-808a-be7d573fad69 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:28.599369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:28.622922 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf9de0-bb67-4e87-8796-b78a130a87d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:28.623594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf9de0-bb67-4e87-8796-b78a130a87d8 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:28.623887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf9de0-bb67-4e87-8796-b78a130a87d8 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:28.624171 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf9de0-bb67-4e87-8796-b78a130a87d8 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:28.624906 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf9de0-bb67-4e87-8796-b78a130a87d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:28.626365 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf9de0-bb67-4e87-8796-b78a130a87d8 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:28.719635 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 24/46] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:02:28 2022] POST /identity/v3/projects => generated 312 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:02:29.859552 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb3cb8-acfe-4a50-8abc-06e6f37d273c None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:29.860159 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb3cb8-acfe-4a50-8abc-06e6f37d273c None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:29.860159 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb3cb8-acfe-4a50-8abc-06e6f37d273c None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:29.861604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 23/47] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:29.867662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd366-4315-4a3d-8cd2-ed7a58da791c None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:29.868184 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd366-4315-4a3d-8cd2-ed7a58da791c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:29.868326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd366-4315-4a3d-8cd2-ed7a58da791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:29.886223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-34cdd366-4315-4a3d-8cd2-ed7a58da791c None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:29.887474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-34cdd366-4315-4a3d-8cd2-ed7a58da791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:29.956166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 25/48] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:29.978845 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb3cb8-acfe-4a50-8abc-06e6f37d273c None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:30.044594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:30.085789 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb3cb8-acfe-4a50-8abc-06e6f37d273c None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:30.119822 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c2601-e520-4cf5-bd27-a1b3bae68f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:30.120616 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c2601-e520-4cf5-bd27-a1b3bae68f1b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:30.120900 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c2601-e520-4cf5-bd27-a1b3bae68f1b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:30.121174 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c2601-e520-4cf5-bd27-a1b3bae68f1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:30.132621 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c2601-e520-4cf5-bd27-a1b3bae68f1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-904c2601-e520-4cf5-bd27-a1b3bae68f1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:30.141344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:30.142506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:30.143868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 24/49] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:30.148292 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdd366-4315-4a3d-8cd2-ed7a58da791c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:30.243780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:30.252975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdd366-4315-4a3d-8cd2-ed7a58da791c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:30.288426 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800fb95-7d50-4025-8cd5-a49eea80daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:30.289124 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800fb95-7d50-4025-8cd5-a49eea80daf1 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:30.289407 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800fb95-7d50-4025-8cd5-a49eea80daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:30.289687 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800fb95-7d50-4025-8cd5-a49eea80daf1 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:30.290447 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800fb95-7d50-4025-8cd5-a49eea80daf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:30.290799 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800fb95-7d50-4025-8cd5-a49eea80daf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:30.292203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800fb95-7d50-4025-8cd5-a49eea80daf1 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:30.302437 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 26/50] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:30.307123 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c2601-e520-4cf5-bd27-a1b3bae68f1b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:30.407182 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c2601-e520-4cf5-bd27-a1b3bae68f1b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:30.427250 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:30.441464 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccdff3-08a8-4dd6-a75f-95a760e2ec6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:30.442342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccdff3-08a8-4dd6-a75f-95a760e2ec6c None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:30.442643 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccdff3-08a8-4dd6-a75f-95a760e2ec6c None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:30.442923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccdff3-08a8-4dd6-a75f-95a760e2ec6c None admin] PATH_INFO: `/v3/users/d596087257d3471085b47d30599a9a82` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:30.444135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccdff3-08a8-4dd6-a75f-95a760e2ec6c None admin] RBAC: Authorizing `identity:get_user(user_id=d596087257d3471085b47d30599a9a82)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:30.445612 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccdff3-08a8-4dd6-a75f-95a760e2ec6c None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:30.447285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 25/51] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:30 2022] GET /identity/v3/users/d596087257d3471085b47d30599a9a82 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:30.452750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800fb95-7d50-4025-8cd5-a49eea80daf1 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:30.554966 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800fb95-7d50-4025-8cd5-a49eea80daf1 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:30.588935 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2caa9-8693-40e6-be43-a9a807b3a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:30.589732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2caa9-8693-40e6-be43-a9a807b3a688 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:30.590019 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2caa9-8693-40e6-be43-a9a807b3a688 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:30.590299 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2caa9-8693-40e6-be43-a9a807b3a688 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:30.592054 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2caa9-8693-40e6-be43-a9a807b3a688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:30.593525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2caa9-8693-40e6-be43-a9a807b3a688 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:30.595232 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 27/52] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:30.600963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccdff3-08a8-4dd6-a75f-95a760e2ec6c None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:30.702240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccdff3-08a8-4dd6-a75f-95a760e2ec6c None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:30.736521 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde2477-8882-4020-9b9c-81a9cfccbfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:30.737181 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde2477-8882-4020-9b9c-81a9cfccbfc4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:30.737462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde2477-8882-4020-9b9c-81a9cfccbfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:30.737825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde2477-8882-4020-9b9c-81a9cfccbfc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:30.738683 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde2477-8882-4020-9b9c-81a9cfccbfc4 None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.domain.id=default, user.id=d596087257d3471085b47d30599a9a82) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:30.738997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde2477-8882-4020-9b9c-81a9cfccbfc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:30.740442 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde2477-8882-4020-9b9c-81a9cfccbfc4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:30.748386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 26/53] 10.222.0.89 () {56 vars in 1322 bytes} [Thu May 19 20:02:30 2022] GET /identity/v3/role_assignments?user.id=d596087257d3471085b47d30599a9a82&scope.domain.id=default&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:30.993573 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e692-7b97-4f88-8de5-81e8f0ccb469 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:30.994081 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e692-7b97-4f88-8de5-81e8f0ccb469 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:30.994081 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e692-7b97-4f88-8de5-81e8f0ccb469 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:30.995466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 28/54] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:31.001495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90397ba1-22e3-4123-a280-546f38ace146 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:31.001959 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90397ba1-22e3-4123-a280-546f38ace146 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:31.002063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90397ba1-22e3-4123-a280-546f38ace146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:31.019230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-90397ba1-22e3-4123-a280-546f38ace146 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:31.020439 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-90397ba1-22e3-4123-a280-546f38ace146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:31.067561 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:31.087163 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 27/55] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:31.110816 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0e692-7b97-4f88-8de5-81e8f0ccb469 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:31.135426 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:31.219054 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0e692-7b97-4f88-8de5-81e8f0ccb469 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:31.256085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93d804-d96a-4b49-851c-a0c90d77f4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:31.256804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d804-d96a-4b49-851c-a0c90d77f4a8 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:31.257088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d804-d96a-4b49-851c-a0c90d77f4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:31.257367 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d804-d96a-4b49-851c-a0c90d77f4a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:31.258588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93d804-d96a-4b49-851c-a0c90d77f4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:31.260117 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93d804-d96a-4b49-851c-a0c90d77f4a8 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:31.261804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 29/56] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:31.267866 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90397ba1-22e3-4123-a280-546f38ace146 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:31.374765 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90397ba1-22e3-4123-a280-546f38ace146 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:31.412527 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557135f-cec2-4595-975d-3bd9ad7bb6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:31.413198 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557135f-cec2-4595-975d-3bd9ad7bb6cb None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:31.413483 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557135f-cec2-4595-975d-3bd9ad7bb6cb None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:31.413762 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557135f-cec2-4595-975d-3bd9ad7bb6cb None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:31.414486 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557135f-cec2-4595-975d-3bd9ad7bb6cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:31.415970 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557135f-cec2-4595-975d-3bd9ad7bb6cb None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:31.479839 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 28/57] 10.222.0.89 () {60 vars in 1140 bytes} [Thu May 19 20:02:31 2022] POST /identity/v3/projects => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:02:33.777373 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede664-7480-4b38-812d-a8332626592c None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:33.777938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede664-7480-4b38-812d-a8332626592c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:33.777938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede664-7480-4b38-812d-a8332626592c None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:33.779395 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 30/58] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:33.784786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307741-a6be-4c20-b343-22963f430d87 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:33.785241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307741-a6be-4c20-b343-22963f430d87 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:33.785353 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307741-a6be-4c20-b343-22963f430d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:33.807065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-99307741-a6be-4c20-b343-22963f430d87 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:33.808271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-99307741-a6be-4c20-b343-22963f430d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:33.837146 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:33.880107 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 29/59] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:33.905543 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede664-7480-4b38-812d-a8332626592c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:34.005824 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:34.016097 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede664-7480-4b38-812d-a8332626592c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:34.054490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901ddf1-fe5f-47fc-9121-0c073804811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:34.055236 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ddf1-fe5f-47fc-9121-0c073804811f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:34.055523 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ddf1-fe5f-47fc-9121-0c073804811f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:34.055802 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ddf1-fe5f-47fc-9121-0c073804811f None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:34.057005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901ddf1-fe5f-47fc-9121-0c073804811f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:34.058484 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901ddf1-fe5f-47fc-9121-0c073804811f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:34.060739 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 31/60] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:34.067557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307741-a6be-4c20-b343-22963f430d87 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:34.171599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307741-a6be-4c20-b343-22963f430d87 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:34.206938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a89c67-11c4-4c75-b66a-58235932b71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:34.207611 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89c67-11c4-4c75-b66a-58235932b71f None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:34.207959 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89c67-11c4-4c75-b66a-58235932b71f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:34.208239 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89c67-11c4-4c75-b66a-58235932b71f None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:34.208967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a89c67-11c4-4c75-b66a-58235932b71f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:34.210439 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a89c67-11c4-4c75-b66a-58235932b71f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:34.329906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 30/61] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:02:34 2022] POST /identity/v3/users => generated 275 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:02:37.848978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2980-36d1-4496-b633-e26f4f7be104 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:37.849599 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2980-36d1-4496-b633-e26f4f7be104 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:37.849599 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2980-36d1-4496-b633-e26f4f7be104 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:37.849774 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dbe4e-0842-46e5-ab4d-018a2614ed1f None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:37.850147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dbe4e-0842-46e5-ab4d-018a2614ed1f None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:37.850480 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dbe4e-0842-46e5-ab4d-018a2614ed1f None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:37.850921 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 32/62] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:37.851855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 31/63] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:02:37.857659 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd84dc9-e9de-49c0-b52f-2fdd10eca6a2 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:37.857837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2d0d-09ea-4d0c-a62f-7eba6531ec72 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:37.858100 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2d0d-09ea-4d0c-a62f-7eba6531ec72 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:37.858391 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2d0d-09ea-4d0c-a62f-7eba6531ec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:37.858920 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd84dc9-e9de-49c0-b52f-2fdd10eca6a2 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:37.859430 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd84dc9-e9de-49c0-b52f-2fdd10eca6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:37.887791 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-ac0e2d0d-09ea-4d0c-a62f-7eba6531ec72 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:37.888998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-ac0e2d0d-09ea-4d0c-a62f-7eba6531ec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:37.893953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-8dd84dc9-e9de-49c0-b52f-2fdd10eca6a2 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:37.895155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-8dd84dc9-e9de-49c0-b52f-2fdd10eca6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:37.931026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:38.032642 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 33/64] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:38.035032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 32/65] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:02:38.058777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e2d0d-09ea-4d0c-a62f-7eba6531ec72 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:38.108361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd84dc9-e9de-49c0-b52f-2fdd10eca6a2 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:38.172370 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:38.187645 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e2d0d-09ea-4d0c-a62f-7eba6531ec72 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:38.226004 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa36b14-857e-4f65-8fb1-091fede467f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:38.226864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa36b14-857e-4f65-8fb1-091fede467f0 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.227360 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa36b14-857e-4f65-8fb1-091fede467f0 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.227803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa36b14-857e-4f65-8fb1-091fede467f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.228831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd84dc9-e9de-49c0-b52f-2fdd10eca6a2 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:38.239937 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa36b14-857e-4f65-8fb1-091fede467f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-efa36b14-857e-4f65-8fb1-091fede467f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:38.249376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:38.250809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:38.252011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:38.254590 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 34/66] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:38.261012 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9969b29-2beb-4051-aac5-ff1d1779e70a None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.261688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9969b29-2beb-4051-aac5-ff1d1779e70a None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.262199 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9969b29-2beb-4051-aac5-ff1d1779e70a None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.264552 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 35/67] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:38.265754 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9969b29-2beb-4051-aac5-ff1d1779e70a None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:38.275351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547442d-484f-4716-acc7-f45981c2782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:38.277180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547442d-484f-4716-acc7-f45981c2782b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.277704 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547442d-484f-4716-acc7-f45981c2782b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.278739 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547442d-484f-4716-acc7-f45981c2782b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.293498 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547442d-484f-4716-acc7-f45981c2782b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-7547442d-484f-4716-acc7-f45981c2782b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:38.305026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:38.306099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:38.307604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:38.314117 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 33/68] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:02:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:02:38.314117 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34287-e0e3-4eae-8d0a-5c790cbffdf5 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.314117 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34287-e0e3-4eae-8d0a-5c790cbffdf5 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.314117 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34287-e0e3-4eae-8d0a-5c790cbffdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.337224 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-66d34287-e0e3-4eae-8d0a-5c790cbffdf5 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:38.339420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-66d34287-e0e3-4eae-8d0a-5c790cbffdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:38.344847 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:38.392095 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9969b29-2beb-4051-aac5-ff1d1779e70a None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:38.421856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 34/69] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:38.422644 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d34287-e0e3-4eae-8d0a-5c790cbffdf5 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:38.434557 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70119f12-ef31-4729-86f0-93cb45ec3f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:38.435641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119f12-ef31-4729-86f0-93cb45ec3f93 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.436129 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119f12-ef31-4729-86f0-93cb45ec3f93 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.436744 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119f12-ef31-4729-86f0-93cb45ec3f93 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.437752 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70119f12-ef31-4729-86f0-93cb45ec3f93 None admin] RBAC: Adding query filter params (name=member) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:38.438268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70119f12-ef31-4729-86f0-93cb45ec3f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:38.440017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70119f12-ef31-4729-86f0-93cb45ec3f93 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:38.451331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 36/70] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:02:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:38.457510 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d6948-c182-4ab5-b11c-a4d73b79013e None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.457806 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d6948-c182-4ab5-b11c-a4d73b79013e None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.458089 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d6948-c182-4ab5-b11c-a4d73b79013e None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.459607 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 37/71] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:38.460140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d6948-c182-4ab5-b11c-a4d73b79013e None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:38.473520 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:38.538138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d34287-e0e3-4eae-8d0a-5c790cbffdf5 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:38.569291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d6948-c182-4ab5-b11c-a4d73b79013e None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:38.573299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9127a-4ab1-4c6c-87a8-e6dbfae6cf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:38.573984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9127a-4ab1-4c6c-87a8-e6dbfae6cf34 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.574272 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9127a-4ab1-4c6c-87a8-e6dbfae6cf34 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.574559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9127a-4ab1-4c6c-87a8-e6dbfae6cf34 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.575887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9127a-4ab1-4c6c-87a8-e6dbfae6cf34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:38.576195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9127a-4ab1-4c6c-87a8-e6dbfae6cf34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:38.577590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9127a-4ab1-4c6c-87a8-e6dbfae6cf34 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:38.586024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 35/72] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:38.586881 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9127a-4ab1-4c6c-87a8-e6dbfae6cf34 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:38.589466 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:38.606864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cea295-3c9f-49a4-96ca-ae1c80bd152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:38.607730 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cea295-3c9f-49a4-96ca-ae1c80bd152e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.608014 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cea295-3c9f-49a4-96ca-ae1c80bd152e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.608292 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cea295-3c9f-49a4-96ca-ae1c80bd152e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.619154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cea295-3c9f-49a4-96ca-ae1c80bd152e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-09cea295-3c9f-49a4-96ca-ae1c80bd152e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:38.627562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:38.628714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:38.629638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 38/73] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:02:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:38.630416 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7042ba2-d906-489e-bfe2-ce53d338d712 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.630416 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7042ba2-d906-489e-bfe2-ce53d338d712 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.630559 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7042ba2-d906-489e-bfe2-ce53d338d712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.648010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-e7042ba2-d906-489e-bfe2-ce53d338d712 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:38.649157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-e7042ba2-d906-489e-bfe2-ce53d338d712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:38.693584 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9127a-4ab1-4c6c-87a8-e6dbfae6cf34 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:38.713380 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:38.718552 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 39/74] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:38.719930 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04c81-7c3a-4928-ac36-b48e7c22191c None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.720260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04c81-7c3a-4928-ac36-b48e7c22191c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.720491 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04c81-7c3a-4928-ac36-b48e7c22191c None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.721764 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 40/75] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:38.722466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e04c81-7c3a-4928-ac36-b48e7c22191c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:38.731072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ad4a-5ae5-46c3-b94a-baf6646a1a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:38.731072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ad4a-5ae5-46c3-b94a-baf6646a1a93 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.731072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ad4a-5ae5-46c3-b94a-baf6646a1a93 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.731072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ad4a-5ae5-46c3-b94a-baf6646a1a93 None admin] PATH_INFO: `/v3/users/1ba763318101478b8fd538190a09e314` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.748699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878ad4a-5ae5-46c3-b94a-baf6646a1a93 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba763318101478b8fd538190a09e314)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:38.750152 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878ad4a-5ae5-46c3-b94a-baf6646a1a93 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:38.751922 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 36/76] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:38 2022] GET /identity/v3/users/1ba763318101478b8fd538190a09e314 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:38.752681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ad4a-5ae5-46c3-b94a-baf6646a1a93 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:38.813381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:38.832618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e04c81-7c3a-4928-ac36-b48e7c22191c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:38.854296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ad4a-5ae5-46c3-b94a-baf6646a1a93 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:38.866298 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e66c5f-051f-425c-9d61-bc6b644f0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:38.867216 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66c5f-051f-425c-9d61-bc6b644f0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.867501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66c5f-051f-425c-9d61-bc6b644f0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.867781 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66c5f-051f-425c-9d61-bc6b644f0eb9 None admin] PATH_INFO: `/v3/users/d596087257d3471085b47d30599a9a82` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.869009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e66c5f-051f-425c-9d61-bc6b644f0eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=d596087257d3471085b47d30599a9a82)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:38.870489 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e66c5f-051f-425c-9d61-bc6b644f0eb9 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:38.872672 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 41/77] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:38 2022] GET /identity/v3/users/d596087257d3471085b47d30599a9a82 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:38.873977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0d5d-7cad-4113-89d2-447eb41b6603 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.874270 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0d5d-7cad-4113-89d2-447eb41b6603 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.874547 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca0d5d-7cad-4113-89d2-447eb41b6603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.891258 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-beca0d5d-7cad-4113-89d2-447eb41b6603 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:38.892470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-beca0d5d-7cad-4113-89d2-447eb41b6603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:38.893799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c516b5-bfde-45af-a168-6183797ec39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:38.894472 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c516b5-bfde-45af-a168-6183797ec39a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.894789 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c516b5-bfde-45af-a168-6183797ec39a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.895770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c516b5-bfde-45af-a168-6183797ec39a None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.895890 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c516b5-bfde-45af-a168-6183797ec39a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:38.896119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c516b5-bfde-45af-a168-6183797ec39a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:38.897508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c516b5-bfde-45af-a168-6183797ec39a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:38.905733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 37/78] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:02:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:38.906484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c516b5-bfde-45af-a168-6183797ec39a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:38.957512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:38.963224 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 42/79] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:38.967907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0d5d-7cad-4113-89d2-447eb41b6603 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:39.012969 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c516b5-bfde-45af-a168-6183797ec39a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:39.035926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:39.047960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57814034-9f37-4ddf-ac34-fdb2c8be4fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:39.048761 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57814034-9f37-4ddf-ac34-fdb2c8be4fa7 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:39.049045 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57814034-9f37-4ddf-ac34-fdb2c8be4fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:39.049322 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57814034-9f37-4ddf-ac34-fdb2c8be4fa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:39.050804 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57814034-9f37-4ddf-ac34-fdb2c8be4fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:39.052254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57814034-9f37-4ddf-ac34-fdb2c8be4fa7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:39.053916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 38/80] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:39.058625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57814034-9f37-4ddf-ac34-fdb2c8be4fa7 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:39.069165 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca0d5d-7cad-4113-89d2-447eb41b6603 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:39.103511 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466479d-4bb4-4863-af0e-069d03e5a2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:39.104174 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466479d-4bb4-4863-af0e-069d03e5a2b9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:39.104491 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466479d-4bb4-4863-af0e-069d03e5a2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:39.104749 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466479d-4bb4-4863-af0e-069d03e5a2b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:39.158867 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57814034-9f37-4ddf-ac34-fdb2c8be4fa7 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:39.171578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:39.175538 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466479d-4bb4-4863-af0e-069d03e5a2b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:39.177016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466479d-4bb4-4863-af0e-069d03e5a2b9 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:39.193456 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10ab5a-04e0-4605-b8bb-998c20457a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:39.194123 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10ab5a-04e0-4605-b8bb-998c20457a73 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:39.194413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10ab5a-04e0-4605-b8bb-998c20457a73 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:39.194729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10ab5a-04e0-4605-b8bb-998c20457a73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:39.254100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:39.264842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10ab5a-04e0-4605-b8bb-998c20457a73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:39.266299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10ab5a-04e0-4605-b8bb-998c20457a73 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:39.280647 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 43/81] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:02:39.282652 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466479d-4bb4-4863-af0e-069d03e5a2b9 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:39.369379 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 39/82] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:02:39.370244 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10ab5a-04e0-4605-b8bb-998c20457a73 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:39.387450 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:39.390983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466479d-4bb4-4863-af0e-069d03e5a2b9 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:39.425999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145091d9-9f9e-46aa-8178-1711cddc97ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:39.426829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145091d9-9f9e-46aa-8178-1711cddc97ac None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:39.427119 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145091d9-9f9e-46aa-8178-1711cddc97ac None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:39.427403 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145091d9-9f9e-46aa-8178-1711cddc97ac None admin] PATH_INFO: `/v3/users/1ba763318101478b8fd538190a09e314` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:39.428643 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145091d9-9f9e-46aa-8178-1711cddc97ac None admin] RBAC: Authorizing `identity:get_user(user_id=1ba763318101478b8fd538190a09e314)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:39.430125 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145091d9-9f9e-46aa-8178-1711cddc97ac None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:39.432791 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 44/83] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:39 2022] GET /identity/v3/users/1ba763318101478b8fd538190a09e314 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:39.433635 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145091d9-9f9e-46aa-8178-1711cddc97ac None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:39.460556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:39.470072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10ab5a-04e0-4605-b8bb-998c20457a73 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:39.505439 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28eb66-5c01-4628-a891-c8e67d07c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:39.506287 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28eb66-5c01-4628-a891-c8e67d07c7bc None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:39.506573 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28eb66-5c01-4628-a891-c8e67d07c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:39.506907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28eb66-5c01-4628-a891-c8e67d07c7bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:39.517235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28eb66-5c01-4628-a891-c8e67d07c7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-2c28eb66-5c01-4628-a891-c8e67d07c7bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:39.525118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:39.526168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 40/84] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:39.527138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28eb66-5c01-4628-a891-c8e67d07c7bc None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:39.543328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145091d9-9f9e-46aa-8178-1711cddc97ac None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:39.581751 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec02f-1646-46e3-a3a9-285c1c3766e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:39.582430 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec02f-1646-46e3-a3a9-285c1c3766e8 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:39.582746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec02f-1646-46e3-a3a9-285c1c3766e8 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:39.583021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec02f-1646-46e3-a3a9-285c1c3766e8 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:39.583747 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bec02f-1646-46e3-a3a9-285c1c3766e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:39.585227 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bec02f-1646-46e3-a3a9-285c1c3766e8 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:39.631423 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28eb66-5c01-4628-a891-c8e67d07c7bc None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:39.665695 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0609802-6c5f-489c-bd6f-fe5f3ef399d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:39.666561 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0609802-6c5f-489c-bd6f-fe5f3ef399d8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:39.666878 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0609802-6c5f-489c-bd6f-fe5f3ef399d8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:39.667156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0609802-6c5f-489c-bd6f-fe5f3ef399d8 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:39.668407 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0609802-6c5f-489c-bd6f-fe5f3ef399d8 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:39.670580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0609802-6c5f-489c-bd6f-fe5f3ef399d8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:39.672322 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 41/85] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:39 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:39.673097 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0609802-6c5f-489c-bd6f-fe5f3ef399d8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:39.691600 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 45/86] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:02:39 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:02:39.691600 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec02f-1646-46e3-a3a9-285c1c3766e8 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:39.705011 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:39.718523 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:39.808772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec02f-1646-46e3-a3a9-285c1c3766e8 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:39.812763 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0609802-6c5f-489c-bd6f-fe5f3ef399d8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:39.850489 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cc71d-39ea-4ef9-a760-43429bfb104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:39.851199 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cc71d-39ea-4ef9-a760-43429bfb104e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:39.851485 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cc71d-39ea-4ef9-a760-43429bfb104e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:39.851765 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cc71d-39ea-4ef9-a760-43429bfb104e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:39.868168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda949a-6c76-416c-8e99-d2363b335f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:39.869472 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda949a-6c76-416c-8e99-d2363b335f19 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:39.870249 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda949a-6c76-416c-8e99-d2363b335f19 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:39.870375 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda949a-6c76-416c-8e99-d2363b335f19 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:39.872720 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda949a-6c76-416c-8e99-d2363b335f19 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:39.875105 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda949a-6c76-416c-8e99-d2363b335f19 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:39.883571 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 42/87] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:39 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:39.883571 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda949a-6c76-416c-8e99-d2363b335f19 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:39.936213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cc71d-39ea-4ef9-a760-43429bfb104e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:39.937717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cc71d-39ea-4ef9-a760-43429bfb104e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:39.970496 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:40.008137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:40.035821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda949a-6c76-416c-8e99-d2363b335f19 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:40.073256 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 46/88] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:02:40.074503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cc71d-39ea-4ef9-a760-43429bfb104e None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:40.084293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed911-3a22-4f54-9f20-4b3db087a929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:40.085002 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed911-3a22-4f54-9f20-4b3db087a929 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:40.085406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed911-3a22-4f54-9f20-4b3db087a929 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:40.085692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed911-3a22-4f54-9f20-4b3db087a929 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:40.086470 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ed911-3a22-4f54-9f20-4b3db087a929 None admin] RBAC: Adding query filter params (name=member) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:40.086808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ed911-3a22-4f54-9f20-4b3db087a929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:40.088410 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ed911-3a22-4f54-9f20-4b3db087a929 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:40.098952 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 43/89] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:02:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:40.103477 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed911-3a22-4f54-9f20-4b3db087a929 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:40.190460 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cc71d-39ea-4ef9-a760-43429bfb104e None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:40.217998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed911-3a22-4f54-9f20-4b3db087a929 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:40.226970 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:40.239386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dc2ea-82aa-4c69-aee8-fcaf11074093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:40.239989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dc2ea-82aa-4c69-aee8-fcaf11074093 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:40.240275 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dc2ea-82aa-4c69-aee8-fcaf11074093 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:40.240553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dc2ea-82aa-4c69-aee8-fcaf11074093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:40.241414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6dc2ea-82aa-4c69-aee8-fcaf11074093 None admin] RBAC: Adding query filter params (role.id=edf99f336b2440b19ff28bcd8da8433b, scope.project.id=d9b28400715c475eb364b4a9afdd6046, user.id=1ba763318101478b8fd538190a09e314) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:40.241732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6dc2ea-82aa-4c69-aee8-fcaf11074093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:40.243271 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6dc2ea-82aa-4c69-aee8-fcaf11074093 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:40.249809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 47/90] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:40 2022] GET /identity/v3/role_assignments?user.id=1ba763318101478b8fd538190a09e314&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:40.250762 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dc2ea-82aa-4c69-aee8-fcaf11074093 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:40.263758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b46a4-68ea-4ce1-ac51-6eb4ed9eb273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:40.265112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b46a4-68ea-4ce1-ac51-6eb4ed9eb273 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:40.265694 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b46a4-68ea-4ce1-ac51-6eb4ed9eb273 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:40.266214 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b46a4-68ea-4ce1-ac51-6eb4ed9eb273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:40.267516 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b46a4-68ea-4ce1-ac51-6eb4ed9eb273 None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=d9b28400715c475eb364b4a9afdd6046, user.id=d596087257d3471085b47d30599a9a82) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:40.268125 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b46a4-68ea-4ce1-ac51-6eb4ed9eb273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:40.270100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b46a4-68ea-4ce1-ac51-6eb4ed9eb273 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:40.277730 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 44/91] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:40 2022] GET /identity/v3/role_assignments?user.id=d596087257d3471085b47d30599a9a82&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:40.279740 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b46a4-68ea-4ce1-ac51-6eb4ed9eb273 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:40.357380 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:40.517825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b46a4-68ea-4ce1-ac51-6eb4ed9eb273 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:40.558038 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dc2ea-82aa-4c69-aee8-fcaf11074093 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:40.564954 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5830796-34ff-4f15-b02f-c5eb25c06dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:40.566162 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5830796-34ff-4f15-b02f-c5eb25c06dc8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:40.566711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5830796-34ff-4f15-b02f-c5eb25c06dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:40.567218 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5830796-34ff-4f15-b02f-c5eb25c06dc8 None admin] PATH_INFO: `/v3/users/1ba763318101478b8fd538190a09e314` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:40.571424 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5830796-34ff-4f15-b02f-c5eb25c06dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba763318101478b8fd538190a09e314)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:40.573251 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5830796-34ff-4f15-b02f-c5eb25c06dc8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:40.575591 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 45/92] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:40 2022] GET /identity/v3/users/1ba763318101478b8fd538190a09e314 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:40.580759 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5830796-34ff-4f15-b02f-c5eb25c06dc8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:40.621556 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19ea34-39d3-4623-9690-04d1d832519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:40.622492 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19ea34-39d3-4623-9690-04d1d832519a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:40.622815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19ea34-39d3-4623-9690-04d1d832519a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:40.623399 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19ea34-39d3-4623-9690-04d1d832519a None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:40.625407 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19ea34-39d3-4623-9690-04d1d832519a None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:40.627030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19ea34-39d3-4623-9690-04d1d832519a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:40.628796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 48/93] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:40 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:40.638807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19ea34-39d3-4623-9690-04d1d832519a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:40.731326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:40.811062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:40.812290 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19ea34-39d3-4623-9690-04d1d832519a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:40.870545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5830796-34ff-4f15-b02f-c5eb25c06dc8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:40.882188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559cd4a-a5f7-49f9-bc1d-ce7c8baef49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:40.883175 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559cd4a-a5f7-49f9-bc1d-ce7c8baef49d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:40.883690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559cd4a-a5f7-49f9-bc1d-ce7c8baef49d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:40.884192 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559cd4a-a5f7-49f9-bc1d-ce7c8baef49d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:40.885266 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559cd4a-a5f7-49f9-bc1d-ce7c8baef49d None admin] RBAC: Adding query filter params (role.id=4876e759b9504964a874992dc66b6df1, scope.project.id=d9b28400715c475eb364b4a9afdd6046, user.id=1ba763318101478b8fd538190a09e314) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:40.885787 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559cd4a-a5f7-49f9-bc1d-ce7c8baef49d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:40.888206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559cd4a-a5f7-49f9-bc1d-ce7c8baef49d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:40.901488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 49/94] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:40 2022] GET /identity/v3/role_assignments?user.id=1ba763318101478b8fd538190a09e314&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=4876e759b9504964a874992dc66b6df1 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:40.936337 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56cbe1-ccf5-42d5-99e6-6e4c7e9f5b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:40.937031 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56cbe1-ccf5-42d5-99e6-6e4c7e9f5b89 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:40.937323 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56cbe1-ccf5-42d5-99e6-6e4c7e9f5b89 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:40.937601 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56cbe1-ccf5-42d5-99e6-6e4c7e9f5b89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:41.042569 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56cbe1-ccf5-42d5-99e6-6e4c7e9f5b89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:41.045192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56cbe1-ccf5-42d5-99e6-6e4c7e9f5b89 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:41.171614 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:41.195894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 46/95] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:02:41.201863 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559cd4a-a5f7-49f9-bc1d-ce7c8baef49d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:41.380573 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559cd4a-a5f7-49f9-bc1d-ce7c8baef49d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:41.399816 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:41.426590 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88727c-dcd0-4513-9f39-b5d497abc3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:41.427414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88727c-dcd0-4513-9f39-b5d497abc3ed None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:41.427695 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88727c-dcd0-4513-9f39-b5d497abc3ed None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:41.427968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88727c-dcd0-4513-9f39-b5d497abc3ed None admin] PATH_INFO: `/v3/projects/06287dec58c042928e43ef18752703c6` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:41.429219 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88727c-dcd0-4513-9f39-b5d497abc3ed None admin] RBAC: Authorizing `identity:get_project(project_id=06287dec58c042928e43ef18752703c6)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:41.430764 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88727c-dcd0-4513-9f39-b5d497abc3ed None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:41.432868 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 50/96] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:41 2022] GET /identity/v3/projects/06287dec58c042928e43ef18752703c6 => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:41.439559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56cbe1-ccf5-42d5-99e6-6e4c7e9f5b89 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:41.579614 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56cbe1-ccf5-42d5-99e6-6e4c7e9f5b89 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:41.620678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67d562-baf0-4e0b-a005-36c01aab6d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:41.621363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67d562-baf0-4e0b-a005-36c01aab6d46 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:41.621644 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67d562-baf0-4e0b-a005-36c01aab6d46 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:41.621978 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67d562-baf0-4e0b-a005-36c01aab6d46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:41.623356 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67d562-baf0-4e0b-a005-36c01aab6d46 None admin] RBAC: Adding query filter params (role.id=edf99f336b2440b19ff28bcd8da8433b, scope.project.id=06287dec58c042928e43ef18752703c6, user.id=1ba763318101478b8fd538190a09e314) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:41.623669 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67d562-baf0-4e0b-a005-36c01aab6d46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:41.625125 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67d562-baf0-4e0b-a005-36c01aab6d46 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:41.631378 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 47/97] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:41 2022] GET /identity/v3/role_assignments?user.id=1ba763318101478b8fd538190a09e314&scope.project.id=06287dec58c042928e43ef18752703c6&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:42.979500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe39f4b-9469-426c-bbb4-fef672edb48f None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:42.980036 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe39f4b-9469-426c-bbb4-fef672edb48f None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:42.980036 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe39f4b-9469-426c-bbb4-fef672edb48f None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:42.982129 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 51/98] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:42.987670 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471d01-6051-465b-a900-b7e025e9a4b3 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:42.988170 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471d01-6051-465b-a900-b7e025e9a4b3 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:42.988261 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471d01-6051-465b-a900-b7e025e9a4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:43.015900 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-79471d01-6051-465b-a900-b7e025e9a4b3 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:43.017139 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-79471d01-6051-465b-a900-b7e025e9a4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:43.071980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:43.117161 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 48/99] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:43.160649 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe39f4b-9469-426c-bbb4-fef672edb48f None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:43.300381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e825833-daa3-4e49-ae68-c3eaee33a116 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:43.300584 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e825833-daa3-4e49-ae68-c3eaee33a116 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:43.300854 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e825833-daa3-4e49-ae68-c3eaee33a116 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:43.302033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe39f4b-9469-426c-bbb4-fef672edb48f None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:43.302418 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 49/100] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:43.310660 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a205b-e622-467d-b2ff-dac77ea44baa None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:43.310948 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a205b-e622-467d-b2ff-dac77ea44baa None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:43.311232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a205b-e622-467d-b2ff-dac77ea44baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:43.347511 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-fe9a205b-e622-467d-b2ff-dac77ea44baa None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:43.348725 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-fe9a205b-e622-467d-b2ff-dac77ea44baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:43.395998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2de7d-6d3c-4637-a30b-f67d7327a735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:43.396803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2de7d-6d3c-4637-a30b-f67d7327a735 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:43.397083 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2de7d-6d3c-4637-a30b-f67d7327a735 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:43.397357 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2de7d-6d3c-4637-a30b-f67d7327a735 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:43.399524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2de7d-6d3c-4637-a30b-f67d7327a735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:43.400982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2de7d-6d3c-4637-a30b-f67d7327a735 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:43.404879 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 52/101] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:43.406137 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63617fa-3859-43bb-b085-cefd2407feb7 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:43.406424 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63617fa-3859-43bb-b085-cefd2407feb7 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:43.406727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63617fa-3859-43bb-b085-cefd2407feb7 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:43.408400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 53/102] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:43.408958 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63617fa-3859-43bb-b085-cefd2407feb7 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:43.462358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 50/103] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:43.463820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c4834-df6a-45cb-bba8-8f93be00eb33 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:43.464116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c4834-df6a-45cb-bba8-8f93be00eb33 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:43.464506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c4834-df6a-45cb-bba8-8f93be00eb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:43.483183 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-ee9c4834-df6a-45cb-bba8-8f93be00eb33 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:43.484390 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-ee9c4834-df6a-45cb-bba8-8f93be00eb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:43.484903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:43.561116 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63617fa-3859-43bb-b085-cefd2407feb7 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:43.561793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 51/104] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:43.563332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9802ed-71e0-4d36-8afc-915c6f5572d6 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:43.563843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9802ed-71e0-4d36-8afc-915c6f5572d6 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:43.564310 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9802ed-71e0-4d36-8afc-915c6f5572d6 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:43.566080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 52/105] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:43.566989 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9802ed-71e0-4d36-8afc-915c6f5572d6 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:43.619593 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:43.619875 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe27c-4ab5-4cfb-aa52-4e6558864806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:43.620519 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe27c-4ab5-4cfb-aa52-4e6558864806 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:43.620806 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe27c-4ab5-4cfb-aa52-4e6558864806 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:43.621085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe27c-4ab5-4cfb-aa52-4e6558864806 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:43.621814 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abe27c-4ab5-4cfb-aa52-4e6558864806 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:43.623406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abe27c-4ab5-4cfb-aa52-4e6558864806 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:43.682528 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9802ed-71e0-4d36-8afc-915c6f5572d6 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:43.720083 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5bdf8-8567-42ca-a9dc-782d5ce36ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:43.720901 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5bdf8-8567-42ca-a9dc-782d5ce36ebe None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:43.721180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5bdf8-8567-42ca-a9dc-782d5ce36ebe None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:43.721490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5bdf8-8567-42ca-a9dc-782d5ce36ebe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:43.725027 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 54/106] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:02:43 2022] POST /identity/v3/projects => generated 302 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:02:43.727814 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f891-1b56-440f-ba36-54da30f17715 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:43.727814 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f891-1b56-440f-ba36-54da30f17715 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:43.727814 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f891-1b56-440f-ba36-54da30f17715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:43.735007 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5bdf8-8567-42ca-a9dc-782d5ce36ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-a8b5bdf8-8567-42ca-a9dc-782d5ce36ebe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:43.743965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:43.745254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:02:43.746364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:43.749117 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 53/107] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:43.750384 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5bdf8-8567-42ca-a9dc-782d5ce36ebe None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:43.763061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-c556f891-1b56-440f-ba36-54da30f17715 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:43.763061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-c556f891-1b56-440f-ba36-54da30f17715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:43.872680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 55/108] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:43.873706 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556f891-1b56-440f-ba36-54da30f17715 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:43.919215 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:43.982371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:43.989319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5bdf8-8567-42ca-a9dc-782d5ce36ebe None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:43.991701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556f891-1b56-440f-ba36-54da30f17715 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:44.026073 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd9479-6a60-44c6-aa69-8754e522916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:44.026924 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd9479-6a60-44c6-aa69-8754e522916d None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:44.027219 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd9479-6a60-44c6-aa69-8754e522916d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:44.027500 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd9479-6a60-44c6-aa69-8754e522916d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:44.030475 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355ba83-b5c5-4571-95ae-1386d09ec350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:44.031255 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355ba83-b5c5-4571-95ae-1386d09ec350 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:44.031612 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355ba83-b5c5-4571-95ae-1386d09ec350 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:44.031960 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355ba83-b5c5-4571-95ae-1386d09ec350 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:44.032799 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355ba83-b5c5-4571-95ae-1386d09ec350 None admin] RBAC: Adding query filter params (name=reader) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:44.033214 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355ba83-b5c5-4571-95ae-1386d09ec350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:44.034731 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355ba83-b5c5-4571-95ae-1386d09ec350 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:44.041044 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd9479-6a60-44c6-aa69-8754e522916d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:44.044550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 56/109] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:02:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:44.059924 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355ba83-b5c5-4571-95ae-1386d09ec350 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-0ddd9479-6a60-44c6-aa69-8754e522916d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:44.060063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:44.061084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 54/110] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:02:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:44.062004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd9479-6a60-44c6-aa69-8754e522916d None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:44.179828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:44.181525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd9479-6a60-44c6-aa69-8754e522916d None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:44.184319 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355ba83-b5c5-4571-95ae-1386d09ec350 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:44.231042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ebe55-3a1e-4e35-95c1-02370188606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:44.232501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ebe55-3a1e-4e35-95c1-02370188606e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:44.232786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ebe55-3a1e-4e35-95c1-02370188606e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:44.233063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ebe55-3a1e-4e35-95c1-02370188606e None admin] PATH_INFO: `/v3/users/1bc1bb82357341f78866f0894f68d2d6` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:44.244628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd529c5-63b9-48e5-ad0c-f0781c667749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:44.245459 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd529c5-63b9-48e5-ad0c-f0781c667749 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:44.245751 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd529c5-63b9-48e5-ad0c-f0781c667749 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:44.246032 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd529c5-63b9-48e5-ad0c-f0781c667749 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:44.259851 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ebe55-3a1e-4e35-95c1-02370188606e None admin] RBAC: Authorizing `identity:get_user(user_id=1bc1bb82357341f78866f0894f68d2d6)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:44.261382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ebe55-3a1e-4e35-95c1-02370188606e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:44.263292 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 55/111] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:44 2022] GET /identity/v3/users/1bc1bb82357341f78866f0894f68d2d6 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:44.265443 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ebe55-3a1e-4e35-95c1-02370188606e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:44.269242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd529c5-63b9-48e5-ad0c-f0781c667749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-3fd529c5-63b9-48e5-ad0c-f0781c667749 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:44.277237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:44.279010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:44.280115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:44.282274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 57/112] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:44.287448 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd529c5-63b9-48e5-ad0c-f0781c667749 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:44.298574 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:44.486372 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ebe55-3a1e-4e35-95c1-02370188606e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:44.518496 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd529c5-63b9-48e5-ad0c-f0781c667749 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:44.533022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970bcc9-cbf4-41db-b405-70e545ed7b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:44.533713 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970bcc9-cbf4-41db-b405-70e545ed7b1a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:44.534325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970bcc9-cbf4-41db-b405-70e545ed7b1a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:44.534634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970bcc9-cbf4-41db-b405-70e545ed7b1a None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:44.535954 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970bcc9-cbf4-41db-b405-70e545ed7b1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:44.536269 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970bcc9-cbf4-41db-b405-70e545ed7b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:44.538277 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970bcc9-cbf4-41db-b405-70e545ed7b1a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:44.549994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 56/113] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:44.555088 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970bcc9-cbf4-41db-b405-70e545ed7b1a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:44.569474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7b2a6-21aa-4e71-8911-9bc08db40e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:44.570668 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7b2a6-21aa-4e71-8911-9bc08db40e32 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:44.570967 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7b2a6-21aa-4e71-8911-9bc08db40e32 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:44.571254 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7b2a6-21aa-4e71-8911-9bc08db40e32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:44.609620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:44.651538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:44.677388 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7b2a6-21aa-4e71-8911-9bc08db40e32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:44.678597 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970bcc9-cbf4-41db-b405-70e545ed7b1a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:44.679356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7b2a6-21aa-4e71-8911-9bc08db40e32 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:44.725827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39fbe0-cfe0-4bb1-a8cd-605ad5905c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:44.726920 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39fbe0-cfe0-4bb1-a8cd-605ad5905c62 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:44.727398 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39fbe0-cfe0-4bb1-a8cd-605ad5905c62 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:44.727842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39fbe0-cfe0-4bb1-a8cd-605ad5905c62 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:44.729514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39fbe0-cfe0-4bb1-a8cd-605ad5905c62 None admin] RBAC: Adding query filter params (name=member) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:44.730536 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39fbe0-cfe0-4bb1-a8cd-605ad5905c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:44.733073 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39fbe0-cfe0-4bb1-a8cd-605ad5905c62 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:44.746443 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 57/114] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:02:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:44.752384 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679e49-84c5-48fa-9945-91fe25bd0617 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:44.752748 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679e49-84c5-48fa-9945-91fe25bd0617 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:44.752951 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679e49-84c5-48fa-9945-91fe25bd0617 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:44.754671 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 58/115] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:44.756539 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a679e49-84c5-48fa-9945-91fe25bd0617 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:44.815038 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 58/116] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:02:44.816362 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7b2a6-21aa-4e71-8911-9bc08db40e32 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:44.877278 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a679e49-84c5-48fa-9945-91fe25bd0617 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:44.884577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:44.926415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1aac0-5c3e-445d-84d6-9a690a138295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:44.927623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1aac0-5c3e-445d-84d6-9a690a138295 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:44.928089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1aac0-5c3e-445d-84d6-9a690a138295 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:44.928557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1aac0-5c3e-445d-84d6-9a690a138295 None admin] PATH_INFO: `/v3/users/d596087257d3471085b47d30599a9a82` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:44.929818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1aac0-5c3e-445d-84d6-9a690a138295 None admin] RBAC: Authorizing `identity:get_user(user_id=d596087257d3471085b47d30599a9a82)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:44.931440 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1aac0-5c3e-445d-84d6-9a690a138295 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:44.933098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 59/117] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:44 2022] GET /identity/v3/users/d596087257d3471085b47d30599a9a82 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:44.934263 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f5e37-9967-41ab-b694-88798ed9888b None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:44.935221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f5e37-9967-41ab-b694-88798ed9888b None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:44.935507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f5e37-9967-41ab-b694-88798ed9888b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:44.941536 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:44.946930 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7b2a6-21aa-4e71-8911-9bc08db40e32 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:44.953341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-d07f5e37-9967-41ab-b694-88798ed9888b None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:44.954636 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-d07f5e37-9967-41ab-b694-88798ed9888b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:44.984929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6a720-6111-4dab-b6dc-cb9312083ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:44.985832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6a720-6111-4dab-b6dc-cb9312083ce2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:44.986116 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6a720-6111-4dab-b6dc-cb9312083ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:44.986393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6a720-6111-4dab-b6dc-cb9312083ce2 None admin] PATH_INFO: `/v3/users/1ba763318101478b8fd538190a09e314` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:44.987883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6a720-6111-4dab-b6dc-cb9312083ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba763318101478b8fd538190a09e314)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:44.989429 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6a720-6111-4dab-b6dc-cb9312083ce2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:44.991610 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 59/118] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:44 2022] GET /identity/v3/users/1ba763318101478b8fd538190a09e314 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:44.992530 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6a720-6111-4dab-b6dc-cb9312083ce2 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:45.038750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 60/119] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:45.044193 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc392-d5b0-466f-b7e9-3ae79b2e3597 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.044702 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc392-d5b0-466f-b7e9-3ae79b2e3597 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.045668 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc392-d5b0-466f-b7e9-3ae79b2e3597 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.047741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 61/120] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:45.048658 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc392-d5b0-466f-b7e9-3ae79b2e3597 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:45.116679 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6a720-6111-4dab-b6dc-cb9312083ce2 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:45.146801 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:45.158289 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6203d-4b73-4feb-a5c6-dfce30043042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:45.159264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6203d-4b73-4feb-a5c6-dfce30043042 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.159660 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6203d-4b73-4feb-a5c6-dfce30043042 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.160061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6203d-4b73-4feb-a5c6-dfce30043042 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.161516 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6203d-4b73-4feb-a5c6-dfce30043042 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:45.163219 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6203d-4b73-4feb-a5c6-dfce30043042 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:45.167834 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc392-d5b0-466f-b7e9-3ae79b2e3597 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:45.170250 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 60/121] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:44 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:45.171467 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6203d-4b73-4feb-a5c6-dfce30043042 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:45.207867 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44085e9d-4e75-414e-b221-6c53b8718b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:45.208748 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085e9d-4e75-414e-b221-6c53b8718b43 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.209034 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085e9d-4e75-414e-b221-6c53b8718b43 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.209312 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085e9d-4e75-414e-b221-6c53b8718b43 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.210578 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44085e9d-4e75-414e-b221-6c53b8718b43 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:45.212068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44085e9d-4e75-414e-b221-6c53b8718b43 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:45.213987 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 62/122] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:45 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:45.221821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c010d88-9a47-4c44-82fb-7074c8e93046 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.221821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c010d88-9a47-4c44-82fb-7074c8e93046 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.221821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c010d88-9a47-4c44-82fb-7074c8e93046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.226203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:45.239722 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-3c010d88-9a47-4c44-82fb-7074c8e93046 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:45.240932 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-3c010d88-9a47-4c44-82fb-7074c8e93046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:45.292273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6203d-4b73-4feb-a5c6-dfce30043042 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:45.319059 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 63/123] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:45.319805 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c010d88-9a47-4c44-82fb-7074c8e93046 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:45.343822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81158d78-bcc5-4c80-ae53-7ccee02f6982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:45.344696 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81158d78-bcc5-4c80-ae53-7ccee02f6982 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.344983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81158d78-bcc5-4c80-ae53-7ccee02f6982 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.345257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81158d78-bcc5-4c80-ae53-7ccee02f6982 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.346592 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81158d78-bcc5-4c80-ae53-7ccee02f6982 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:45.348077 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81158d78-bcc5-4c80-ae53-7ccee02f6982 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:45.349992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 61/124] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:45 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:45.350580 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81158d78-bcc5-4c80-ae53-7ccee02f6982 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:45.414748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:45.433043 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c010d88-9a47-4c44-82fb-7074c8e93046 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:45.456278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81158d78-bcc5-4c80-ae53-7ccee02f6982 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:45.466317 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:45.471555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e7561-d635-4e96-a970-6c9f9a09f8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:45.472534 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e7561-d635-4e96-a970-6c9f9a09f8fe None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.472833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e7561-d635-4e96-a970-6c9f9a09f8fe None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.477426 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e7561-d635-4e96-a970-6c9f9a09f8fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.484520 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e7561-d635-4e96-a970-6c9f9a09f8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:45.492473 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb88e9-3da1-4387-ad4b-4d42165e99c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-b65e7561-d635-4e96-a970-6c9f9a09f8fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:45.492963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:45.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:02:45.495525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:45.496363 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb88e9-3da1-4387-ad4b-4d42165e99c6 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.496363 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb88e9-3da1-4387-ad4b-4d42165e99c6 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.496543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 64/125] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:02:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:45.496543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e7561-d635-4e96-a970-6c9f9a09f8fe None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:45.496718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb88e9-3da1-4387-ad4b-4d42165e99c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.496718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb88e9-3da1-4387-ad4b-4d42165e99c6 None admin] RBAC: Adding query filter params (role.id=03fc945060c64e0cb56cff9471d1b1c2, scope.project.id=d9b28400715c475eb364b4a9afdd6046, user.id=1bc1bb82357341f78866f0894f68d2d6) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:45.496718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb88e9-3da1-4387-ad4b-4d42165e99c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:45.498524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb88e9-3da1-4387-ad4b-4d42165e99c6 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:45.505191 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 62/126] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:45 2022] GET /identity/v3/role_assignments?user.id=1bc1bb82357341f78866f0894f68d2d6&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=03fc945060c64e0cb56cff9471d1b1c2 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:45.505910 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb88e9-3da1-4387-ad4b-4d42165e99c6 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:45.632262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb88e9-3da1-4387-ad4b-4d42165e99c6 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:45.634400 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e7561-d635-4e96-a970-6c9f9a09f8fe None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:45.664453 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:45.674825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ecd80-f237-4477-9060-b528da56a3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:45.675893 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22347ee-c533-40ad-ac1e-835a81415422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:45.683421 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ecd80-f237-4477-9060-b528da56a3cd None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.683421 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ecd80-f237-4477-9060-b528da56a3cd None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.683680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22347ee-c533-40ad-ac1e-835a81415422 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.683770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ecd80-f237-4477-9060-b528da56a3cd None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046/users/d596087257d3471085b47d30599a9a82/roles/38e07a16dc8b4306be7688b9d5cd626b` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.683862 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22347ee-c533-40ad-ac1e-835a81415422 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.683862 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22347ee-c533-40ad-ac1e-835a81415422 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.684018 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ecd80-f237-4477-9060-b528da56a3cd None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b28400715c475eb364b4a9afdd6046, user_id=d596087257d3471085b47d30599a9a82, role_id=38e07a16dc8b4306be7688b9d5cd626b)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:45.684018 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ecd80-f237-4477-9060-b528da56a3cd None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:45.691180 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22347ee-c533-40ad-ac1e-835a81415422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-f22347ee-c533-40ad-ac1e-835a81415422 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:45.699031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:45.700326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:45.701423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:45.704284 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 63/127] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:45.708824 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22347ee-c533-40ad-ac1e-835a81415422 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:45.775591 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 65/128] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:02:45 2022] PUT /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046/users/d596087257d3471085b47d30599a9a82/roles/38e07a16dc8b4306be7688b9d5cd626b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:02:45.776829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ecd80-f237-4477-9060-b528da56a3cd None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:45.817491 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22347ee-c533-40ad-ac1e-835a81415422 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:45.845450 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:45.860438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9003771-d5b9-47aa-9cfd-dd633f633a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:45.861737 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9003771-d5b9-47aa-9cfd-dd633f633a5f None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.862269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9003771-d5b9-47aa-9cfd-dd633f633a5f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.862815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9003771-d5b9-47aa-9cfd-dd633f633a5f None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046/users/1ba763318101478b8fd538190a09e314/roles/edf99f336b2440b19ff28bcd8da8433b` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.865068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9003771-d5b9-47aa-9cfd-dd633f633a5f None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b28400715c475eb364b4a9afdd6046, user_id=1ba763318101478b8fd538190a09e314, role_id=edf99f336b2440b19ff28bcd8da8433b)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:45.866807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9003771-d5b9-47aa-9cfd-dd633f633a5f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:45.912974 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ecd80-f237-4477-9060-b528da56a3cd None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:45.956502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cee10-6c85-417d-95f5-f92fa4c27ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:45.957216 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cee10-6c85-417d-95f5-f92fa4c27ec9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.957803 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cee10-6c85-417d-95f5-f92fa4c27ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.958101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cee10-6c85-417d-95f5-f92fa4c27ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.958965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cee10-6c85-417d-95f5-f92fa4c27ec9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:45.959284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cee10-6c85-417d-95f5-f92fa4c27ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:45.960766 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cee10-6c85-417d-95f5-f92fa4c27ec9 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:45.970830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 66/129] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:02:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:45.971744 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cee10-6c85-417d-95f5-f92fa4c27ec9 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:46.013640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 64/130] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:02:45 2022] PUT /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046/users/1ba763318101478b8fd538190a09e314/roles/edf99f336b2440b19ff28bcd8da8433b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:02:46.015566 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9003771-d5b9-47aa-9cfd-dd633f633a5f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:46.094675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cee10-6c85-417d-95f5-f92fa4c27ec9 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:46.095874 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:46.112034 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:46.136050 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59033-5a3a-406f-85c2-8683db322f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:46.136755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59033-5a3a-406f-85c2-8683db322f1b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:46.137048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59033-5a3a-406f-85c2-8683db322f1b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:46.137334 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59033-5a3a-406f-85c2-8683db322f1b None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:46.138148 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59033-5a3a-406f-85c2-8683db322f1b None admin] RBAC: Adding query filter params (name=member) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:46.138465 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59033-5a3a-406f-85c2-8683db322f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:46.139898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59033-5a3a-406f-85c2-8683db322f1b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:46.152270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 67/131] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:02:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:46.159605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59033-5a3a-406f-85c2-8683db322f1b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:46.185323 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9003771-d5b9-47aa-9cfd-dd633f633a5f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:46.262166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b3d24-d60d-45a9-b931-b08ac3a259be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:46.263117 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b3d24-d60d-45a9-b931-b08ac3a259be None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:46.263401 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b3d24-d60d-45a9-b931-b08ac3a259be None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:46.263682 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b3d24-d60d-45a9-b931-b08ac3a259be None admin] PATH_INFO: `/v3/users/1ba763318101478b8fd538190a09e314` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:46.266072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b3d24-d60d-45a9-b931-b08ac3a259be None admin] RBAC: Authorizing `identity:get_user(user_id=1ba763318101478b8fd538190a09e314)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:46.267629 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b3d24-d60d-45a9-b931-b08ac3a259be None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:46.269393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 65/132] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:46 2022] GET /identity/v3/users/1ba763318101478b8fd538190a09e314 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:46.277047 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b3d24-d60d-45a9-b931-b08ac3a259be None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:46.396576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59033-5a3a-406f-85c2-8683db322f1b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:46.407489 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b3d24-d60d-45a9-b931-b08ac3a259be None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:46.440052 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:46.445500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e00bb-738c-40b0-88af-25eba4abc71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:46.446381 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e00bb-738c-40b0-88af-25eba4abc71e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:46.446704 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e00bb-738c-40b0-88af-25eba4abc71e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:46.446987 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e00bb-738c-40b0-88af-25eba4abc71e None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:46.448220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e00bb-738c-40b0-88af-25eba4abc71e None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:46.450671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e00bb-738c-40b0-88af-25eba4abc71e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:46.453003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e5195-c9e1-4df0-9df0-5a64dd852b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:46.453216 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 66/133] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:46 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:46.456605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5195-c9e1-4df0-9df0-5a64dd852b7f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:46.456721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2192ba-6bf3-4bd0-a1c8-f32d27cb69a8 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:46.456802 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5195-c9e1-4df0-9df0-5a64dd852b7f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:46.456878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2192ba-6bf3-4bd0-a1c8-f32d27cb69a8 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:46.456960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5195-c9e1-4df0-9df0-5a64dd852b7f None admin] PATH_INFO: `/v3/users/1ba763318101478b8fd538190a09e314` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:46.457050 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2192ba-6bf3-4bd0-a1c8-f32d27cb69a8 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:46.457050 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 67/134] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:46.459412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e5195-c9e1-4df0-9df0-5a64dd852b7f None admin] RBAC: Authorizing `identity:get_user(user_id=1ba763318101478b8fd538190a09e314)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:46.461103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e5195-c9e1-4df0-9df0-5a64dd852b7f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:46.462114 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2192ba-6bf3-4bd0-a1c8-f32d27cb69a8 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:46.466679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 68/135] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:46 2022] GET /identity/v3/users/1ba763318101478b8fd538190a09e314 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:46.467655 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba93690-0583-4e8f-bc24-d44d0945570f None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:46.467955 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba93690-0583-4e8f-bc24-d44d0945570f None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:46.468235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba93690-0583-4e8f-bc24-d44d0945570f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:46.490263 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-aba93690-0583-4e8f-bc24-d44d0945570f None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:46.491911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-aba93690-0583-4e8f-bc24-d44d0945570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:46.562262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:46.581544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2192ba-6bf3-4bd0-a1c8-f32d27cb69a8 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:46.613223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 69/136] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:46.614003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba93690-0583-4e8f-bc24-d44d0945570f None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:46.619779 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca39155-8796-44e6-8b3b-3b491200d900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:46.620688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca39155-8796-44e6-8b3b-3b491200d900 None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:46.620971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca39155-8796-44e6-8b3b-3b491200d900 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:46.621248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca39155-8796-44e6-8b3b-3b491200d900 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046/users/1ba763318101478b8fd538190a09e314/roles/4876e759b9504964a874992dc66b6df1` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:46.623564 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca39155-8796-44e6-8b3b-3b491200d900 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b28400715c475eb364b4a9afdd6046, user_id=1ba763318101478b8fd538190a09e314, role_id=4876e759b9504964a874992dc66b6df1)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:46.625032 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca39155-8796-44e6-8b3b-3b491200d900 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:46.708039 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 68/137] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:02:46 2022] PUT /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046/users/1ba763318101478b8fd538190a09e314/roles/4876e759b9504964a874992dc66b6df1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:02:46.708610 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca39155-8796-44e6-8b3b-3b491200d900 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:46.771377 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:46.801618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba93690-0583-4e8f-bc24-d44d0945570f None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:46.879562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca39155-8796-44e6-8b3b-3b491200d900 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:46.923375 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dab35-f556-4ad6-91ee-469b7c5764c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:46.924282 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dab35-f556-4ad6-91ee-469b7c5764c5 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:46.924572 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dab35-f556-4ad6-91ee-469b7c5764c5 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:46.924854 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dab35-f556-4ad6-91ee-469b7c5764c5 None admin] PATH_INFO: `/v3/projects/06287dec58c042928e43ef18752703c6` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:46.931034 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359631df-12e9-491c-b991-1a7976b1bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:46.931478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dab35-f556-4ad6-91ee-469b7c5764c5 None admin] RBAC: Authorizing `identity:get_project(project_id=06287dec58c042928e43ef18752703c6)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:46.931858 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359631df-12e9-491c-b991-1a7976b1bc25 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:46.932194 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359631df-12e9-491c-b991-1a7976b1bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:46.932475 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359631df-12e9-491c-b991-1a7976b1bc25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:46.932984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dab35-f556-4ad6-91ee-469b7c5764c5 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:46.933731 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359631df-12e9-491c-b991-1a7976b1bc25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:46.935628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 70/138] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:46 2022] GET /identity/v3/projects/06287dec58c042928e43ef18752703c6 => generated 312 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:46.935851 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359631df-12e9-491c-b991-1a7976b1bc25 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:46.943679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dab35-f556-4ad6-91ee-469b7c5764c5 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:46.943912 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 69/139] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:46.951256 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359631df-12e9-491c-b991-1a7976b1bc25 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:47.066814 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:47.126282 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359631df-12e9-491c-b991-1a7976b1bc25 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:47.148049 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:47.175619 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dab35-f556-4ad6-91ee-469b7c5764c5 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:47.223644 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f06b0-f25f-442f-a968-502830aee642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:47.224636 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f06b0-f25f-442f-a968-502830aee642 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:47.224970 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f06b0-f25f-442f-a968-502830aee642 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:47.225255 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f06b0-f25f-442f-a968-502830aee642 None admin] PATH_INFO: `/v3/projects/06287dec58c042928e43ef18752703c6/users/1ba763318101478b8fd538190a09e314/roles/edf99f336b2440b19ff28bcd8da8433b` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:47.227535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f06b0-f25f-442f-a968-502830aee642 None admin] RBAC: Authorizing `identity:create_grant(project_id=06287dec58c042928e43ef18752703c6, user_id=1ba763318101478b8fd538190a09e314, role_id=edf99f336b2440b19ff28bcd8da8433b)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:47.229039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f06b0-f25f-442f-a968-502830aee642 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:47.240363 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e8a7c-3e1a-45ae-99c6-35b87574a4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:47.241116 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8a7c-3e1a-45ae-99c6-35b87574a4bb None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:47.241413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8a7c-3e1a-45ae-99c6-35b87574a4bb None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:47.241735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8a7c-3e1a-45ae-99c6-35b87574a4bb None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:47.242535 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e8a7c-3e1a-45ae-99c6-35b87574a4bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:47.244093 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e8a7c-3e1a-45ae-99c6-35b87574a4bb None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:47.324742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 71/140] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:02:46 2022] PUT /identity/v3/projects/06287dec58c042928e43ef18752703c6/users/1ba763318101478b8fd538190a09e314/roles/edf99f336b2440b19ff28bcd8da8433b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:02:47.366466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 70/141] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:02:46 2022] POST /identity/v3/users => generated 283 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:02:48.506000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf90d-821a-4195-843c-d4a638c2491a None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:48.506501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf90d-821a-4195-843c-d4a638c2491a None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:48.506501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf90d-821a-4195-843c-d4a638c2491a None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:48.508025 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 72/142] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:48.514436 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856f961-155e-4403-8a40-92c5202ff4a5 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:48.515355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856f961-155e-4403-8a40-92c5202ff4a5 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:48.515843 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856f961-155e-4403-8a40-92c5202ff4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:48.535387 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57999e-1c3d-4079-851c-f54fe8cd080b None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:48.535856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57999e-1c3d-4079-851c-f54fe8cd080b None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:48.536267 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57999e-1c3d-4079-851c-f54fe8cd080b None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:48.537866 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 73/143] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:48.539191 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-0856f961-155e-4403-8a40-92c5202ff4a5 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:48.540433 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-0856f961-155e-4403-8a40-92c5202ff4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:48.544132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08515e4-1913-4137-9912-e2de27b876a0 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:48.544432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08515e4-1913-4137-9912-e2de27b876a0 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:48.544712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08515e4-1913-4137-9912-e2de27b876a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:48.571184 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-e08515e4-1913-4137-9912-e2de27b876a0 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:48.572450 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-e08515e4-1913-4137-9912-e2de27b876a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:48.648335 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 71/144] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:48.678720 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 74/145] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:02:48.686395 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856f961-155e-4403-8a40-92c5202ff4a5 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:48.752552 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08515e4-1913-4137-9912-e2de27b876a0 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:48.804131 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:48.844021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:48.853758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856f961-155e-4403-8a40-92c5202ff4a5 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:48.921453 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce282d5-f883-4cb3-9300-3631d49213b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:48.922270 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce282d5-f883-4cb3-9300-3631d49213b9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:48.922552 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce282d5-f883-4cb3-9300-3631d49213b9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:48.922875 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce282d5-f883-4cb3-9300-3631d49213b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:48.929135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08515e4-1913-4137-9912-e2de27b876a0 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:48.959648 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce282d5-f883-4cb3-9300-3631d49213b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-fce282d5-f883-4cb3-9300-3631d49213b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:48.967733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:48.968804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:48.969717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 72/146] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:48.978229 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce282d5-f883-4cb3-9300-3631d49213b9 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:48.978566 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed370c-5fa6-4f07-92ba-6095b598bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:48.979636 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed370c-5fa6-4f07-92ba-6095b598bbcf None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:48.979920 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed370c-5fa6-4f07-92ba-6095b598bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:48.980196 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed370c-5fa6-4f07-92ba-6095b598bbcf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:48.994949 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed370c-5fa6-4f07-92ba-6095b598bbcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-38ed370c-5fa6-4f07-92ba-6095b598bbcf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:49.005362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:49.007707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:49.009916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 75/147] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:02:49.015708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed370c-5fa6-4f07-92ba-6095b598bbcf None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:49.137049 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce282d5-f883-4cb3-9300-3631d49213b9 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:49.169909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:49.184223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed370c-5fa6-4f07-92ba-6095b598bbcf None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:49.192268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d7e25-fd3a-4329-ad27-1384a8dec3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:49.192968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d7e25-fd3a-4329-ad27-1384a8dec3fe None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:49.193250 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d7e25-fd3a-4329-ad27-1384a8dec3fe None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:49.193528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d7e25-fd3a-4329-ad27-1384a8dec3fe None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:49.194302 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d7e25-fd3a-4329-ad27-1384a8dec3fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:49.194631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d7e25-fd3a-4329-ad27-1384a8dec3fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:49.196063 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d7e25-fd3a-4329-ad27-1384a8dec3fe None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:49.215574 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 73/148] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:49.228338 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d7e25-fd3a-4329-ad27-1384a8dec3fe None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:49.254482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:49.255544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aef960-072e-4bd2-84fe-a32ef2c96bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:49.256228 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aef960-072e-4bd2-84fe-a32ef2c96bf0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:49.256510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aef960-072e-4bd2-84fe-a32ef2c96bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:49.261106 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aef960-072e-4bd2-84fe-a32ef2c96bf0 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:49.261106 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aef960-072e-4bd2-84fe-a32ef2c96bf0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:49.261106 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aef960-072e-4bd2-84fe-a32ef2c96bf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:49.261106 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aef960-072e-4bd2-84fe-a32ef2c96bf0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:49.274159 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 76/149] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:02:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:49.280877 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aef960-072e-4bd2-84fe-a32ef2c96bf0 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:49.368115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d7e25-fd3a-4329-ad27-1384a8dec3fe None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:49.418260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ddb0d-19e9-410d-bdf3-50cc7cb8995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:49.419663 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ddb0d-19e9-410d-bdf3-50cc7cb8995b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:49.419945 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ddb0d-19e9-410d-bdf3-50cc7cb8995b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:49.420218 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ddb0d-19e9-410d-bdf3-50cc7cb8995b None admin] PATH_INFO: `/v3/users/d596087257d3471085b47d30599a9a82` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:49.421504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ddb0d-19e9-410d-bdf3-50cc7cb8995b None admin] RBAC: Authorizing `identity:get_user(user_id=d596087257d3471085b47d30599a9a82)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:49.423025 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ddb0d-19e9-410d-bdf3-50cc7cb8995b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:49.424725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 74/150] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:49 2022] GET /identity/v3/users/d596087257d3471085b47d30599a9a82 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:49.434774 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ddb0d-19e9-410d-bdf3-50cc7cb8995b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:49.471781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aef960-072e-4bd2-84fe-a32ef2c96bf0 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:49.536548 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:49.542459 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d2138-8695-4107-8899-074a1ea303ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:49.544587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d2138-8695-4107-8899-074a1ea303ac None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:49.545031 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d2138-8695-4107-8899-074a1ea303ac None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:49.548355 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d2138-8695-4107-8899-074a1ea303ac None admin] PATH_INFO: `/v3/users/1bc1bb82357341f78866f0894f68d2d6` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:49.548355 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d2138-8695-4107-8899-074a1ea303ac None admin] RBAC: Authorizing `identity:get_user(user_id=1bc1bb82357341f78866f0894f68d2d6)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:49.548355 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d2138-8695-4107-8899-074a1ea303ac None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:49.550988 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 77/151] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:49 2022] GET /identity/v3/users/1bc1bb82357341f78866f0894f68d2d6 => generated 289 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:49.556635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d2138-8695-4107-8899-074a1ea303ac None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:49.562353 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ddb0d-19e9-410d-bdf3-50cc7cb8995b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:49.591495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:49.644309 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b33d1a-7e85-4563-90c3-03363a6d3b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:49.644986 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b33d1a-7e85-4563-90c3-03363a6d3b15 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:49.645274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b33d1a-7e85-4563-90c3-03363a6d3b15 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:49.645558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b33d1a-7e85-4563-90c3-03363a6d3b15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:49.749041 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d2138-8695-4107-8899-074a1ea303ac None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:49.777427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b33d1a-7e85-4563-90c3-03363a6d3b15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:49.783860 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b33d1a-7e85-4563-90c3-03363a6d3b15 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:49.820297 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394c9f-5958-45d9-9371-c154d2f64e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:49.821447 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394c9f-5958-45d9-9371-c154d2f64e73 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:49.821959 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394c9f-5958-45d9-9371-c154d2f64e73 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:49.822408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394c9f-5958-45d9-9371-c154d2f64e73 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:49.823913 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3394c9f-5958-45d9-9371-c154d2f64e73 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:49.826133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3394c9f-5958-45d9-9371-c154d2f64e73 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:49.831009 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 78/152] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:49 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:49.836969 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394c9f-5958-45d9-9371-c154d2f64e73 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:49.975909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:50.002448 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 75/153] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:02:50.013938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b33d1a-7e85-4563-90c3-03363a6d3b15 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:50.024767 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:50.052122 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394c9f-5958-45d9-9371-c154d2f64e73 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:50.136263 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8975b-fc7a-41af-9019-8e83eb5b34b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:50.138086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8975b-fc7a-41af-9019-8e83eb5b34b0 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:50.138559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8975b-fc7a-41af-9019-8e83eb5b34b0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:50.139071 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8975b-fc7a-41af-9019-8e83eb5b34b0 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046/users/1bc1bb82357341f78866f0894f68d2d6/roles/03fc945060c64e0cb56cff9471d1b1c2` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:50.142626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8975b-fc7a-41af-9019-8e83eb5b34b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b28400715c475eb364b4a9afdd6046, user_id=1bc1bb82357341f78866f0894f68d2d6, role_id=03fc945060c64e0cb56cff9471d1b1c2)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:50.144360 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8975b-fc7a-41af-9019-8e83eb5b34b0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:50.163089 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b33d1a-7e85-4563-90c3-03363a6d3b15 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:50.213079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c3c7c-6d2a-4899-8e2a-80f7bea41240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:50.213973 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c3c7c-6d2a-4899-8e2a-80f7bea41240 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:50.214258 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c3c7c-6d2a-4899-8e2a-80f7bea41240 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:50.214592 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c3c7c-6d2a-4899-8e2a-80f7bea41240 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:50.219457 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c3c7c-6d2a-4899-8e2a-80f7bea41240 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:50.221064 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c3c7c-6d2a-4899-8e2a-80f7bea41240 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:50.224062 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 76/154] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:50 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:50.226731 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30207f4-e1ee-4901-9f9e-ab9c80c705e3 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:50.227187 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30207f4-e1ee-4901-9f9e-ab9c80c705e3 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:50.227626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30207f4-e1ee-4901-9f9e-ab9c80c705e3 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:50.229103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 77/155] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:02:50.230011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30207f4-e1ee-4901-9f9e-ab9c80c705e3 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:50.249161 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 79/156] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:02:49 2022] PUT /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046/users/1bc1bb82357341f78866f0894f68d2d6/roles/03fc945060c64e0cb56cff9471d1b1c2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:02:50.250882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9bf41-fb0f-42c5-a4d2-5d6599f04839 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:50.251377 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9bf41-fb0f-42c5-a4d2-5d6599f04839 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:50.251885 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9bf41-fb0f-42c5-a4d2-5d6599f04839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:50.286169 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-12e9bf41-fb0f-42c5-a4d2-5d6599f04839 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:50.287827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-12e9bf41-fb0f-42c5-a4d2-5d6599f04839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:50.323338 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:50.412993 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30207f4-e1ee-4901-9f9e-ab9c80c705e3 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:50.425823 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 80/157] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:50.466330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea355d-f5b2-4d84-9ef2-6cf7be59a41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:50.467051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea355d-f5b2-4d84-9ef2-6cf7be59a41a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:50.467337 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea355d-f5b2-4d84-9ef2-6cf7be59a41a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:50.467617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea355d-f5b2-4d84-9ef2-6cf7be59a41a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:50.468484 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea355d-f5b2-4d84-9ef2-6cf7be59a41a None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=d9b28400715c475eb364b4a9afdd6046, user.id=d596087257d3471085b47d30599a9a82) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:50.468799 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea355d-f5b2-4d84-9ef2-6cf7be59a41a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:50.470274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea355d-f5b2-4d84-9ef2-6cf7be59a41a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:50.477447 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 78/158] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:50 2022] GET /identity/v3/role_assignments?user.id=d596087257d3471085b47d30599a9a82&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:50.478858 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9bf41-fb0f-42c5-a4d2-5d6599f04839 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:50.486670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb4fca-d382-4ba2-8473-fdb42d226b2a None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:50.486670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb4fca-d382-4ba2-8473-fdb42d226b2a None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:50.486670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb4fca-d382-4ba2-8473-fdb42d226b2a None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:50.486670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 79/159] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:50.491414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034b1c5-8999-490f-a560-95dd0b99b455 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:50.491698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034b1c5-8999-490f-a560-95dd0b99b455 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:50.491988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034b1c5-8999-490f-a560-95dd0b99b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:50.522667 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-e034b1c5-8999-490f-a560-95dd0b99b455 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:50.522667 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-e034b1c5-8999-490f-a560-95dd0b99b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:50.625355 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:50.636847 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 80/160] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:50.651831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9bf41-fb0f-42c5-a4d2-5d6599f04839 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:50.680710 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034b1c5-8999-490f-a560-95dd0b99b455 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:50.698903 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc64747-446f-4139-82b9-1c4e98d995c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:50.700079 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc64747-446f-4139-82b9-1c4e98d995c9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:50.700552 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc64747-446f-4139-82b9-1c4e98d995c9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:50.701318 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc64747-446f-4139-82b9-1c4e98d995c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:50.713899 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc64747-446f-4139-82b9-1c4e98d995c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-0cc64747-446f-4139-82b9-1c4e98d995c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:50.722382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:50.724976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:50.725886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:50.728433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 81/161] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:50.735983 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc64747-446f-4139-82b9-1c4e98d995c9 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:50.802271 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:50.915277 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc64747-446f-4139-82b9-1c4e98d995c9 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:50.936863 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034b1c5-8999-490f-a560-95dd0b99b455 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:50.992473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709b0d-be8f-4756-aee4-0fd7d15acbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:50.993162 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709b0d-be8f-4756-aee4-0fd7d15acbc3 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:50.993449 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709b0d-be8f-4756-aee4-0fd7d15acbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:50.993733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709b0d-be8f-4756-aee4-0fd7d15acbc3 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:50.994663 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6709b0d-be8f-4756-aee4-0fd7d15acbc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:50.994978 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6709b0d-be8f-4756-aee4-0fd7d15acbc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:50.996390 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6709b0d-be8f-4756-aee4-0fd7d15acbc3 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:51.014945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 82/162] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:02:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:51.020822 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709b0d-be8f-4756-aee4-0fd7d15acbc3 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:51.023340 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a1f4c-d3d7-4893-b295-4895d672c0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:51.024176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a1f4c-d3d7-4893-b295-4895d672c0c1 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:51.024458 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a1f4c-d3d7-4893-b295-4895d672c0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:51.024765 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a1f4c-d3d7-4893-b295-4895d672c0c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:51.029404 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:51.051575 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a1f4c-d3d7-4893-b295-4895d672c0c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-a98a1f4c-d3d7-4893-b295-4895d672c0c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:51.060488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:51.061528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:51.062427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 81/163] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:02:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:51.067699 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a1f4c-d3d7-4893-b295-4895d672c0c1 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:51.220062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709b0d-be8f-4756-aee4-0fd7d15acbc3 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:51.270474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a1f4c-d3d7-4893-b295-4895d672c0c1 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:51.281555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:51.322473 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946db7-3918-4588-b397-9af7f987f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:51.323673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946db7-3918-4588-b397-9af7f987f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:51.324057 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946db7-3918-4588-b397-9af7f987f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:51.324569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946db7-3918-4588-b397-9af7f987f6f1 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:51.325569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946db7-3918-4588-b397-9af7f987f6f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:51.326002 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946db7-3918-4588-b397-9af7f987f6f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:51.327129 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe363191-09b2-4355-93fa-e6c0aaf6616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:51.328231 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe363191-09b2-4355-93fa-e6c0aaf6616e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:51.328693 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe363191-09b2-4355-93fa-e6c0aaf6616e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:51.328914 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946db7-3918-4588-b397-9af7f987f6f1 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:51.329297 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe363191-09b2-4355-93fa-e6c0aaf6616e None admin] PATH_INFO: `/v3/users/1ba763318101478b8fd538190a09e314` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:51.335549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe363191-09b2-4355-93fa-e6c0aaf6616e None admin] RBAC: Authorizing `identity:get_user(user_id=1ba763318101478b8fd538190a09e314)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:51.337271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe363191-09b2-4355-93fa-e6c0aaf6616e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:51.338581 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 82/164] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:02:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:51.339816 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 83/165] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:51 2022] GET /identity/v3/users/1ba763318101478b8fd538190a09e314 => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:51.348377 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946db7-3918-4588-b397-9af7f987f6f1 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:51.348570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe363191-09b2-4355-93fa-e6c0aaf6616e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:51.487046 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:51.560654 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946db7-3918-4588-b397-9af7f987f6f1 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:51.576801 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe363191-09b2-4355-93fa-e6c0aaf6616e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:51.652682 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7af428-5c85-4405-8fb7-1d944eaa27ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:51.654494 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7af428-5c85-4405-8fb7-1d944eaa27ab None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:51.654983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7af428-5c85-4405-8fb7-1d944eaa27ab None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:51.655541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7af428-5c85-4405-8fb7-1d944eaa27ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:51.688728 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc241a-0e49-4821-9aa5-07483cd00949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:51.689635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc241a-0e49-4821-9aa5-07483cd00949 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:51.689916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc241a-0e49-4821-9aa5-07483cd00949 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:51.690189 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc241a-0e49-4821-9aa5-07483cd00949 None admin] PATH_INFO: `/v3/users/1ba763318101478b8fd538190a09e314` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:51.695383 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc241a-0e49-4821-9aa5-07483cd00949 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba763318101478b8fd538190a09e314)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:51.696860 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc241a-0e49-4821-9aa5-07483cd00949 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:51.698966 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 84/166] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:51 2022] GET /identity/v3/users/1ba763318101478b8fd538190a09e314 => generated 275 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:51.704479 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc241a-0e49-4821-9aa5-07483cd00949 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:51.736054 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:51.784493 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7af428-5c85-4405-8fb7-1d944eaa27ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:51.786315 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7af428-5c85-4405-8fb7-1d944eaa27ab None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:51.980627 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc241a-0e49-4821-9aa5-07483cd00949 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:52.058426 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 83/167] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:02:52.060169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a75a2-d37c-4be3-8d7d-f1c20e55f48f None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:52.060456 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a75a2-d37c-4be3-8d7d-f1c20e55f48f None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:52.060806 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a75a2-d37c-4be3-8d7d-f1c20e55f48f None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:52.062256 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 84/168] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:52.067815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b615-8bd1-4472-aa87-871ee6714ab9 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:52.068096 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b615-8bd1-4472-aa87-871ee6714ab9 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:52.068373 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b615-8bd1-4472-aa87-871ee6714ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:52.069086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0e2ee-cf50-4421-8efc-d539238429ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:52.069753 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0e2ee-cf50-4421-8efc-d539238429ed None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:52.070039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0e2ee-cf50-4421-8efc-d539238429ed None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:52.070317 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0e2ee-cf50-4421-8efc-d539238429ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:52.086950 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:52.114648 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-9276b615-8bd1-4472-aa87-871ee6714ab9 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:52.115862 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-9276b615-8bd1-4472-aa87-871ee6714ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:52.246150 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0e2ee-cf50-4421-8efc-d539238429ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:52.248234 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0e2ee-cf50-4421-8efc-d539238429ed None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:52.295715 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:52.309261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 85/169] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:02:52.310650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276b615-8bd1-4472-aa87-871ee6714ab9 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:52.498525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 85/170] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:02:52.499247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0e2ee-cf50-4421-8efc-d539238429ed None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:52.538637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276b615-8bd1-4472-aa87-871ee6714ab9 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:52.577510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:52.615263 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a26fb3-92af-42a3-b201-3e9b82caef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:52.616155 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a26fb3-92af-42a3-b201-3e9b82caef43 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:52.616431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a26fb3-92af-42a3-b201-3e9b82caef43 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:52.616701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a26fb3-92af-42a3-b201-3e9b82caef43 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:52.620470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a26fb3-92af-42a3-b201-3e9b82caef43 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:52.623521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a26fb3-92af-42a3-b201-3e9b82caef43 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:52.625369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 86/171] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:52 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:52.626135 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a26fb3-92af-42a3-b201-3e9b82caef43 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:52.680545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0e2ee-cf50-4421-8efc-d539238429ed None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:52.720379 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589304c7-1a5c-440f-a523-dee1dbf734df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:52.721245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589304c7-1a5c-440f-a523-dee1dbf734df None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:52.721533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589304c7-1a5c-440f-a523-dee1dbf734df None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:52.721810 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589304c7-1a5c-440f-a523-dee1dbf734df None admin] PATH_INFO: `/v3/roles/member` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:52.747189 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589304c7-1a5c-440f-a523-dee1dbf734df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-589304c7-1a5c-440f-a523-dee1dbf734df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:52.756438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:52.757452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:52.758403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 86/172] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:52.759201 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589304c7-1a5c-440f-a523-dee1dbf734df None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:52.769674 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:52.817157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a26fb3-92af-42a3-b201-3e9b82caef43 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:52.860607 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751e402-cd66-42fb-a009-021a85778015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:52.861470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e402-cd66-42fb-a009-021a85778015 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:52.861752 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e402-cd66-42fb-a009-021a85778015 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:52.862022 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e402-cd66-42fb-a009-021a85778015 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:52.864158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751e402-cd66-42fb-a009-021a85778015 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:52.865608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751e402-cd66-42fb-a009-021a85778015 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:52.867525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 87/173] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:52 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:52.868532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574313ce-da5f-44ab-afa9-243b07b06601 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:52.868814 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574313ce-da5f-44ab-afa9-243b07b06601 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:52.869089 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574313ce-da5f-44ab-afa9-243b07b06601 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:52.875410 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 88/174] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:52.882134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574313ce-da5f-44ab-afa9-243b07b06601 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:52.942342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589304c7-1a5c-440f-a523-dee1dbf734df None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:52.954998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:53.034359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054e89d-9d95-4da4-891e-6890af489a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:53.035084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e89d-9d95-4da4-891e-6890af489a8e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.035372 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e89d-9d95-4da4-891e-6890af489a8e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.035710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e89d-9d95-4da4-891e-6890af489a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.036573 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054e89d-9d95-4da4-891e-6890af489a8e None admin] RBAC: Adding query filter params (role.id=edf99f336b2440b19ff28bcd8da8433b, scope.project.id=d9b28400715c475eb364b4a9afdd6046, user.id=1ba763318101478b8fd538190a09e314) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:53.036930 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054e89d-9d95-4da4-891e-6890af489a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:53.038450 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054e89d-9d95-4da4-891e-6890af489a8e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:53.060398 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 87/175] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:52 2022] GET /identity/v3/role_assignments?user.id=1ba763318101478b8fd538190a09e314&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:53.061750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054e89d-9d95-4da4-891e-6890af489a8e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:53.159640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574313ce-da5f-44ab-afa9-243b07b06601 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:53.212109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5917e3c-0aa8-4d7b-86c9-60efe397ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:53.212803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5917e3c-0aa8-4d7b-86c9-60efe397ef53 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.213086 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5917e3c-0aa8-4d7b-86c9-60efe397ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.213361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5917e3c-0aa8-4d7b-86c9-60efe397ef53 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.214139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5917e3c-0aa8-4d7b-86c9-60efe397ef53 None admin] RBAC: Adding query filter params (name=member) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:53.214453 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5917e3c-0aa8-4d7b-86c9-60efe397ef53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:53.217232 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5917e3c-0aa8-4d7b-86c9-60efe397ef53 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:53.220278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:53.230107 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 89/176] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:02:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:53.231859 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa33fc9-c194-4473-ae8c-183432265693 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.233218 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa33fc9-c194-4473-ae8c-183432265693 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.233646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa33fc9-c194-4473-ae8c-183432265693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.254723 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-9aa33fc9-c194-4473-ae8c-183432265693 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:53.256208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-9aa33fc9-c194-4473-ae8c-183432265693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:53.288079 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054e89d-9d95-4da4-891e-6890af489a8e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:53.331123 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb28662-6791-4b4a-8cf9-9003c7b5616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:53.331808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb28662-6791-4b4a-8cf9-9003c7b5616c None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.332085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb28662-6791-4b4a-8cf9-9003c7b5616c None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.332363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb28662-6791-4b4a-8cf9-9003c7b5616c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.333492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb28662-6791-4b4a-8cf9-9003c7b5616c None admin] RBAC: Adding query filter params (role.id=4876e759b9504964a874992dc66b6df1, scope.project.id=d9b28400715c475eb364b4a9afdd6046, user.id=1ba763318101478b8fd538190a09e314) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:53.334037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb28662-6791-4b4a-8cf9-9003c7b5616c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:53.336633 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb28662-6791-4b4a-8cf9-9003c7b5616c None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:53.345741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 88/177] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:53 2022] GET /identity/v3/role_assignments?user.id=1ba763318101478b8fd538190a09e314&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=4876e759b9504964a874992dc66b6df1 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:53.347080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a23ca-930b-4ec3-9253-032abc2f5f80 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.347368 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a23ca-930b-4ec3-9253-032abc2f5f80 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.347641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a23ca-930b-4ec3-9253-032abc2f5f80 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.348956 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 89/178] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:53.350581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a23ca-930b-4ec3-9253-032abc2f5f80 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:53.351606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 90/179] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:53.359787 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc61837-d07e-4d89-8e89-67ae7f7e2a3e None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.360409 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc61837-d07e-4d89-8e89-67ae7f7e2a3e None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.360889 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc61837-d07e-4d89-8e89-67ae7f7e2a3e None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.362766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 91/180] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:53.364294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c187b51-403c-48b2-bf39-f53bcb721c37 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.364765 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c187b51-403c-48b2-bf39-f53bcb721c37 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.365256 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c187b51-403c-48b2-bf39-f53bcb721c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.384933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:53.392770 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-9c187b51-403c-48b2-bf39-f53bcb721c37 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:53.394062 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-9c187b51-403c-48b2-bf39-f53bcb721c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:53.496193 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a23ca-930b-4ec3-9253-032abc2f5f80 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:53.500258 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 92/181] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:53.501607 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518637c4-c75c-4b71-ab2f-65780365d3ee None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.501951 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518637c4-c75c-4b71-ab2f-65780365d3ee None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.502235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518637c4-c75c-4b71-ab2f-65780365d3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.524622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-518637c4-c75c-4b71-ab2f-65780365d3ee None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:53.526084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-518637c4-c75c-4b71-ab2f-65780365d3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:53.573570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d1c57-773f-47fd-8e7e-33d8ea80c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:53.574470 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d1c57-773f-47fd-8e7e-33d8ea80c645 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.574788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d1c57-773f-47fd-8e7e-33d8ea80c645 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.575130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d1c57-773f-47fd-8e7e-33d8ea80c645 None admin] PATH_INFO: `/v3/users/1ba763318101478b8fd538190a09e314` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.576560 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d1c57-773f-47fd-8e7e-33d8ea80c645 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba763318101478b8fd538190a09e314)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:53.578505 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d1c57-773f-47fd-8e7e-33d8ea80c645 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:53.579986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 90/182] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:53 2022] GET /identity/v3/users/1ba763318101478b8fd538190a09e314 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:53.580609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d1c57-773f-47fd-8e7e-33d8ea80c645 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:53.613435 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:53.625366 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 93/183] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:53.626233 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518637c4-c75c-4b71-ab2f-65780365d3ee None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:53.699687 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:53.710706 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d1c57-773f-47fd-8e7e-33d8ea80c645 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:53.750093 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08774c4-161d-49fd-814a-94e2e2432925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:53.750902 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08774c4-161d-49fd-814a-94e2e2432925 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.751182 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08774c4-161d-49fd-814a-94e2e2432925 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.751455 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08774c4-161d-49fd-814a-94e2e2432925 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.757551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518637c4-c75c-4b71-ab2f-65780365d3ee None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:53.762207 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08774c4-161d-49fd-814a-94e2e2432925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-d08774c4-161d-49fd-814a-94e2e2432925 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:53.770065 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:53.771115 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 91/184] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:53.777039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08774c4-161d-49fd-814a-94e2e2432925 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:53.805116 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bb6a9-a69a-46d6-ae0e-98912087fcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:53.806048 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb6a9-a69a-46d6-ae0e-98912087fcbf None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.806240 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb6a9-a69a-46d6-ae0e-98912087fcbf None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.806480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb6a9-a69a-46d6-ae0e-98912087fcbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.817948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bb6a9-a69a-46d6-ae0e-98912087fcbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-a17bb6a9-a69a-46d6-ae0e-98912087fcbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:53.826206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:53.827443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 94/185] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:02:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:53.833451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bb6a9-a69a-46d6-ae0e-98912087fcbf None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:53.884048 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:53.892585 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08774c4-161d-49fd-814a-94e2e2432925 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:53.928289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56151e-bf12-4521-be79-55aa072d1289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:53.928946 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56151e-bf12-4521-be79-55aa072d1289 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.929238 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56151e-bf12-4521-be79-55aa072d1289 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.929520 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56151e-bf12-4521-be79-55aa072d1289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.940353 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bb6a9-a69a-46d6-ae0e-98912087fcbf None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:53.954536 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:53.977041 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969be1d3-eded-4dc2-8d8d-8e57cfec9980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:53.978027 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be1d3-eded-4dc2-8d8d-8e57cfec9980 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:53.978313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be1d3-eded-4dc2-8d8d-8e57cfec9980 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:53.978594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be1d3-eded-4dc2-8d8d-8e57cfec9980 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:53.979879 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969be1d3-eded-4dc2-8d8d-8e57cfec9980 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:53.981937 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969be1d3-eded-4dc2-8d8d-8e57cfec9980 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:53.983632 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 95/186] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:53.984391 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969be1d3-eded-4dc2-8d8d-8e57cfec9980 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:54.001436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56151e-bf12-4521-be79-55aa072d1289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:54.002828 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56151e-bf12-4521-be79-55aa072d1289 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:54.084654 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969be1d3-eded-4dc2-8d8d-8e57cfec9980 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:54.101031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:54.101681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 92/187] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:02:54.102527 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56151e-bf12-4521-be79-55aa072d1289 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:54.120429 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29a333-db84-4052-aad3-3dd0497eb413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:54.126977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29a333-db84-4052-aad3-3dd0497eb413 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:54.126977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29a333-db84-4052-aad3-3dd0497eb413 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:54.126977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29a333-db84-4052-aad3-3dd0497eb413 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:54.126977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29a333-db84-4052-aad3-3dd0497eb413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:54.126977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29a333-db84-4052-aad3-3dd0497eb413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:54.126977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29a333-db84-4052-aad3-3dd0497eb413 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:54.132986 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 96/188] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:54.134287 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a77c6-34e1-4193-8e3b-e28a55567612 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:54.134587 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a77c6-34e1-4193-8e3b-e28a55567612 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:54.134926 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a77c6-34e1-4193-8e3b-e28a55567612 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:54.136377 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 97/189] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:54.136908 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a77c6-34e1-4193-8e3b-e28a55567612 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:54.162505 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:54.208642 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56151e-bf12-4521-be79-55aa072d1289 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:54.242561 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a77c6-34e1-4193-8e3b-e28a55567612 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:54.246764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ebc09-5410-4bdf-b195-25cc268e4732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:54.247477 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ebc09-5410-4bdf-b195-25cc268e4732 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:54.247762 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ebc09-5410-4bdf-b195-25cc268e4732 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:54.248042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ebc09-5410-4bdf-b195-25cc268e4732 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:54.248802 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ebc09-5410-4bdf-b195-25cc268e4732 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:54.249112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ebc09-5410-4bdf-b195-25cc268e4732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:54.250495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ebc09-5410-4bdf-b195-25cc268e4732 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:54.261840 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 93/190] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:02:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:54.261840 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ebc09-5410-4bdf-b195-25cc268e4732 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:54.276859 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e97d1-3a69-49e3-8404-09a156d707ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:54.277531 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e97d1-3a69-49e3-8404-09a156d707ec None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:54.277813 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e97d1-3a69-49e3-8404-09a156d707ec None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:54.278724 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e97d1-3a69-49e3-8404-09a156d707ec None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:54.279579 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e97d1-3a69-49e3-8404-09a156d707ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:54.281039 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e97d1-3a69-49e3-8404-09a156d707ec None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:54.367311 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ebc09-5410-4bdf-b195-25cc268e4732 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:54.386634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 98/191] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:02:54 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:02:54.386634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e97d1-3a69-49e3-8404-09a156d707ec None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:54.392630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:54.413568 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27531fa-6ec8-4816-9fca-3c889b66050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:54.414666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27531fa-6ec8-4816-9fca-3c889b66050a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:54.414979 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27531fa-6ec8-4816-9fca-3c889b66050a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:54.415246 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27531fa-6ec8-4816-9fca-3c889b66050a None admin] PATH_INFO: `/v3/projects/06287dec58c042928e43ef18752703c6` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:54.417509 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27531fa-6ec8-4816-9fca-3c889b66050a None admin] RBAC: Authorizing `identity:get_project(project_id=06287dec58c042928e43ef18752703c6)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:54.419666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27531fa-6ec8-4816-9fca-3c889b66050a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:54.422078 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 94/192] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:54 2022] GET /identity/v3/projects/06287dec58c042928e43ef18752703c6 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:54.428567 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16708d-3a69-4dea-aa32-7383f6fe5429 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:54.428846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16708d-3a69-4dea-aa32-7383f6fe5429 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:54.429125 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16708d-3a69-4dea-aa32-7383f6fe5429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:54.441170 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:54.452922 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-3d16708d-3a69-4dea-aa32-7383f6fe5429 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:54.454786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-3d16708d-3a69-4dea-aa32-7383f6fe5429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:54.517228 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e97d1-3a69-49e3-8404-09a156d707ec None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:54.558021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b86e2f-3df6-4046-8d32-78af1bcfcd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:54.559899 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b86e2f-3df6-4046-8d32-78af1bcfcd16 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:54.560384 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b86e2f-3df6-4046-8d32-78af1bcfcd16 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:54.560868 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b86e2f-3df6-4046-8d32-78af1bcfcd16 None admin] PATH_INFO: `/v3/users/c99d969974c84462b79d8430e49cd38c` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:54.567610 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 95/193] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:54.569285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16708d-3a69-4dea-aa32-7383f6fe5429 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:54.589134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b86e2f-3df6-4046-8d32-78af1bcfcd16 None admin] RBAC: Authorizing `identity:get_user(user_id=c99d969974c84462b79d8430e49cd38c)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:54.591439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b86e2f-3df6-4046-8d32-78af1bcfcd16 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:54.593574 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 99/194] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:54 2022] GET /identity/v3/users/c99d969974c84462b79d8430e49cd38c => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:54.594645 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b86e2f-3df6-4046-8d32-78af1bcfcd16 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:54.705811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16708d-3a69-4dea-aa32-7383f6fe5429 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:54.716085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:54.727319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:54.730367 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b86e2f-3df6-4046-8d32-78af1bcfcd16 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:54.754027 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb3109-2228-42e1-87ab-aa104baedf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:54.755113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3109-2228-42e1-87ab-aa104baedf28 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:54.755396 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3109-2228-42e1-87ab-aa104baedf28 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:54.755713 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3109-2228-42e1-87ab-aa104baedf28 None admin] PATH_INFO: `/v3/users/c99d969974c84462b79d8430e49cd38c` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:54.756914 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb3109-2228-42e1-87ab-aa104baedf28 None admin] RBAC: Authorizing `identity:get_user(user_id=c99d969974c84462b79d8430e49cd38c)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:54.758578 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb3109-2228-42e1-87ab-aa104baedf28 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:54.760535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 96/195] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:54 2022] GET /identity/v3/users/c99d969974c84462b79d8430e49cd38c => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:54.761274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb3109-2228-42e1-87ab-aa104baedf28 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:54.779298 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9313549-318a-4b08-87d5-3d093b5bcd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:54.779534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9313549-318a-4b08-87d5-3d093b5bcd1c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:54.779761 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9313549-318a-4b08-87d5-3d093b5bcd1c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:54.780045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9313549-318a-4b08-87d5-3d093b5bcd1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:54.781786 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9313549-318a-4b08-87d5-3d093b5bcd1c None admin] RBAC: Adding query filter params (role.id=edf99f336b2440b19ff28bcd8da8433b, scope.project.id=06287dec58c042928e43ef18752703c6, user.id=1ba763318101478b8fd538190a09e314) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:54.782106 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9313549-318a-4b08-87d5-3d093b5bcd1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:54.783743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9313549-318a-4b08-87d5-3d093b5bcd1c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:54.796230 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 100/196] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:54 2022] GET /identity/v3/role_assignments?user.id=1ba763318101478b8fd538190a09e314&scope.project.id=06287dec58c042928e43ef18752703c6&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:54.797098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9313549-318a-4b08-87d5-3d093b5bcd1c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:54.910489 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb3109-2228-42e1-87ab-aa104baedf28 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:54.958936 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9313549-318a-4b08-87d5-3d093b5bcd1c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:54.968275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2f7c6-2af2-4d65-bf40-a03105116245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:54.968947 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2f7c6-2af2-4d65-bf40-a03105116245 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:54.969225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2f7c6-2af2-4d65-bf40-a03105116245 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:54.969495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2f7c6-2af2-4d65-bf40-a03105116245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.004116 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153365a2-9622-42bd-937a-3461d4704ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:55.004934 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153365a2-9622-42bd-937a-3461d4704ccb None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:55.005217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153365a2-9622-42bd-937a-3461d4704ccb None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:55.005495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153365a2-9622-42bd-937a-3461d4704ccb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.018107 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153365a2-9622-42bd-937a-3461d4704ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-153365a2-9622-42bd-937a-3461d4704ccb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:55.026079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:55.027197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:55.028691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 101/197] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:55.029488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153365a2-9622-42bd-937a-3461d4704ccb None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:55.051122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:55.082980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:55.117716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2f7c6-2af2-4d65-bf40-a03105116245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:55.119234 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2f7c6-2af2-4d65-bf40-a03105116245 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:55.143804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153365a2-9622-42bd-937a-3461d4704ccb None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:55.192509 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d1b47-4a9c-401b-a289-83431441f0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:55.193219 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1b47-4a9c-401b-a289-83431441f0a6 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:55.193508 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1b47-4a9c-401b-a289-83431441f0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:55.193782 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1b47-4a9c-401b-a289-83431441f0a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.249590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 97/198] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:02:55.250939 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2f7c6-2af2-4d65-bf40-a03105116245 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:55.299073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d1b47-4a9c-401b-a289-83431441f0a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:55.301220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d1b47-4a9c-401b-a289-83431441f0a6 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:55.329079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:55.364880 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:55.388601 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2f7c6-2af2-4d65-bf40-a03105116245 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:55.440957 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6919a-9db1-4fab-bffa-a050a343fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:55.441184 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 102/199] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:02:55.442051 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6919a-9db1-4fab-bffa-a050a343fdfc None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:55.442280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d1b47-4a9c-401b-a289-83431441f0a6 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:55.442893 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6919a-9db1-4fab-bffa-a050a343fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:55.443386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6919a-9db1-4fab-bffa-a050a343fdfc None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.444381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6919a-9db1-4fab-bffa-a050a343fdfc None admin] RBAC: Adding query filter params (name=reader) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:55.444929 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6919a-9db1-4fab-bffa-a050a343fdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:55.447980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6919a-9db1-4fab-bffa-a050a343fdfc None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:55.460130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 98/200] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:02:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:55.466598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6919a-9db1-4fab-bffa-a050a343fdfc None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:55.569910 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d1b47-4a9c-401b-a289-83431441f0a6 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:55.594084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:55.601957 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6919a-9db1-4fab-bffa-a050a343fdfc None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:55.618978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0efea-e925-461c-a6b6-2f2089bbfa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:55.620431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0efea-e925-461c-a6b6-2f2089bbfa31 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:55.622184 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0efea-e925-461c-a6b6-2f2089bbfa31 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:55.622691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0efea-e925-461c-a6b6-2f2089bbfa31 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.624116 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0efea-e925-461c-a6b6-2f2089bbfa31 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:55.626808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0efea-e925-461c-a6b6-2f2089bbfa31 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:55.634379 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 103/201] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:55 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:55.634379 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0efea-e925-461c-a6b6-2f2089bbfa31 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:55.652831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a62da-6718-4036-86a4-3aff786ee6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:55.654329 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a62da-6718-4036-86a4-3aff786ee6ee None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:55.655161 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a62da-6718-4036-86a4-3aff786ee6ee None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:55.655670 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a62da-6718-4036-86a4-3aff786ee6ee None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.657509 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a62da-6718-4036-86a4-3aff786ee6ee None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:55.659743 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a62da-6718-4036-86a4-3aff786ee6ee None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:55.662550 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 99/202] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:55 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:55.664241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a62da-6718-4036-86a4-3aff786ee6ee None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:55.685053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:55.750357 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0efea-e925-461c-a6b6-2f2089bbfa31 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:55.788358 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290910ef-26da-45f7-916c-2bfafdaaac97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:55.789378 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290910ef-26da-45f7-916c-2bfafdaaac97 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:55.789733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290910ef-26da-45f7-916c-2bfafdaaac97 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:55.790702 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290910ef-26da-45f7-916c-2bfafdaaac97 None admin] PATH_INFO: `/v3/users/1bc1bb82357341f78866f0894f68d2d6` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.791704 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290910ef-26da-45f7-916c-2bfafdaaac97 None admin] RBAC: Authorizing `identity:get_user(user_id=1bc1bb82357341f78866f0894f68d2d6)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:55.794338 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290910ef-26da-45f7-916c-2bfafdaaac97 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:55.801345 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 104/203] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:55 2022] GET /identity/v3/users/1bc1bb82357341f78866f0894f68d2d6 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:55.801345 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290910ef-26da-45f7-916c-2bfafdaaac97 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:55.815965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a62da-6718-4036-86a4-3aff786ee6ee None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:55.867447 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea6965-e1ca-4ca3-9fb7-b18d2dbde9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:55.868439 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea6965-e1ca-4ca3-9fb7-b18d2dbde9d0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:55.869091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea6965-e1ca-4ca3-9fb7-b18d2dbde9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:55.869566 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea6965-e1ca-4ca3-9fb7-b18d2dbde9d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.871433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea6965-e1ca-4ca3-9fb7-b18d2dbde9d0 None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e, user.id=c99d969974c84462b79d8430e49cd38c) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:55.871988 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea6965-e1ca-4ca3-9fb7-b18d2dbde9d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:55.874250 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea6965-e1ca-4ca3-9fb7-b18d2dbde9d0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:55.877360 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:55.881872 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 100/204] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:55 2022] GET /identity/v3/role_assignments?user.id=c99d969974c84462b79d8430e49cd38c&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:55.891763 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea6965-e1ca-4ca3-9fb7-b18d2dbde9d0 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:55.924152 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290910ef-26da-45f7-916c-2bfafdaaac97 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:55.967648 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c88d1-7ba1-463a-92b7-0b609d124418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:55.968329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c88d1-7ba1-463a-92b7-0b609d124418 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:55.968601 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c88d1-7ba1-463a-92b7-0b609d124418 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:55.968882 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c88d1-7ba1-463a-92b7-0b609d124418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.969751 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c88d1-7ba1-463a-92b7-0b609d124418 None admin] RBAC: Adding query filter params (role.id=4876e759b9504964a874992dc66b6df1, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e, user.id=c99d969974c84462b79d8430e49cd38c) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:55.970065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c88d1-7ba1-463a-92b7-0b609d124418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:55.971848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c88d1-7ba1-463a-92b7-0b609d124418 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:55.979084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 105/205] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:55 2022] GET /identity/v3/role_assignments?user.id=c99d969974c84462b79d8430e49cd38c&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=4876e759b9504964a874992dc66b6df1 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:56.049380 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:56.089837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea6965-e1ca-4ca3-9fb7-b18d2dbde9d0 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:56.145366 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40511eec-dcb2-4f7a-8ea6-a5d5edd81267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:56.145979 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40511eec-dcb2-4f7a-8ea6-a5d5edd81267 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:56.146268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40511eec-dcb2-4f7a-8ea6-a5d5edd81267 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:56.146548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40511eec-dcb2-4f7a-8ea6-a5d5edd81267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:56.233944 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40511eec-dcb2-4f7a-8ea6-a5d5edd81267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:56.235553 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40511eec-dcb2-4f7a-8ea6-a5d5edd81267 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:56.317303 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:56.350531 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 101/206] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:02:56.356164 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c88d1-7ba1-463a-92b7-0b609d124418 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:56.490062 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c88d1-7ba1-463a-92b7-0b609d124418 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:56.515018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:56.529737 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfc0c3-8617-41ca-bdfd-68b4fe96bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:56.530629 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfc0c3-8617-41ca-bdfd-68b4fe96bc22 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:56.532711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfc0c3-8617-41ca-bdfd-68b4fe96bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:56.532711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfc0c3-8617-41ca-bdfd-68b4fe96bc22 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:56.532711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfc0c3-8617-41ca-bdfd-68b4fe96bc22 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:56.534061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfc0c3-8617-41ca-bdfd-68b4fe96bc22 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:56.536211 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 106/207] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:56 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:56.544429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40511eec-dcb2-4f7a-8ea6-a5d5edd81267 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:56.672512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40511eec-dcb2-4f7a-8ea6-a5d5edd81267 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:56.719242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc355b9a-4925-4861-bacf-dbd46ae0984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:56.719926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc355b9a-4925-4861-bacf-dbd46ae0984e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:56.720211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc355b9a-4925-4861-bacf-dbd46ae0984e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:56.720489 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc355b9a-4925-4861-bacf-dbd46ae0984e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:56.721497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc355b9a-4925-4861-bacf-dbd46ae0984e None admin] RBAC: Adding query filter params (role.id=03fc945060c64e0cb56cff9471d1b1c2, scope.project.id=d9b28400715c475eb364b4a9afdd6046, user.id=1bc1bb82357341f78866f0894f68d2d6) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:56.721820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc355b9a-4925-4861-bacf-dbd46ae0984e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:56.723293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc355b9a-4925-4861-bacf-dbd46ae0984e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:56.734597 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 102/208] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:56 2022] GET /identity/v3/role_assignments?user.id=1bc1bb82357341f78866f0894f68d2d6&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=03fc945060c64e0cb56cff9471d1b1c2 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:57.100369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f378e-d95e-464d-9caf-5a7fad2bac7b None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:57.101123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f378e-d95e-464d-9caf-5a7fad2bac7b None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:57.101123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f378e-d95e-464d-9caf-5a7fad2bac7b None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:57.102464 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 107/209] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:57.109413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b1f4c-c50c-42d2-bfc2-e24601927029 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:57.110000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b1f4c-c50c-42d2-bfc2-e24601927029 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:57.110000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b1f4c-c50c-42d2-bfc2-e24601927029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:57.131673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-6f1b1f4c-c50c-42d2-bfc2-e24601927029 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:57.132917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-6f1b1f4c-c50c-42d2-bfc2-e24601927029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:57.178152 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:57.219568 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 103/210] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:57.248595 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f378e-d95e-464d-9caf-5a7fad2bac7b None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:57.261046 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72221f-88fb-411b-a2ed-49543c86780c None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:57.261336 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72221f-88fb-411b-a2ed-49543c86780c None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:57.263654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72221f-88fb-411b-a2ed-49543c86780c None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:57.263654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 104/211] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:57.269060 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d68c8-8f88-4c60-898a-212ef8728e2a None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:57.269349 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d68c8-8f88-4c60-898a-212ef8728e2a None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:57.269632 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d68c8-8f88-4c60-898a-212ef8728e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:57.290953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-438d68c8-8f88-4c60-898a-212ef8728e2a None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:57.295843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-438d68c8-8f88-4c60-898a-212ef8728e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:57.377826 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 105/212] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:02:57.389201 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f378e-d95e-464d-9caf-5a7fad2bac7b None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:57.402080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d68c8-8f88-4c60-898a-212ef8728e2a None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:57.445487 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94887e-c3bb-4644-8ba1-6c5fe207cff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:57.446319 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94887e-c3bb-4644-8ba1-6c5fe207cff6 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:57.446599 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94887e-c3bb-4644-8ba1-6c5fe207cff6 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:57.446895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94887e-c3bb-4644-8ba1-6c5fe207cff6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:57.460576 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94887e-c3bb-4644-8ba1-6c5fe207cff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-5d94887e-c3bb-4644-8ba1-6c5fe207cff6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:57.468352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:57.469439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:02:57.470392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:57.474475 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 108/213] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:02:57.475408 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94887e-c3bb-4644-8ba1-6c5fe207cff6 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:57.527553 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:57.531837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d68c8-8f88-4c60-898a-212ef8728e2a None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:57.538335 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:57.583313 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586f1f7-aa7c-4b94-ab57-6b5f97ae5353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:57.584453 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f1f7-aa7c-4b94-ab57-6b5f97ae5353 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:57.585231 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f1f7-aa7c-4b94-ab57-6b5f97ae5353 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:57.585627 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f1f7-aa7c-4b94-ab57-6b5f97ae5353 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:57.587202 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586f1f7-aa7c-4b94-ab57-6b5f97ae5353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:57.589361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586f1f7-aa7c-4b94-ab57-6b5f97ae5353 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:57.592206 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 106/214] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:02:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:57.601764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586f1f7-aa7c-4b94-ab57-6b5f97ae5353 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:57.612284 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94887e-c3bb-4644-8ba1-6c5fe207cff6 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:57.649870 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d5245-6b36-4799-86fe-9af77fac7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:57.650497 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d5245-6b36-4799-86fe-9af77fac7d49 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:57.650805 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d5245-6b36-4799-86fe-9af77fac7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:57.651079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d5245-6b36-4799-86fe-9af77fac7d49 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:57.651851 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d5245-6b36-4799-86fe-9af77fac7d49 None admin] RBAC: Adding query filter params (name=member) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:57.652160 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d5245-6b36-4799-86fe-9af77fac7d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:57.654174 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d5245-6b36-4799-86fe-9af77fac7d49 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:57.663245 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 109/215] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:02:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:57.669255 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d5245-6b36-4799-86fe-9af77fac7d49 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:57.722086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586f1f7-aa7c-4b94-ab57-6b5f97ae5353 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:57.759222 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7179b1a-69aa-4823-be9c-8d2062696c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:57.759906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7179b1a-69aa-4823-be9c-8d2062696c00 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:57.760197 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7179b1a-69aa-4823-be9c-8d2062696c00 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:57.760481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7179b1a-69aa-4823-be9c-8d2062696c00 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:57.761318 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7179b1a-69aa-4823-be9c-8d2062696c00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:57.763071 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7179b1a-69aa-4823-be9c-8d2062696c00 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:57.778514 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d5245-6b36-4799-86fe-9af77fac7d49 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:57.786039 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:57.814575 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f90d8-79f5-4a59-a65e-12d5e43d74f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:57.815555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f90d8-79f5-4a59-a65e-12d5e43d74f2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:57.815834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f90d8-79f5-4a59-a65e-12d5e43d74f2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:57.816158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f90d8-79f5-4a59-a65e-12d5e43d74f2 None admin] PATH_INFO: `/v3/users/4ec49c2a2fae4219bc5b8d57e6c012cf` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:57.830199 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f90d8-79f5-4a59-a65e-12d5e43d74f2 None admin] RBAC: Authorizing `identity:get_user(user_id=4ec49c2a2fae4219bc5b8d57e6c012cf)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:57.831692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f90d8-79f5-4a59-a65e-12d5e43d74f2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:57.833657 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 110/216] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:57 2022] GET /identity/v3/users/4ec49c2a2fae4219bc5b8d57e6c012cf => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:57.838819 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f90d8-79f5-4a59-a65e-12d5e43d74f2 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:57.868729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 107/217] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:02:57 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:02:57.962810 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f90d8-79f5-4a59-a65e-12d5e43d74f2 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:58.004594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc613-c1a8-49a7-9b09-df7e18f6e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:58.005833 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc613-c1a8-49a7-9b09-df7e18f6e56a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:58.006349 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc613-c1a8-49a7-9b09-df7e18f6e56a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:58.006882 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc613-c1a8-49a7-9b09-df7e18f6e56a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:58.043636 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:58.088007 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc613-c1a8-49a7-9b09-df7e18f6e56a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:58.089969 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc613-c1a8-49a7-9b09-df7e18f6e56a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:58.218918 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 111/218] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:02:58.226548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7179b1a-69aa-4823-be9c-8d2062696c00 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:58.256458 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:58.338074 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7179b1a-69aa-4823-be9c-8d2062696c00 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:58.377566 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74fc69-ef2e-4462-8ba4-2d1721c0425b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:58.378455 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74fc69-ef2e-4462-8ba4-2d1721c0425b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:58.378774 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74fc69-ef2e-4462-8ba4-2d1721c0425b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:58.379054 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74fc69-ef2e-4462-8ba4-2d1721c0425b None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:58.380319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74fc69-ef2e-4462-8ba4-2d1721c0425b None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:58.381752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74fc69-ef2e-4462-8ba4-2d1721c0425b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:58.383854 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 108/219] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:58 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:58.390882 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc613-c1a8-49a7-9b09-df7e18f6e56a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:58.483445 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:58.545165 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc613-c1a8-49a7-9b09-df7e18f6e56a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:58.598024 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b43994-e249-45cf-bf38-675f0df17eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:58.598722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b43994-e249-45cf-bf38-675f0df17eb9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:58.599006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b43994-e249-45cf-bf38-675f0df17eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:58.599282 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b43994-e249-45cf-bf38-675f0df17eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:58.600135 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b43994-e249-45cf-bf38-675f0df17eb9 None admin] RBAC: Adding query filter params (role.id=edf99f336b2440b19ff28bcd8da8433b, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e, user.id=4ec49c2a2fae4219bc5b8d57e6c012cf) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:58.600446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b43994-e249-45cf-bf38-675f0df17eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:58.601906 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b43994-e249-45cf-bf38-675f0df17eb9 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:58.611151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 112/220] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:02:58 2022] GET /identity/v3/role_assignments?user.id=4ec49c2a2fae4219bc5b8d57e6c012cf&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:58.638515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36ac15-41dd-43ac-91ac-6dcd09a46e00 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:58.639072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36ac15-41dd-43ac-91ac-6dcd09a46e00 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:58.639588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36ac15-41dd-43ac-91ac-6dcd09a46e00 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:58.642391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 109/221] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:58.649853 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7ca72-7fa4-4fdf-8839-f60bc3b74ce9 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:58.650353 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7ca72-7fa4-4fdf-8839-f60bc3b74ce9 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:58.650897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7ca72-7fa4-4fdf-8839-f60bc3b74ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:58.667677 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72687-0685-4e9e-aac9-422b9d642a72 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:58.668040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72687-0685-4e9e-aac9-422b9d642a72 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:58.668235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72687-0685-4e9e-aac9-422b9d642a72 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:58.670719 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 110/222] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:58.676653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ccb73-c0af-412c-91e4-a48e294a9372 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:58.676970 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ccb73-c0af-412c-91e4-a48e294a9372 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:58.677316 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ccb73-c0af-412c-91e4-a48e294a9372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:58.688773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-75d7ca72-7fa4-4fdf-8839-f60bc3b74ce9 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:58.689996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-75d7ca72-7fa4-4fdf-8839-f60bc3b74ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:58.711867 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-5c2ccb73-c0af-412c-91e4-a48e294a9372 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:58.713109 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-5c2ccb73-c0af-412c-91e4-a48e294a9372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:58.798271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 111/223] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:02:58.841509 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ccb73-c0af-412c-91e4-a48e294a9372 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:58.873024 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 113/224] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:02:58.877903 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:58.913955 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7ca72-7fa4-4fdf-8839-f60bc3b74ce9 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:58.994991 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:59.013114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ccb73-c0af-412c-91e4-a48e294a9372 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:59.039884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7ca72-7fa4-4fdf-8839-f60bc3b74ce9 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:59.089909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf340aae-459e-40b4-96ac-ef872237b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:59.090897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf340aae-459e-40b4-96ac-ef872237b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:59.091076 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf340aae-459e-40b4-96ac-ef872237b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:59.091406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf340aae-459e-40b4-96ac-ef872237b8e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:59.099316 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a6b8f-9649-4d3d-8c63-487eba5d02aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:59.100132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a6b8f-9649-4d3d-8c63-487eba5d02aa None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:59.100409 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a6b8f-9649-4d3d-8c63-487eba5d02aa None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:59.100683 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a6b8f-9649-4d3d-8c63-487eba5d02aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:59.102511 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf340aae-459e-40b4-96ac-ef872237b8e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-bf340aae-459e-40b4-96ac-ef872237b8e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:59.111005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:59.112300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:02:59.113238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 114/225] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:02:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:02:59.118880 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf340aae-459e-40b4-96ac-ef872237b8e3 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:59.135696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a6b8f-9649-4d3d-8c63-487eba5d02aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-311a6b8f-9649-4d3d-8c63-487eba5d02aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:02:59.146037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:02:59.148153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:02:59.149285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 112/226] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:02:59.155865 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a6b8f-9649-4d3d-8c63-487eba5d02aa None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:59.274234 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf340aae-459e-40b4-96ac-ef872237b8e3 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:59.307559 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:59.339504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c703d-cfe8-4002-9b7b-e31477d56207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:59.341225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c703d-cfe8-4002-9b7b-e31477d56207 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:59.343937 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c703d-cfe8-4002-9b7b-e31477d56207 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:59.344461 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c703d-cfe8-4002-9b7b-e31477d56207 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:59.345446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c703d-cfe8-4002-9b7b-e31477d56207 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:59.347471 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c703d-cfe8-4002-9b7b-e31477d56207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:59.351939 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c703d-cfe8-4002-9b7b-e31477d56207 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:59.354940 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:59.368950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 115/227] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:02:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:59.375428 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c703d-cfe8-4002-9b7b-e31477d56207 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:59.396248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a6b8f-9649-4d3d-8c63-487eba5d02aa None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:59.441147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82581f3b-595d-4311-bc06-181c443fd48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:59.441844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82581f3b-595d-4311-bc06-181c443fd48b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:59.442128 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82581f3b-595d-4311-bc06-181c443fd48b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:59.442407 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82581f3b-595d-4311-bc06-181c443fd48b None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:59.443211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82581f3b-595d-4311-bc06-181c443fd48b None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:02:59.443523 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82581f3b-595d-4311-bc06-181c443fd48b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:59.444942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82581f3b-595d-4311-bc06-181c443fd48b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:59.463587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 113/228] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:02:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:59.471213 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82581f3b-595d-4311-bc06-181c443fd48b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:59.547931 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c703d-cfe8-4002-9b7b-e31477d56207 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:59.590779 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49113eae-a544-4d71-bbdd-75f5c13a42ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:59.591732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49113eae-a544-4d71-bbdd-75f5c13a42ce None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:59.591956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49113eae-a544-4d71-bbdd-75f5c13a42ce None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:59.592234 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49113eae-a544-4d71-bbdd-75f5c13a42ce None admin] PATH_INFO: `/v3/users/c99d969974c84462b79d8430e49cd38c` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:59.593688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49113eae-a544-4d71-bbdd-75f5c13a42ce None admin] RBAC: Authorizing `identity:get_user(user_id=c99d969974c84462b79d8430e49cd38c)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:59.595725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49113eae-a544-4d71-bbdd-75f5c13a42ce None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:59.597957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 116/229] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:59 2022] GET /identity/v3/users/c99d969974c84462b79d8430e49cd38c => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:59.603885 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49113eae-a544-4d71-bbdd-75f5c13a42ce None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:59.709102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:59.731654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82581f3b-595d-4311-bc06-181c443fd48b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:59.784524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49113eae-a544-4d71-bbdd-75f5c13a42ce None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:59.798396 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa090e5-44f2-480d-ae63-81486fe165d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:59.799325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa090e5-44f2-480d-ae63-81486fe165d8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:59.799606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa090e5-44f2-480d-ae63-81486fe165d8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:59.799882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa090e5-44f2-480d-ae63-81486fe165d8 None admin] PATH_INFO: `/v3/users/c99d969974c84462b79d8430e49cd38c` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:59.802595 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa090e5-44f2-480d-ae63-81486fe165d8 None admin] RBAC: Authorizing `identity:get_user(user_id=c99d969974c84462b79d8430e49cd38c)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:59.804069 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa090e5-44f2-480d-ae63-81486fe165d8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:59.807178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 114/230] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:02:59 2022] GET /identity/v3/users/c99d969974c84462b79d8430e49cd38c => generated 283 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:02:59.813542 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa090e5-44f2-480d-ae63-81486fe165d8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:59.839982 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:59.864173 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3f576-7539-416a-8e51-84f4ffa379f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:59.865508 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3f576-7539-416a-8e51-84f4ffa379f7 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:59.865932 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3f576-7539-416a-8e51-84f4ffa379f7 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:59.866362 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3f576-7539-416a-8e51-84f4ffa379f7 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:59.868429 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3f576-7539-416a-8e51-84f4ffa379f7 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:59.872688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3f576-7539-416a-8e51-84f4ffa379f7 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:59.875112 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 117/231] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:59 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:02:59.883933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3f576-7539-416a-8e51-84f4ffa379f7 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:59.979142 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa090e5-44f2-480d-ae63-81486fe165d8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:00.055428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e5ea0-4500-416d-9185-3276bfdf48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:00.056316 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e5ea0-4500-416d-9185-3276bfdf48ef None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:00.056602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e5ea0-4500-416d-9185-3276bfdf48ef None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:00.056882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e5ea0-4500-416d-9185-3276bfdf48ef None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:00.058320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e5ea0-4500-416d-9185-3276bfdf48ef None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:00.061561 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e5ea0-4500-416d-9185-3276bfdf48ef None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:00.072265 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 115/232] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:02:59 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:00.078396 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e5ea0-4500-416d-9185-3276bfdf48ef None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:00.082493 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3f576-7539-416a-8e51-84f4ffa379f7 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:00.105863 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:00.147426 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aebd74-afcf-4b0f-8cd0-3da2b63ae95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:00.148266 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebd74-afcf-4b0f-8cd0-3da2b63ae95b None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:00.148546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebd74-afcf-4b0f-8cd0-3da2b63ae95b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:00.148834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebd74-afcf-4b0f-8cd0-3da2b63ae95b None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/users/c99d969974c84462b79d8430e49cd38c/roles/4876e759b9504964a874992dc66b6df1` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:00.155947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aebd74-afcf-4b0f-8cd0-3da2b63ae95b None admin] RBAC: Authorizing `identity:create_grant(project_id=72282c5cb5cb4eb792a0e612a389ee4e, user_id=c99d969974c84462b79d8430e49cd38c, role_id=4876e759b9504964a874992dc66b6df1)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:00.157420 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aebd74-afcf-4b0f-8cd0-3da2b63ae95b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:00.192654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e5ea0-4500-416d-9185-3276bfdf48ef None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:00.195693 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:00.229919 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d3ade-9506-4bb2-a3e7-c3ea8729e008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:00.231003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3ade-9506-4bb2-a3e7-c3ea8729e008 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:00.231264 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3ade-9506-4bb2-a3e7-c3ea8729e008 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:00.231536 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3ade-9506-4bb2-a3e7-c3ea8729e008 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/users/c99d969974c84462b79d8430e49cd38c/roles/38e07a16dc8b4306be7688b9d5cd626b` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:00.233726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d3ade-9506-4bb2-a3e7-c3ea8729e008 None admin] RBAC: Authorizing `identity:create_grant(project_id=72282c5cb5cb4eb792a0e612a389ee4e, user_id=c99d969974c84462b79d8430e49cd38c, role_id=38e07a16dc8b4306be7688b9d5cd626b)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:00.235203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d3ade-9506-4bb2-a3e7-c3ea8729e008 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:00.250701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 118/233] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:02:59 2022] PUT /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/users/c99d969974c84462b79d8430e49cd38c/roles/4876e759b9504964a874992dc66b6df1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:00.358546 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 116/234] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:03:00 2022] PUT /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/users/c99d969974c84462b79d8430e49cd38c/roles/38e07a16dc8b4306be7688b9d5cd626b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:00.862997 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de220cfd-fd0a-4787-9620-991e90445ed8 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:00.864569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de220cfd-fd0a-4787-9620-991e90445ed8 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:00.865162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de220cfd-fd0a-4787-9620-991e90445ed8 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:00.867215 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 119/235] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:00.873782 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2bc07-5064-4f38-ac0b-1d2782a3c840 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:00.874415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2bc07-5064-4f38-ac0b-1d2782a3c840 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:00.874955 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2bc07-5064-4f38-ac0b-1d2782a3c840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:00.896134 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-81d2bc07-5064-4f38-ac0b-1d2782a3c840 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:00.897702 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-81d2bc07-5064-4f38-ac0b-1d2782a3c840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:00.970402 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 117/236] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:01.019172 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de220cfd-fd0a-4787-9620-991e90445ed8 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:01.030785 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8123b0c-0ed1-4626-9937-595290ed6c1b None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.031403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8123b0c-0ed1-4626-9937-595290ed6c1b None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.031905 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8123b0c-0ed1-4626-9937-595290ed6c1b None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.033535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 118/237] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:01.039209 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07040893-e601-4a11-9536-65d7034bca4d None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.039860 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07040893-e601-4a11-9536-65d7034bca4d None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.040345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07040893-e601-4a11-9536-65d7034bca4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.070543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-07040893-e601-4a11-9536-65d7034bca4d None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:01.073926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-07040893-e601-4a11-9536-65d7034bca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:01.190716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:01.196279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 119/238] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:01.204857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de220cfd-fd0a-4787-9620-991e90445ed8 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:01.237508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07040893-e601-4a11-9536-65d7034bca4d None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:01.242362 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c46a75-08d5-446b-a884-20c8000dc453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:01.243196 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46a75-08d5-446b-a884-20c8000dc453 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.243474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46a75-08d5-446b-a884-20c8000dc453 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.243744 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46a75-08d5-446b-a884-20c8000dc453 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.250944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c46a75-08d5-446b-a884-20c8000dc453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:01.250944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c46a75-08d5-446b-a884-20c8000dc453 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:01.250944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 120/239] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:01.258987 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c46a75-08d5-446b-a884-20c8000dc453 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:01.342464 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:01.401558 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07040893-e601-4a11-9536-65d7034bca4d None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:01.413567 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c46a75-08d5-446b-a884-20c8000dc453 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:01.457270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c2b1a-757e-4bf0-835f-911424cc0747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:01.458097 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c2b1a-757e-4bf0-835f-911424cc0747 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.458454 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c2b1a-757e-4bf0-835f-911424cc0747 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.458846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c2b1a-757e-4bf0-835f-911424cc0747 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.461318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0372c7-93b5-4c31-9f3f-612590c27685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:01.462172 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0372c7-93b5-4c31-9f3f-612590c27685 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.462632 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0372c7-93b5-4c31-9f3f-612590c27685 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.463079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0372c7-93b5-4c31-9f3f-612590c27685 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.463953 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0372c7-93b5-4c31-9f3f-612590c27685 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:01.466156 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0372c7-93b5-4c31-9f3f-612590c27685 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:01.471534 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c2b1a-757e-4bf0-835f-911424cc0747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-a82c2b1a-757e-4bf0-835f-911424cc0747 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:01.482301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:01.483738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:01.484887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:01.485837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 120/240] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:01.487345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8506f9-494f-4106-b587-fc0797682bc8 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.487786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8506f9-494f-4106-b587-fc0797682bc8 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.489506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8506f9-494f-4106-b587-fc0797682bc8 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.489772 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 121/241] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:01.490723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8506f9-494f-4106-b587-fc0797682bc8 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:01.554920 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 121/242] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:03:01 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:03:01.556825 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5679616-dbf5-400c-ba93-8818b50b608a None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.557371 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5679616-dbf5-400c-ba93-8818b50b608a None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.557862 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5679616-dbf5-400c-ba93-8818b50b608a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.566252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:01.599962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-d5679616-dbf5-400c-ba93-8818b50b608a None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:01.601596 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-d5679616-dbf5-400c-ba93-8818b50b608a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:01.625526 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8506f9-494f-4106-b587-fc0797682bc8 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:01.671747 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2281c1f-2658-4719-b484-b53d7c1cf2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:01.672450 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2281c1f-2658-4719-b484-b53d7c1cf2c1 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.672742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2281c1f-2658-4719-b484-b53d7c1cf2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.673023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2281c1f-2658-4719-b484-b53d7c1cf2c1 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.673807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2281c1f-2658-4719-b484-b53d7c1cf2c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:01.674128 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2281c1f-2658-4719-b484-b53d7c1cf2c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:01.676269 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2281c1f-2658-4719-b484-b53d7c1cf2c1 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:01.692070 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 122/243] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:01.693551 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2281c1f-2658-4719-b484-b53d7c1cf2c1 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:01.808901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 122/244] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:01.834999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5679616-dbf5-400c-ba93-8818b50b608a None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:01.843885 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2281c1f-2658-4719-b484-b53d7c1cf2c1 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:01.874475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:01.875283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:01.889037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61ab2e-aa64-47da-a628-2823abfdc022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:01.893445 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ab2e-aa64-47da-a628-2823abfdc022 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.893445 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ab2e-aa64-47da-a628-2823abfdc022 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.893445 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ab2e-aa64-47da-a628-2823abfdc022 None admin] PATH_INFO: `/v3/users/19ec0d85b5414c80ba649b521a0c0679` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.907195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61ab2e-aa64-47da-a628-2823abfdc022 None admin] RBAC: Authorizing `identity:get_user(user_id=19ec0d85b5414c80ba649b521a0c0679)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:01.909030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61ab2e-aa64-47da-a628-2823abfdc022 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:01.911369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 123/245] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:01 2022] GET /identity/v3/users/19ec0d85b5414c80ba649b521a0c0679 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:01.917132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61ab2e-aa64-47da-a628-2823abfdc022 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:01.990136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5679616-dbf5-400c-ba93-8818b50b608a None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:02.043923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534c03e-639e-4efd-b97b-d9763e469441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:02.044779 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534c03e-639e-4efd-b97b-d9763e469441 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:02.045270 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534c03e-639e-4efd-b97b-d9763e469441 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:02.045562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534c03e-639e-4efd-b97b-d9763e469441 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:02.061716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61ab2e-aa64-47da-a628-2823abfdc022 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:02.061912 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534c03e-639e-4efd-b97b-d9763e469441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-e534c03e-639e-4efd-b97b-d9763e469441 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:02.070735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:02.071839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:02.072777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:02.077560 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 123/246] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:02.078848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534c03e-639e-4efd-b97b-d9763e469441 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:02.108816 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896b214-8722-4ed9-915f-560914359855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:02.110007 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896b214-8722-4ed9-915f-560914359855 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:02.110897 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896b214-8722-4ed9-915f-560914359855 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:02.111544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896b214-8722-4ed9-915f-560914359855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:02.177053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:02.192957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:02.204212 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896b214-8722-4ed9-915f-560914359855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:02.205124 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534c03e-639e-4efd-b97b-d9763e469441 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:02.206262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896b214-8722-4ed9-915f-560914359855 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:02.261047 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e078a-c815-42c2-b7a0-1c5275220144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:02.262068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e078a-c815-42c2-b7a0-1c5275220144 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:02.265809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e078a-c815-42c2-b7a0-1c5275220144 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:02.265809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e078a-c815-42c2-b7a0-1c5275220144 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:02.265809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e078a-c815-42c2-b7a0-1c5275220144 None admin] RBAC: Adding query filter params (name=member) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:02.266447 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e078a-c815-42c2-b7a0-1c5275220144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:02.268861 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e078a-c815-42c2-b7a0-1c5275220144 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:02.280734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 124/247] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:02.286721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e078a-c815-42c2-b7a0-1c5275220144 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:02.339999 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 124/248] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:03:02.345808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896b214-8722-4ed9-915f-560914359855 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:02.417785 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e078a-c815-42c2-b7a0-1c5275220144 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:02.451501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:02.463194 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896b214-8722-4ed9-915f-560914359855 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:02.485242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cbd7e-e466-44a7-b7e5-9d27a2b0e20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:02.486134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbd7e-e466-44a7-b7e5-9d27a2b0e20d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:02.486419 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbd7e-e466-44a7-b7e5-9d27a2b0e20d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:02.486719 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbd7e-e466-44a7-b7e5-9d27a2b0e20d None admin] PATH_INFO: `/v3/users/4ec49c2a2fae4219bc5b8d57e6c012cf` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:02.489736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cbd7e-e466-44a7-b7e5-9d27a2b0e20d None admin] RBAC: Authorizing `identity:get_user(user_id=4ec49c2a2fae4219bc5b8d57e6c012cf)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:02.491253 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cbd7e-e466-44a7-b7e5-9d27a2b0e20d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:02.493270 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 125/249] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:02 2022] GET /identity/v3/users/4ec49c2a2fae4219bc5b8d57e6c012cf => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:02.503165 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cbd7e-e466-44a7-b7e5-9d27a2b0e20d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:02.507541 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53990097-746e-43fd-9131-d7ed71f878cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:02.508429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53990097-746e-43fd-9131-d7ed71f878cc None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:02.508711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53990097-746e-43fd-9131-d7ed71f878cc None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:02.509019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53990097-746e-43fd-9131-d7ed71f878cc None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:02.510319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53990097-746e-43fd-9131-d7ed71f878cc None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:02.511879 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53990097-746e-43fd-9131-d7ed71f878cc None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:02.517966 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 125/250] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:02 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:02.522127 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53990097-746e-43fd-9131-d7ed71f878cc None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:02.547639 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:02.657576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53990097-746e-43fd-9131-d7ed71f878cc None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:02.701251 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7e6af-7f0b-4403-9f91-0ffe6c98471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:02.701913 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7e6af-7f0b-4403-9f91-0ffe6c98471b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:02.702201 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7e6af-7f0b-4403-9f91-0ffe6c98471b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:02.702461 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7e6af-7f0b-4403-9f91-0ffe6c98471b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:02.703358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7e6af-7f0b-4403-9f91-0ffe6c98471b None admin] RBAC: Adding query filter params (role.id=03fc945060c64e0cb56cff9471d1b1c2, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e, user.id=19ec0d85b5414c80ba649b521a0c0679) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:02.704123 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7e6af-7f0b-4403-9f91-0ffe6c98471b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:02.705758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7e6af-7f0b-4403-9f91-0ffe6c98471b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:02.718014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 126/251] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:02 2022] GET /identity/v3/role_assignments?user.id=19ec0d85b5414c80ba649b521a0c0679&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=03fc945060c64e0cb56cff9471d1b1c2 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:02.733725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cbd7e-e466-44a7-b7e5-9d27a2b0e20d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:02.794084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b1b20-6bcc-498c-be40-ac4c059f3016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:02.795043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b1b20-6bcc-498c-be40-ac4c059f3016 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:02.795324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b1b20-6bcc-498c-be40-ac4c059f3016 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:02.795600 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b1b20-6bcc-498c-be40-ac4c059f3016 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:02.796987 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b1b20-6bcc-498c-be40-ac4c059f3016 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:02.798492 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b1b20-6bcc-498c-be40-ac4c059f3016 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:02.800946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 126/252] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:02 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:02.806639 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7e6af-7f0b-4403-9f91-0ffe6c98471b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:02.827290 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:02.932434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7e6af-7f0b-4403-9f91-0ffe6c98471b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:02.972556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdaaf5-91a4-4ddb-bc72-d1612c9767f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:02.973462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdaaf5-91a4-4ddb-bc72-d1612c9767f2 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:02.973742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdaaf5-91a4-4ddb-bc72-d1612c9767f2 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:02.974014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdaaf5-91a4-4ddb-bc72-d1612c9767f2 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/users/4ec49c2a2fae4219bc5b8d57e6c012cf/roles/edf99f336b2440b19ff28bcd8da8433b` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:02.976139 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdaaf5-91a4-4ddb-bc72-d1612c9767f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=72282c5cb5cb4eb792a0e612a389ee4e, user_id=4ec49c2a2fae4219bc5b8d57e6c012cf, role_id=edf99f336b2440b19ff28bcd8da8433b)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:02.977530 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdaaf5-91a4-4ddb-bc72-d1612c9767f2 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:03.067988 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 127/253] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:03:02 2022] PUT /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/users/4ec49c2a2fae4219bc5b8d57e6c012cf/roles/edf99f336b2440b19ff28bcd8da8433b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:03.249574 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb8227-da6f-46d0-96c0-6560d7baf855 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:03.250238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb8227-da6f-46d0-96c0-6560d7baf855 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:03.250238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb8227-da6f-46d0-96c0-6560d7baf855 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:03.251924 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 127/254] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:03.264533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33e315-0727-4837-a473-d142c9b615cf None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:03.268618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33e315-0727-4837-a473-d142c9b615cf None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:03.268618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33e315-0727-4837-a473-d142c9b615cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:03.291112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-1e33e315-0727-4837-a473-d142c9b615cf None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:03.292329 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-1e33e315-0727-4837-a473-d142c9b615cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:03.399985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 128/255] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:03.438101 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb8227-da6f-46d0-96c0-6560d7baf855 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:03.551639 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:03.568667 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb8227-da6f-46d0-96c0-6560d7baf855 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:03.611898 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe9aa1-d58b-44ef-ba7d-990441caeb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:03.612721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9aa1-d58b-44ef-ba7d-990441caeb18 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:03.612998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9aa1-d58b-44ef-ba7d-990441caeb18 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:03.613268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9aa1-d58b-44ef-ba7d-990441caeb18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:03.628292 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe9aa1-d58b-44ef-ba7d-990441caeb18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-b8fe9aa1-d58b-44ef-ba7d-990441caeb18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:03.636414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:03.638850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:03.640957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 128/256] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:03:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:03.646680 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33e315-0727-4837-a473-d142c9b615cf None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:03.646680 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:03.722503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c8d0e-625e-46a9-9534-ef460a607ce4 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:03.722889 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c8d0e-625e-46a9-9534-ef460a607ce4 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:03.723068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c8d0e-625e-46a9-9534-ef460a607ce4 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:03.724442 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 129/257] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:03:03.732948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f030163-c216-45e6-9e2d-d413a913e158 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:03.733253 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f030163-c216-45e6-9e2d-d413a913e158 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:03.733492 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f030163-c216-45e6-9e2d-d413a913e158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:03.760399 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-5f030163-c216-45e6-9e2d-d413a913e158 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:03.761600 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-5f030163-c216-45e6-9e2d-d413a913e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:03.834520 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33e315-0727-4837-a473-d142c9b615cf None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:03.893467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ff3df-b9f5-475a-92bd-79a1c2d38640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:03.894150 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ff3df-b9f5-475a-92bd-79a1c2d38640 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:03.894453 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ff3df-b9f5-475a-92bd-79a1c2d38640 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:03.894759 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ff3df-b9f5-475a-92bd-79a1c2d38640 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:03.895517 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ff3df-b9f5-475a-92bd-79a1c2d38640 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:03.896116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ff3df-b9f5-475a-92bd-79a1c2d38640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:03.897760 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ff3df-b9f5-475a-92bd-79a1c2d38640 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:03.908379 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 129/258] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:03.918632 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 130/259] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:03:03.918824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ff3df-b9f5-475a-92bd-79a1c2d38640 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:03.952820 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f030163-c216-45e6-9e2d-d413a913e158 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:04.082971 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:04.113589 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:04.147868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ff3df-b9f5-475a-92bd-79a1c2d38640 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:04.151064 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f030163-c216-45e6-9e2d-d413a913e158 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:04.212114 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66b9b-c948-4dcb-b1ab-ac131e786945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:04.212916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66b9b-c948-4dcb-b1ab-ac131e786945 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:04.213195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66b9b-c948-4dcb-b1ab-ac131e786945 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:04.213468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66b9b-c948-4dcb-b1ab-ac131e786945 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:04.214561 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0168ab-1fdc-4b4c-9a0b-14e00c870491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:04.215511 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0168ab-1fdc-4b4c-9a0b-14e00c870491 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:04.215792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0168ab-1fdc-4b4c-9a0b-14e00c870491 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:04.216074 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0168ab-1fdc-4b4c-9a0b-14e00c870491 None admin] PATH_INFO: `/v3/users/c99d969974c84462b79d8430e49cd38c` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:04.219467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0168ab-1fdc-4b4c-9a0b-14e00c870491 None admin] RBAC: Authorizing `identity:get_user(user_id=c99d969974c84462b79d8430e49cd38c)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:04.220258 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0168ab-1fdc-4b4c-9a0b-14e00c870491 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:04.226627 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 130/260] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:03 2022] GET /identity/v3/users/c99d969974c84462b79d8430e49cd38c => generated 283 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:04.232402 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0168ab-1fdc-4b4c-9a0b-14e00c870491 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:04.245738 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f66b9b-c948-4dcb-b1ab-ac131e786945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-11f66b9b-c948-4dcb-b1ab-ac131e786945 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:04.256293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:04.257722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:03:04.258681 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:04.259405 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 131/261] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:03:04.266238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66b9b-c948-4dcb-b1ab-ac131e786945 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:04.428671 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0168ab-1fdc-4b4c-9a0b-14e00c870491 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:04.456925 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66b9b-c948-4dcb-b1ab-ac131e786945 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:04.482992 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:04.493382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ddb05-63d2-4c84-a7fe-49a0e1cdbb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:04.494042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ddb05-63d2-4c84-a7fe-49a0e1cdbb87 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:04.494397 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ddb05-63d2-4c84-a7fe-49a0e1cdbb87 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:04.494732 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ddb05-63d2-4c84-a7fe-49a0e1cdbb87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:04.523213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd4d63-ddb6-48c5-bacb-5d2fa4f9e446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:04.523952 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4d63-ddb6-48c5-bacb-5d2fa4f9e446 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:04.524232 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4d63-ddb6-48c5-bacb-5d2fa4f9e446 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:04.524506 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4d63-ddb6-48c5-bacb-5d2fa4f9e446 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:04.525329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd4d63-ddb6-48c5-bacb-5d2fa4f9e446 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:04.525636 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd4d63-ddb6-48c5-bacb-5d2fa4f9e446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:04.527318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd4d63-ddb6-48c5-bacb-5d2fa4f9e446 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:04.538636 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:04.545214 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 132/262] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:04.552038 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd4d63-ddb6-48c5-bacb-5d2fa4f9e446 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:04.639695 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ddb05-63d2-4c84-a7fe-49a0e1cdbb87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:04.641628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ddb05-63d2-4c84-a7fe-49a0e1cdbb87 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:04.701662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd4d63-ddb6-48c5-bacb-5d2fa4f9e446 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:04.768690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a42bb-d3e9-490c-a390-1849f89641fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:04.769582 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a42bb-d3e9-490c-a390-1849f89641fb None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:04.769897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a42bb-d3e9-490c-a390-1849f89641fb None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:04.770182 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a42bb-d3e9-490c-a390-1849f89641fb None admin] PATH_INFO: `/v3/users/c99d969974c84462b79d8430e49cd38c` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:04.771394 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a42bb-d3e9-490c-a390-1849f89641fb None admin] RBAC: Authorizing `identity:get_user(user_id=c99d969974c84462b79d8430e49cd38c)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:04.772884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a42bb-d3e9-490c-a390-1849f89641fb None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:04.778630 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 133/263] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:04 2022] GET /identity/v3/users/c99d969974c84462b79d8430e49cd38c => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:04.789094 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a42bb-d3e9-490c-a390-1849f89641fb None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:04.851103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 131/264] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:04.864591 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ddb05-63d2-4c84-a7fe-49a0e1cdbb87 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:04.918643 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:04.960702 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a42bb-d3e9-490c-a390-1849f89641fb None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:04.980789 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:05.039816 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45609c6-c6c4-40e7-b87b-d22b05bee1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:05.040480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45609c6-c6c4-40e7-b87b-d22b05bee1f5 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:05.040761 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45609c6-c6c4-40e7-b87b-d22b05bee1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:05.041031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45609c6-c6c4-40e7-b87b-d22b05bee1f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:05.126532 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ddb05-63d2-4c84-a7fe-49a0e1cdbb87 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:05.180074 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e11733-b92d-49c5-95b7-c4e362d5647e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:05.180974 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11733-b92d-49c5-95b7-c4e362d5647e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:05.181537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11733-b92d-49c5-95b7-c4e362d5647e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:05.182056 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11733-b92d-49c5-95b7-c4e362d5647e None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:05.183751 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e11733-b92d-49c5-95b7-c4e362d5647e None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:05.186054 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e11733-b92d-49c5-95b7-c4e362d5647e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:05.188554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 132/265] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:04 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:05.190342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c69228-6eaa-4586-b0b3-1a531152f846 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:05.190914 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c69228-6eaa-4586-b0b3-1a531152f846 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:05.191426 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c69228-6eaa-4586-b0b3-1a531152f846 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:05.193127 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 133/266] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:05.195353 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c69228-6eaa-4586-b0b3-1a531152f846 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:05.195533 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45609c6-c6c4-40e7-b87b-d22b05bee1f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:05.197398 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45609c6-c6c4-40e7-b87b-d22b05bee1f5 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:05.342720 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c69228-6eaa-4586-b0b3-1a531152f846 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:05.346398 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:05.348282 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:05.390622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 134/267] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:03:05.392274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3b093-b626-41f8-8b1f-b29a561835d4 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:05.392779 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3b093-b626-41f8-8b1f-b29a561835d4 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:05.393293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3b093-b626-41f8-8b1f-b29a561835d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:05.409887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-76e3b093-b626-41f8-8b1f-b29a561835d4 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:05.411464 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-76e3b093-b626-41f8-8b1f-b29a561835d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:05.421638 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a972dd-dc1b-4f95-8bfa-6010afb7105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:05.424774 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a972dd-dc1b-4f95-8bfa-6010afb7105f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:05.425320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a972dd-dc1b-4f95-8bfa-6010afb7105f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:05.426077 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a972dd-dc1b-4f95-8bfa-6010afb7105f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:05.428657 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a972dd-dc1b-4f95-8bfa-6010afb7105f None admin] RBAC: Adding query filter params (role.id=4876e759b9504964a874992dc66b6df1, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e, user.id=c99d969974c84462b79d8430e49cd38c) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:05.429995 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a972dd-dc1b-4f95-8bfa-6010afb7105f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:05.431635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a972dd-dc1b-4f95-8bfa-6010afb7105f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:05.446647 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 134/268] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:05 2022] GET /identity/v3/role_assignments?user.id=c99d969974c84462b79d8430e49cd38c&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=4876e759b9504964a874992dc66b6df1 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:05.446647 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a972dd-dc1b-4f95-8bfa-6010afb7105f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:05.554729 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 135/269] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:05.556027 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f582-9750-4b67-833b-e70e5cc51065 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:05.556312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f582-9750-4b67-833b-e70e5cc51065 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:05.556592 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f582-9750-4b67-833b-e70e5cc51065 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:05.557986 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 136/270] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:05.572281 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89d5a-1e83-44a0-b291-25e42ac29d56 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:05.572620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89d5a-1e83-44a0-b291-25e42ac29d56 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:05.572838 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89d5a-1e83-44a0-b291-25e42ac29d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:05.604736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-2af89d5a-1e83-44a0-b291-25e42ac29d56 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:05.606523 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-2af89d5a-1e83-44a0-b291-25e42ac29d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:05.615319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a972dd-dc1b-4f95-8bfa-6010afb7105f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:05.660456 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3cfae-1b4d-43b3-bac5-06824050ada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:05.661400 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3cfae-1b4d-43b3-bac5-06824050ada2 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:05.661677 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3cfae-1b4d-43b3-bac5-06824050ada2 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:05.661946 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3cfae-1b4d-43b3-bac5-06824050ada2 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:05.663268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3cfae-1b4d-43b3-bac5-06824050ada2 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:05.664752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3cfae-1b4d-43b3-bac5-06824050ada2 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:05.666954 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 135/271] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:05 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:05.667742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3cfae-1b4d-43b3-bac5-06824050ada2 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:05.703822 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:05.716839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 137/272] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:05.717725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af89d5a-1e83-44a0-b291-25e42ac29d56 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:05.768040 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:05.806379 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3cfae-1b4d-43b3-bac5-06824050ada2 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:05.859836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea79cf2-144b-4d3b-90de-9536155476ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:05.862254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea79cf2-144b-4d3b-90de-9536155476ef None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:05.862927 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea79cf2-144b-4d3b-90de-9536155476ef None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:05.863436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea79cf2-144b-4d3b-90de-9536155476ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:05.865326 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea79cf2-144b-4d3b-90de-9536155476ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:05.867482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea79cf2-144b-4d3b-90de-9536155476ef None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:05.870450 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 136/273] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:05.872081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea79cf2-144b-4d3b-90de-9536155476ef None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:05.878357 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af89d5a-1e83-44a0-b291-25e42ac29d56 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:05.922387 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff179f-ac64-40d3-8556-b81d28e9db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:05.922672 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff179f-ac64-40d3-8556-b81d28e9db69 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:05.923902 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff179f-ac64-40d3-8556-b81d28e9db69 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:05.924185 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff179f-ac64-40d3-8556-b81d28e9db69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:05.925146 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff179f-ac64-40d3-8556-b81d28e9db69 None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e, user.id=c99d969974c84462b79d8430e49cd38c) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:05.925461 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff179f-ac64-40d3-8556-b81d28e9db69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:05.927250 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff179f-ac64-40d3-8556-b81d28e9db69 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:05.935880 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 138/274] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:05 2022] GET /identity/v3/role_assignments?user.id=c99d969974c84462b79d8430e49cd38c&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:05.936725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff179f-ac64-40d3-8556-b81d28e9db69 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:06.071572 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:06.075977 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea79cf2-144b-4d3b-90de-9536155476ef None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:06.080520 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:06.092353 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff179f-ac64-40d3-8556-b81d28e9db69 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:06.133944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadce583-658c-4f50-814c-94093e30c4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:06.135015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c31180-df81-4597-85d6-08c5c77096f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:06.136018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadce583-658c-4f50-814c-94093e30c4c6 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:06.137462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c31180-df81-4597-85d6-08c5c77096f8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:06.138021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadce583-658c-4f50-814c-94093e30c4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:06.138505 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadce583-658c-4f50-814c-94093e30c4c6 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:06.139024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c31180-df81-4597-85d6-08c5c77096f8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:06.140184 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c31180-df81-4597-85d6-08c5c77096f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:06.141225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadce583-658c-4f50-814c-94093e30c4c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:06.142976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadce583-658c-4f50-814c-94093e30c4c6 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:06.168064 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c31180-df81-4597-85d6-08c5c77096f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-63c31180-df81-4597-85d6-08c5c77096f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:06.178502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:06.179699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:06.180963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:06.183434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 137/275] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:06.189432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c31180-df81-4597-85d6-08c5c77096f8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:06.250299 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 139/276] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:03:05 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:03:06.251835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f459bcf-95bf-4752-8fb4-e59d8ed8fc92 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:06.252195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f459bcf-95bf-4752-8fb4-e59d8ed8fc92 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:06.252716 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f459bcf-95bf-4752-8fb4-e59d8ed8fc92 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:06.258645 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 140/277] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:06.269189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff45dfe-7c46-4d73-bb4f-91bd1d0d462c None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:06.269826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff45dfe-7c46-4d73-bb4f-91bd1d0d462c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:06.271006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff45dfe-7c46-4d73-bb4f-91bd1d0d462c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:06.296513 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-8ff45dfe-7c46-4d73-bb4f-91bd1d0d462c None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:06.298185 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-8ff45dfe-7c46-4d73-bb4f-91bd1d0d462c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:06.342151 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c31180-df81-4597-85d6-08c5c77096f8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:06.383776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 141/278] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:06.387786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9086a8-be46-43e1-83ee-ec34359ccf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:06.387786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9086a8-be46-43e1-83ee-ec34359ccf2a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:06.387786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9086a8-be46-43e1-83ee-ec34359ccf2a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:06.387786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9086a8-be46-43e1-83ee-ec34359ccf2a None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:06.388136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9086a8-be46-43e1-83ee-ec34359ccf2a None admin] RBAC: Adding query filter params (name=member) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:06.388136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9086a8-be46-43e1-83ee-ec34359ccf2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:06.392395 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9086a8-be46-43e1-83ee-ec34359ccf2a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:06.399096 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 138/279] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:06.404559 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff45dfe-7c46-4d73-bb4f-91bd1d0d462c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:06.412592 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9086a8-be46-43e1-83ee-ec34359ccf2a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:06.451699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:06.507950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:06.531603 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff45dfe-7c46-4d73-bb4f-91bd1d0d462c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:06.534996 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9086a8-be46-43e1-83ee-ec34359ccf2a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:06.575904 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18b623-194d-4b56-973e-5db966f41799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:06.576719 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18b623-194d-4b56-973e-5db966f41799 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:06.577004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18b623-194d-4b56-973e-5db966f41799 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:06.577317 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18b623-194d-4b56-973e-5db966f41799 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:06.577948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91be459-0ebc-4cde-a6d6-d56bf077d6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:06.578874 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be459-0ebc-4cde-a6d6-d56bf077d6c3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:06.579148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be459-0ebc-4cde-a6d6-d56bf077d6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:06.579416 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be459-0ebc-4cde-a6d6-d56bf077d6c3 None admin] PATH_INFO: `/v3/users/d57dd5b4295445dc9ac438cab8d4e5f9` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:06.592262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18b623-194d-4b56-973e-5db966f41799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:06.595883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91be459-0ebc-4cde-a6d6-d56bf077d6c3 None admin] RBAC: Authorizing `identity:get_user(user_id=d57dd5b4295445dc9ac438cab8d4e5f9)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:06.597615 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91be459-0ebc-4cde-a6d6-d56bf077d6c3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:06.603415 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 142/280] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:06 2022] GET /identity/v3/users/d57dd5b4295445dc9ac438cab8d4e5f9 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:06.603415 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19cb8d-c1e5-48a4-9cb6-97d5855b797a None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:06.603415 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19cb8d-c1e5-48a4-9cb6-97d5855b797a None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:06.603415 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19cb8d-c1e5-48a4-9cb6-97d5855b797a None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-1d18b623-194d-4b56-973e-5db966f41799 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:06.603790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:06.604807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:06.605818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:06.607239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 143/281] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:06.607323 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 139/282] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:03:06.608722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19cb8d-c1e5-48a4-9cb6-97d5855b797a None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:06.609415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250acca-0129-416a-ba5d-56a28b40e07d None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:06.609734 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250acca-0129-416a-ba5d-56a28b40e07d None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:06.609990 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250acca-0129-416a-ba5d-56a28b40e07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:06.632328 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-4250acca-0129-416a-ba5d-56a28b40e07d None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:06.633482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-4250acca-0129-416a-ba5d-56a28b40e07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:06.722427 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 140/283] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:03:06.723729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250acca-0129-416a-ba5d-56a28b40e07d None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:06.748189 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:06.748690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19cb8d-c1e5-48a4-9cb6-97d5855b797a None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:06.788790 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b4670-6943-4a63-85ab-39f4c72fdf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:06.789865 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b4670-6943-4a63-85ab-39f4c72fdf9b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:06.790402 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b4670-6943-4a63-85ab-39f4c72fdf9b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:06.790918 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b4670-6943-4a63-85ab-39f4c72fdf9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:06.792149 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b4670-6943-4a63-85ab-39f4c72fdf9b None admin] RBAC: Adding query filter params (role.id=edf99f336b2440b19ff28bcd8da8433b, user.id=d57dd5b4295445dc9ac438cab8d4e5f9, scope.system=all) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:06.792735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b4670-6943-4a63-85ab-39f4c72fdf9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:06.795248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b4670-6943-4a63-85ab-39f4c72fdf9b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:06.798920 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:06.803440 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 144/284] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:03:06 2022] GET /identity/v3/role_assignments?user.id=d57dd5b4295445dc9ac438cab8d4e5f9&scope.system=all&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:06.806694 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b4670-6943-4a63-85ab-39f4c72fdf9b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:06.861380 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250acca-0129-416a-ba5d-56a28b40e07d None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:06.905548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6213fd7-bb00-4c0e-961d-160a9355b7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:06.906252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213fd7-bb00-4c0e-961d-160a9355b7e6 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:06.906555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213fd7-bb00-4c0e-961d-160a9355b7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:06.906852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213fd7-bb00-4c0e-961d-160a9355b7e6 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:06.907649 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6213fd7-bb00-4c0e-961d-160a9355b7e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:06.907960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6213fd7-bb00-4c0e-961d-160a9355b7e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:06.909409 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6213fd7-bb00-4c0e-961d-160a9355b7e6 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:06.926196 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 141/285] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:06.928716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6213fd7-bb00-4c0e-961d-160a9355b7e6 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:07.028787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:07.084279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6213fd7-bb00-4c0e-961d-160a9355b7e6 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:07.085166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b4670-6943-4a63-85ab-39f4c72fdf9b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:07.127439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11428e2-291a-407a-8f85-1f9de3fdd53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:07.128929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11428e2-291a-407a-8f85-1f9de3fdd53c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:07.129529 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11428e2-291a-407a-8f85-1f9de3fdd53c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:07.130199 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11428e2-291a-407a-8f85-1f9de3fdd53c None admin] PATH_INFO: `/v3/roles/member` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:07.132099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32eeec-2f5f-45dd-9119-c40654da32d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:07.133255 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32eeec-2f5f-45dd-9119-c40654da32d6 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:07.133535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32eeec-2f5f-45dd-9119-c40654da32d6 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:07.133808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32eeec-2f5f-45dd-9119-c40654da32d6 None admin] PATH_INFO: `/v3/users/19ec0d85b5414c80ba649b521a0c0679` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:07.135458 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32eeec-2f5f-45dd-9119-c40654da32d6 None admin] RBAC: Authorizing `identity:get_user(user_id=19ec0d85b5414c80ba649b521a0c0679)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:07.136922 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32eeec-2f5f-45dd-9119-c40654da32d6 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:07.139738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 142/286] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:06 2022] GET /identity/v3/users/19ec0d85b5414c80ba649b521a0c0679 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:07.144312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11428e2-291a-407a-8f85-1f9de3fdd53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:07.144881 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32eeec-2f5f-45dd-9119-c40654da32d6 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-d11428e2-291a-407a-8f85-1f9de3fdd53c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:07.153594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:07.154697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:07.155626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:07.158190 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 145/287] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:07.167023 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11428e2-291a-407a-8f85-1f9de3fdd53c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:07.270551 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32eeec-2f5f-45dd-9119-c40654da32d6 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:07.302360 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:07.312690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d45f4-0757-4dfb-a82f-c42b19a3f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:07.313564 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d45f4-0757-4dfb-a82f-c42b19a3f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:07.313841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d45f4-0757-4dfb-a82f-c42b19a3f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:07.314285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d45f4-0757-4dfb-a82f-c42b19a3f3b2 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:07.319406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d45f4-0757-4dfb-a82f-c42b19a3f3b2 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:07.321599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d45f4-0757-4dfb-a82f-c42b19a3f3b2 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:07.323728 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 143/288] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:07 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:07.331702 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d45f4-0757-4dfb-a82f-c42b19a3f3b2 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:07.358423 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:07.401294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11428e2-291a-407a-8f85-1f9de3fdd53c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:07.468836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5f968-752f-415b-b8b7-6082f63be19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:07.469524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5f968-752f-415b-b8b7-6082f63be19e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:07.469806 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5f968-752f-415b-b8b7-6082f63be19e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:07.470082 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5f968-752f-415b-b8b7-6082f63be19e None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:07.470867 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5f968-752f-415b-b8b7-6082f63be19e None admin] RBAC: Adding query filter params (name=member) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:07.471176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5f968-752f-415b-b8b7-6082f63be19e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:07.472574 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5f968-752f-415b-b8b7-6082f63be19e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:07.486874 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 146/289] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:07.492499 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5f968-752f-415b-b8b7-6082f63be19e None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:07.529992 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d45f4-0757-4dfb-a82f-c42b19a3f3b2 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:07.598154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34890199-7f18-46df-90e5-69cb6997d228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:07.599079 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34890199-7f18-46df-90e5-69cb6997d228 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:07.599359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34890199-7f18-46df-90e5-69cb6997d228 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:07.599635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34890199-7f18-46df-90e5-69cb6997d228 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/users/19ec0d85b5414c80ba649b521a0c0679/roles/03fc945060c64e0cb56cff9471d1b1c2` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:07.608178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34890199-7f18-46df-90e5-69cb6997d228 None admin] RBAC: Authorizing `identity:create_grant(project_id=72282c5cb5cb4eb792a0e612a389ee4e, user_id=19ec0d85b5414c80ba649b521a0c0679, role_id=03fc945060c64e0cb56cff9471d1b1c2)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:07.609733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34890199-7f18-46df-90e5-69cb6997d228 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:07.633669 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5f968-752f-415b-b8b7-6082f63be19e None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:07.659780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:07.674466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883c3fd-7598-4bd1-adec-62edb34c2c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:07.698294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883c3fd-7598-4bd1-adec-62edb34c2c00 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:07.698294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883c3fd-7598-4bd1-adec-62edb34c2c00 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:07.698294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883c3fd-7598-4bd1-adec-62edb34c2c00 None admin] PATH_INFO: `/v3/users/4ec49c2a2fae4219bc5b8d57e6c012cf` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:07.698294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883c3fd-7598-4bd1-adec-62edb34c2c00 None admin] RBAC: Authorizing `identity:get_user(user_id=4ec49c2a2fae4219bc5b8d57e6c012cf)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:07.698294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883c3fd-7598-4bd1-adec-62edb34c2c00 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:07.698294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 147/290] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:07 2022] GET /identity/v3/users/4ec49c2a2fae4219bc5b8d57e6c012cf => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:07.698866 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883c3fd-7598-4bd1-adec-62edb34c2c00 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:07.813717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883c3fd-7598-4bd1-adec-62edb34c2c00 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:07.854575 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d85ed-4519-47ea-9125-c0d8e1904092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:07.855957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d85ed-4519-47ea-9125-c0d8e1904092 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:07.857070 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d85ed-4519-47ea-9125-c0d8e1904092 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:07.857564 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d85ed-4519-47ea-9125-c0d8e1904092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:07.867275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 144/291] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:03:07 2022] PUT /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/users/19ec0d85b5414c80ba649b521a0c0679/roles/03fc945060c64e0cb56cff9471d1b1c2 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:07.968182 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:07.971438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d85ed-4519-47ea-9125-c0d8e1904092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:07.973099 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d85ed-4519-47ea-9125-c0d8e1904092 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:08.107180 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 148/292] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:03:08.113187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34890199-7f18-46df-90e5-69cb6997d228 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:08.206968 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:08.256455 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34890199-7f18-46df-90e5-69cb6997d228 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:08.299010 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee08b30-29fa-40a5-b4b6-608cbd459089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:08.299894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee08b30-29fa-40a5-b4b6-608cbd459089 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:08.300180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee08b30-29fa-40a5-b4b6-608cbd459089 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:08.300460 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee08b30-29fa-40a5-b4b6-608cbd459089 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:08.301999 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee08b30-29fa-40a5-b4b6-608cbd459089 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:08.303486 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee08b30-29fa-40a5-b4b6-608cbd459089 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:08.306986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 145/293] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:08 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:08.311757 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d85ed-4519-47ea-9125-c0d8e1904092 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:08.422980 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:08.431333 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d85ed-4519-47ea-9125-c0d8e1904092 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:08.468808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416a582-ae8a-4fb3-aca7-ee7e4f5d6607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:08.469486 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a582-ae8a-4fb3-aca7-ee7e4f5d6607 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:08.469776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a582-ae8a-4fb3-aca7-ee7e4f5d6607 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:08.470061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a582-ae8a-4fb3-aca7-ee7e4f5d6607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:08.470954 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416a582-ae8a-4fb3-aca7-ee7e4f5d6607 None admin] RBAC: Adding query filter params (role.id=edf99f336b2440b19ff28bcd8da8433b, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e, user.id=4ec49c2a2fae4219bc5b8d57e6c012cf) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:08.471856 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416a582-ae8a-4fb3-aca7-ee7e4f5d6607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:08.473340 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416a582-ae8a-4fb3-aca7-ee7e4f5d6607 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:08.480484 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 149/294] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:08 2022] GET /identity/v3/role_assignments?user.id=4ec49c2a2fae4219bc5b8d57e6c012cf&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:08.871235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c0697-0536-4e0e-bc7e-842ab9701853 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:08.872320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c0697-0536-4e0e-bc7e-842ab9701853 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:08.872320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c0697-0536-4e0e-bc7e-842ab9701853 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:08.873736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 146/295] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:08.879484 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8104801-b54f-4681-8cc9-00a77bac7e78 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:08.879887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8104801-b54f-4681-8cc9-00a77bac7e78 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:08.880263 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8104801-b54f-4681-8cc9-00a77bac7e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:08.899230 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-b8104801-b54f-4681-8cc9-00a77bac7e78 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:08.900422 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-b8104801-b54f-4681-8cc9-00a77bac7e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:08.976247 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 150/296] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:08.999835 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c0697-0536-4e0e-bc7e-842ab9701853 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:09.126526 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c0697-0536-4e0e-bc7e-842ab9701853 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:09.170367 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c98e7d-c6bb-464a-a709-809932d3bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:09.171250 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c98e7d-c6bb-464a-a709-809932d3bf3f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:09.171536 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c98e7d-c6bb-464a-a709-809932d3bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:09.171813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c98e7d-c6bb-464a-a709-809932d3bf3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:09.182555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:09.191191 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c98e7d-c6bb-464a-a709-809932d3bf3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-10c98e7d-c6bb-464a-a709-809932d3bf3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:09.199436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:09.201132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:09.202192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 147/297] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:09.209020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8104801-b54f-4681-8cc9-00a77bac7e78 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:09.308462 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:09.325138 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8104801-b54f-4681-8cc9-00a77bac7e78 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:09.366208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b8be9-350b-41ad-a629-35f00ac02e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:09.366922 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b8be9-350b-41ad-a629-35f00ac02e22 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:09.367207 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b8be9-350b-41ad-a629-35f00ac02e22 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:09.367485 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b8be9-350b-41ad-a629-35f00ac02e22 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:09.368257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b8be9-350b-41ad-a629-35f00ac02e22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:09.368565 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b8be9-350b-41ad-a629-35f00ac02e22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:09.369965 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b8be9-350b-41ad-a629-35f00ac02e22 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:09.380317 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 151/298] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:09.385464 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c98e7d-c6bb-464a-a709-809932d3bf3f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:09.399676 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff560-b734-4a30-b713-2fdca260f740 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:09.399945 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff560-b734-4a30-b713-2fdca260f740 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:09.400226 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff560-b734-4a30-b713-2fdca260f740 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:09.401905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 152/299] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:03:09.407695 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7d56-4b07-4b98-a415-f7176a106bcc None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:09.407988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7d56-4b07-4b98-a415-f7176a106bcc None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:09.408273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7d56-4b07-4b98-a415-f7176a106bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:09.426137 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-d12f7d56-4b07-4b98-a415-f7176a106bcc None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:09.427431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-d12f7d56-4b07-4b98-a415-f7176a106bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:09.516891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 153/300] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:03:09.518417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c98e7d-c6bb-464a-a709-809932d3bf3f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:09.540093 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f7d56-4b07-4b98-a415-f7176a106bcc None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:09.558309 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10647dc7-2cdf-4a28-85be-53d6c743e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:09.560220 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647dc7-2cdf-4a28-85be-53d6c743e576 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:09.560716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647dc7-2cdf-4a28-85be-53d6c743e576 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:09.561234 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647dc7-2cdf-4a28-85be-53d6c743e576 None admin] PATH_INFO: `/v3/users/84e20985e1aa4c8092c7685969e989ab` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:09.576671 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10647dc7-2cdf-4a28-85be-53d6c743e576 None admin] RBAC: Authorizing `identity:get_user(user_id=84e20985e1aa4c8092c7685969e989ab)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:09.578783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10647dc7-2cdf-4a28-85be-53d6c743e576 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:09.581034 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 148/301] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:09 2022] GET /identity/v3/users/84e20985e1aa4c8092c7685969e989ab => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:09.587561 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10647dc7-2cdf-4a28-85be-53d6c743e576 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:09.641404 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:09.655339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:09.665436 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f7d56-4b07-4b98-a415-f7176a106bcc None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:09.705566 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10647dc7-2cdf-4a28-85be-53d6c743e576 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:09.707034 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ab515-5893-4ae6-be83-f3f9edce6eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:09.707853 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab515-5893-4ae6-be83-f3f9edce6eae None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:09.708157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab515-5893-4ae6-be83-f3f9edce6eae None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:09.708405 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab515-5893-4ae6-be83-f3f9edce6eae None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:09.709622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ab515-5893-4ae6-be83-f3f9edce6eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:09.711173 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ab515-5893-4ae6-be83-f3f9edce6eae None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:09.713057 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 154/302] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:09.714248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11813f-c5cb-4a33-bf05-88c0fa4049ce None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:09.714540 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11813f-c5cb-4a33-bf05-88c0fa4049ce None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:09.714843 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11813f-c5cb-4a33-bf05-88c0fa4049ce None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:09.719140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 155/303] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:09.720649 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11813f-c5cb-4a33-bf05-88c0fa4049ce None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:09.746017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946ccc6-4918-409a-a5ca-5b7a42f0071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:09.747239 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ccc6-4918-409a-a5ca-5b7a42f0071e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:09.747524 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ccc6-4918-409a-a5ca-5b7a42f0071e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:09.747802 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ccc6-4918-409a-a5ca-5b7a42f0071e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:09.748635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946ccc6-4918-409a-a5ca-5b7a42f0071e None admin] RBAC: Adding query filter params (role.id=03fc945060c64e0cb56cff9471d1b1c2, user.id=84e20985e1aa4c8092c7685969e989ab, scope.system=all) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:09.748949 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946ccc6-4918-409a-a5ca-5b7a42f0071e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:09.750384 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946ccc6-4918-409a-a5ca-5b7a42f0071e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:09.755691 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 149/304] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:03:09 2022] GET /identity/v3/role_assignments?user.id=84e20985e1aa4c8092c7685969e989ab&scope.system=all&role.id=03fc945060c64e0cb56cff9471d1b1c2 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:09.756886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46557f5-8767-4181-bf78-3b9822de7e1d None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:09.757170 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46557f5-8767-4181-bf78-3b9822de7e1d None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:09.757449 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46557f5-8767-4181-bf78-3b9822de7e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:09.775683 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-c46557f5-8767-4181-bf78-3b9822de7e1d None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:09.776929 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-c46557f5-8767-4181-bf78-3b9822de7e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:09.867753 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 150/305] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:09.869923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11813f-c5cb-4a33-bf05-88c0fa4049ce None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:09.891241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46557f5-8767-4181-bf78-3b9822de7e1d None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:09.916221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645a7d0-8ac1-447b-b15d-bcc7d5708471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:09.916820 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645a7d0-8ac1-447b-b15d-bcc7d5708471 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:09.917104 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645a7d0-8ac1-447b-b15d-bcc7d5708471 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:09.917381 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645a7d0-8ac1-447b-b15d-bcc7d5708471 None admin] PATH_INFO: `/v3/groups` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:09.918098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645a7d0-8ac1-447b-b15d-bcc7d5708471 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:09.920441 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645a7d0-8ac1-447b-b15d-bcc7d5708471 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:09.955232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:09.985177 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 156/306] 10.222.0.89 () {60 vars in 1134 bytes} [Thu May 19 20:03:09 2022] POST /identity/v3/groups => generated 229 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:03:10.018271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46557f5-8767-4181-bf78-3b9822de7e1d None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:10.060332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91f5ca-a7bd-4d26-98e1-7f0be1545ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:10.061624 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91f5ca-a7bd-4d26-98e1-7f0be1545ba0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:10.062138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91f5ca-a7bd-4d26-98e1-7f0be1545ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:10.062672 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91f5ca-a7bd-4d26-98e1-7f0be1545ba0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:10.076213 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91f5ca-a7bd-4d26-98e1-7f0be1545ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-ef91f5ca-a7bd-4d26-98e1-7f0be1545ba0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:10.084795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:10.085934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:10.086896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:10.089925 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 151/307] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:03:10.096228 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645a7d0-8ac1-447b-b15d-bcc7d5708471 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:10.100621 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:10.213450 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645a7d0-8ac1-447b-b15d-bcc7d5708471 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:10.256256 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaecf01-a8c7-4052-bc5e-4244cca39fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:10.256936 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaecf01-a8c7-4052-bc5e-4244cca39fda None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:10.257220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaecf01-a8c7-4052-bc5e-4244cca39fda None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:10.257500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaecf01-a8c7-4052-bc5e-4244cca39fda None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:10.258263 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaecf01-a8c7-4052-bc5e-4244cca39fda None admin] RBAC: Adding query filter params (name=member) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:10.258574 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaecf01-a8c7-4052-bc5e-4244cca39fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:10.260006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaecf01-a8c7-4052-bc5e-4244cca39fda None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:10.269756 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 157/308] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:10.275503 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91f5ca-a7bd-4d26-98e1-7f0be1545ba0 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:10.395648 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91f5ca-a7bd-4d26-98e1-7f0be1545ba0 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:10.411969 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:10.438829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42c1c8-9e86-4ecb-80f8-637fc7c76e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:10.439719 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c1c8-9e86-4ecb-80f8-637fc7c76e63 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:10.440005 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c1c8-9e86-4ecb-80f8-637fc7c76e63 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:10.440281 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c1c8-9e86-4ecb-80f8-637fc7c76e63 None admin] PATH_INFO: `/v3/users/d57dd5b4295445dc9ac438cab8d4e5f9` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:10.441588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42c1c8-9e86-4ecb-80f8-637fc7c76e63 None admin] RBAC: Authorizing `identity:get_user(user_id=d57dd5b4295445dc9ac438cab8d4e5f9)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:10.443075 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42c1c8-9e86-4ecb-80f8-637fc7c76e63 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:10.445238 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 152/309] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:10 2022] GET /identity/v3/users/d57dd5b4295445dc9ac438cab8d4e5f9 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:10.450728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaecf01-a8c7-4052-bc5e-4244cca39fda None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:10.526429 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:10.564097 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaecf01-a8c7-4052-bc5e-4244cca39fda None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:10.567937 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9429-deb7-4932-9b30-71208ae2aa0e None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:10.568226 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9429-deb7-4932-9b30-71208ae2aa0e None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:10.568510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9429-deb7-4932-9b30-71208ae2aa0e None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:10.570204 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 153/310] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:10.576073 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d5fee-d2e5-485e-8773-111ee1f878f5 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:10.576351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d5fee-d2e5-485e-8773-111ee1f878f5 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:10.576628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d5fee-d2e5-485e-8773-111ee1f878f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:10.596013 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-115d5fee-d2e5-485e-8773-111ee1f878f5 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:10.597941 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-115d5fee-d2e5-485e-8773-111ee1f878f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:10.603859 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20ebe6-dfd6-4607-a999-72cd9f001584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:10.604738 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ebe6-dfd6-4607-a999-72cd9f001584 None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:10.605017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ebe6-dfd6-4607-a999-72cd9f001584 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:10.605292 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ebe6-dfd6-4607-a999-72cd9f001584 None admin] PATH_INFO: `/v3/system/users/d57dd5b4295445dc9ac438cab8d4e5f9/roles/edf99f336b2440b19ff28bcd8da8433b` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:10.607020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20ebe6-dfd6-4607-a999-72cd9f001584 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d57dd5b4295445dc9ac438cab8d4e5f9, role_id=edf99f336b2440b19ff28bcd8da8433b)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:10.608466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20ebe6-dfd6-4607-a999-72cd9f001584 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:10.671048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 154/311] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:10.695077 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d5fee-d2e5-485e-8773-111ee1f878f5 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:10.718352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 158/312] 10.222.0.89 () {58 vars in 1334 bytes} [Thu May 19 20:03:10 2022] PUT /identity/v3/system/users/d57dd5b4295445dc9ac438cab8d4e5f9/roles/edf99f336b2440b19ff28bcd8da8433b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:10.847914 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d5fee-d2e5-485e-8773-111ee1f878f5 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:10.859825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:10.889968 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f44c0-635a-4912-af97-e67133e0fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:10.891414 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f44c0-635a-4912-af97-e67133e0fd5e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:10.892384 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f44c0-635a-4912-af97-e67133e0fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:10.892927 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f44c0-635a-4912-af97-e67133e0fd5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:10.907150 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f44c0-635a-4912-af97-e67133e0fd5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-c30f44c0-635a-4912-af97-e67133e0fd5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:10.915363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:10.916575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:10.917721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:10.919953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 155/313] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:03:10.926321 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20ebe6-dfd6-4607-a999-72cd9f001584 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:11.046902 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20ebe6-dfd6-4607-a999-72cd9f001584 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:11.078946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:11.085310 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35c27b-3df2-48d6-ac1e-425bbe1d1c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:11.093167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35c27b-3df2-48d6-ac1e-425bbe1d1c5b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:11.093167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35c27b-3df2-48d6-ac1e-425bbe1d1c5b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:11.093167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35c27b-3df2-48d6-ac1e-425bbe1d1c5b None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:11.093167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35c27b-3df2-48d6-ac1e-425bbe1d1c5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:11.093167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35c27b-3df2-48d6-ac1e-425bbe1d1c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:11.093167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35c27b-3df2-48d6-ac1e-425bbe1d1c5b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:11.099899 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 159/314] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:11.107726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f44c0-635a-4912-af97-e67133e0fd5e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:11.219561 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f44c0-635a-4912-af97-e67133e0fd5e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:11.257801 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f98115-14b5-4262-961a-5ea36d003c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:11.258724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f98115-14b5-4262-961a-5ea36d003c46 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:11.259010 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f98115-14b5-4262-961a-5ea36d003c46 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:11.259288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f98115-14b5-4262-961a-5ea36d003c46 None admin] PATH_INFO: `/v3/users/19ec0d85b5414c80ba649b521a0c0679` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:11.260585 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f98115-14b5-4262-961a-5ea36d003c46 None admin] RBAC: Authorizing `identity:get_user(user_id=19ec0d85b5414c80ba649b521a0c0679)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:11.262116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f98115-14b5-4262-961a-5ea36d003c46 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:11.264774 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 156/315] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:11 2022] GET /identity/v3/users/19ec0d85b5414c80ba649b521a0c0679 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:11.270275 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35c27b-3df2-48d6-ac1e-425bbe1d1c5b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:11.422817 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35c27b-3df2-48d6-ac1e-425bbe1d1c5b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:11.460364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f289eb-de70-454b-a7e5-c77cd546f147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:11.461838 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f289eb-de70-454b-a7e5-c77cd546f147 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:11.462393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f289eb-de70-454b-a7e5-c77cd546f147 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:11.462910 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f289eb-de70-454b-a7e5-c77cd546f147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:11.538988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:11.541160 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f289eb-de70-454b-a7e5-c77cd546f147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:11.542968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f289eb-de70-454b-a7e5-c77cd546f147 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:11.649903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 160/316] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:11.655489 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f98115-14b5-4262-961a-5ea36d003c46 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:11.694947 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:11.763850 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f98115-14b5-4262-961a-5ea36d003c46 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:11.801723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f987654-be94-495b-a25a-5f1ed2be11e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:11.802622 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f987654-be94-495b-a25a-5f1ed2be11e4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:11.802908 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f987654-be94-495b-a25a-5f1ed2be11e4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:11.803187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f987654-be94-495b-a25a-5f1ed2be11e4 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:11.804395 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f987654-be94-495b-a25a-5f1ed2be11e4 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:11.805836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f987654-be94-495b-a25a-5f1ed2be11e4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:11.807981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 157/317] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:11 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:11.815601 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f289eb-de70-454b-a7e5-c77cd546f147 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:11.919040 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:11.930011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f289eb-de70-454b-a7e5-c77cd546f147 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:11.971040 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368881c-9388-45ea-8c55-6040148ee8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:11.971625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368881c-9388-45ea-8c55-6040148ee8fc None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:11.971905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368881c-9388-45ea-8c55-6040148ee8fc None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:11.972181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368881c-9388-45ea-8c55-6040148ee8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:11.973030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368881c-9388-45ea-8c55-6040148ee8fc None admin] RBAC: Adding query filter params (role.id=03fc945060c64e0cb56cff9471d1b1c2, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e, user.id=19ec0d85b5414c80ba649b521a0c0679) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:11.973341 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368881c-9388-45ea-8c55-6040148ee8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:11.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368881c-9388-45ea-8c55-6040148ee8fc None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:11.982399 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 161/318] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:11 2022] GET /identity/v3/role_assignments?user.id=19ec0d85b5414c80ba649b521a0c0679&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=03fc945060c64e0cb56cff9471d1b1c2 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:12.181956 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8e3e8-eace-42e7-bb38-aa3fc13b060e None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.182493 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8e3e8-eace-42e7-bb38-aa3fc13b060e None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.182493 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8e3e8-eace-42e7-bb38-aa3fc13b060e None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.184582 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 158/319] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:12.189989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46169654-1da6-474a-bc47-b3391fd03356 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.190282 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46169654-1da6-474a-bc47-b3391fd03356 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.190652 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46169654-1da6-474a-bc47-b3391fd03356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.209045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-46169654-1da6-474a-bc47-b3391fd03356 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:12.210268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-46169654-1da6-474a-bc47-b3391fd03356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:12.292300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 162/320] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:12.315418 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8e3e8-eace-42e7-bb38-aa3fc13b060e None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:12.422256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8e3e8-eace-42e7-bb38-aa3fc13b060e None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:12.424925 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:12.426853 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fcf73-46a1-47ec-8786-c35e49dcff45 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.427152 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fcf73-46a1-47ec-8786-c35e49dcff45 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.427439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fcf73-46a1-47ec-8786-c35e49dcff45 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.428999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 163/321] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:03:12.434979 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1d17-d879-429d-a579-bdb41754c20f None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.437543 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1d17-d879-429d-a579-bdb41754c20f None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.437543 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1d17-d879-429d-a579-bdb41754c20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.455187 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-836a1d17-d879-429d-a579-bdb41754c20f None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:12.456467 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-836a1d17-d879-429d-a579-bdb41754c20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:12.464089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f6070-499e-4d88-9cf3-018f9fd4a214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:12.465378 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f6070-499e-4d88-9cf3-018f9fd4a214 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.465666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f6070-499e-4d88-9cf3-018f9fd4a214 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.465942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f6070-499e-4d88-9cf3-018f9fd4a214 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.477765 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f6070-499e-4d88-9cf3-018f9fd4a214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-656f6070-499e-4d88-9cf3-018f9fd4a214 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:12.486019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:12.487085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:12.488000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 159/322] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:12.493420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f6070-499e-4d88-9cf3-018f9fd4a214 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:12.531728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 164/323] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:03:12.554992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a1d17-d879-429d-a579-bdb41754c20f None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:12.572947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:12.601594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f6070-499e-4d88-9cf3-018f9fd4a214 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:12.638461 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80b616-efe4-41f4-a03f-625db0491daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:12.639186 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80b616-efe4-41f4-a03f-625db0491daa None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.639470 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80b616-efe4-41f4-a03f-625db0491daa None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.639780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80b616-efe4-41f4-a03f-625db0491daa None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.640494 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80b616-efe4-41f4-a03f-625db0491daa None admin] RBAC: Adding query filter params (name=reader) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:12.640803 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80b616-efe4-41f4-a03f-625db0491daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:12.642181 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80b616-efe4-41f4-a03f-625db0491daa None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:12.650745 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 160/324] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:12.656649 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80b616-efe4-41f4-a03f-625db0491daa None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:12.659775 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a1d17-d879-429d-a579-bdb41754c20f None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:12.686226 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:12.698021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0590f-f392-468b-a814-63353fea0b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:12.698862 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0590f-f392-468b-a814-63353fea0b2e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.699149 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0590f-f392-468b-a814-63353fea0b2e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.701409 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0590f-f392-468b-a814-63353fea0b2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.701409 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0590f-f392-468b-a814-63353fea0b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:12.702150 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0590f-f392-468b-a814-63353fea0b2e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:12.703993 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 165/325] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:12.709485 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0590f-f392-468b-a814-63353fea0b2e None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:12.766433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80b616-efe4-41f4-a03f-625db0491daa None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:12.797562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:12.809602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b5e43-4c39-494c-85d9-be4e2a8e5af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:12.812153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b5e43-4c39-494c-85d9-be4e2a8e5af2 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.812153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b5e43-4c39-494c-85d9-be4e2a8e5af2 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.812153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b5e43-4c39-494c-85d9-be4e2a8e5af2 None admin] PATH_INFO: `/v3/users/84e20985e1aa4c8092c7685969e989ab` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.812805 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b5e43-4c39-494c-85d9-be4e2a8e5af2 None admin] RBAC: Authorizing `identity:get_user(user_id=84e20985e1aa4c8092c7685969e989ab)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:12.814263 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b5e43-4c39-494c-85d9-be4e2a8e5af2 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:12.814626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0590f-f392-468b-a814-63353fea0b2e None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:12.816156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 161/326] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:12 2022] GET /identity/v3/users/84e20985e1aa4c8092c7685969e989ab => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:12.821517 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b5e43-4c39-494c-85d9-be4e2a8e5af2 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:12.856976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6b210-98a1-48ea-aa6d-91e4c9f67719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:12.857661 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6b210-98a1-48ea-aa6d-91e4c9f67719 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.857980 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6b210-98a1-48ea-aa6d-91e4c9f67719 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.858212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6b210-98a1-48ea-aa6d-91e4c9f67719 None admin] PATH_INFO: `/v3/groups` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.858970 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6b210-98a1-48ea-aa6d-91e4c9f67719 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:12.860492 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6b210-98a1-48ea-aa6d-91e4c9f67719 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:12.927038 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:12.937971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 166/327] 10.222.0.89 () {60 vars in 1134 bytes} [Thu May 19 20:03:12 2022] POST /identity/v3/groups => generated 226 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:03:12.938192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b5e43-4c39-494c-85d9-be4e2a8e5af2 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:12.973445 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545db1a-7b19-451f-bd93-2b5e1df34f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:12.974349 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545db1a-7b19-451f-bd93-2b5e1df34f9f None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.974681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545db1a-7b19-451f-bd93-2b5e1df34f9f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.974941 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545db1a-7b19-451f-bd93-2b5e1df34f9f None admin] PATH_INFO: `/v3/system/users/84e20985e1aa4c8092c7685969e989ab/roles/03fc945060c64e0cb56cff9471d1b1c2` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.976568 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545db1a-7b19-451f-bd93-2b5e1df34f9f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=84e20985e1aa4c8092c7685969e989ab, role_id=03fc945060c64e0cb56cff9471d1b1c2)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:12.977969 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545db1a-7b19-451f-bd93-2b5e1df34f9f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:13.045494 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 162/328] 10.222.0.89 () {58 vars in 1334 bytes} [Thu May 19 20:03:12 2022] PUT /identity/v3/system/users/84e20985e1aa4c8092c7685969e989ab/roles/03fc945060c64e0cb56cff9471d1b1c2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:03:13.050235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ab52-9925-4c54-8c54-a1a2e3e9d431 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:13.050566 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ab52-9925-4c54-8c54-a1a2e3e9d431 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:13.051192 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ab52-9925-4c54-8c54-a1a2e3e9d431 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:13.052746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 167/329] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:13.059116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fa999-ac5f-47c5-8e57-7528b440ed78 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:13.059481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fa999-ac5f-47c5-8e57-7528b440ed78 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:13.059719 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fa999-ac5f-47c5-8e57-7528b440ed78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:13.079360 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-3a9fa999-ac5f-47c5-8e57-7528b440ed78 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:13.080611 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-3a9fa999-ac5f-47c5-8e57-7528b440ed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:13.164030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 163/330] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:13.189850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320ab52-9925-4c54-8c54-a1a2e3e9d431 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:13.310723 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320ab52-9925-4c54-8c54-a1a2e3e9d431 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:13.348950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021371d-c9cc-4476-a760-41bff1cb273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:13.349758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021371d-c9cc-4476-a760-41bff1cb273e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:13.350035 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021371d-c9cc-4476-a760-41bff1cb273e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:13.350364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021371d-c9cc-4476-a760-41bff1cb273e None admin] PATH_INFO: `/v3/roles/member` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:13.363517 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021371d-c9cc-4476-a760-41bff1cb273e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-9021371d-c9cc-4476-a760-41bff1cb273e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:13.371452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:13.372998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:13.373999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:13.377973 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 168/331] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:13.379383 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fa999-ac5f-47c5-8e57-7528b440ed78 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:13.480472 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:13.495045 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fa999-ac5f-47c5-8e57-7528b440ed78 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:13.536113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260ad55-243a-436e-83f7-5a8a49aa7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:13.536802 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ad55-243a-436e-83f7-5a8a49aa7df4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:13.537085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ad55-243a-436e-83f7-5a8a49aa7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:13.537363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ad55-243a-436e-83f7-5a8a49aa7df4 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:13.538130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260ad55-243a-436e-83f7-5a8a49aa7df4 None admin] RBAC: Adding query filter params (name=member) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:13.538442 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260ad55-243a-436e-83f7-5a8a49aa7df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:13.539895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260ad55-243a-436e-83f7-5a8a49aa7df4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:13.549917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 164/332] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:13.555862 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021371d-c9cc-4476-a760-41bff1cb273e None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:13.560997 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:13.683232 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021371d-c9cc-4476-a760-41bff1cb273e None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:13.719789 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981232a5-aab3-48ee-9fe2-87b19ae5c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:13.720671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981232a5-aab3-48ee-9fe2-87b19ae5c2b4 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:13.720949 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981232a5-aab3-48ee-9fe2-87b19ae5c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:13.721219 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981232a5-aab3-48ee-9fe2-87b19ae5c2b4 None admin] PATH_INFO: `/v3/users/d57dd5b4295445dc9ac438cab8d4e5f9` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:13.722461 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981232a5-aab3-48ee-9fe2-87b19ae5c2b4 None admin] RBAC: Authorizing `identity:get_user(user_id=d57dd5b4295445dc9ac438cab8d4e5f9)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:13.723967 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981232a5-aab3-48ee-9fe2-87b19ae5c2b4 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:13.725916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 169/333] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:13 2022] GET /identity/v3/users/d57dd5b4295445dc9ac438cab8d4e5f9 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:13.731750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260ad55-243a-436e-83f7-5a8a49aa7df4 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:13.851399 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260ad55-243a-436e-83f7-5a8a49aa7df4 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:13.892721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2565a5-b174-4013-bf73-38d7fe4b16a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:13.893383 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2565a5-b174-4013-bf73-38d7fe4b16a6 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:13.893668 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2565a5-b174-4013-bf73-38d7fe4b16a6 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:13.893984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2565a5-b174-4013-bf73-38d7fe4b16a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:13.894852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2565a5-b174-4013-bf73-38d7fe4b16a6 None admin] RBAC: Adding query filter params (role.id=edf99f336b2440b19ff28bcd8da8433b, user.id=d57dd5b4295445dc9ac438cab8d4e5f9, scope.system=all) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:13.895160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2565a5-b174-4013-bf73-38d7fe4b16a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:13.896612 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2565a5-b174-4013-bf73-38d7fe4b16a6 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:13.910966 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 165/334] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:03:13 2022] GET /identity/v3/role_assignments?user.id=d57dd5b4295445dc9ac438cab8d4e5f9&scope.system=all&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:15.547075 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9396e4-19ec-408e-9784-92ea3049726c None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:15.547573 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9396e4-19ec-408e-9784-92ea3049726c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:15.547573 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9396e4-19ec-408e-9784-92ea3049726c None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:15.549167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 170/335] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:15.555153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59c381-e329-45f4-9a4f-3aa1caac8d53 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:15.555605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59c381-e329-45f4-9a4f-3aa1caac8d53 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:15.555703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59c381-e329-45f4-9a4f-3aa1caac8d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:15.580570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-ef59c381-e329-45f4-9a4f-3aa1caac8d53 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:15.581790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-ef59c381-e329-45f4-9a4f-3aa1caac8d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:15.583979 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:15.667590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 166/336] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:03:15.703897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9396e4-19ec-408e-9784-92ea3049726c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:15.793474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:15.833095 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9396e4-19ec-408e-9784-92ea3049726c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:15.885756 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd8f64-d1d7-4929-b8fd-d0f3338c6443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:15.886568 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8f64-d1d7-4929-b8fd-d0f3338c6443 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:15.886884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8f64-d1d7-4929-b8fd-d0f3338c6443 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:15.887733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8f64-d1d7-4929-b8fd-d0f3338c6443 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:15.907556 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd8f64-d1d7-4929-b8fd-d0f3338c6443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-d3fd8f64-d1d7-4929-b8fd-d0f3338c6443 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:15.915385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:15.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:15.917823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 171/337] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:15.922756 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59c381-e329-45f4-9a4f-3aa1caac8d53 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:16.044163 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59c381-e329-45f4-9a4f-3aa1caac8d53 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:16.092701 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6993b0-1ad5-40b3-92f9-dd0e688809a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:16.093310 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6993b0-1ad5-40b3-92f9-dd0e688809a1 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:16.093596 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6993b0-1ad5-40b3-92f9-dd0e688809a1 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:16.093874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6993b0-1ad5-40b3-92f9-dd0e688809a1 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:16.094655 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6993b0-1ad5-40b3-92f9-dd0e688809a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:16.094975 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6993b0-1ad5-40b3-92f9-dd0e688809a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:16.096366 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6993b0-1ad5-40b3-92f9-dd0e688809a1 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:16.107048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:16.111463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 167/338] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:16.116731 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd8f64-d1d7-4929-b8fd-d0f3338c6443 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:16.256561 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd8f64-d1d7-4929-b8fd-d0f3338c6443 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:16.291491 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:16.302168 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03c62-97f2-4eec-a685-f215563bce27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:16.302903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03c62-97f2-4eec-a685-f215563bce27 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:16.303191 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03c62-97f2-4eec-a685-f215563bce27 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:16.303474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03c62-97f2-4eec-a685-f215563bce27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:16.439926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e1e3a-353a-4b40-aa4b-6b00308eba80 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:16.440304 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e1e3a-353a-4b40-aa4b-6b00308eba80 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:16.440483 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e1e3a-353a-4b40-aa4b-6b00308eba80 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:16.442587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 168/339] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:16.456244 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625648a-a696-43c3-bee2-78f537a486a6 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:16.456579 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625648a-a696-43c3-bee2-78f537a486a6 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:16.456809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625648a-a696-43c3-bee2-78f537a486a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:16.488330 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-9625648a-a696-43c3-bee2-78f537a486a6 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:16.490787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-9625648a-a696-43c3-bee2-78f537a486a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:16.529918 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03c62-97f2-4eec-a685-f215563bce27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:16.531458 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03c62-97f2-4eec-a685-f215563bce27 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:16.589883 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 169/340] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:16.596240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aad25-9863-4e7e-85ab-4ce649e597b3 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:16.596832 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aad25-9863-4e7e-85ab-4ce649e597b3 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:16.597380 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aad25-9863-4e7e-85ab-4ce649e597b3 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:16.599292 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 170/341] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:16.617769 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e69696-15a4-4d9a-9186-22a8af6c423d None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:16.618668 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e69696-15a4-4d9a-9186-22a8af6c423d None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:16.619177 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e69696-15a4-4d9a-9186-22a8af6c423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:16.643951 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-46e69696-15a4-4d9a-9186-22a8af6c423d None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:16.645568 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-46e69696-15a4-4d9a-9186-22a8af6c423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:16.701333 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 172/342] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:16.701960 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03c62-97f2-4eec-a685-f215563bce27 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:16.757997 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:16.782057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 171/343] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:16.782959 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e69696-15a4-4d9a-9186-22a8af6c423d None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:16.857390 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03c62-97f2-4eec-a685-f215563bce27 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:16.872320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:16.920964 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7ed7b-7a23-4173-8c51-c29ec55da2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:16.922159 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7ed7b-7a23-4173-8c51-c29ec55da2cd None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:16.922294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e69696-15a4-4d9a-9186-22a8af6c423d None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:16.922943 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7ed7b-7a23-4173-8c51-c29ec55da2cd None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:16.923445 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7ed7b-7a23-4173-8c51-c29ec55da2cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:16.940412 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7ed7b-7a23-4173-8c51-c29ec55da2cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-93e7ed7b-7a23-4173-8c51-c29ec55da2cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:16.953305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:16.955009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 173/344] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:16.956498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7ed7b-7a23-4173-8c51-c29ec55da2cd None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:16.980617 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b947c69-cf3e-49aa-89ff-6b859d4d3862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:16.981569 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947c69-cf3e-49aa-89ff-6b859d4d3862 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:16.981861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947c69-cf3e-49aa-89ff-6b859d4d3862 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:16.982117 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947c69-cf3e-49aa-89ff-6b859d4d3862 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:16.986707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b947c69-cf3e-49aa-89ff-6b859d4d3862 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:16.988204 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b947c69-cf3e-49aa-89ff-6b859d4d3862 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:16.990589 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 172/345] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:16 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:16.991512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b947c69-cf3e-49aa-89ff-6b859d4d3862 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:17.108738 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:17.115969 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b947c69-cf3e-49aa-89ff-6b859d4d3862 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:17.118065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7ed7b-7a23-4173-8c51-c29ec55da2cd None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:17.146916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:17.155555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac8f00-fd61-43f6-85c1-a7d5dca306a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:17.156344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b6dbe-0b1d-48f1-918a-8f671d2ae949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:17.156576 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac8f00-fd61-43f6-85c1-a7d5dca306a7 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.156749 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac8f00-fd61-43f6-85c1-a7d5dca306a7 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.157064 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac8f00-fd61-43f6-85c1-a7d5dca306a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:17.157246 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6dbe-0b1d-48f1-918a-8f671d2ae949 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.157796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6dbe-0b1d-48f1-918a-8f671d2ae949 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.162637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6dbe-0b1d-48f1-918a-8f671d2ae949 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:17.162637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b6dbe-0b1d-48f1-918a-8f671d2ae949 None admin] RBAC: Adding query filter params (name=reader) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:17.162637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b6dbe-0b1d-48f1-918a-8f671d2ae949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:17.162637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b6dbe-0b1d-48f1-918a-8f671d2ae949 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:17.171030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 173/346] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:17.171321 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac8f00-fd61-43f6-85c1-a7d5dca306a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:17.171735 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b6dbe-0b1d-48f1-918a-8f671d2ae949 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-c4ac8f00-fd61-43f6-85c1-a7d5dca306a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:17.179718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:17.182213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 174/347] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:17.184836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babb3bf-6a28-4f03-be98-cb76faf145f4 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.186765 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babb3bf-6a28-4f03-be98-cb76faf145f4 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.186765 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babb3bf-6a28-4f03-be98-cb76faf145f4 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:17.186765 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 175/348] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:17.187189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b436012-7011-47bd-a046-1c8a44688745 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.189561 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b436012-7011-47bd-a046-1c8a44688745 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.189561 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b436012-7011-47bd-a046-1c8a44688745 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:17.189561 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 176/349] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:17.190075 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b436012-7011-47bd-a046-1c8a44688745 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:17.336242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b6dbe-0b1d-48f1-918a-8f671d2ae949 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:17.343067 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b436012-7011-47bd-a046-1c8a44688745 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:17.381935 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91242f7d-fc8f-4890-9a5e-8dedb4296d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:17.383476 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91242f7d-fc8f-4890-9a5e-8dedb4296d42 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.384233 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91242f7d-fc8f-4890-9a5e-8dedb4296d42 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.384674 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91242f7d-fc8f-4890-9a5e-8dedb4296d42 None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:17.392208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80840550-deb4-4105-bb58-f61f2d940731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:17.393505 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840550-deb4-4105-bb58-f61f2d940731 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.393903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840550-deb4-4105-bb58-f61f2d940731 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.394243 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840550-deb4-4105-bb58-f61f2d940731 None admin] PATH_INFO: `/v3/users/84e20985e1aa4c8092c7685969e989ab` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:17.394788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91242f7d-fc8f-4890-9a5e-8dedb4296d42 None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:17.395898 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80840550-deb4-4105-bb58-f61f2d940731 None admin] RBAC: Authorizing `identity:get_user(user_id=84e20985e1aa4c8092c7685969e989ab)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:17.396359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91242f7d-fc8f-4890-9a5e-8dedb4296d42 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:17.397412 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80840550-deb4-4105-bb58-f61f2d940731 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:17.398239 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 174/350] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:17 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:17.399728 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91242f7d-fc8f-4890-9a5e-8dedb4296d42 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:17.400461 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 177/351] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:03:17 2022] GET /identity/v3/users/84e20985e1aa4c8092c7685969e989ab => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:17.401669 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c09f67-2166-4b50-bb14-09a80abbe5d8 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.401953 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c09f67-2166-4b50-bb14-09a80abbe5d8 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.402230 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c09f67-2166-4b50-bb14-09a80abbe5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:17.420944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-62c09f67-2166-4b50-bb14-09a80abbe5d8 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:17.422142 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-62c09f67-2166-4b50-bb14-09a80abbe5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:17.444260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:17.479431 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:17.520951 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 178/352] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:17.522600 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be4ce7-098e-4ecc-ab17-3cb84bbd5e25 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.523107 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be4ce7-098e-4ecc-ab17-3cb84bbd5e25 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.523522 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be4ce7-098e-4ecc-ab17-3cb84bbd5e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:17.541996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-10be4ce7-098e-4ecc-ab17-3cb84bbd5e25 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:17.544008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-10be4ce7-098e-4ecc-ab17-3cb84bbd5e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:17.552904 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91242f7d-fc8f-4890-9a5e-8dedb4296d42 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:17.599748 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a059-cf3e-42c4-90dd-07484cfac080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:17.601803 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a059-cf3e-42c4-90dd-07484cfac080 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.602374 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a059-cf3e-42c4-90dd-07484cfac080 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.602850 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a059-cf3e-42c4-90dd-07484cfac080 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:17.603992 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a059-cf3e-42c4-90dd-07484cfac080 None admin] RBAC: Adding query filter params (name=member) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:17.604308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a059-cf3e-42c4-90dd-07484cfac080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:17.606562 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a059-cf3e-42c4-90dd-07484cfac080 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:17.617531 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 175/353] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:17.618211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a059-cf3e-42c4-90dd-07484cfac080 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:17.627023 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 179/354] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:17.628208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be4ce7-098e-4ecc-ab17-3cb84bbd5e25 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:17.736526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:17.750068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a059-cf3e-42c4-90dd-07484cfac080 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:17.759537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be4ce7-098e-4ecc-ab17-3cb84bbd5e25 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:17.768694 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:17.792784 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c856-6919-44dc-a9df-36de7b0845fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:17.794007 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c856-6919-44dc-a9df-36de7b0845fb None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.794301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c856-6919-44dc-a9df-36de7b0845fb None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.794539 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c856-6919-44dc-a9df-36de7b0845fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:17.795540 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c856-6919-44dc-a9df-36de7b0845fb None admin] RBAC: Adding query filter params (group.id=477cc74912d1491881b1dd89737e141c, role.id=edf99f336b2440b19ff28bcd8da8433b, scope.project.id=d9b28400715c475eb364b4a9afdd6046) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:17.796002 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c856-6919-44dc-a9df-36de7b0845fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:17.797474 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c856-6919-44dc-a9df-36de7b0845fb None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:17.805247 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76908114-9c01-4471-bb67-a7806e68f46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:17.805577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908114-9c01-4471-bb67-a7806e68f46e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.805861 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908114-9c01-4471-bb67-a7806e68f46e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.806037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 176/355] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:03:17 2022] GET /identity/v3/role_assignments?group.id=477cc74912d1491881b1dd89737e141c&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:17.806141 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908114-9c01-4471-bb67-a7806e68f46e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:17.807627 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c856-6919-44dc-a9df-36de7b0845fb None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:17.807751 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76908114-9c01-4471-bb67-a7806e68f46e None admin] RBAC: Adding query filter params (role.id=03fc945060c64e0cb56cff9471d1b1c2, user.id=84e20985e1aa4c8092c7685969e989ab, scope.system=all) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:17.807751 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76908114-9c01-4471-bb67-a7806e68f46e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:17.808774 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76908114-9c01-4471-bb67-a7806e68f46e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:17.831223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 180/356] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:03:17 2022] GET /identity/v3/role_assignments?user.id=84e20985e1aa4c8092c7685969e989ab&scope.system=all&role.id=03fc945060c64e0cb56cff9471d1b1c2 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:17.831907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76908114-9c01-4471-bb67-a7806e68f46e None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:17.944255 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c856-6919-44dc-a9df-36de7b0845fb None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:17.962426 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76908114-9c01-4471-bb67-a7806e68f46e None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:17.987378 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f278cb-a6e6-4c56-98be-7a4e3b327905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:17.988616 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f278cb-a6e6-4c56-98be-7a4e3b327905 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:17.989130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f278cb-a6e6-4c56-98be-7a4e3b327905 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:17.989623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f278cb-a6e6-4c56-98be-7a4e3b327905 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:18.004217 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f278cb-a6e6-4c56-98be-7a4e3b327905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-23f278cb-a6e6-4c56-98be-7a4e3b327905 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:18.014994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:18.016086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:18.017023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:18.017729 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee2ac9-fdc8-4e95-b799-0cd83cc86ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:18.017729 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee2ac9-fdc8-4e95-b799-0cd83cc86ad5 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:18.017729 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee2ac9-fdc8-4e95-b799-0cd83cc86ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:18.017729 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee2ac9-fdc8-4e95-b799-0cd83cc86ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:18.020082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 177/357] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:03:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:18.021247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f278cb-a6e6-4c56-98be-7a4e3b327905 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:18.053849 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:18.071896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:18.193873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f278cb-a6e6-4c56-98be-7a4e3b327905 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:18.196026 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee2ac9-fdc8-4e95-b799-0cd83cc86ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:18.199241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee2ac9-fdc8-4e95-b799-0cd83cc86ad5 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:18.284616 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768d7d8-6fff-4c46-939e-295f55fcdb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:18.285366 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768d7d8-6fff-4c46-939e-295f55fcdb6a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:18.285643 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768d7d8-6fff-4c46-939e-295f55fcdb6a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:18.285916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768d7d8-6fff-4c46-939e-295f55fcdb6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:18.308020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768d7d8-6fff-4c46-939e-295f55fcdb6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-5768d7d8-6fff-4c46-939e-295f55fcdb6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:18.317024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:18.318119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:18.319081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:18.323338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 178/358] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:03:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:18.324418 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768d7d8-6fff-4c46-939e-295f55fcdb6a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:18.348111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 181/359] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:18.350539 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee2ac9-fdc8-4e95-b799-0cd83cc86ad5 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:18.420062 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:18.483849 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:18.487752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768d7d8-6fff-4c46-939e-295f55fcdb6a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:18.506780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee2ac9-fdc8-4e95-b799-0cd83cc86ad5 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:18.540870 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2232d-111c-4fdd-be4d-957361ecc727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:18.541467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2232d-111c-4fdd-be4d-957361ecc727 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:18.541746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2232d-111c-4fdd-be4d-957361ecc727 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:18.542020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2232d-111c-4fdd-be4d-957361ecc727 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:18.544732 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2232d-111c-4fdd-be4d-957361ecc727 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:18.545685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2232d-111c-4fdd-be4d-957361ecc727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:18.547308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2232d-111c-4fdd-be4d-957361ecc727 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:18.554511 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7003302-87aa-4c6c-93a4-94b7bc1ba36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:18.555574 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7003302-87aa-4c6c-93a4-94b7bc1ba36c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:18.556077 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7003302-87aa-4c6c-93a4-94b7bc1ba36c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:18.556584 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7003302-87aa-4c6c-93a4-94b7bc1ba36c None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:18.557106 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 179/360] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:18.557807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7003302-87aa-4c6c-93a4-94b7bc1ba36c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:18.557935 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2232d-111c-4fdd-be4d-957361ecc727 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:18.558564 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7003302-87aa-4c6c-93a4-94b7bc1ba36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:18.560836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7003302-87aa-4c6c-93a4-94b7bc1ba36c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:18.576725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 182/361] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:18.578174 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3fb2f-b4a1-4d46-bbf5-32f3a5e21912 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:18.578467 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3fb2f-b4a1-4d46-bbf5-32f3a5e21912 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:18.578783 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3fb2f-b4a1-4d46-bbf5-32f3a5e21912 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:18.580289 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 183/362] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:18.581001 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3fb2f-b4a1-4d46-bbf5-32f3a5e21912 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:18.704849 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2232d-111c-4fdd-be4d-957361ecc727 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:18.707440 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:18.714120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3fb2f-b4a1-4d46-bbf5-32f3a5e21912 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:18.748155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7c4ad-4251-4c54-bb08-26790ce40c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:18.749063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c4ad-4251-4c54-bb08-26790ce40c19 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:18.749344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c4ad-4251-4c54-bb08-26790ce40c19 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:18.750020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c4ad-4251-4c54-bb08-26790ce40c19 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:18.750868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7c4ad-4251-4c54-bb08-26790ce40c19 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:18.752444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7c4ad-4251-4c54-bb08-26790ce40c19 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:18.758741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 180/363] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:18 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:18.759867 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7c4ad-4251-4c54-bb08-26790ce40c19 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:18.767481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09418c5d-6e2a-4d47-bbdc-8c84539dbfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:18.768280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418c5d-6e2a-4d47-bbdc-8c84539dbfbe None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:18.768567 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418c5d-6e2a-4d47-bbdc-8c84539dbfbe None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:18.768844 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418c5d-6e2a-4d47-bbdc-8c84539dbfbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:18.799821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:18.873781 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09418c5d-6e2a-4d47-bbdc-8c84539dbfbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:18.875351 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09418c5d-6e2a-4d47-bbdc-8c84539dbfbe None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:18.891302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7c4ad-4251-4c54-bb08-26790ce40c19 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:18.944238 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896eb44-625c-4959-9577-e92330d98e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:18.944921 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896eb44-625c-4959-9577-e92330d98e08 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:18.945207 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896eb44-625c-4959-9577-e92330d98e08 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:18.945486 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896eb44-625c-4959-9577-e92330d98e08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:19.018705 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:19.022733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 184/364] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:19.024286 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6534d4-54d5-4020-bf2b-cbf3039289ae None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:19.024585 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6534d4-54d5-4020-bf2b-cbf3039289ae None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:19.024864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6534d4-54d5-4020-bf2b-cbf3039289ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:19.040701 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896eb44-625c-4959-9577-e92330d98e08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:19.042531 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896eb44-625c-4959-9577-e92330d98e08 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:19.047110 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-7b6534d4-54d5-4020-bf2b-cbf3039289ae None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:19.048322 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-7b6534d4-54d5-4020-bf2b-cbf3039289ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:19.078416 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:19.145727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 185/365] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:19.146745 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6534d4-54d5-4020-bf2b-cbf3039289ae None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:19.180596 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 181/366] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:19.182487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896eb44-625c-4959-9577-e92330d98e08 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:19.278742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6534d4-54d5-4020-bf2b-cbf3039289ae None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:19.315782 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:19.324427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8138d-0379-4a7a-8818-070e288667d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:19.331283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8138d-0379-4a7a-8818-070e288667d7 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:19.331283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8138d-0379-4a7a-8818-070e288667d7 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:19.331283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8138d-0379-4a7a-8818-070e288667d7 None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:19.331283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8138d-0379-4a7a-8818-070e288667d7 None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:19.331635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896eb44-625c-4959-9577-e92330d98e08 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:19.331721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8138d-0379-4a7a-8818-070e288667d7 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:19.332752 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 186/367] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:19 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:19.333825 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8138d-0379-4a7a-8818-070e288667d7 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:19.368771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:19.377769 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cca13-77c5-4e76-abb5-ad5dfffc9843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:19.378701 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cca13-77c5-4e76-abb5-ad5dfffc9843 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:19.382051 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cca13-77c5-4e76-abb5-ad5dfffc9843 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:19.382051 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cca13-77c5-4e76-abb5-ad5dfffc9843 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:19.382051 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cca13-77c5-4e76-abb5-ad5dfffc9843 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:19.383688 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cca13-77c5-4e76-abb5-ad5dfffc9843 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:19.386137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 182/368] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:19 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:19.393538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cca13-77c5-4e76-abb5-ad5dfffc9843 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:19.486692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8138d-0379-4a7a-8818-070e288667d7 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:19.526317 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cca13-77c5-4e76-abb5-ad5dfffc9843 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:19.529659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840b5da-e86e-4139-a74a-1476e7540810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:19.530544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b5da-e86e-4139-a74a-1476e7540810 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:19.530964 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b5da-e86e-4139-a74a-1476e7540810 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:19.531203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b5da-e86e-4139-a74a-1476e7540810 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:19.546022 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840b5da-e86e-4139-a74a-1476e7540810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-b840b5da-e86e-4139-a74a-1476e7540810 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:19.556369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:19.557618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:03:19.558641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:19.561361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 187/369] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:03:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:19.562820 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840b5da-e86e-4139-a74a-1476e7540810 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:19.575316 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aba90-5b8e-41d7-adc5-91f975870caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:19.576779 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aba90-5b8e-41d7-adc5-91f975870caf None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:19.576779 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aba90-5b8e-41d7-adc5-91f975870caf None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:19.576779 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aba90-5b8e-41d7-adc5-91f975870caf None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:19.579857 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aba90-5b8e-41d7-adc5-91f975870caf None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:19.581374 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aba90-5b8e-41d7-adc5-91f975870caf None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:19.585245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 183/370] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:19 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:19.585245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aba90-5b8e-41d7-adc5-91f975870caf None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:19.654660 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:19.670180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:19.717227 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aba90-5b8e-41d7-adc5-91f975870caf None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:19.721150 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840b5da-e86e-4139-a74a-1476e7540810 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:19.760821 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19871091-35db-4627-acba-1830b619f5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:19.761502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d8b70-bcc1-4939-8473-af6159067317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:19.762059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871091-35db-4627-acba-1830b619f5fb None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:19.762504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871091-35db-4627-acba-1830b619f5fb None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:19.762737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d8b70-bcc1-4939-8473-af6159067317 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:19.763122 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d8b70-bcc1-4939-8473-af6159067317 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:19.763413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871091-35db-4627-acba-1830b619f5fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:19.763639 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d8b70-bcc1-4939-8473-af6159067317 None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:19.764653 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19871091-35db-4627-acba-1830b619f5fb None admin] RBAC: Adding query filter params (group.id=477cc74912d1491881b1dd89737e141c, role.id=edf99f336b2440b19ff28bcd8da8433b, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:19.764978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19871091-35db-4627-acba-1830b619f5fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:19.765087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d8b70-bcc1-4939-8473-af6159067317 None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:19.766484 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19871091-35db-4627-acba-1830b619f5fb None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:19.766657 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d8b70-bcc1-4939-8473-af6159067317 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:19.768695 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 184/371] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:19 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:19.769530 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d8b70-bcc1-4939-8473-af6159067317 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:19.775168 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 188/372] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:03:19 2022] GET /identity/v3/role_assignments?group.id=477cc74912d1491881b1dd89737e141c&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:19.776006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19871091-35db-4627-acba-1830b619f5fb None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:19.894645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d8b70-bcc1-4939-8473-af6159067317 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:19.914046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19871091-35db-4627-acba-1830b619f5fb None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:19.936157 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ab931-4630-4bb2-bedc-4ce97c56c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:19.936859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab931-4630-4bb2-bedc-4ce97c56c6e7 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:19.937142 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab931-4630-4bb2-bedc-4ce97c56c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:19.937420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab931-4630-4bb2-bedc-4ce97c56c6e7 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:19.938204 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ab931-4630-4bb2-bedc-4ce97c56c6e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:19.938512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ab931-4630-4bb2-bedc-4ce97c56c6e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:19.939960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ab931-4630-4bb2-bedc-4ce97c56c6e7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:19.941658 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:19.947017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:19.952422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 185/373] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:19.958095 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ab931-4630-4bb2-bedc-4ce97c56c6e7 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:19.961552 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351da4-ec81-4077-b286-66af386da757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:19.962758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351da4-ec81-4077-b286-66af386da757 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:19.963047 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351da4-ec81-4077-b286-66af386da757 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:19.964272 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351da4-ec81-4077-b286-66af386da757 None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:19.966383 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57351da4-ec81-4077-b286-66af386da757 None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:19.969102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57351da4-ec81-4077-b286-66af386da757 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:19.970069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 189/374] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:19 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:19.971055 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351da4-ec81-4077-b286-66af386da757 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:20.089862 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ab931-4630-4bb2-bedc-4ce97c56c6e7 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:20.096143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351da4-ec81-4077-b286-66af386da757 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:20.131083 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d82b-2f14-467a-8b57-ee0ed4de13bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:20.131750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d82b-2f14-467a-8b57-ee0ed4de13bc None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:20.132036 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d82b-2f14-467a-8b57-ee0ed4de13bc None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:20.132315 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d82b-2f14-467a-8b57-ee0ed4de13bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:20.133163 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d82b-2f14-467a-8b57-ee0ed4de13bc None admin] RBAC: Adding query filter params (group.id=477cc74912d1491881b1dd89737e141c, role.id=4876e759b9504964a874992dc66b6df1, scope.project.id=d9b28400715c475eb364b4a9afdd6046) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:20.133477 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d82b-2f14-467a-8b57-ee0ed4de13bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:20.133598 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6fce8-0da7-4736-abca-5fb80a193bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:20.134135 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6fce8-0da7-4736-abca-5fb80a193bea None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:20.134422 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6fce8-0da7-4736-abca-5fb80a193bea None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:20.134755 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6fce8-0da7-4736-abca-5fb80a193bea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:20.134979 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d82b-2f14-467a-8b57-ee0ed4de13bc None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:20.142215 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 186/375] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:03:19 2022] GET /identity/v3/role_assignments?group.id=477cc74912d1491881b1dd89737e141c&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=4876e759b9504964a874992dc66b6df1 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:20.143071 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d82b-2f14-467a-8b57-ee0ed4de13bc None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:20.213269 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:20.240705 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:20.265916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d82b-2f14-467a-8b57-ee0ed4de13bc None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:20.269242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6fce8-0da7-4736-abca-5fb80a193bea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:20.270774 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6fce8-0da7-4736-abca-5fb80a193bea None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:20.308382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e1709-12c2-46e1-8800-6131529e64d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:20.310184 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e1709-12c2-46e1-8800-6131529e64d0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:20.310715 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e1709-12c2-46e1-8800-6131529e64d0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:20.311312 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e1709-12c2-46e1-8800-6131529e64d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:20.312428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e1709-12c2-46e1-8800-6131529e64d0 None admin] RBAC: Adding query filter params (group.id=477cc74912d1491881b1dd89737e141c, role.id=4876e759b9504964a874992dc66b6df1, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:20.312975 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e1709-12c2-46e1-8800-6131529e64d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:20.314872 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e1709-12c2-46e1-8800-6131529e64d0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:20.322638 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 187/376] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:03:20 2022] GET /identity/v3/role_assignments?group.id=477cc74912d1491881b1dd89737e141c&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=4876e759b9504964a874992dc66b6df1 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:20.494476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 190/377] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:20.501022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e1709-12c2-46e1-8800-6131529e64d0 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:20.587579 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9945de-8240-43ae-a2eb-6bc312dedfc6 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:20.588061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9945de-8240-43ae-a2eb-6bc312dedfc6 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:20.588401 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9945de-8240-43ae-a2eb-6bc312dedfc6 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:20.590280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 191/378] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:20.595489 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce967c-6bd2-46fa-9ba6-666d2ace387e None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:20.595853 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce967c-6bd2-46fa-9ba6-666d2ace387e None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:20.596207 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce967c-6bd2-46fa-9ba6-666d2ace387e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:20.617362 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-17ce967c-6bd2-46fa-9ba6-666d2ace387e None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:20.619882 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-17ce967c-6bd2-46fa-9ba6-666d2ace387e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:20.625468 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e1709-12c2-46e1-8800-6131529e64d0 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:20.680732 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:20.692192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62bd25-b250-4dce-aa84-3a6076ca7693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:20.693414 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62bd25-b250-4dce-aa84-3a6076ca7693 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:20.693918 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62bd25-b250-4dce-aa84-3a6076ca7693 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:20.694410 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62bd25-b250-4dce-aa84-3a6076ca7693 None admin] PATH_INFO: `/v3/projects/40e10dfaa67a4db08ea8ec190c3b285d` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:20.696130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62bd25-b250-4dce-aa84-3a6076ca7693 None admin] RBAC: Authorizing `identity:get_project(project_id=40e10dfaa67a4db08ea8ec190c3b285d)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:20.697789 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62bd25-b250-4dce-aa84-3a6076ca7693 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:20.704690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 188/379] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:20 2022] GET /identity/v3/projects/40e10dfaa67a4db08ea8ec190c3b285d => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:20.712130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62bd25-b250-4dce-aa84-3a6076ca7693 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:20.762098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 192/380] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:20.784139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce967c-6bd2-46fa-9ba6-666d2ace387e None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:20.817342 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:20.916793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62bd25-b250-4dce-aa84-3a6076ca7693 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:20.954744 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5da2b4-36d7-4c92-8a75-549d3f354666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:20.955618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5da2b4-36d7-4c92-8a75-549d3f354666 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:20.955899 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5da2b4-36d7-4c92-8a75-549d3f354666 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:20.956175 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5da2b4-36d7-4c92-8a75-549d3f354666 None admin] PATH_INFO: `/v3/groups/c0a4f537e6cb474b9ce6e5c9e3491888` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:20.961582 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5da2b4-36d7-4c92-8a75-549d3f354666 None admin] RBAC: Authorizing `identity:get_group(group_id=c0a4f537e6cb474b9ce6e5c9e3491888)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:20.963097 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5da2b4-36d7-4c92-8a75-549d3f354666 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:20.964979 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 189/381] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:20 2022] GET /identity/v3/groups/c0a4f537e6cb474b9ce6e5c9e3491888 => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:20.970969 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5da2b4-36d7-4c92-8a75-549d3f354666 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:20.997395 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce967c-6bd2-46fa-9ba6-666d2ace387e None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:21.041018 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:21.076507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5da2b4-36d7-4c92-8a75-549d3f354666 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:21.111329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ede64-dc93-427d-849f-a6120e62d46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:21.112157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ede64-dc93-427d-849f-a6120e62d46a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:21.112442 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ede64-dc93-427d-849f-a6120e62d46a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:21.112724 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ede64-dc93-427d-849f-a6120e62d46a None admin] PATH_INFO: `/v3/roles/member` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:21.114212 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c443694-33d7-4fc1-9932-fe57d8de6ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:21.115097 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c443694-33d7-4fc1-9932-fe57d8de6ee7 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:21.115536 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c443694-33d7-4fc1-9932-fe57d8de6ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:21.116036 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c443694-33d7-4fc1-9932-fe57d8de6ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:21.117029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c443694-33d7-4fc1-9932-fe57d8de6ee7 None admin] RBAC: Adding query filter params (group.id=c0a4f537e6cb474b9ce6e5c9e3491888, role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=40e10dfaa67a4db08ea8ec190c3b285d) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:21.117509 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c443694-33d7-4fc1-9932-fe57d8de6ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:21.119203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c443694-33d7-4fc1-9932-fe57d8de6ee7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:21.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 190/382] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:03:20 2022] GET /identity/v3/role_assignments?group.id=c0a4f537e6cb474b9ce6e5c9e3491888&scope.project.id=40e10dfaa67a4db08ea8ec190c3b285d&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:21.146299 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ede64-dc93-427d-849f-a6120e62d46a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-c10ede64-dc93-427d-849f-a6120e62d46a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:21.163151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:21.164549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:21.165662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 193/383] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:03:21.173446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c443694-33d7-4fc1-9932-fe57d8de6ee7 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:21.341866 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c443694-33d7-4fc1-9932-fe57d8de6ee7 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:21.374342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:21.396299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dfcc4-0b64-4c3c-9f1d-a2ae2a53cbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:21.396996 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dfcc4-0b64-4c3c-9f1d-a2ae2a53cbdd None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:21.397274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dfcc4-0b64-4c3c-9f1d-a2ae2a53cbdd None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:21.397547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dfcc4-0b64-4c3c-9f1d-a2ae2a53cbdd None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:21.398326 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dfcc4-0b64-4c3c-9f1d-a2ae2a53cbdd None admin] RBAC: Adding query filter params (name=member) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:21.398655 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dfcc4-0b64-4c3c-9f1d-a2ae2a53cbdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:21.400063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dfcc4-0b64-4c3c-9f1d-a2ae2a53cbdd None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:21.415715 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 191/384] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:21.421858 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ede64-dc93-427d-849f-a6120e62d46a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:21.528871 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:21.555552 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ede64-dc93-427d-849f-a6120e62d46a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:21.609735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aded6b-93e0-4874-bf85-1912ea425861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:21.610905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aded6b-93e0-4874-bf85-1912ea425861 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:21.611359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aded6b-93e0-4874-bf85-1912ea425861 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:21.611798 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aded6b-93e0-4874-bf85-1912ea425861 None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:21.613283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aded6b-93e0-4874-bf85-1912ea425861 None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:21.614969 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aded6b-93e0-4874-bf85-1912ea425861 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:21.617076 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 194/385] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:21 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:21.623217 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dfcc4-0b64-4c3c-9f1d-a2ae2a53cbdd None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:21.733224 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dfcc4-0b64-4c3c-9f1d-a2ae2a53cbdd None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:21.771769 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68412b-cd31-4f51-b3f2-9e02515af86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:21.772934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68412b-cd31-4f51-b3f2-9e02515af86a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:21.773372 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68412b-cd31-4f51-b3f2-9e02515af86a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:21.773799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68412b-cd31-4f51-b3f2-9e02515af86a None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:21.775204 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68412b-cd31-4f51-b3f2-9e02515af86a None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:21.776803 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68412b-cd31-4f51-b3f2-9e02515af86a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:21.779757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 192/386] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:21 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:21.785663 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aded6b-93e0-4874-bf85-1912ea425861 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:21.929780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aded6b-93e0-4874-bf85-1912ea425861 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:21.976481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f72871-02dc-4544-a77a-404ab2b6b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:21.977382 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f72871-02dc-4544-a77a-404ab2b6b043 None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:21.977662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f72871-02dc-4544-a77a-404ab2b6b043 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:21.977945 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f72871-02dc-4544-a77a-404ab2b6b043 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046/groups/477cc74912d1491881b1dd89737e141c/roles/edf99f336b2440b19ff28bcd8da8433b` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:21.983949 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f72871-02dc-4544-a77a-404ab2b6b043 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b28400715c475eb364b4a9afdd6046, group_id=477cc74912d1491881b1dd89737e141c, role_id=edf99f336b2440b19ff28bcd8da8433b)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:21.985440 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f72871-02dc-4544-a77a-404ab2b6b043 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:22.068120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 195/387] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:03:21 2022] PUT /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046/groups/477cc74912d1491881b1dd89737e141c/roles/edf99f336b2440b19ff28bcd8da8433b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:22.690009 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea02d-c301-443b-814a-8489182827ce None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:22.690546 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea02d-c301-443b-814a-8489182827ce None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:22.690546 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea02d-c301-443b-814a-8489182827ce None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:22.692249 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 193/388] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:22.697343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090c56-7aff-4372-8070-87c35a93a747 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:22.697636 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090c56-7aff-4372-8070-87c35a93a747 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:22.697911 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090c56-7aff-4372-8070-87c35a93a747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:22.719093 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-c4090c56-7aff-4372-8070-87c35a93a747 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:22.720283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-c4090c56-7aff-4372-8070-87c35a93a747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:22.722564 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:22.826741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 196/389] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:22.852004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afea02d-c301-443b-814a-8489182827ce None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:22.974584 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526a646-f695-4aba-a97c-a6c11576f830 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:22.974584 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526a646-f695-4aba-a97c-a6c11576f830 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:22.974584 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526a646-f695-4aba-a97c-a6c11576f830 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:22.978355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 197/390] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:22.980330 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:22.985724 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1088482-21f9-4e24-938e-c351efc79b5b None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:22.985724 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1088482-21f9-4e24-938e-c351efc79b5b None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:22.985724 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1088482-21f9-4e24-938e-c351efc79b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:23.019581 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-a1088482-21f9-4e24-938e-c351efc79b5b None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:23.022744 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-a1088482-21f9-4e24-938e-c351efc79b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:23.091405 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afea02d-c301-443b-814a-8489182827ce None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:23.129067 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 198/391] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 20:03:23.135914 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f1071-3250-469f-8468-7b383b082ac6 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:23.136209 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f1071-3250-469f-8468-7b383b082ac6 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:23.136491 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f1071-3250-469f-8468-7b383b082ac6 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:23.142145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 199/392] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:23.143671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd34fe-68dc-4353-8207-3eca78f34fd8 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:23.143962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd34fe-68dc-4353-8207-3eca78f34fd8 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:23.144359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd34fe-68dc-4353-8207-3eca78f34fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:23.165730 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42087f1b-2e8c-4136-99af-e31909666804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:23.166596 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42087f1b-2e8c-4136-99af-e31909666804 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:23.166902 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42087f1b-2e8c-4136-99af-e31909666804 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:23.167179 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42087f1b-2e8c-4136-99af-e31909666804 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:23.182246 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-6ebd34fe-68dc-4353-8207-3eca78f34fd8 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:23.185769 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-6ebd34fe-68dc-4353-8207-3eca78f34fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:23.189567 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42087f1b-2e8c-4136-99af-e31909666804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-42087f1b-2e8c-4136-99af-e31909666804 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:23.208053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:23.209180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:23.210089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:23.222471 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 194/393] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:23.224725 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42087f1b-2e8c-4136-99af-e31909666804 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:23.313334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:23.331162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 200/394] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:23.336493 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd34fe-68dc-4353-8207-3eca78f34fd8 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:23.402336 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42087f1b-2e8c-4136-99af-e31909666804 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:23.423028 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:23.459244 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192ae68-d5ce-439d-b35e-ee1a8a6d9061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:23.460448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192ae68-d5ce-439d-b35e-ee1a8a6d9061 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:23.460966 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192ae68-d5ce-439d-b35e-ee1a8a6d9061 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:23.461465 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192ae68-d5ce-439d-b35e-ee1a8a6d9061 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:23.473098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192ae68-d5ce-439d-b35e-ee1a8a6d9061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-4192ae68-d5ce-439d-b35e-ee1a8a6d9061 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:23.482347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:23.483448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:23.484391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:23.492004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 195/395] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:03:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:23.493435 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192ae68-d5ce-439d-b35e-ee1a8a6d9061 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:23.497840 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd34fe-68dc-4353-8207-3eca78f34fd8 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:23.536729 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc0c96-7197-4308-9f88-62177ac67e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:23.537404 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc0c96-7197-4308-9f88-62177ac67e2e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:23.537686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc0c96-7197-4308-9f88-62177ac67e2e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:23.537960 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc0c96-7197-4308-9f88-62177ac67e2e None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:23.538747 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc0c96-7197-4308-9f88-62177ac67e2e None admin] RBAC: Adding query filter params (name=member) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:23.539054 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc0c96-7197-4308-9f88-62177ac67e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:23.540610 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc0c96-7197-4308-9f88-62177ac67e2e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:23.550188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 201/396] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:23.551380 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc0c96-7197-4308-9f88-62177ac67e2e None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:23.612650 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192ae68-d5ce-439d-b35e-ee1a8a6d9061 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:23.614634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:23.650358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1b0ff-c8be-4237-b67e-d9fd6ae23329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:23.651395 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b0ff-c8be-4237-b67e-d9fd6ae23329 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:23.651783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b0ff-c8be-4237-b67e-d9fd6ae23329 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:23.652164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b0ff-c8be-4237-b67e-d9fd6ae23329 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:23.660314 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc0c96-7197-4308-9f88-62177ac67e2e None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:23.663725 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1b0ff-c8be-4237-b67e-d9fd6ae23329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-01e1b0ff-c8be-4237-b67e-d9fd6ae23329 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:23.672357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:23.673420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:23.674346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:23.678749 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 196/397] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:03:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:23.679690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1b0ff-c8be-4237-b67e-d9fd6ae23329 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:23.705225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb8fe7-3600-4a19-a936-64e1bdbab2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:23.706326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb8fe7-3600-4a19-a936-64e1bdbab2db None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:23.706876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb8fe7-3600-4a19-a936-64e1bdbab2db None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:23.707542 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb8fe7-3600-4a19-a936-64e1bdbab2db None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:23.708528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb8fe7-3600-4a19-a936-64e1bdbab2db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:23.709155 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb8fe7-3600-4a19-a936-64e1bdbab2db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:23.710795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb8fe7-3600-4a19-a936-64e1bdbab2db None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:23.717054 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:23.721470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 202/398] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:23.722628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb8fe7-3600-4a19-a936-64e1bdbab2db None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:23.802246 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1b0ff-c8be-4237-b67e-d9fd6ae23329 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:23.839957 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb8fe7-3600-4a19-a936-64e1bdbab2db None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:23.844430 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79933-695f-40fb-b934-b32234db4eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:23.845199 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79933-695f-40fb-b934-b32234db4eb7 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:23.845484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79933-695f-40fb-b934-b32234db4eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:23.845814 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79933-695f-40fb-b934-b32234db4eb7 None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:23.847048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f79933-695f-40fb-b934-b32234db4eb7 None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:23.848503 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f79933-695f-40fb-b934-b32234db4eb7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:23.850565 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 197/399] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:23 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:23.851401 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79933-695f-40fb-b934-b32234db4eb7 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:23.868982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:23.882863 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1f7a4-3651-4d5e-b8c2-6605c84ce9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:23.884452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1f7a4-3651-4d5e-b8c2-6605c84ce9cf None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:23.884452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1f7a4-3651-4d5e-b8c2-6605c84ce9cf None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:23.884822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1f7a4-3651-4d5e-b8c2-6605c84ce9cf None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:23.885809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1f7a4-3651-4d5e-b8c2-6605c84ce9cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:23.886338 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1f7a4-3651-4d5e-b8c2-6605c84ce9cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:23.888581 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1f7a4-3651-4d5e-b8c2-6605c84ce9cf None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:23.898059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 203/400] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:23.899257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1f7a4-3651-4d5e-b8c2-6605c84ce9cf None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:23.973470 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:23.978337 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79933-695f-40fb-b934-b32234db4eb7 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:24.015513 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39744e-3435-4286-9678-98bda560bc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:24.015777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1f7a4-3651-4d5e-b8c2-6605c84ce9cf None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:24.016522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39744e-3435-4286-9678-98bda560bc6c None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.016872 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39744e-3435-4286-9678-98bda560bc6c None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.017225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39744e-3435-4286-9678-98bda560bc6c None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.018435 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39744e-3435-4286-9678-98bda560bc6c None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:24.019975 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39744e-3435-4286-9678-98bda560bc6c None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:24.021627 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 198/401] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:23 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:24.022386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39744e-3435-4286-9678-98bda560bc6c None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:24.057539 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7af6f8-9f85-4487-a2cb-f11d13ef0658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:24.059685 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af6f8-9f85-4487-a2cb-f11d13ef0658 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.059965 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af6f8-9f85-4487-a2cb-f11d13ef0658 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.060238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af6f8-9f85-4487-a2cb-f11d13ef0658 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.061467 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7af6f8-9f85-4487-a2cb-f11d13ef0658 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:24.063022 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7af6f8-9f85-4487-a2cb-f11d13ef0658 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:24.069686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 204/402] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:23 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:24.069686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717dfbe-d563-461e-a7f6-8d5b98b746ec None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.069686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717dfbe-d563-461e-a7f6-8d5b98b746ec None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.069686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717dfbe-d563-461e-a7f6-8d5b98b746ec None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.069686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 205/403] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:24.069686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717dfbe-d563-461e-a7f6-8d5b98b746ec None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:24.129884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:24.139483 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39744e-3435-4286-9678-98bda560bc6c None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:24.178904 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13ebcb-a809-4b78-8627-8b33df9d6ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:24.179123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717dfbe-d563-461e-a7f6-8d5b98b746ec None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:24.179774 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13ebcb-a809-4b78-8627-8b33df9d6ae8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.180057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13ebcb-a809-4b78-8627-8b33df9d6ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.180602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13ebcb-a809-4b78-8627-8b33df9d6ae8 None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.182829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13ebcb-a809-4b78-8627-8b33df9d6ae8 None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:24.184901 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13ebcb-a809-4b78-8627-8b33df9d6ae8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:24.191142 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 199/404] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:24 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:24.191142 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13ebcb-a809-4b78-8627-8b33df9d6ae8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:24.222898 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e54bf-01b0-452e-bc63-c902e5dcd974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:24.224612 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e54bf-01b0-452e-bc63-c902e5dcd974 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.224902 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e54bf-01b0-452e-bc63-c902e5dcd974 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.225478 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e54bf-01b0-452e-bc63-c902e5dcd974 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.227474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e54bf-01b0-452e-bc63-c902e5dcd974 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:24.229475 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e54bf-01b0-452e-bc63-c902e5dcd974 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:24.237247 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 206/405] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:24 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:24.237425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:24.237528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679441b-14d6-4e48-b59d-9aa2811be9ce None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.237528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679441b-14d6-4e48-b59d-9aa2811be9ce None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.237528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679441b-14d6-4e48-b59d-9aa2811be9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.255416 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-f679441b-14d6-4e48-b59d-9aa2811be9ce None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:24.256616 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-f679441b-14d6-4e48-b59d-9aa2811be9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:24.313197 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13ebcb-a809-4b78-8627-8b33df9d6ae8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:24.330844 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 207/406] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:24.331831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679441b-14d6-4e48-b59d-9aa2811be9ce None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:24.358622 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71211d3b-02f1-4a9a-bc33-bb5f638ce205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:24.359532 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71211d3b-02f1-4a9a-bc33-bb5f638ce205 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.360281 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71211d3b-02f1-4a9a-bc33-bb5f638ce205 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.360576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71211d3b-02f1-4a9a-bc33-bb5f638ce205 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/groups/477cc74912d1491881b1dd89737e141c/roles/edf99f336b2440b19ff28bcd8da8433b` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.362850 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71211d3b-02f1-4a9a-bc33-bb5f638ce205 None admin] RBAC: Authorizing `identity:create_grant(project_id=72282c5cb5cb4eb792a0e612a389ee4e, group_id=477cc74912d1491881b1dd89737e141c, role_id=edf99f336b2440b19ff28bcd8da8433b)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:24.364611 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71211d3b-02f1-4a9a-bc33-bb5f638ce205 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:24.389733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:24.423025 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 200/407] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:03:24 2022] PUT /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/groups/477cc74912d1491881b1dd89737e141c/roles/edf99f336b2440b19ff28bcd8da8433b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:24.424184 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71211d3b-02f1-4a9a-bc33-bb5f638ce205 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:24.461902 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679441b-14d6-4e48-b59d-9aa2811be9ce None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:24.504708 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f3d52-d00a-4d09-a752-03fa92859cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:24.506059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f3d52-d00a-4d09-a752-03fa92859cc6 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.506059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f3d52-d00a-4d09-a752-03fa92859cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.506466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f3d52-d00a-4d09-a752-03fa92859cc6 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.507923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f3d52-d00a-4d09-a752-03fa92859cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:24.509508 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f3d52-d00a-4d09-a752-03fa92859cc6 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:24.517242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 208/408] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:24 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:24.518462 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f3d52-d00a-4d09-a752-03fa92859cc6 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:24.566390 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:24.574735 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71211d3b-02f1-4a9a-bc33-bb5f638ce205 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:24.617467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c73ca-a441-40ed-9f33-8b42cd700cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:24.618702 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c73ca-a441-40ed-9f33-8b42cd700cab None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.619083 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c73ca-a441-40ed-9f33-8b42cd700cab None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.619455 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c73ca-a441-40ed-9f33-8b42cd700cab None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046/groups/477cc74912d1491881b1dd89737e141c/roles/4876e759b9504964a874992dc66b6df1` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.621760 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c73ca-a441-40ed-9f33-8b42cd700cab None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b28400715c475eb364b4a9afdd6046, group_id=477cc74912d1491881b1dd89737e141c, role_id=4876e759b9504964a874992dc66b6df1)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:24.623319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c73ca-a441-40ed-9f33-8b42cd700cab None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:24.651363 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f3d52-d00a-4d09-a752-03fa92859cc6 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:24.673585 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:24.692343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54261c2d-61a2-4ad7-abbd-55da3f501944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:24.693198 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54261c2d-61a2-4ad7-abbd-55da3f501944 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.693589 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54261c2d-61a2-4ad7-abbd-55da3f501944 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.693872 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54261c2d-61a2-4ad7-abbd-55da3f501944 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.705507 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54261c2d-61a2-4ad7-abbd-55da3f501944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-54261c2d-61a2-4ad7-abbd-55da3f501944 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:24.713903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:24.715051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:03:24.715995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:24.717399 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 201/409] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:03:24 2022] PUT /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046/groups/477cc74912d1491881b1dd89737e141c/roles/4876e759b9504964a874992dc66b6df1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:24.719035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c73ca-a441-40ed-9f33-8b42cd700cab None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:24.723128 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 209/410] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:03:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:24.729113 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54261c2d-61a2-4ad7-abbd-55da3f501944 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:24.872278 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c73ca-a441-40ed-9f33-8b42cd700cab None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:24.909556 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54261c2d-61a2-4ad7-abbd-55da3f501944 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:24.928869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8e9f8-434b-4603-989f-3e9d1f7ec93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:24.929785 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8e9f8-434b-4603-989f-3e9d1f7ec93d None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.930068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8e9f8-434b-4603-989f-3e9d1f7ec93d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.930344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8e9f8-434b-4603-989f-3e9d1f7ec93d None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/groups/477cc74912d1491881b1dd89737e141c/roles/4876e759b9504964a874992dc66b6df1` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.933034 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8e9f8-434b-4603-989f-3e9d1f7ec93d None admin] RBAC: Authorizing `identity:create_grant(project_id=72282c5cb5cb4eb792a0e612a389ee4e, group_id=477cc74912d1491881b1dd89737e141c, role_id=4876e759b9504964a874992dc66b6df1)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:24.935145 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8e9f8-434b-4603-989f-3e9d1f7ec93d None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:24.958658 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fe4e3-894c-4852-b270-cddd1118c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:24.959753 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fe4e3-894c-4852-b270-cddd1118c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.960241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fe4e3-894c-4852-b270-cddd1118c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.960755 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fe4e3-894c-4852-b270-cddd1118c3a8 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.961746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fe4e3-894c-4852-b270-cddd1118c3a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:24.962270 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fe4e3-894c-4852-b270-cddd1118c3a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:24.963939 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fe4e3-894c-4852-b270-cddd1118c3a8 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:24.974325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 210/411] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:24.976025 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855ca50-79c4-4150-aeef-0a951450a357 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:24.976313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855ca50-79c4-4150-aeef-0a951450a357 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:24.976588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855ca50-79c4-4150-aeef-0a951450a357 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:24.978023 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 211/412] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:24.979663 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855ca50-79c4-4150-aeef-0a951450a357 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:25.011632 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 202/413] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:03:24 2022] PUT /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e/groups/477cc74912d1491881b1dd89737e141c/roles/4876e759b9504964a874992dc66b6df1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:25.012629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d765c-1c04-4ee6-9b16-b0c318807480 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:25.013534 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d765c-1c04-4ee6-9b16-b0c318807480 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:25.013534 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d765c-1c04-4ee6-9b16-b0c318807480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:25.049875 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-952d765c-1c04-4ee6-9b16-b0c318807480 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:25.052798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-952d765c-1c04-4ee6-9b16-b0c318807480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:25.067820 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:25.075208 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:25.171223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855ca50-79c4-4150-aeef-0a951450a357 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:25.181195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 203/414] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:25.211844 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2bd42-693d-4441-bf2c-344367e5dff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:25.212984 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2bd42-693d-4441-bf2c-344367e5dff5 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:25.213456 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2bd42-693d-4441-bf2c-344367e5dff5 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:25.213897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2bd42-693d-4441-bf2c-344367e5dff5 None admin] PATH_INFO: `/v3/groups/c0a4f537e6cb474b9ce6e5c9e3491888` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:25.215781 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2bd42-693d-4441-bf2c-344367e5dff5 None admin] RBAC: Authorizing `identity:get_group(group_id=c0a4f537e6cb474b9ce6e5c9e3491888)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:25.217448 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2bd42-693d-4441-bf2c-344367e5dff5 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:25.221642 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d765c-1c04-4ee6-9b16-b0c318807480 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:25.231306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 212/415] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:24 2022] GET /identity/v3/groups/c0a4f537e6cb474b9ce6e5c9e3491888 => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:25.231306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2bd42-693d-4441-bf2c-344367e5dff5 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:25.339728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2bd42-693d-4441-bf2c-344367e5dff5 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:25.350207 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:25.378525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1df654-5a05-43cb-acd4-88c9f6def6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:25.379434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1df654-5a05-43cb-acd4-88c9f6def6d1 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:25.379723 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1df654-5a05-43cb-acd4-88c9f6def6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:25.380001 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1df654-5a05-43cb-acd4-88c9f6def6d1 None admin] PATH_INFO: `/v3/projects/40e10dfaa67a4db08ea8ec190c3b285d` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:25.381434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1df654-5a05-43cb-acd4-88c9f6def6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=40e10dfaa67a4db08ea8ec190c3b285d)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:25.384384 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1df654-5a05-43cb-acd4-88c9f6def6d1 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:25.386945 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 213/416] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:25 2022] GET /identity/v3/projects/40e10dfaa67a4db08ea8ec190c3b285d => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:25.392998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1df654-5a05-43cb-acd4-88c9f6def6d1 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:25.407879 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d765c-1c04-4ee6-9b16-b0c318807480 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:25.456395 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38602412-8275-4db8-8eb3-6bf31b1b33d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:25.457131 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38602412-8275-4db8-8eb3-6bf31b1b33d8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:25.457414 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38602412-8275-4db8-8eb3-6bf31b1b33d8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:25.457709 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38602412-8275-4db8-8eb3-6bf31b1b33d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:25.473455 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38602412-8275-4db8-8eb3-6bf31b1b33d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-38602412-8275-4db8-8eb3-6bf31b1b33d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:25.483339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:25.484457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:25.485411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:25.489909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 204/417] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:25.494654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38602412-8275-4db8-8eb3-6bf31b1b33d8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:25.504530 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:25.544173 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1df654-5a05-43cb-acd4-88c9f6def6d1 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:25.609452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878da392-689b-4eb9-b983-87ec567bc160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:25.610370 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878da392-689b-4eb9-b983-87ec567bc160 None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:25.610677 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878da392-689b-4eb9-b983-87ec567bc160 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:25.610961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878da392-689b-4eb9-b983-87ec567bc160 None admin] PATH_INFO: `/v3/projects/40e10dfaa67a4db08ea8ec190c3b285d/groups/c0a4f537e6cb474b9ce6e5c9e3491888/roles/38e07a16dc8b4306be7688b9d5cd626b` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:25.613042 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878da392-689b-4eb9-b983-87ec567bc160 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e10dfaa67a4db08ea8ec190c3b285d, group_id=c0a4f537e6cb474b9ce6e5c9e3491888, role_id=38e07a16dc8b4306be7688b9d5cd626b)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:25.614533 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878da392-689b-4eb9-b983-87ec567bc160 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:25.662150 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38602412-8275-4db8-8eb3-6bf31b1b33d8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:25.705955 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 214/418] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:03:25 2022] PUT /identity/v3/projects/40e10dfaa67a4db08ea8ec190c3b285d/groups/c0a4f537e6cb474b9ce6e5c9e3491888/roles/38e07a16dc8b4306be7688b9d5cd626b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:25.713615 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d3dad-1931-4f1c-be78-1626154b3607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:25.714237 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d3dad-1931-4f1c-be78-1626154b3607 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:25.714521 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d3dad-1931-4f1c-be78-1626154b3607 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:25.714829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d3dad-1931-4f1c-be78-1626154b3607 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:25.715753 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d3dad-1931-4f1c-be78-1626154b3607 None admin] RBAC: Adding query filter params (name=member) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:25.716070 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d3dad-1931-4f1c-be78-1626154b3607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:25.717510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d3dad-1931-4f1c-be78-1626154b3607 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:25.732529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 205/419] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:25.738874 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878da392-689b-4eb9-b983-87ec567bc160 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:25.802296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:25.889768 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878da392-689b-4eb9-b983-87ec567bc160 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:25.935872 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e0f6-27e8-4382-921a-f1c4eba02f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:25.936639 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e0f6-27e8-4382-921a-f1c4eba02f15 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:25.936897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e0f6-27e8-4382-921a-f1c4eba02f15 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:25.937176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e0f6-27e8-4382-921a-f1c4eba02f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:26.040120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7e0f6-27e8-4382-921a-f1c4eba02f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:26.041536 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7e0f6-27e8-4382-921a-f1c4eba02f15 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:26.082838 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:26.172948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 215/420] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:26.174445 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d3dad-1931-4f1c-be78-1626154b3607 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:26.272777 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:26.321158 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d3dad-1931-4f1c-be78-1626154b3607 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:26.358595 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ea7e4-8446-478c-b637-42b99e6d5157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:26.359513 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ea7e4-8446-478c-b637-42b99e6d5157 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:26.359800 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ea7e4-8446-478c-b637-42b99e6d5157 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:26.360081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ea7e4-8446-478c-b637-42b99e6d5157 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:26.361337 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ea7e4-8446-478c-b637-42b99e6d5157 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:26.362820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ea7e4-8446-478c-b637-42b99e6d5157 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:26.369203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 206/421] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:26 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:26.370661 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e0f6-27e8-4382-921a-f1c4eba02f15 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:26.511411 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e0f6-27e8-4382-921a-f1c4eba02f15 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:26.571708 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b237a-109b-4b52-af2b-07ede34bdcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:26.572507 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b237a-109b-4b52-af2b-07ede34bdcb2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:26.572794 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b237a-109b-4b52-af2b-07ede34bdcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:26.573076 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b237a-109b-4b52-af2b-07ede34bdcb2 None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:26.574348 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b237a-109b-4b52-af2b-07ede34bdcb2 None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:26.575849 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b237a-109b-4b52-af2b-07ede34bdcb2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:26.578891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 216/422] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:26 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:26.583863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ea7e4-8446-478c-b637-42b99e6d5157 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:26.694359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ea7e4-8446-478c-b637-42b99e6d5157 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:26.731554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e0722-791e-4165-ac48-bd179a964528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:26.732374 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e0722-791e-4165-ac48-bd179a964528 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:26.732565 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e0722-791e-4165-ac48-bd179a964528 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:26.732762 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e0722-791e-4165-ac48-bd179a964528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:26.733629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e0722-791e-4165-ac48-bd179a964528 None admin] RBAC: Adding query filter params (group.id=477cc74912d1491881b1dd89737e141c, role.id=edf99f336b2440b19ff28bcd8da8433b, scope.project.id=d9b28400715c475eb364b4a9afdd6046) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:26.734016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e0722-791e-4165-ac48-bd179a964528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:26.735618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e0722-791e-4165-ac48-bd179a964528 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:26.743003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:26.747410 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 207/423] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:03:26 2022] GET /identity/v3/role_assignments?group.id=477cc74912d1491881b1dd89737e141c&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:27.180901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48689-7a98-4b2a-b3d3-1a8f99884f4c None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:27.181636 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48689-7a98-4b2a-b3d3-1a8f99884f4c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:27.181636 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48689-7a98-4b2a-b3d3-1a8f99884f4c None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:27.183186 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 217/424] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:27.189026 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea29e79-8c28-4c88-92c8-5cf944b40811 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:27.189415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea29e79-8c28-4c88-92c8-5cf944b40811 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:27.189657 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea29e79-8c28-4c88-92c8-5cf944b40811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:27.210557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-eea29e79-8c28-4c88-92c8-5cf944b40811 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:27.211786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-eea29e79-8c28-4c88-92c8-5cf944b40811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:27.295198 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 208/425] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:27.319591 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e48689-7a98-4b2a-b3d3-1a8f99884f4c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:27.326590 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:27.468318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e48689-7a98-4b2a-b3d3-1a8f99884f4c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:27.519732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9e48-a7f6-4095-b306-1a57274006f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:27.520990 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9e48-a7f6-4095-b306-1a57274006f8 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:27.521445 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9e48-a7f6-4095-b306-1a57274006f8 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:27.521911 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9e48-a7f6-4095-b306-1a57274006f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:27.536549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c9e48-a7f6-4095-b306-1a57274006f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-7b7c9e48-a7f6-4095-b306-1a57274006f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:27.545307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:27.547693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:27.549296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 218/426] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:27.552807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea29e79-8c28-4c88-92c8-5cf944b40811 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:27.653528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef2f8-46c3-4525-9762-2b837b5620b3 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:27.653946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef2f8-46c3-4525-9762-2b837b5620b3 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:27.654389 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef2f8-46c3-4525-9762-2b837b5620b3 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:27.658816 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 219/427] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:27.666655 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f3965-269e-448b-bff4-b0ce128e9ab0 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:27.666655 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f3965-269e-448b-bff4-b0ce128e9ab0 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:27.666655 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f3965-269e-448b-bff4-b0ce128e9ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:27.689510 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-2b3f3965-269e-448b-bff4-b0ce128e9ab0 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:27.691210 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-2b3f3965-269e-448b-bff4-b0ce128e9ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:27.705450 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea29e79-8c28-4c88-92c8-5cf944b40811 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:27.740900 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:27.748837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64cdcb-dd98-4911-bac5-4c71e2666a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:27.749524 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64cdcb-dd98-4911-bac5-4c71e2666a41 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:27.749807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64cdcb-dd98-4911-bac5-4c71e2666a41 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:27.750084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64cdcb-dd98-4911-bac5-4c71e2666a41 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:27.750868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64cdcb-dd98-4911-bac5-4c71e2666a41 None admin] RBAC: Adding query filter params (name=member) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:27.751230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64cdcb-dd98-4911-bac5-4c71e2666a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:27.752653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64cdcb-dd98-4911-bac5-4c71e2666a41 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:27.764287 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 209/428] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:03:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:27.770805 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64cdcb-dd98-4911-bac5-4c71e2666a41 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:27.787688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:27.800303 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 220/429] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:03:27.835737 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f3965-269e-448b-bff4-b0ce128e9ab0 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:27.906234 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64cdcb-dd98-4911-bac5-4c71e2666a41 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:27.955627 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58901d57-13f7-4d4b-b181-333a481b2be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:27.956657 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58901d57-13f7-4d4b-b181-333a481b2be8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:27.957168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58901d57-13f7-4d4b-b181-333a481b2be8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:27.957654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58901d57-13f7-4d4b-b181-333a481b2be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:27.973365 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f3965-269e-448b-bff4-b0ce128e9ab0 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:28.017273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a525a40-826c-4698-b4ae-62d60b228955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:28.018465 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a525a40-826c-4698-b4ae-62d60b228955 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.018985 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a525a40-826c-4698-b4ae-62d60b228955 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.019490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a525a40-826c-4698-b4ae-62d60b228955 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.035799 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a525a40-826c-4698-b4ae-62d60b228955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:28.036003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-9a525a40-826c-4698-b4ae-62d60b228955 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:28.044139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:28.051525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 221/430] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:03:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:28.052443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91521347-ee82-4a05-8d46-48457a0dcc06 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.053340 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91521347-ee82-4a05-8d46-48457a0dcc06 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.053340 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91521347-ee82-4a05-8d46-48457a0dcc06 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.053340 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 222/431] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:28.053986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58901d57-13f7-4d4b-b181-333a481b2be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:28.054178 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91521347-ee82-4a05-8d46-48457a0dcc06 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:28.055200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58901d57-13f7-4d4b-b181-333a481b2be8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:28.129933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:28.176337 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 210/432] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:03:28.177997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880eea3-0f1d-4336-a235-8c853af0ccea None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.178283 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880eea3-0f1d-4336-a235-8c853af0ccea None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.178560 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880eea3-0f1d-4336-a235-8c853af0ccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.194621 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91521347-ee82-4a05-8d46-48457a0dcc06 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:28.199281 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-b880eea3-0f1d-4336-a235-8c853af0ccea None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:28.200969 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-b880eea3-0f1d-4336-a235-8c853af0ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:28.242304 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206218c-3485-4d10-8718-36635eb39db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:28.243489 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206218c-3485-4d10-8718-36635eb39db8 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.243956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206218c-3485-4d10-8718-36635eb39db8 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.244236 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206218c-3485-4d10-8718-36635eb39db8 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.245000 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206218c-3485-4d10-8718-36635eb39db8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:28.245308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206218c-3485-4d10-8718-36635eb39db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:28.247349 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206218c-3485-4d10-8718-36635eb39db8 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:28.260884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 223/433] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:28.260884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206218c-3485-4d10-8718-36635eb39db8 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:28.306714 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 211/434] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:28.306714 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880eea3-0f1d-4336-a235-8c853af0ccea None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:28.328364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:28.398519 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206218c-3485-4d10-8718-36635eb39db8 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:28.418548 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:28.424592 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880eea3-0f1d-4336-a235-8c853af0ccea None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:28.445166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c72300-10c7-407c-8b71-9d2293ac7b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:28.446046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c72300-10c7-407c-8b71-9d2293ac7b07 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.446322 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c72300-10c7-407c-8b71-9d2293ac7b07 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.446752 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c72300-10c7-407c-8b71-9d2293ac7b07 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.448134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c72300-10c7-407c-8b71-9d2293ac7b07 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:28.450172 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c72300-10c7-407c-8b71-9d2293ac7b07 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:28.456960 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 224/435] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:28 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:28.456960 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c72300-10c7-407c-8b71-9d2293ac7b07 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:28.473408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82875dba-2c2a-4ba9-ab2c-86c4f3b920d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:28.474181 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875dba-2c2a-4ba9-ab2c-86c4f3b920d6 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.474471 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875dba-2c2a-4ba9-ab2c-86c4f3b920d6 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.474776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875dba-2c2a-4ba9-ab2c-86c4f3b920d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.572733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82875dba-2c2a-4ba9-ab2c-86c4f3b920d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:28.574134 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82875dba-2c2a-4ba9-ab2c-86c4f3b920d6 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:28.580316 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c72300-10c7-407c-8b71-9d2293ac7b07 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:28.597296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:28.617908 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571eb1b-179c-4733-a026-927dfc445912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:28.618771 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571eb1b-179c-4733-a026-927dfc445912 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.619052 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571eb1b-179c-4733-a026-927dfc445912 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.619335 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571eb1b-179c-4733-a026-927dfc445912 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.630492 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571eb1b-179c-4733-a026-927dfc445912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-0571eb1b-179c-4733-a026-927dfc445912 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:28.638701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:28.639933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 225/436] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:03:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:28.640992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571eb1b-179c-4733-a026-927dfc445912 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:28.683934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 212/437] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:28.685323 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa079c3-efce-4a23-8ef1-dcdf5c63c42b None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.685608 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa079c3-efce-4a23-8ef1-dcdf5c63c42b None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.685884 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa079c3-efce-4a23-8ef1-dcdf5c63c42b None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.687233 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 213/438] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:28.690803 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa079c3-efce-4a23-8ef1-dcdf5c63c42b None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:28.699084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:28.761067 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571eb1b-179c-4733-a026-927dfc445912 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:28.799350 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdbda9-4984-407d-beba-3de88f3234ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:28.800222 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdbda9-4984-407d-beba-3de88f3234ce None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.800507 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdbda9-4984-407d-beba-3de88f3234ce None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.800787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa079c3-efce-4a23-8ef1-dcdf5c63c42b None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:28.801615 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdbda9-4984-407d-beba-3de88f3234ce None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.802444 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdbda9-4984-407d-beba-3de88f3234ce None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:28.804030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdbda9-4984-407d-beba-3de88f3234ce None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:28.805784 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 226/439] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:28 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:28.806562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdbda9-4984-407d-beba-3de88f3234ce None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:28.822709 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:28.840740 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dddc01-ce94-413b-be81-1a2f46ad4aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:28.840740 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dddc01-ce94-413b-be81-1a2f46ad4aef None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.840740 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dddc01-ce94-413b-be81-1a2f46ad4aef None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.840740 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dddc01-ce94-413b-be81-1a2f46ad4aef None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.841273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dddc01-ce94-413b-be81-1a2f46ad4aef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:28.841273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dddc01-ce94-413b-be81-1a2f46ad4aef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:28.842009 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dddc01-ce94-413b-be81-1a2f46ad4aef None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:28.851231 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 214/440] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:28.852514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9adca8-0255-417f-9abf-76e420250173 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.852853 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9adca8-0255-417f-9abf-76e420250173 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.853108 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9adca8-0255-417f-9abf-76e420250173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.872086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-2f9adca8-0255-417f-9abf-76e420250173 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:28.873369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-2f9adca8-0255-417f-9abf-76e420250173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:28.925649 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdbda9-4984-407d-beba-3de88f3234ce None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:28.940654 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:28.946012 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 215/441] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:28.946978 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9adca8-0255-417f-9abf-76e420250173 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:28.969775 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b6e6f-f250-4085-882b-dba15b500da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:28.970699 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6e6f-f250-4085-882b-dba15b500da3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:28.970984 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6e6f-f250-4085-882b-dba15b500da3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:28.971263 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6e6f-f250-4085-882b-dba15b500da3 None admin] PATH_INFO: `/v3/projects/d9b28400715c475eb364b4a9afdd6046` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:28.972554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b6e6f-f250-4085-882b-dba15b500da3 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b28400715c475eb364b4a9afdd6046)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:28.974033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b6e6f-f250-4085-882b-dba15b500da3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:28.978786 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 227/442] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:28 2022] GET /identity/v3/projects/d9b28400715c475eb364b4a9afdd6046 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:28.979725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b6e6f-f250-4085-882b-dba15b500da3 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:29.068553 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9adca8-0255-417f-9abf-76e420250173 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:29.082401 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:29.100488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b6e6f-f250-4085-882b-dba15b500da3 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:29.103899 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d891c04-af14-4f80-95e2-8b72896230a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:29.104567 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d891c04-af14-4f80-95e2-8b72896230a5 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:29.104849 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d891c04-af14-4f80-95e2-8b72896230a5 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:29.105124 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d891c04-af14-4f80-95e2-8b72896230a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:29.106081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d891c04-af14-4f80-95e2-8b72896230a5 None admin] RBAC: Adding query filter params (group.id=477cc74912d1491881b1dd89737e141c, role.id=edf99f336b2440b19ff28bcd8da8433b, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:29.106313 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d891c04-af14-4f80-95e2-8b72896230a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:29.107787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d891c04-af14-4f80-95e2-8b72896230a5 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:29.122832 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 216/443] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:03:28 2022] GET /identity/v3/role_assignments?group.id=477cc74912d1491881b1dd89737e141c&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=edf99f336b2440b19ff28bcd8da8433b => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:29.122832 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d891c04-af14-4f80-95e2-8b72896230a5 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:29.138572 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc92c5-a1b2-4829-a3e7-1e34e2be2833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:29.139909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc92c5-a1b2-4829-a3e7-1e34e2be2833 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:29.140467 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc92c5-a1b2-4829-a3e7-1e34e2be2833 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:29.140955 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc92c5-a1b2-4829-a3e7-1e34e2be2833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:29.229837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:29.258021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc92c5-a1b2-4829-a3e7-1e34e2be2833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:29.259700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc92c5-a1b2-4829-a3e7-1e34e2be2833 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:29.263221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d891c04-af14-4f80-95e2-8b72896230a5 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:29.305063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522d194-726c-446e-b35d-483fcaf3ca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:29.306181 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522d194-726c-446e-b35d-483fcaf3ca97 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:29.306573 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522d194-726c-446e-b35d-483fcaf3ca97 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:29.307003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522d194-726c-446e-b35d-483fcaf3ca97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:29.323235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522d194-726c-446e-b35d-483fcaf3ca97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-0522d194-726c-446e-b35d-483fcaf3ca97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:29.333103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:29.334351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 217/444] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:29.335428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522d194-726c-446e-b35d-483fcaf3ca97 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:29.386107 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:29.393194 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 228/445] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:29.394659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc92c5-a1b2-4829-a3e7-1e34e2be2833 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:29.459881 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522d194-726c-446e-b35d-483fcaf3ca97 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:29.495592 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eba510-ae4c-415a-8128-8c48b2e7c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:29.496515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eba510-ae4c-415a-8128-8c48b2e7c13f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:29.496683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:29.496776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eba510-ae4c-415a-8128-8c48b2e7c13f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:29.497059 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eba510-ae4c-415a-8128-8c48b2e7c13f None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:29.498302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eba510-ae4c-415a-8128-8c48b2e7c13f None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:29.499794 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eba510-ae4c-415a-8128-8c48b2e7c13f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:29.501449 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 218/446] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:29 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:29.502270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eba510-ae4c-415a-8128-8c48b2e7c13f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:29.523599 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc92c5-a1b2-4829-a3e7-1e34e2be2833 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:29.564136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8845ea-7301-4713-a274-80746346f5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:29.564810 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8845ea-7301-4713-a274-80746346f5d8 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:29.565093 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8845ea-7301-4713-a274-80746346f5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:29.565370 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8845ea-7301-4713-a274-80746346f5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:29.566138 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8845ea-7301-4713-a274-80746346f5d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:29.566438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8845ea-7301-4713-a274-80746346f5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:29.567868 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8845ea-7301-4713-a274-80746346f5d8 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:29.577150 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 229/447] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:29.577981 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8845ea-7301-4713-a274-80746346f5d8 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:29.611436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eba510-ae4c-415a-8128-8c48b2e7c13f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:29.614070 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:29.656608 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c2cbb-e20b-4ea3-abf7-942eba32e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:29.657660 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2cbb-e20b-4ea3-abf7-942eba32e757 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:29.658057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2cbb-e20b-4ea3-abf7-942eba32e757 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:29.658336 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2cbb-e20b-4ea3-abf7-942eba32e757 None admin] PATH_INFO: `/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:29.660118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c2cbb-e20b-4ea3-abf7-942eba32e757 None admin] RBAC: Authorizing `identity:get_project(project_id=72282c5cb5cb4eb792a0e612a389ee4e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:29.661861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c2cbb-e20b-4ea3-abf7-942eba32e757 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:29.663803 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 219/448] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:29 2022] GET /identity/v3/projects/72282c5cb5cb4eb792a0e612a389ee4e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:29.664457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c2cbb-e20b-4ea3-abf7-942eba32e757 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:29.691988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8845ea-7301-4713-a274-80746346f5d8 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:29.732112 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa2328-9ae5-4921-951e-67c98050954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:29.732773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa2328-9ae5-4921-951e-67c98050954a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:29.733054 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa2328-9ae5-4921-951e-67c98050954a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:29.733753 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa2328-9ae5-4921-951e-67c98050954a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:29.734167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa2328-9ae5-4921-951e-67c98050954a None admin] RBAC: Adding query filter params (group.id=477cc74912d1491881b1dd89737e141c, role.id=4876e759b9504964a874992dc66b6df1, scope.project.id=d9b28400715c475eb364b4a9afdd6046) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:29.734474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa2328-9ae5-4921-951e-67c98050954a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:29.735955 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa2328-9ae5-4921-951e-67c98050954a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:29.742052 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 230/449] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:03:29 2022] GET /identity/v3/role_assignments?group.id=477cc74912d1491881b1dd89737e141c&scope.project.id=d9b28400715c475eb364b4a9afdd6046&role.id=4876e759b9504964a874992dc66b6df1 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:29.742883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa2328-9ae5-4921-951e-67c98050954a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:29.753866 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:29.792296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c2cbb-e20b-4ea3-abf7-942eba32e757 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:29.847736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db1fe-da63-4dee-a28e-dccb41322934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:29.848769 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db1fe-da63-4dee-a28e-dccb41322934 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:29.848769 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db1fe-da63-4dee-a28e-dccb41322934 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:29.849151 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db1fe-da63-4dee-a28e-dccb41322934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:29.888497 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa2328-9ae5-4921-951e-67c98050954a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:29.904485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:29.930062 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a54bb3-d798-4ec5-8107-fc4964e2eb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:29.930886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a54bb3-d798-4ec5-8107-fc4964e2eb6b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:29.931174 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a54bb3-d798-4ec5-8107-fc4964e2eb6b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:29.931567 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a54bb3-d798-4ec5-8107-fc4964e2eb6b None admin] PATH_INFO: `/v3/groups/477cc74912d1491881b1dd89737e141c` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:29.932832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a54bb3-d798-4ec5-8107-fc4964e2eb6b None admin] RBAC: Authorizing `identity:get_group(group_id=477cc74912d1491881b1dd89737e141c)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:29.934917 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a54bb3-d798-4ec5-8107-fc4964e2eb6b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:29.936628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 231/450] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:29 2022] GET /identity/v3/groups/477cc74912d1491881b1dd89737e141c => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:29.937549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98db1fe-da63-4dee-a28e-dccb41322934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:29.939120 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98db1fe-da63-4dee-a28e-dccb41322934 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:29.942434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a54bb3-d798-4ec5-8107-fc4964e2eb6b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:30.045772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:30.081270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 220/451] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:30.086479 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a54bb3-d798-4ec5-8107-fc4964e2eb6b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:30.087101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db1fe-da63-4dee-a28e-dccb41322934 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:30.131461 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bef8de-386b-4a20-bc62-066a8164083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:30.132686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bef8de-386b-4a20-bc62-066a8164083e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:30.133184 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bef8de-386b-4a20-bc62-066a8164083e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:30.133664 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bef8de-386b-4a20-bc62-066a8164083e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:30.134536 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bef8de-386b-4a20-bc62-066a8164083e None admin] RBAC: Adding query filter params (group.id=477cc74912d1491881b1dd89737e141c, role.id=4876e759b9504964a874992dc66b6df1, scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:30.134867 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bef8de-386b-4a20-bc62-066a8164083e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:30.136326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bef8de-386b-4a20-bc62-066a8164083e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:30.142946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 232/452] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:03:29 2022] GET /identity/v3/role_assignments?group.id=477cc74912d1491881b1dd89737e141c&scope.project.id=72282c5cb5cb4eb792a0e612a389ee4e&role.id=4876e759b9504964a874992dc66b6df1 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:30.195177 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:30.248084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db1fe-da63-4dee-a28e-dccb41322934 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:30.291207 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eee13-7a7f-47d7-9006-98f7913a8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:30.292127 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eee13-7a7f-47d7-9006-98f7913a8baa None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:30.292410 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eee13-7a7f-47d7-9006-98f7913a8baa None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:30.292690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eee13-7a7f-47d7-9006-98f7913a8baa None admin] PATH_INFO: `/v3/projects/40e10dfaa67a4db08ea8ec190c3b285d` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:30.294134 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374eee13-7a7f-47d7-9006-98f7913a8baa None admin] RBAC: Authorizing `identity:get_project(project_id=40e10dfaa67a4db08ea8ec190c3b285d)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:30.295686 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374eee13-7a7f-47d7-9006-98f7913a8baa None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:30.297536 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 221/453] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:03:30 2022] GET /identity/v3/projects/40e10dfaa67a4db08ea8ec190c3b285d => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:30.303663 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bef8de-386b-4a20-bc62-066a8164083e None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:30.431840 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bef8de-386b-4a20-bc62-066a8164083e None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:30.470263 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16e55c-709c-414a-b911-ec1158e8b443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:30.471091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e55c-709c-414a-b911-ec1158e8b443 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:30.471372 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e55c-709c-414a-b911-ec1158e8b443 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:30.471644 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e55c-709c-414a-b911-ec1158e8b443 None admin] PATH_INFO: `/v3/groups/c0a4f537e6cb474b9ce6e5c9e3491888` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:30.472883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16e55c-709c-414a-b911-ec1158e8b443 None admin] RBAC: Authorizing `identity:get_group(group_id=c0a4f537e6cb474b9ce6e5c9e3491888)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:30.474345 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16e55c-709c-414a-b911-ec1158e8b443 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:30.476073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 233/454] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:03:30 2022] GET /identity/v3/groups/c0a4f537e6cb474b9ce6e5c9e3491888 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:30.482735 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eee13-7a7f-47d7-9006-98f7913a8baa None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:30.597633 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eee13-7a7f-47d7-9006-98f7913a8baa None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:30.631905 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b06dc-e0a3-4395-a739-525fa5c6f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:30.632564 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b06dc-e0a3-4395-a739-525fa5c6f494 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:30.632850 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b06dc-e0a3-4395-a739-525fa5c6f494 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:30.633127 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b06dc-e0a3-4395-a739-525fa5c6f494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:30.633971 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b06dc-e0a3-4395-a739-525fa5c6f494 None admin] RBAC: Adding query filter params (group.id=c0a4f537e6cb474b9ce6e5c9e3491888, role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=40e10dfaa67a4db08ea8ec190c3b285d) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:30.634283 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b06dc-e0a3-4395-a739-525fa5c6f494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:30.635762 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b06dc-e0a3-4395-a739-525fa5c6f494 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:30.641921 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 222/455] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:03:30 2022] GET /identity/v3/role_assignments?group.id=c0a4f537e6cb474b9ce6e5c9e3491888&scope.project.id=40e10dfaa67a4db08ea8ec190c3b285d&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:33.503816 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95d97-580c-42a2-9543-30148e4dfabb None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:33.504328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95d97-580c-42a2-9543-30148e4dfabb None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:33.504328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95d97-580c-42a2-9543-30148e4dfabb None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:33.505987 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 234/456] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:33.511571 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613ac6-cef8-4221-9d58-793a99853e85 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:33.512143 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613ac6-cef8-4221-9d58-793a99853e85 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:33.512252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613ac6-cef8-4221-9d58-793a99853e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:33.518776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:33.535898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-4d613ac6-cef8-4221-9d58-793a99853e85 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:33.537147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-4d613ac6-cef8-4221-9d58-793a99853e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:33.636499 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 223/457] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:33.673839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b95d97-580c-42a2-9543-30148e4dfabb None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:33.686719 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:33.807477 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b95d97-580c-42a2-9543-30148e4dfabb None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:33.842437 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a890d2-9d72-4fc9-b85e-9e3ccb8cc26e None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:33.843003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a890d2-9d72-4fc9-b85e-9e3ccb8cc26e None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:33.843467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a890d2-9d72-4fc9-b85e-9e3ccb8cc26e None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:33.845346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 224/458] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:33.856243 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d33d7-b40b-48aa-b1bc-36a0bda751ce None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:33.856528 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d33d7-b40b-48aa-b1bc-36a0bda751ce None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:33.856810 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d33d7-b40b-48aa-b1bc-36a0bda751ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:33.865260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8220b95-e2f5-4d97-8f5c-6aacbefcdd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:33.866734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8220b95-e2f5-4d97-8f5c-6aacbefcdd64 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:33.867072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8220b95-e2f5-4d97-8f5c-6aacbefcdd64 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:33.867362 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8220b95-e2f5-4d97-8f5c-6aacbefcdd64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:33.883408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-171d33d7-b40b-48aa-b1bc-36a0bda751ce None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:33.883643 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8220b95-e2f5-4d97-8f5c-6aacbefcdd64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:33.884660 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-171d33d7-b40b-48aa-b1bc-36a0bda751ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:33.885066 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8220b95-e2f5-4d97-8f5c-6aacbefcdd64 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-b8220b95-e2f5-4d97-8f5c-6aacbefcdd64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:33.906501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:33.907619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:33.908605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:33.908605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:33.908605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:33.908605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:33.912977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 235/459] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:33.914527 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b2a3d-9358-4904-a9e9-d889f41dfc43 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:33.914847 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b2a3d-9358-4904-a9e9-d889f41dfc43 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:33.915128 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b2a3d-9358-4904-a9e9-d889f41dfc43 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:33.916879 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 236/460] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:33.918144 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b2a3d-9358-4904-a9e9-d889f41dfc43 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:33.972440 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 225/461] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:03:33.973822 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede065fe-d9d4-45ed-9606-0cb334a3c13f None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:33.974122 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede065fe-d9d4-45ed-9606-0cb334a3c13f None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:33.974400 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede065fe-d9d4-45ed-9606-0cb334a3c13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:33.990794 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:33.998171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-ede065fe-d9d4-45ed-9606-0cb334a3c13f None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:34.000134 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-ede065fe-d9d4-45ed-9606-0cb334a3c13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:34.040918 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b2a3d-9358-4904-a9e9-d889f41dfc43 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:34.099104 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5031a-b63d-4399-bde6-65daafa403a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:34.099795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5031a-b63d-4399-bde6-65daafa403a4 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:34.100180 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5031a-b63d-4399-bde6-65daafa403a4 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:34.100494 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:34.100619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5031a-b63d-4399-bde6-65daafa403a4 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:34.101388 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5031a-b63d-4399-bde6-65daafa403a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:34.101707 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5031a-b63d-4399-bde6-65daafa403a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:34.103166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5031a-b63d-4399-bde6-65daafa403a4 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:34.110014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 226/462] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:34.111006 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede065fe-d9d4-45ed-9606-0cb334a3c13f None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:34.124472 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 237/463] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:34.126344 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c5522-a8a8-46b0-8b5f-6eb22ce83910 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:34.126961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c5522-a8a8-46b0-8b5f-6eb22ce83910 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:34.127471 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c5522-a8a8-46b0-8b5f-6eb22ce83910 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:34.129333 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 238/464] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:34.135180 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c5522-a8a8-46b0-8b5f-6eb22ce83910 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:34.262434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede065fe-d9d4-45ed-9606-0cb334a3c13f None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:34.279576 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c5522-a8a8-46b0-8b5f-6eb22ce83910 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:34.303421 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675275fa-8bd6-4606-9c04-563f077987d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:34.304233 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675275fa-8bd6-4606-9c04-563f077987d6 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:34.304514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675275fa-8bd6-4606-9c04-563f077987d6 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:34.304789 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675275fa-8bd6-4606-9c04-563f077987d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:34.311479 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:34.317910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675275fa-8bd6-4606-9c04-563f077987d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:34.319443 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675275fa-8bd6-4606-9c04-563f077987d6 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:34.330278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824bebb-d780-45b4-9546-58cd5854e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:34.330997 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824bebb-d780-45b4-9546-58cd5854e4fc None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:34.331277 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824bebb-d780-45b4-9546-58cd5854e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:34.331549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824bebb-d780-45b4-9546-58cd5854e4fc None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:34.332272 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824bebb-d780-45b4-9546-58cd5854e4fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:34.333748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824bebb-d780-45b4-9546-58cd5854e4fc None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-675275fa-8bd6-4606-9c04-563f077987d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:34.339082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:34.340984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:34.341972 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:34.341972 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:34.341972 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:34.341972 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:34.341972 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 227/465] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:34.343307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b577-21e5-4449-92e7-58ae0c8fb670 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:34.343598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b577-21e5-4449-92e7-58ae0c8fb670 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:34.343879 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b577-21e5-4449-92e7-58ae0c8fb670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:34.365519 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-a0e3b577-21e5-4449-92e7-58ae0c8fb670 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:34.366755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-a0e3b577-21e5-4449-92e7-58ae0c8fb670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:34.416327 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:34.445187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 228/466] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:34.446487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b577-21e5-4449-92e7-58ae0c8fb670 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:34.450778 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 239/467] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:03:34 2022] POST /identity/v3/users => generated 246 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:03:34.452068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824bebb-d780-45b4-9546-58cd5854e4fc None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:34.604274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b577-21e5-4449-92e7-58ae0c8fb670 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:34.627878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824bebb-d780-45b4-9546-58cd5854e4fc None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:34.653718 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799a540-babc-4145-94d4-406361c859ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:34.654525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799a540-babc-4145-94d4-406361c859ea None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:34.654840 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799a540-babc-4145-94d4-406361c859ea None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:34.655113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799a540-babc-4145-94d4-406361c859ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:34.667828 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799a540-babc-4145-94d4-406361c859ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:34.669330 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799a540-babc-4145-94d4-406361c859ea None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:34.673576 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39875743-e4e0-45ba-9df5-88fdabffe782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:34.674253 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875743-e4e0-45ba-9df5-88fdabffe782 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:34.674536 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875743-e4e0-45ba-9df5-88fdabffe782 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:34.674888 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875743-e4e0-45ba-9df5-88fdabffe782 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:34.675654 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39875743-e4e0-45ba-9df5-88fdabffe782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:34.675962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39875743-e4e0-45ba-9df5-88fdabffe782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:34.677675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39875743-e4e0-45ba-9df5-88fdabffe782 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-8799a540-babc-4145-94d4-406361c859ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:34.689299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:34.690352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:34.691396 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:34.691396 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:34.691396 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:34.691396 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:34.691396 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 229/468] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:34.691723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799a540-babc-4145-94d4-406361c859ea None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:34.694721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 240/469] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:34.697670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39875743-e4e0-45ba-9df5-88fdabffe782 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:34.736269 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:34.748547 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:34.827100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799a540-babc-4145-94d4-406361c859ea None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:34.828359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39875743-e4e0-45ba-9df5-88fdabffe782 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:34.866657 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e88af-1acb-43f7-820d-3ddf01f8fb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:34.867548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e88af-1acb-43f7-820d-3ddf01f8fb42 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:34.867833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e88af-1acb-43f7-820d-3ddf01f8fb42 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:34.868113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e88af-1acb-43f7-820d-3ddf01f8fb42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:34.877190 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085732b-6791-4eec-bb45-4c8f99b4f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:34.878203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085732b-6791-4eec-bb45-4c8f99b4f8ef None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:34.879169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085732b-6791-4eec-bb45-4c8f99b4f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:34.879675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085732b-6791-4eec-bb45-4c8f99b4f8ef None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:34.880845 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085732b-6791-4eec-bb45-4c8f99b4f8ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:34.880962 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e88af-1acb-43f7-820d-3ddf01f8fb42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:34.882483 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e88af-1acb-43f7-820d-3ddf01f8fb42 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:34.882937 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085732b-6791-4eec-bb45-4c8f99b4f8ef None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-775e88af-1acb-43f7-820d-3ddf01f8fb42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:34.901796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:34.903623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:34.904629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:34.904629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:34.904629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:34.904629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:34.904629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 230/470] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:34.906764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e88af-1acb-43f7-820d-3ddf01f8fb42 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:34.988283 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:34.993697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 241/471] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:03:34 2022] POST /identity/v3/users => generated 248 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:03:34.995118 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf17c8-24af-4cfd-a141-d969766cb94e None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:34.995413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf17c8-24af-4cfd-a141-d969766cb94e None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:34.995691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf17c8-24af-4cfd-a141-d969766cb94e None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:34.997316 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 242/472] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:35.002256 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf17c8-24af-4cfd-a141-d969766cb94e None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:35.030575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e88af-1acb-43f7-820d-3ddf01f8fb42 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:35.083907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac620fae-737f-49d2-b42e-4b9aff354963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:35.084884 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620fae-737f-49d2-b42e-4b9aff354963 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.085167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620fae-737f-49d2-b42e-4b9aff354963 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.085442 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620fae-737f-49d2-b42e-4b9aff354963 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:35.086462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac620fae-737f-49d2-b42e-4b9aff354963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:35.087282 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac620fae-737f-49d2-b42e-4b9aff354963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:35.089344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac620fae-737f-49d2-b42e-4b9aff354963 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:35.115085 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 231/473] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:35.116308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a6a85-c648-4733-a17d-541409c642fa None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.116629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a6a85-c648-4733-a17d-541409c642fa None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.116903 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a6a85-c648-4733-a17d-541409c642fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:35.133946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:35.145998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-5c8a6a85-c648-4733-a17d-541409c642fa None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:35.149163 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-5c8a6a85-c648-4733-a17d-541409c642fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:35.150570 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf17c8-24af-4cfd-a141-d969766cb94e None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:35.204243 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dfcbb-926e-4fbd-9399-105e188a2bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:35.204988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dfcbb-926e-4fbd-9399-105e188a2bdd None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.205274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dfcbb-926e-4fbd-9399-105e188a2bdd None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.205556 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dfcbb-926e-4fbd-9399-105e188a2bdd None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:35.206432 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dfcbb-926e-4fbd-9399-105e188a2bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:35.206711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dfcbb-926e-4fbd-9399-105e188a2bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:35.208134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dfcbb-926e-4fbd-9399-105e188a2bdd None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:35.223245 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 243/474] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:35.224937 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dfcbb-926e-4fbd-9399-105e188a2bdd None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:35.252304 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 232/475] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:35.252975 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a6a85-c648-4733-a17d-541409c642fa None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:35.345091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:35.372141 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dfcbb-926e-4fbd-9399-105e188a2bdd None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:35.380154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a6a85-c648-4733-a17d-541409c642fa None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:35.417542 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85efa1-77cb-479e-97f2-07f4869cedb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:35.419184 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85efa1-77cb-479e-97f2-07f4869cedb2 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.419683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85efa1-77cb-479e-97f2-07f4869cedb2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.420197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85efa1-77cb-479e-97f2-07f4869cedb2 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:35.421163 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85efa1-77cb-479e-97f2-07f4869cedb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:35.422915 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85efa1-77cb-479e-97f2-07f4869cedb2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:35.425348 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758823ca-edf9-4560-8af8-89f9c510ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:35.426037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758823ca-edf9-4560-8af8-89f9c510ecd8 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.426692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758823ca-edf9-4560-8af8-89f9c510ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.426982 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758823ca-edf9-4560-8af8-89f9c510ecd8 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:35.427706 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758823ca-edf9-4560-8af8-89f9c510ecd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:35.429149 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758823ca-edf9-4560-8af8-89f9c510ecd8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:35.538694 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 244/476] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:03:35 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:03:35.538694 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85efa1-77cb-479e-97f2-07f4869cedb2 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:35.550412 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:35.570792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 233/477] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:03:35 2022] POST /identity/v3/users => generated 249 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:03:35.692526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85efa1-77cb-479e-97f2-07f4869cedb2 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:35.745462 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3bfef-046b-488a-bceb-f8f461f8ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:35.746239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3bfef-046b-488a-bceb-f8f461f8ee94 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.746522 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3bfef-046b-488a-bceb-f8f461f8ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.746825 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3bfef-046b-488a-bceb-f8f461f8ee94 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:35.747901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3bfef-046b-488a-bceb-f8f461f8ee94 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:35.749507 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3bfef-046b-488a-bceb-f8f461f8ee94 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:35.799050 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.sql.core [None req-f3a3bfef-046b-488a-bceb-f8f461f8ee94 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:03:35.799050 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 20:03:35.799050 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [parameters: {'id': 'b256ea278cdd478891af9847430af624', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 20:03:35.799050 dv-cinder-841302-4-smb devstack@keystone.service[156425]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=156425) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-f3a3bfef-046b-488a-bceb-f8f461f8ee94 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application conn.query(q) May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application result.read() May 19 20:03:35.817989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return ref.to_dict() May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:03:35.819558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application next(self.gen) May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application yield resource May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application next(self.gen) May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise self.value May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application session.commit() May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:03:35.821073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self.session.flush() May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application compat.raise_( May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:03:35.822260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:03:35.823680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application conn.query(q) May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application result.read() May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:03:35.825503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [parameters: {'id': 'b256ea278cdd478891af9847430af624', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:35.827808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 20:03:35.829122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:35.830380 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 245/478] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:03:35 2022] POST /identity/v3/roles => generated 144 bytes in 288 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:35.836142 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758823ca-edf9-4560-8af8-89f9c510ecd8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:35.953563 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758823ca-edf9-4560-8af8-89f9c510ecd8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:35.983466 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:35.992714 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef063b74-3bc3-4c6a-94df-60088af0b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:35.994738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063b74-3bc3-4c6a-94df-60088af0b276 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.994738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063b74-3bc3-4c6a-94df-60088af0b276 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.994738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063b74-3bc3-4c6a-94df-60088af0b276 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:36.006769 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef063b74-3bc3-4c6a-94df-60088af0b276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-ef063b74-3bc3-4c6a-94df-60088af0b276 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:36.016408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:36.017656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:03:36.018724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:36.021706 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 234/479] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:03:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:36.028003 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3bfef-046b-488a-bceb-f8f461f8ee94 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:36.107247 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:36.141457 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3bfef-046b-488a-bceb-f8f461f8ee94 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:36.179925 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023bd57-0625-467e-a80c-cd5e37c418db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:36.180856 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023bd57-0625-467e-a80c-cd5e37c418db None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:36.181309 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023bd57-0625-467e-a80c-cd5e37c418db None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:36.181768 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023bd57-0625-467e-a80c-cd5e37c418db None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:36.182719 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023bd57-0625-467e-a80c-cd5e37c418db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:36.183335 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023bd57-0625-467e-a80c-cd5e37c418db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:36.185432 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023bd57-0625-467e-a80c-cd5e37c418db None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:36.198217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 246/480] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:37.111618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8c212-4fe0-4d81-9467-90747ff9fefb None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:37.112521 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8c212-4fe0-4d81-9467-90747ff9fefb None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:37.112954 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8c212-4fe0-4d81-9467-90747ff9fefb None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:37.114850 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 235/481] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:37.120032 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02371f-7b2f-41aa-8ab2-cdc47e373375 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:37.120956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02371f-7b2f-41aa-8ab2-cdc47e373375 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:37.121473 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02371f-7b2f-41aa-8ab2-cdc47e373375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:37.147632 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-9c02371f-7b2f-41aa-8ab2-cdc47e373375 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:37.149186 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-9c02371f-7b2f-41aa-8ab2-cdc47e373375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:37.244424 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 247/482] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:37.268639 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8c212-4fe0-4d81-9467-90747ff9fefb None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:37.404600 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8c212-4fe0-4d81-9467-90747ff9fefb None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:37.458000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326d205-f848-4db8-950c-8bbe711ba897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:37.458829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d205-f848-4db8-950c-8bbe711ba897 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:37.459109 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d205-f848-4db8-950c-8bbe711ba897 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:37.459379 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d205-f848-4db8-950c-8bbe711ba897 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:37.475739 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326d205-f848-4db8-950c-8bbe711ba897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-8326d205-f848-4db8-950c-8bbe711ba897 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:37.483481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:37.484485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:37.485388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:37.487595 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 236/483] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:37.492439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02371f-7b2f-41aa-8ab2-cdc47e373375 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:37.583690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:37.599192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096dec6b-a448-4597-8aa5-77434298373e None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:37.600519 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096dec6b-a448-4597-8aa5-77434298373e None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:37.600519 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096dec6b-a448-4597-8aa5-77434298373e None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:37.601371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 237/484] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:37.607038 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f356eb-8b4d-4a03-b9b2-0a681eaa9d37 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:37.607324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f356eb-8b4d-4a03-b9b2-0a681eaa9d37 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:37.607606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f356eb-8b4d-4a03-b9b2-0a681eaa9d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:37.631099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-59f356eb-8b4d-4a03-b9b2-0a681eaa9d37 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:37.632300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-59f356eb-8b4d-4a03-b9b2-0a681eaa9d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:37.651199 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02371f-7b2f-41aa-8ab2-cdc47e373375 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:37.689888 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbdbcc-923f-4e74-a129-992158f07821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:37.690458 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbdbcc-923f-4e74-a129-992158f07821 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:37.690774 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbdbcc-923f-4e74-a129-992158f07821 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:37.691054 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbdbcc-923f-4e74-a129-992158f07821 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:37.694627 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbdbcc-923f-4e74-a129-992158f07821 None admin] RBAC: Adding query filter params (name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:37.694627 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbdbcc-923f-4e74-a129-992158f07821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:37.694627 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbdbcc-923f-4e74-a129-992158f07821 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:37.703847 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 248/485] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:37.717379 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbdbcc-923f-4e74-a129-992158f07821 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:37.722158 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:37.792316 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 238/486] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:03:37.827734 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f356eb-8b4d-4a03-b9b2-0a681eaa9d37 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:37.832318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbdbcc-923f-4e74-a129-992158f07821 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:37.858590 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:37.874631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44591d16-0e3c-46ae-a44c-e7c397d64fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:37.874631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44591d16-0e3c-46ae-a44c-e7c397d64fc0 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:37.874631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44591d16-0e3c-46ae-a44c-e7c397d64fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:37.874631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44591d16-0e3c-46ae-a44c-e7c397d64fc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:37.884812 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44591d16-0e3c-46ae-a44c-e7c397d64fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:37.886302 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44591d16-0e3c-46ae-a44c-e7c397d64fc0 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-44591d16-0e3c-46ae-a44c-e7c397d64fc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:37.905895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:37.906947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:37.908016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:37.908016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:37.908016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:37.908016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:37.908016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 249/487] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:37.915206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44591d16-0e3c-46ae-a44c-e7c397d64fc0 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:38.066678 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44591d16-0e3c-46ae-a44c-e7c397d64fc0 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:38.086516 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f356eb-8b4d-4a03-b9b2-0a681eaa9d37 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:38.104064 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc58d82-3eca-4ecc-b70f-e56833edffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:38.104766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58d82-3eca-4ecc-b70f-e56833edffe1 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.105053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58d82-3eca-4ecc-b70f-e56833edffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.106179 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58d82-3eca-4ecc-b70f-e56833edffe1 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.107204 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc58d82-3eca-4ecc-b70f-e56833edffe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:38.107628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc58d82-3eca-4ecc-b70f-e56833edffe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:38.109184 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc58d82-3eca-4ecc-b70f-e56833edffe1 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:38.124109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 250/488] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:38.134774 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc58d82-3eca-4ecc-b70f-e56833edffe1 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:38.156304 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699b14-403d-4b1e-a3be-f92ec3206c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:38.157124 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699b14-403d-4b1e-a3be-f92ec3206c0a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.157403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699b14-403d-4b1e-a3be-f92ec3206c0a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.157673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699b14-403d-4b1e-a3be-f92ec3206c0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.175878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:38.180509 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33699b14-403d-4b1e-a3be-f92ec3206c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-33699b14-403d-4b1e-a3be-f92ec3206c0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:38.196630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:38.197731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:38.198703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:38.202961 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 239/489] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:38.207594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699b14-403d-4b1e-a3be-f92ec3206c0a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:38.248631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc58d82-3eca-4ecc-b70f-e56833edffe1 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:38.267377 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:38.303121 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61779e36-1622-4fb6-8268-0445e56a410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:38.304038 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61779e36-1622-4fb6-8268-0445e56a410e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.304326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61779e36-1622-4fb6-8268-0445e56a410e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.304605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61779e36-1622-4fb6-8268-0445e56a410e None admin] PATH_INFO: `/v3/users/nova` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.313400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61779e36-1622-4fb6-8268-0445e56a410e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:38.315214 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61779e36-1622-4fb6-8268-0445e56a410e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-61779e36-1622-4fb6-8268-0445e56a410e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:38.333343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:38.334470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:38.335544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:38.335544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:38.335544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:38.335544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:38.335544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:38.335544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:38.335544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:38.335544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:38.335544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:03:38.335544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:38.335544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 251/490] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:03:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:38.340308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61779e36-1622-4fb6-8268-0445e56a410e None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:38.403062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699b14-403d-4b1e-a3be-f92ec3206c0a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:38.461348 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:38.468522 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61779e36-1622-4fb6-8268-0445e56a410e None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:38.470351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc692fca-b698-49ac-a4f4-f239bd69d647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:38.474820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc692fca-b698-49ac-a4f4-f239bd69d647 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.474820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc692fca-b698-49ac-a4f4-f239bd69d647 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.474820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc692fca-b698-49ac-a4f4-f239bd69d647 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.474820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc692fca-b698-49ac-a4f4-f239bd69d647 None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:38.474820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc692fca-b698-49ac-a4f4-f239bd69d647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:38.474820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc692fca-b698-49ac-a4f4-f239bd69d647 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:38.488761 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 240/491] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:38.490365 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f79d3-9ad5-485b-b300-7148ffd27a2e None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.490677 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f79d3-9ad5-485b-b300-7148ffd27a2e None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.490960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f79d3-9ad5-485b-b300-7148ffd27a2e None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.492729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 241/492] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:38.493545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f79d3-9ad5-485b-b300-7148ffd27a2e None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:38.509993 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecb188-2473-4399-815c-7b8295af9794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:38.510731 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecb188-2473-4399-815c-7b8295af9794 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.511021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecb188-2473-4399-815c-7b8295af9794 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.511309 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecb188-2473-4399-815c-7b8295af9794 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.512765 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecb188-2473-4399-815c-7b8295af9794 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:38.513080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecb188-2473-4399-815c-7b8295af9794 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:38.514572 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecb188-2473-4399-815c-7b8295af9794 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:38.554136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 252/493] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:03:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:38.559892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81b61-d139-4b23-96bb-145043014274 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.560192 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81b61-d139-4b23-96bb-145043014274 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.560471 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81b61-d139-4b23-96bb-145043014274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.582394 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-07e81b61-d139-4b23-96bb-145043014274 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:38.583856 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-07e81b61-d139-4b23-96bb-145043014274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:38.622839 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:38.630901 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f79d3-9ad5-485b-b300-7148ffd27a2e None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:38.677382 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 253/494] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:38.678559 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e81b61-d139-4b23-96bb-145043014274 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:38.681031 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaf70c-e28b-4569-8d11-195789c50c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:38.682398 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaf70c-e28b-4569-8d11-195789c50c16 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.683977 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaf70c-e28b-4569-8d11-195789c50c16 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.684522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaf70c-e28b-4569-8d11-195789c50c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.698704 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaf70c-e28b-4569-8d11-195789c50c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:38.702062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaf70c-e28b-4569-8d11-195789c50c16 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-faaaf70c-e28b-4569-8d11-195789c50c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:38.724894 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:38.726116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:38.728692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:38.728692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:38.728692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:38.728692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:38.728692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 242/495] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:38.728692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe153-028a-4f44-91f0-f1aaef4859b4 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.728692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe153-028a-4f44-91f0-f1aaef4859b4 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.728692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe153-028a-4f44-91f0-f1aaef4859b4 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.733929 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 243/496] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:38.733929 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efe153-028a-4f44-91f0-f1aaef4859b4 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:38.787151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:38.810305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e81b61-d139-4b23-96bb-145043014274 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:38.854802 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f863c-12eb-4aa1-b9c6-0a0ae2299a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:38.855202 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efe153-028a-4f44-91f0-f1aaef4859b4 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:38.855466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f863c-12eb-4aa1-b9c6-0a0ae2299a4c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.856273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f863c-12eb-4aa1-b9c6-0a0ae2299a4c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.856546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f863c-12eb-4aa1-b9c6-0a0ae2299a4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.899073 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d89420-db80-4e90-ac45-5c3615fbfe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:38.899868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d89420-db80-4e90-ac45-5c3615fbfe38 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.900151 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d89420-db80-4e90-ac45-5c3615fbfe38 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.900424 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d89420-db80-4e90-ac45-5c3615fbfe38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.914179 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d89420-db80-4e90-ac45-5c3615fbfe38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-37d89420-db80-4e90-ac45-5c3615fbfe38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:38.922040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:38.923252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 244/497] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:38.924223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d89420-db80-4e90-ac45-5c3615fbfe38 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:38.938269 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:38.940789 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f863c-12eb-4aa1-b9c6-0a0ae2299a4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:38.942452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f863c-12eb-4aa1-b9c6-0a0ae2299a4c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:39.035845 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d89420-db80-4e90-ac45-5c3615fbfe38 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:39.036923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:39.060662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 254/498] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:39.060662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf156b0-55a9-46b8-885c-e0839b89d253 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.060662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf156b0-55a9-46b8-885c-e0839b89d253 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.060662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf156b0-55a9-46b8-885c-e0839b89d253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.072030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa687-8f46-4224-9fe1-1ba9104306dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:39.072698 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa687-8f46-4224-9fe1-1ba9104306dc None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.072983 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa687-8f46-4224-9fe1-1ba9104306dc None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.073261 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa687-8f46-4224-9fe1-1ba9104306dc None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.073982 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aa687-8f46-4224-9fe1-1ba9104306dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:39.074873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aa687-8f46-4224-9fe1-1ba9104306dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:39.076271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aa687-8f46-4224-9fe1-1ba9104306dc None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:39.079648 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-ccf156b0-55a9-46b8-885c-e0839b89d253 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:39.081151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-ccf156b0-55a9-46b8-885c-e0839b89d253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:39.092918 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 245/499] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:39.092918 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa687-8f46-4224-9fe1-1ba9104306dc None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:39.170690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 255/500] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:39.172278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf156b0-55a9-46b8-885c-e0839b89d253 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:39.185345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:39.229364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa687-8f46-4224-9fe1-1ba9104306dc None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:39.274415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42239f0-41cb-4186-8f44-05c082590bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:39.275129 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42239f0-41cb-4186-8f44-05c082590bb5 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.275417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42239f0-41cb-4186-8f44-05c082590bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.275695 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42239f0-41cb-4186-8f44-05c082590bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.276453 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42239f0-41cb-4186-8f44-05c082590bb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:39.277330 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42239f0-41cb-4186-8f44-05c082590bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:39.279283 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42239f0-41cb-4186-8f44-05c082590bb5 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:39.288721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 246/501] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:39.289417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42239f0-41cb-4186-8f44-05c082590bb5 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:39.295905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf156b0-55a9-46b8-885c-e0839b89d253 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:39.311230 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:39.333352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f4914-a667-40b4-b27f-3e228706302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:39.334148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f4914-a667-40b4-b27f-3e228706302b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.334435 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f4914-a667-40b4-b27f-3e228706302b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.334760 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f4914-a667-40b4-b27f-3e228706302b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.346013 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f4914-a667-40b4-b27f-3e228706302b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:39.347506 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f4914-a667-40b4-b27f-3e228706302b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-992f4914-a667-40b4-b27f-3e228706302b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:39.365640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:39.366878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:39.367844 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:39.367844 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:39.367844 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:39.367844 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:39.367844 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 256/502] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:39.367844 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f4914-a667-40b4-b27f-3e228706302b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:39.396467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42239f0-41cb-4186-8f44-05c082590bb5 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:39.425815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:39.431066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf36de2-e879-47fb-bc0c-37a450a52f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:39.431875 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf36de2-e879-47fb-bc0c-37a450a52f36 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.432163 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf36de2-e879-47fb-bc0c-37a450a52f36 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.432444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf36de2-e879-47fb-bc0c-37a450a52f36 None admin] PATH_INFO: `/v3/users/glance` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.440847 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf36de2-e879-47fb-bc0c-37a450a52f36 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:39.442294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf36de2-e879-47fb-bc0c-37a450a52f36 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-ccf36de2-e879-47fb-bc0c-37a450a52f36 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:39.460350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:39.461673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 247/503] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:39.463042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf36de2-e879-47fb-bc0c-37a450a52f36 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:39.474975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f4914-a667-40b4-b27f-3e228706302b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:39.508572 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40055a7-6d4a-4d48-b11c-cbc06815feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:39.509369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40055a7-6d4a-4d48-b11c-cbc06815feb7 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.509650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40055a7-6d4a-4d48-b11c-cbc06815feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.509932 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40055a7-6d4a-4d48-b11c-cbc06815feb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.520897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40055a7-6d4a-4d48-b11c-cbc06815feb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-c40055a7-6d4a-4d48-b11c-cbc06815feb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:39.529221 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:39.530361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:39.531318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 257/504] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:39.532090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2d5d9-eca5-4f0b-b297-094e63d2aa78 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.532090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2d5d9-eca5-4f0b-b297-094e63d2aa78 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.532362 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2d5d9-eca5-4f0b-b297-094e63d2aa78 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.537599 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 258/505] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:39.537599 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2d5d9-eca5-4f0b-b297-094e63d2aa78 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:39.563235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:39.568203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf36de2-e879-47fb-bc0c-37a450a52f36 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:39.602195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7f16-185c-465e-9d71-55a1ade9230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:39.603034 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7f16-185c-465e-9d71-55a1ade9230e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.603317 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7f16-185c-465e-9d71-55a1ade9230e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.603595 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7f16-185c-465e-9d71-55a1ade9230e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.615020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa7f16-185c-465e-9d71-55a1ade9230e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:39.616546 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa7f16-185c-465e-9d71-55a1ade9230e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-10fa7f16-185c-465e-9d71-55a1ade9230e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:39.635419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:39.637490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:39.638500 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:39.638500 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:39.638500 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:39.638500 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:39.638500 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 248/506] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:39.638500 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7f16-185c-465e-9d71-55a1ade9230e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:39.649834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2d5d9-eca5-4f0b-b297-094e63d2aa78 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:39.687377 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aa720-c659-4ca3-9d6d-732422b38b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:39.687965 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aa720-c659-4ca3-9d6d-732422b38b2c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.688141 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:39.688249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aa720-c659-4ca3-9d6d-732422b38b2c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.688507 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aa720-c659-4ca3-9d6d-732422b38b2c None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.689251 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817aa720-c659-4ca3-9d6d-732422b38b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:39.689562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817aa720-c659-4ca3-9d6d-732422b38b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:39.691008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817aa720-c659-4ca3-9d6d-732422b38b2c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:39.704557 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 259/507] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:39.706879 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aa720-c659-4ca3-9d6d-732422b38b2c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:39.748531 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7f16-185c-465e-9d71-55a1ade9230e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:39.784839 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543a948-739c-4dfe-b29e-f7ee4bb7e7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:39.785539 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543a948-739c-4dfe-b29e-f7ee4bb7e7c9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.785827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543a948-739c-4dfe-b29e-f7ee4bb7e7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.786111 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543a948-739c-4dfe-b29e-f7ee4bb7e7c9 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.787003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543a948-739c-4dfe-b29e-f7ee4bb7e7c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:39.787320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543a948-739c-4dfe-b29e-f7ee4bb7e7c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:39.788788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543a948-739c-4dfe-b29e-f7ee4bb7e7c9 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:39.802334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:39.818233 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aa720-c659-4ca3-9d6d-732422b38b2c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:39.827998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 249/508] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:03:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:39.829310 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aca0a9-4394-4a22-8c7e-8ac950cd05be None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.829604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aca0a9-4394-4a22-8c7e-8ac950cd05be None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.829884 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aca0a9-4394-4a22-8c7e-8ac950cd05be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.846851 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-14aca0a9-4394-4a22-8c7e-8ac950cd05be None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:39.848080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-14aca0a9-4394-4a22-8c7e-8ac950cd05be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:39.865658 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9bc55-3405-4830-9a88-594963b22b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:39.866334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9bc55-3405-4830-9a88-594963b22b55 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:39.866626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9bc55-3405-4830-9a88-594963b22b55 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:39.866918 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9bc55-3405-4830-9a88-594963b22b55 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:39.867679 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9bc55-3405-4830-9a88-594963b22b55 None admin] RBAC: Adding query filter params (name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:39.867999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9bc55-3405-4830-9a88-594963b22b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:39.869373 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9bc55-3405-4830-9a88-594963b22b55 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:39.878397 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 260/509] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:39.879281 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9bc55-3405-4830-9a88-594963b22b55 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:39.926530 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 250/510] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:39.927582 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aca0a9-4394-4a22-8c7e-8ac950cd05be None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:39.963994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:40.012732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9bc55-3405-4830-9a88-594963b22b55 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:40.042576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aca0a9-4394-4a22-8c7e-8ac950cd05be None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:40.047283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9740c5b-bad7-4d75-8530-f1ca9b9ffce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:40.047954 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9740c5b-bad7-4d75-8530-f1ca9b9ffce9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.048234 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9740c5b-bad7-4d75-8530-f1ca9b9ffce9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.048511 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9740c5b-bad7-4d75-8530-f1ca9b9ffce9 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.049244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9740c5b-bad7-4d75-8530-f1ca9b9ffce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:40.049555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9740c5b-bad7-4d75-8530-f1ca9b9ffce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:40.050976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9740c5b-bad7-4d75-8530-f1ca9b9ffce9 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:40.064362 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 261/511] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:40.065199 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9740c5b-bad7-4d75-8530-f1ca9b9ffce9 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:40.075912 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:40.079640 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3804b3-0046-4322-b2d1-8cff2fead3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:40.080457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3804b3-0046-4322-b2d1-8cff2fead3d0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.080742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3804b3-0046-4322-b2d1-8cff2fead3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.081022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3804b3-0046-4322-b2d1-8cff2fead3d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.088172 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3804b3-0046-4322-b2d1-8cff2fead3d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:40.089997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3804b3-0046-4322-b2d1-8cff2fead3d0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-0f3804b3-0046-4322-b2d1-8cff2fead3d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:40.104716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:40.106717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:40.107741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:40.107741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:40.107741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:40.107741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:40.107741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:40.107741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:40.107741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:40.107741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:40.107741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 251/512] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:40.108307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3804b3-0046-4322-b2d1-8cff2fead3d0 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:40.170821 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9740c5b-bad7-4d75-8530-f1ca9b9ffce9 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:40.201699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:40.205607 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a0f0e-9ede-4fea-b23d-7ddac7398cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:40.206289 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a0f0e-9ede-4fea-b23d-7ddac7398cd9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.206571 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a0f0e-9ede-4fea-b23d-7ddac7398cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.206885 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a0f0e-9ede-4fea-b23d-7ddac7398cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.211054 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3804b3-0046-4322-b2d1-8cff2fead3d0 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:40.246016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b34947-fecc-42d0-87a2-763192b06fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:40.247433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b34947-fecc-42d0-87a2-763192b06fab None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.247719 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b34947-fecc-42d0-87a2-763192b06fab None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.247996 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b34947-fecc-42d0-87a2-763192b06fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.258286 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b34947-fecc-42d0-87a2-763192b06fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:40.259793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b34947-fecc-42d0-87a2-763192b06fab None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-14b34947-fecc-42d0-87a2-763192b06fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:40.278667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:40.279831 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:40.281077 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:40.281077 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:40.281077 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:40.281077 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:40.281337 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a0f0e-9ede-4fea-b23d-7ddac7398cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:40.281426 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 252/513] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:40.281506 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a0f0e-9ede-4fea-b23d-7ddac7398cd9 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:40.281579 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b34947-fecc-42d0-87a2-763192b06fab None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:40.318727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:40.406984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b34947-fecc-42d0-87a2-763192b06fab None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:40.410892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 262/514] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:40.411726 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a0f0e-9ede-4fea-b23d-7ddac7398cd9 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:40.442066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303daae-8794-4392-a1e8-3b1e13b0c735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:40.442886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303daae-8794-4392-a1e8-3b1e13b0c735 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.443165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303daae-8794-4392-a1e8-3b1e13b0c735 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.443441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303daae-8794-4392-a1e8-3b1e13b0c735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.454397 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303daae-8794-4392-a1e8-3b1e13b0c735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:40.455984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303daae-8794-4392-a1e8-3b1e13b0c735 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:40.458537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-0303daae-8794-4392-a1e8-3b1e13b0c735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:40.477945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:40.479354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:40.480621 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:40.480621 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:40.480621 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:40.480621 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:40.480621 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 253/515] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:40.480621 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303daae-8794-4392-a1e8-3b1e13b0c735 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:40.528735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a0f0e-9ede-4fea-b23d-7ddac7398cd9 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:40.538560 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:40.564484 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbef7b-34c9-4f3e-ba5b-a81d3fb08877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:40.565283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbef7b-34c9-4f3e-ba5b-a81d3fb08877 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.565569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbef7b-34c9-4f3e-ba5b-a81d3fb08877 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.565847 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbef7b-34c9-4f3e-ba5b-a81d3fb08877 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.573444 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbef7b-34c9-4f3e-ba5b-a81d3fb08877 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:40.574976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbef7b-34c9-4f3e-ba5b-a81d3fb08877 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:40.582515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303daae-8794-4392-a1e8-3b1e13b0c735 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-36dbef7b-34c9-4f3e-ba5b-a81d3fb08877 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:40.588941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:40.590776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:40.592147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:40.592147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:40.592147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:40.592147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:40.592147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:40.592147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:40.592147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:40.592147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:40.592147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:03:40.592147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:40.592147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 263/516] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:40.592848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbef7b-34c9-4f3e-ba5b-a81d3fb08877 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:40.622257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973453f-aebc-46a6-bc78-d2a79c1515c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:40.622970 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973453f-aebc-46a6-bc78-d2a79c1515c8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.623251 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973453f-aebc-46a6-bc78-d2a79c1515c8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.623529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973453f-aebc-46a6-bc78-d2a79c1515c8 None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.624337 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973453f-aebc-46a6-bc78-d2a79c1515c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:40.624652 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973453f-aebc-46a6-bc78-d2a79c1515c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:40.626119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973453f-aebc-46a6-bc78-d2a79c1515c8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:40.645609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 254/517] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:40.646461 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973453f-aebc-46a6-bc78-d2a79c1515c8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:40.701438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbef7b-34c9-4f3e-ba5b-a81d3fb08877 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:40.709459 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:40.737808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7998fb8-f2c9-4f76-8803-353b3228f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:40.738385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7998fb8-f2c9-4f76-8803-353b3228f0bf None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.738700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7998fb8-f2c9-4f76-8803-353b3228f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.738978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7998fb8-f2c9-4f76-8803-353b3228f0bf None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.739755 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7998fb8-f2c9-4f76-8803-353b3228f0bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:40.740067 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7998fb8-f2c9-4f76-8803-353b3228f0bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:40.741454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7998fb8-f2c9-4f76-8803-353b3228f0bf None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:40.753627 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 264/518] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:40.754275 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7998fb8-f2c9-4f76-8803-353b3228f0bf None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:40.754387 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973453f-aebc-46a6-bc78-d2a79c1515c8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:40.783022 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:40.791146 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91b414-97d4-4a17-9b2f-3f004c61d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:40.791952 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91b414-97d4-4a17-9b2f-3f004c61d330 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.792287 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91b414-97d4-4a17-9b2f-3f004c61d330 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.792565 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91b414-97d4-4a17-9b2f-3f004c61d330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.804245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91b414-97d4-4a17-9b2f-3f004c61d330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:40.805697 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91b414-97d4-4a17-9b2f-3f004c61d330 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-de91b414-97d4-4a17-9b2f-3f004c61d330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:40.823888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:40.825609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:40.831537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:40.831537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:40.831537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:40.831537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:40.831537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 255/519] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:40.831537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91b414-97d4-4a17-9b2f-3f004c61d330 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:40.868770 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7998fb8-f2c9-4f76-8803-353b3228f0bf None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:40.905222 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877ae0d-91d1-4a55-b239-88310402581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:40.905882 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877ae0d-91d1-4a55-b239-88310402581b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.906164 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877ae0d-91d1-4a55-b239-88310402581b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.906438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877ae0d-91d1-4a55-b239-88310402581b None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.907199 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877ae0d-91d1-4a55-b239-88310402581b None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:40.907504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877ae0d-91d1-4a55-b239-88310402581b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:40.908898 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877ae0d-91d1-4a55-b239-88310402581b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:40.920626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 265/520] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:40.921548 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877ae0d-91d1-4a55-b239-88310402581b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:40.930754 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91b414-97d4-4a17-9b2f-3f004c61d330 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:40.940118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:40.965538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333364a9-25b1-49b6-91fe-7c76a82c85dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:40.966208 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333364a9-25b1-49b6-91fe-7c76a82c85dd None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.966487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333364a9-25b1-49b6-91fe-7c76a82c85dd None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.966830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333364a9-25b1-49b6-91fe-7c76a82c85dd None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.967672 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333364a9-25b1-49b6-91fe-7c76a82c85dd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:40.967982 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333364a9-25b1-49b6-91fe-7c76a82c85dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:40.969541 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333364a9-25b1-49b6-91fe-7c76a82c85dd None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:40.988886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 256/521] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:40.989630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333364a9-25b1-49b6-91fe-7c76a82c85dd None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:41.012503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:41.024242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877ae0d-91d1-4a55-b239-88310402581b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:41.060994 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28054418-6d3b-4295-b3a7-271830a6b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:41.061646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28054418-6d3b-4295-b3a7-271830a6b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.061929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28054418-6d3b-4295-b3a7-271830a6b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.062208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28054418-6d3b-4295-b3a7-271830a6b8d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.063236 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28054418-6d3b-4295-b3a7-271830a6b8d4 None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=e0b88c1582c849349cc441446f6cca20) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:41.063550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28054418-6d3b-4295-b3a7-271830a6b8d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:41.064995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28054418-6d3b-4295-b3a7-271830a6b8d4 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:41.070474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 266/522] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/role_assignments?user.id=e0b88c1582c849349cc441446f6cca20&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:41.071277 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28054418-6d3b-4295-b3a7-271830a6b8d4 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:41.092876 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333364a9-25b1-49b6-91fe-7c76a82c85dd None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:41.136502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008dcf3-01db-4123-adaa-0de0ccaed04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:41.138325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008dcf3-01db-4123-adaa-0de0ccaed04f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.138717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008dcf3-01db-4123-adaa-0de0ccaed04f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.139068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008dcf3-01db-4123-adaa-0de0ccaed04f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.149097 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008dcf3-01db-4123-adaa-0de0ccaed04f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:41.151384 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008dcf3-01db-4123-adaa-0de0ccaed04f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-a008dcf3-01db-4123-adaa-0de0ccaed04f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:41.170981 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:41.172343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:41.173690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:41.173690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:41.173690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:41.173690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:41.173690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:41.173690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:41.173690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:41.173690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:41.173690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:03:41.173690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:41.174938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 257/523] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:41.176058 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008dcf3-01db-4123-adaa-0de0ccaed04f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:41.208542 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:41.225850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28054418-6d3b-4295-b3a7-271830a6b8d4 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:41.265867 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eeefc-b06d-4cf4-a89f-9614655b1edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:41.266463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eeefc-b06d-4cf4-a89f-9614655b1edd None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.266778 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eeefc-b06d-4cf4-a89f-9614655b1edd None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.267408 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eeefc-b06d-4cf4-a89f-9614655b1edd None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.267784 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eeefc-b06d-4cf4-a89f-9614655b1edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:41.268086 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eeefc-b06d-4cf4-a89f-9614655b1edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:41.269556 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eeefc-b06d-4cf4-a89f-9614655b1edd None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:41.288411 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 267/524] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:41.289440 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eeefc-b06d-4cf4-a89f-9614655b1edd None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:41.298518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008dcf3-01db-4123-adaa-0de0ccaed04f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:41.306441 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:41.336192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106efab9-af71-4b27-979f-2736fad13c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:41.336895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106efab9-af71-4b27-979f-2736fad13c40 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.337179 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106efab9-af71-4b27-979f-2736fad13c40 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.337459 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106efab9-af71-4b27-979f-2736fad13c40 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.338180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106efab9-af71-4b27-979f-2736fad13c40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:41.339665 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106efab9-af71-4b27-979f-2736fad13c40 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:41.399829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eeefc-b06d-4cf4-a89f-9614655b1edd None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:41.422243 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 258/525] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:03:41 2022] POST /identity/v3/users => generated 247 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:03:41.423114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106efab9-af71-4b27-979f-2736fad13c40 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:41.449058 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d48a9-3dad-43ad-8acc-88bb09b1c1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:41.450819 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d48a9-3dad-43ad-8acc-88bb09b1c1ad None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.451419 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d48a9-3dad-43ad-8acc-88bb09b1c1ad None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.451698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d48a9-3dad-43ad-8acc-88bb09b1c1ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.528063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:41.549277 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106efab9-af71-4b27-979f-2736fad13c40 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:41.555543 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d48a9-3dad-43ad-8acc-88bb09b1c1ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:41.557138 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d48a9-3dad-43ad-8acc-88bb09b1c1ad None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:41.580045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:41.604212 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0826e6-cf54-45f7-be92-f2ec2986f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:41.604986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0826e6-cf54-45f7-be92-f2ec2986f184 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.605269 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0826e6-cf54-45f7-be92-f2ec2986f184 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.605586 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0826e6-cf54-45f7-be92-f2ec2986f184 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.606507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0826e6-cf54-45f7-be92-f2ec2986f184 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:41.606856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0826e6-cf54-45f7-be92-f2ec2986f184 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:41.608361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0826e6-cf54-45f7-be92-f2ec2986f184 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:41.630218 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 259/526] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:03:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:41.631345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0826e6-cf54-45f7-be92-f2ec2986f184 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:41.684018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 268/527] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:41.684990 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d48a9-3dad-43ad-8acc-88bb09b1c1ad None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:41.752476 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0826e6-cf54-45f7-be92-f2ec2986f184 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:41.799889 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d443fc-fe74-47cb-b4b0-97983db9e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:41.800622 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d443fc-fe74-47cb-b4b0-97983db9e087 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.800897 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d443fc-fe74-47cb-b4b0-97983db9e087 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.801167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d443fc-fe74-47cb-b4b0-97983db9e087 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.809653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d443fc-fe74-47cb-b4b0-97983db9e087 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:41.811135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d443fc-fe74-47cb-b4b0-97983db9e087 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:41.813083 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d48a9-3dad-43ad-8acc-88bb09b1c1ad None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:41.813793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-14d443fc-fe74-47cb-b4b0-97983db9e087 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:41.826967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:41.831296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:41.832308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:41.832308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:41.832308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:41.832308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:41.832308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:41.832308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:41.832308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:41.832308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:41.832809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:41.832892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 260/528] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:41.832892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d443fc-fe74-47cb-b4b0-97983db9e087 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:41.852911 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b3c5a-fdb4-4706-bff1-2d2c23a4c448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:41.853627 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b3c5a-fdb4-4706-bff1-2d2c23a4c448 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.853909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b3c5a-fdb4-4706-bff1-2d2c23a4c448 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.854329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b3c5a-fdb4-4706-bff1-2d2c23a4c448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.937296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b3c5a-fdb4-4706-bff1-2d2c23a4c448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:41.939138 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b3c5a-fdb4-4706-bff1-2d2c23a4c448 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:41.941834 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d443fc-fe74-47cb-b4b0-97983db9e087 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:41.980289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc3434-8a87-4305-ba46-052e9e4600db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:41.982287 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc3434-8a87-4305-ba46-052e9e4600db None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.982575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc3434-8a87-4305-ba46-052e9e4600db None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.982881 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc3434-8a87-4305-ba46-052e9e4600db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.997503 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc3434-8a87-4305-ba46-052e9e4600db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:41.999357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc3434-8a87-4305-ba46-052e9e4600db None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-2fdc3434-8a87-4305-ba46-052e9e4600db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:42.028371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:42.029842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:42.031098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:42.031098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:42.031098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:42.031098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:42.031098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 261/529] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:42.031549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc3434-8a87-4305-ba46-052e9e4600db None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:42.064078 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 269/530] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:42.064859 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b3c5a-fdb4-4706-bff1-2d2c23a4c448 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:42.080583 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:42.107029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:42.163284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc3434-8a87-4305-ba46-052e9e4600db None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:42.179333 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b3c5a-fdb4-4706-bff1-2d2c23a4c448 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:42.212446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bc79a-8081-48a6-99f4-9dc2ba10c832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:42.213979 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc79a-8081-48a6-99f4-9dc2ba10c832 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:42.214456 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc79a-8081-48a6-99f4-9dc2ba10c832 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:42.215829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc79a-8081-48a6-99f4-9dc2ba10c832 None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:42.217283 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bc79a-8081-48a6-99f4-9dc2ba10c832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:42.217938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bc79a-8081-48a6-99f4-9dc2ba10c832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:42.219986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bc79a-8081-48a6-99f4-9dc2ba10c832 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:42.227985 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55e686-b7aa-4747-8192-bc0f23aa4dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:42.228906 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55e686-b7aa-4747-8192-bc0f23aa4dd9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:42.229281 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55e686-b7aa-4747-8192-bc0f23aa4dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:42.229769 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55e686-b7aa-4747-8192-bc0f23aa4dd9 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:42.230699 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55e686-b7aa-4747-8192-bc0f23aa4dd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:42.231075 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55e686-b7aa-4747-8192-bc0f23aa4dd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:42.232539 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55e686-b7aa-4747-8192-bc0f23aa4dd9 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:42.243801 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 262/531] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:42.245114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bc79a-8081-48a6-99f4-9dc2ba10c832 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:42.250028 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 270/532] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:42.251263 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55e686-b7aa-4747-8192-bc0f23aa4dd9 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:42.336364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:42.368105 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55e686-b7aa-4747-8192-bc0f23aa4dd9 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:42.397527 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bc79a-8081-48a6-99f4-9dc2ba10c832 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:42.407241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594175-e280-48e3-9904-6ad813def158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:42.408227 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594175-e280-48e3-9904-6ad813def158 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:42.408227 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594175-e280-48e3-9904-6ad813def158 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:42.408508 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594175-e280-48e3-9904-6ad813def158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:42.409467 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594175-e280-48e3-9904-6ad813def158 None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=537c1b1095ce482a8d1f5fd95bd98db5) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:42.409863 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594175-e280-48e3-9904-6ad813def158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:42.411399 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594175-e280-48e3-9904-6ad813def158 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:42.416501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:42.424213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 271/533] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:42 2022] GET /identity/v3/role_assignments?user.id=537c1b1095ce482a8d1f5fd95bd98db5&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:42.426788 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594175-e280-48e3-9904-6ad813def158 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:42.453888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055d430-db70-4a15-8833-708ac9092e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:42.455188 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055d430-db70-4a15-8833-708ac9092e79 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:42.455721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055d430-db70-4a15-8833-708ac9092e79 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:42.456304 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055d430-db70-4a15-8833-708ac9092e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:42.474681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055d430-db70-4a15-8833-708ac9092e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:42.476619 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055d430-db70-4a15-8833-708ac9092e79 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-5055d430-db70-4a15-8833-708ac9092e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:42.522016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:42.523137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:42.524180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:42.524180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:42.524180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:42.524180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:42.527750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 263/534] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:42.535758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055d430-db70-4a15-8833-708ac9092e79 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:42.615034 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594175-e280-48e3-9904-6ad813def158 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:42.663392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e07b-7a35-4a0c-83a7-e61b96eda33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:42.664223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e07b-7a35-4a0c-83a7-e61b96eda33e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:42.664509 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e07b-7a35-4a0c-83a7-e61b96eda33e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:42.664788 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e07b-7a35-4a0c-83a7-e61b96eda33e None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:42.673313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:42.683562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902e07b-7a35-4a0c-83a7-e61b96eda33e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:42.689914 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902e07b-7a35-4a0c-83a7-e61b96eda33e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-6902e07b-7a35-4a0c-83a7-e61b96eda33e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:42.721030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:42.722153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:42.727938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:42.727938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:42.727938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:42.727938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:42.727938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:42.727938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:42.727938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:42.727938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:42.727938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 272/535] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:42.730969 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e07b-7a35-4a0c-83a7-e61b96eda33e None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:42.749589 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055d430-db70-4a15-8833-708ac9092e79 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:42.824912 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c67693-98e3-42fd-9f5e-39f32e4aaf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:42.825598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c67693-98e3-42fd-9f5e-39f32e4aaf02 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:42.825878 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c67693-98e3-42fd-9f5e-39f32e4aaf02 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:42.826156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c67693-98e3-42fd-9f5e-39f32e4aaf02 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:42.826928 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c67693-98e3-42fd-9f5e-39f32e4aaf02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:42.827237 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c67693-98e3-42fd-9f5e-39f32e4aaf02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:42.828629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c67693-98e3-42fd-9f5e-39f32e4aaf02 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:42.859493 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 264/536] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:42.866731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c67693-98e3-42fd-9f5e-39f32e4aaf02 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:42.918874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:42.943846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e07b-7a35-4a0c-83a7-e61b96eda33e None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:43.014235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b94f9b-e2dc-4d64-9bce-75708fd50a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:43.014943 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b94f9b-e2dc-4d64-9bce-75708fd50a38 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:43.015226 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b94f9b-e2dc-4d64-9bce-75708fd50a38 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:43.015504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b94f9b-e2dc-4d64-9bce-75708fd50a38 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:43.016321 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b94f9b-e2dc-4d64-9bce-75708fd50a38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:43.016631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b94f9b-e2dc-4d64-9bce-75708fd50a38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:43.018138 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b94f9b-e2dc-4d64-9bce-75708fd50a38 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:43.047322 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 273/537] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:43.055689 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b94f9b-e2dc-4d64-9bce-75708fd50a38 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:43.062450 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c67693-98e3-42fd-9f5e-39f32e4aaf02 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:43.128766 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c634c-dee4-4448-aff3-80397897958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:43.129496 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c634c-dee4-4448-aff3-80397897958e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:43.129779 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c634c-dee4-4448-aff3-80397897958e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:43.130051 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c634c-dee4-4448-aff3-80397897958e None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:43.143245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c634c-dee4-4448-aff3-80397897958e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:43.143245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c634c-dee4-4448-aff3-80397897958e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:43.149688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-fa2c634c-dee4-4448-aff3-80397897958e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:43.158232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:43.159271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:43.160260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:43.160260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:43.160260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:43.160260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:43.160260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:43.160260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:43.160260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:43.160260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:43.160260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 265/538] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:43.171736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c634c-dee4-4448-aff3-80397897958e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:43.202935 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b94f9b-e2dc-4d64-9bce-75708fd50a38 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:43.246016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87e29e-68c3-42f7-984e-fd906a6b007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:43.246821 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e29e-68c3-42f7-984e-fd906a6b007c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:43.246999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e29e-68c3-42f7-984e-fd906a6b007c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:43.247275 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e29e-68c3-42f7-984e-fd906a6b007c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:43.248277 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87e29e-68c3-42f7-984e-fd906a6b007c None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=d42b12ce8488404d8ae10a4fefcdddb4) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:43.248591 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87e29e-68c3-42f7-984e-fd906a6b007c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:43.250051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87e29e-68c3-42f7-984e-fd906a6b007c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:43.257018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 274/539] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:43 2022] GET /identity/v3/role_assignments?user.id=d42b12ce8488404d8ae10a4fefcdddb4&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:43.368882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:43.392109 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c634c-dee4-4448-aff3-80397897958e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:43.439230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef6947-a9f0-407c-a31f-b1a5d86f2468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:43.440347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef6947-a9f0-407c-a31f-b1a5d86f2468 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:43.440844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef6947-a9f0-407c-a31f-b1a5d86f2468 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:43.441346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef6947-a9f0-407c-a31f-b1a5d86f2468 None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:43.442377 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef6947-a9f0-407c-a31f-b1a5d86f2468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:43.442943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef6947-a9f0-407c-a31f-b1a5d86f2468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:43.444711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef6947-a9f0-407c-a31f-b1a5d86f2468 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:43.458487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 266/540] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:43.466768 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87e29e-68c3-42f7-984e-fd906a6b007c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:43.536491 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4cf0-4c02-4ced-806a-ad764514d62b None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:43.537184 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4cf0-4c02-4ced-806a-ad764514d62b None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:43.537696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4cf0-4c02-4ced-806a-ad764514d62b None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:43.539684 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 267/541] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:03:43.546153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d0c0-66af-4469-91e3-a6ebf17447d5 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:43.546773 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d0c0-66af-4469-91e3-a6ebf17447d5 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:43.547298 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d0c0-66af-4469-91e3-a6ebf17447d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:43.572446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-4b48d0c0-66af-4469-91e3-a6ebf17447d5 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:43.573817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-4b48d0c0-66af-4469-91e3-a6ebf17447d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:43.622025 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87e29e-68c3-42f7-984e-fd906a6b007c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:43.654721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:43.674814 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c16505-45cb-42cb-ac53-d08b3236a70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:43.675482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c16505-45cb-42cb-ac53-d08b3236a70f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:43.675759 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c16505-45cb-42cb-ac53-d08b3236a70f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:43.676030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c16505-45cb-42cb-ac53-d08b3236a70f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:43.677145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c16505-45cb-42cb-ac53-d08b3236a70f None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=c771be7b66514ef99680f64fb486e205) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:43.677534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c16505-45cb-42cb-ac53-d08b3236a70f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:43.679033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c16505-45cb-42cb-ac53-d08b3236a70f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:43.692251 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 275/542] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:43 2022] GET /identity/v3/role_assignments?user.id=c771be7b66514ef99680f64fb486e205&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:43.700158 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 268/543] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:03:43.744166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c16505-45cb-42cb-ac53-d08b3236a70f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:43.872482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c16505-45cb-42cb-ac53-d08b3236a70f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:43.916961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b4ef-5b2f-4aae-9eb3-fd2561797849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:43.918334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b4ef-5b2f-4aae-9eb3-fd2561797849 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:43.918878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b4ef-5b2f-4aae-9eb3-fd2561797849 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:43.919374 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b4ef-5b2f-4aae-9eb3-fd2561797849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:43.941634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4b4ef-5b2f-4aae-9eb3-fd2561797849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-09c4b4ef-5b2f-4aae-9eb3-fd2561797849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:43.957526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:43.958743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:43.959675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:43.960539 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 276/544] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:43.972117 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48d0c0-66af-4469-91e3-a6ebf17447d5 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:44.073012 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:44.100293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48d0c0-66af-4469-91e3-a6ebf17447d5 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:44.146257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f023c-4089-4d26-b929-ad4ef6286bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:44.146974 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f023c-4089-4d26-b929-ad4ef6286bf9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:44.147261 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f023c-4089-4d26-b929-ad4ef6286bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:44.147543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f023c-4089-4d26-b929-ad4ef6286bf9 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:44.148309 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f023c-4089-4d26-b929-ad4ef6286bf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:44.148618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f023c-4089-4d26-b929-ad4ef6286bf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:44.150005 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f023c-4089-4d26-b929-ad4ef6286bf9 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:44.159784 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 269/545] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:44.165282 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b4ef-5b2f-4aae-9eb3-fd2561797849 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:44.229207 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1c777-c3c7-447a-8bd9-05540116d8cc None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:44.229545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1c777-c3c7-447a-8bd9-05540116d8cc None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:44.229832 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1c777-c3c7-447a-8bd9-05540116d8cc None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:44.231694 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 270/546] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:44.237256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ae6e7-ca4b-4912-875b-df0aa3e2128d None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:44.237786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ae6e7-ca4b-4912-875b-df0aa3e2128d None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:44.238228 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ae6e7-ca4b-4912-875b-df0aa3e2128d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:44.250985 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:44.258283 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-ee6ae6e7-ca4b-4912-875b-df0aa3e2128d None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:44.259757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-ee6ae6e7-ca4b-4912-875b-df0aa3e2128d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:44.362931 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b4ef-5b2f-4aae-9eb3-fd2561797849 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:44.390152 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 271/547] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:03:44.422252 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeef69-0cd8-4da7-9aad-93abd10266fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:44.423389 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeef69-0cd8-4da7-9aad-93abd10266fa None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:44.423828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeef69-0cd8-4da7-9aad-93abd10266fa None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:44.424285 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeef69-0cd8-4da7-9aad-93abd10266fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:44.427154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ae6e7-ca4b-4912-875b-df0aa3e2128d None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:44.444214 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caeef69-0cd8-4da7-9aad-93abd10266fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:44.446071 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caeef69-0cd8-4da7-9aad-93abd10266fa None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-6caeef69-0cd8-4da7-9aad-93abd10266fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:44.475242 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:44.476532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:44.477734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:44.477734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:44.477734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:44.477734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:44.479972 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 277/548] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:44.486452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeef69-0cd8-4da7-9aad-93abd10266fa None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:44.500473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:44.537306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ae6e7-ca4b-4912-875b-df0aa3e2128d None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:44.575240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff55db-214d-4f1b-9765-0cff3de2a487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:44.576197 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff55db-214d-4f1b-9765-0cff3de2a487 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:44.576582 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff55db-214d-4f1b-9765-0cff3de2a487 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:44.576957 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff55db-214d-4f1b-9765-0cff3de2a487 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:44.588227 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff55db-214d-4f1b-9765-0cff3de2a487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-94ff55db-214d-4f1b-9765-0cff3de2a487 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:44.596256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:44.597557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:44.598737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:44.600703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 272/549] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:03:44.604066 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:44.606899 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff55db-214d-4f1b-9765-0cff3de2a487 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:44.611893 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeef69-0cd8-4da7-9aad-93abd10266fa None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:44.663195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87dce7-fabd-4fc5-9eea-2dffb6da7a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:44.664220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87dce7-fabd-4fc5-9eea-2dffb6da7a15 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:44.664767 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87dce7-fabd-4fc5-9eea-2dffb6da7a15 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:44.665194 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87dce7-fabd-4fc5-9eea-2dffb6da7a15 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:44.666109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87dce7-fabd-4fc5-9eea-2dffb6da7a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:44.666648 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87dce7-fabd-4fc5-9eea-2dffb6da7a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:44.669109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87dce7-fabd-4fc5-9eea-2dffb6da7a15 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:44.698191 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 278/550] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:44.703989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87dce7-fabd-4fc5-9eea-2dffb6da7a15 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:44.722647 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff55db-214d-4f1b-9765-0cff3de2a487 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:44.745953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:44.755978 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd0d86-3896-4c2e-867f-fc24a103eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:44.755978 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd0d86-3896-4c2e-867f-fc24a103eb4d None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:44.756362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd0d86-3896-4c2e-867f-fc24a103eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:44.760338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd0d86-3896-4c2e-867f-fc24a103eb4d None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:44.760338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd0d86-3896-4c2e-867f-fc24a103eb4d None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:44.760338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd0d86-3896-4c2e-867f-fc24a103eb4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:44.760338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd0d86-3896-4c2e-867f-fc24a103eb4d None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:44.768940 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 273/551] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:44.774309 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd0d86-3896-4c2e-867f-fc24a103eb4d None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:44.846789 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87dce7-fabd-4fc5-9eea-2dffb6da7a15 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:44.881313 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd0d86-3896-4c2e-867f-fc24a103eb4d None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:44.917270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809be2c5-ffcd-46a7-a72a-3de9831a166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:44.918639 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809be2c5-ffcd-46a7-a72a-3de9831a166b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:44.919028 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809be2c5-ffcd-46a7-a72a-3de9831a166b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:44.919418 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809be2c5-ffcd-46a7-a72a-3de9831a166b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:44.931626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809be2c5-ffcd-46a7-a72a-3de9831a166b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:44.933256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809be2c5-ffcd-46a7-a72a-3de9831a166b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-809be2c5-ffcd-46a7-a72a-3de9831a166b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:44.955242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:44.956306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:44.957334 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:44.957334 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:44.957334 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:44.957334 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:44.957640 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 274/552] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:03:44.963424 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809be2c5-ffcd-46a7-a72a-3de9831a166b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:44.983085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6643d1-2d63-4a4b-b94d-030cf8cb2eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:44.984755 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6643d1-2d63-4a4b-b94d-030cf8cb2eaf None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:44.990798 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6643d1-2d63-4a4b-b94d-030cf8cb2eaf None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:44.991131 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6643d1-2d63-4a4b-b94d-030cf8cb2eaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:45.019705 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6643d1-2d63-4a4b-b94d-030cf8cb2eaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:45.021157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6643d1-2d63-4a4b-b94d-030cf8cb2eaf None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:45.027001 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-5f6643d1-2d63-4a4b-b94d-030cf8cb2eaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:45.067325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:45.080239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 279/553] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:03:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:03:45.081463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6643d1-2d63-4a4b-b94d-030cf8cb2eaf None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:45.091403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809be2c5-ffcd-46a7-a72a-3de9831a166b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:45.124323 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:45.129545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf47fb-bfc9-4d48-915e-af00773eb3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:45.130542 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf47fb-bfc9-4d48-915e-af00773eb3cb None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:45.131000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf47fb-bfc9-4d48-915e-af00773eb3cb None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:45.141619 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf47fb-bfc9-4d48-915e-af00773eb3cb None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:45.141619 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf47fb-bfc9-4d48-915e-af00773eb3cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:45.141619 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf47fb-bfc9-4d48-915e-af00773eb3cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:45.141619 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf47fb-bfc9-4d48-915e-af00773eb3cb None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:45.150705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 275/554] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:45.153326 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf47fb-bfc9-4d48-915e-af00773eb3cb None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:45.267066 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6643d1-2d63-4a4b-b94d-030cf8cb2eaf None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:45.307755 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9d494-b25b-4753-b964-04c702895d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:45.309473 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d494-b25b-4753-b964-04c702895d1d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:45.309970 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d494-b25b-4753-b964-04c702895d1d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:45.310474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d494-b25b-4753-b964-04c702895d1d None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:45.311730 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9d494-b25b-4753-b964-04c702895d1d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:45.312254 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9d494-b25b-4753-b964-04c702895d1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:45.314049 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9d494-b25b-4753-b964-04c702895d1d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:45.318895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:45.321705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf47fb-bfc9-4d48-915e-af00773eb3cb None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:45.335735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 280/555] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:03:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:45.342106 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730291e-a984-408f-b0f8-32032a06bb47 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:45.342691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730291e-a984-408f-b0f8-32032a06bb47 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:45.343156 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730291e-a984-408f-b0f8-32032a06bb47 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:45.345178 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 281/556] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:45.346331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730291e-a984-408f-b0f8-32032a06bb47 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:45.366514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a27381-13ba-44d7-bd8c-5b1e3b564e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:45.367518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a27381-13ba-44d7-bd8c-5b1e3b564e20 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:45.367806 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a27381-13ba-44d7-bd8c-5b1e3b564e20 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:45.368124 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a27381-13ba-44d7-bd8c-5b1e3b564e20 None admin] PATH_INFO: `/v3/users/swift` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:45.377028 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a27381-13ba-44d7-bd8c-5b1e3b564e20 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:45.378681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a27381-13ba-44d7-bd8c-5b1e3b564e20 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-d3a27381-13ba-44d7-bd8c-5b1e3b564e20 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:45.394653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:45.396338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:45.397481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:45.397481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:45.397481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:45.397481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:45.397481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:45.397481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:45.397481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:45.397481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:45.397481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:03:45.397481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:45.397481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 276/557] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:03:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:45.398168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a39f-e213-4af3-9523-9af704f60cbb None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:45.398168 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a39f-e213-4af3-9523-9af704f60cbb None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:45.398301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a39f-e213-4af3-9523-9af704f60cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:45.416911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-f827a39f-e213-4af3-9523-9af704f60cbb None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:45.419056 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-f827a39f-e213-4af3-9523-9af704f60cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:45.440109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:45.467720 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730291e-a984-408f-b0f8-32032a06bb47 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:45.502836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 277/558] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:45.503906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827a39f-e213-4af3-9523-9af704f60cbb None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:45.506804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579826b-9d6c-44b8-b9e5-eded878dfdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:45.507898 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579826b-9d6c-44b8-b9e5-eded878dfdcb None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:45.508414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579826b-9d6c-44b8-b9e5-eded878dfdcb None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:45.508916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579826b-9d6c-44b8-b9e5-eded878dfdcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:45.521008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579826b-9d6c-44b8-b9e5-eded878dfdcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:45.523070 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579826b-9d6c-44b8-b9e5-eded878dfdcb None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-9579826b-9d6c-44b8-b9e5-eded878dfdcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:45.543944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:45.545020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:45.546087 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:45.546087 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:45.546087 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:45.546087 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:45.548451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 282/559] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:45.554417 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579826b-9d6c-44b8-b9e5-eded878dfdcb None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:45.626768 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:45.637961 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827a39f-e213-4af3-9523-9af704f60cbb None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:45.665145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579826b-9d6c-44b8-b9e5-eded878dfdcb None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:45.675879 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b940cd5-0505-4c73-b405-93b0d5441546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:45.676827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940cd5-0505-4c73-b405-93b0d5441546 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:45.677109 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940cd5-0505-4c73-b405-93b0d5441546 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:45.677382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940cd5-0505-4c73-b405-93b0d5441546 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:45.678385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b940cd5-0505-4c73-b405-93b0d5441546 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:45.678723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b940cd5-0505-4c73-b405-93b0d5441546 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:45.680374 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b940cd5-0505-4c73-b405-93b0d5441546 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:45.697941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:45.702271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 278/560] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:03:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:45.703610 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b940cd5-0505-4c73-b405-93b0d5441546 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:45.706463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86628d0b-3ac6-47eb-ae17-cba1613a4b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:45.707256 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86628d0b-3ac6-47eb-ae17-cba1613a4b3e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:45.707545 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86628d0b-3ac6-47eb-ae17-cba1613a4b3e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:45.713883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86628d0b-3ac6-47eb-ae17-cba1613a4b3e None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:45.713883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86628d0b-3ac6-47eb-ae17-cba1613a4b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:45.713883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86628d0b-3ac6-47eb-ae17-cba1613a4b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:45.713883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86628d0b-3ac6-47eb-ae17-cba1613a4b3e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:45.727778 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 283/561] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:45.728827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86628d0b-3ac6-47eb-ae17-cba1613a4b3e None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:45.824160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b940cd5-0505-4c73-b405-93b0d5441546 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:45.841361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86628d0b-3ac6-47eb-ae17-cba1613a4b3e None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:45.864457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8e6c8-e7dc-4654-b05a-7dd80822fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:45.865679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8e6c8-e7dc-4654-b05a-7dd80822fa75 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:45.866192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8e6c8-e7dc-4654-b05a-7dd80822fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:45.866786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8e6c8-e7dc-4654-b05a-7dd80822fa75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:45.878699 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b0f7-6bb5-4c4a-905b-88fa348e7c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:45.879325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b0f7-6bb5-4c4a-905b-88fa348e7c39 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:45.879678 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b0f7-6bb5-4c4a-905b-88fa348e7c39 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:45.880031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b0f7-6bb5-4c4a-905b-88fa348e7c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:45.880471 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8e6c8-e7dc-4654-b05a-7dd80822fa75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-d1d8e6c8-e7dc-4654-b05a-7dd80822fa75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:45.889507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:45.890587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:45.891555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:45.898848 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 279/562] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:45.899899 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8e6c8-e7dc-4654-b05a-7dd80822fa75 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:45.913523 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:45.942703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:45.957764 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b0f7-6bb5-4c4a-905b-88fa348e7c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:45.959445 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b0f7-6bb5-4c4a-905b-88fa348e7c39 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:46.016931 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8e6c8-e7dc-4654-b05a-7dd80822fa75 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:46.051952 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9cd92-5027-4bad-b4b9-713c825f08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:46.052757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9cd92-5027-4bad-b4b9-713c825f08e4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.053042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9cd92-5027-4bad-b4b9-713c825f08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.053322 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9cd92-5027-4bad-b4b9-713c825f08e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.060364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9cd92-5027-4bad-b4b9-713c825f08e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:46.061812 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9cd92-5027-4bad-b4b9-713c825f08e4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:46.078203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 284/563] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:46.078203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b0f7-6bb5-4c4a-905b-88fa348e7c39 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-fef9cd92-5027-4bad-b4b9-713c825f08e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:46.078488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:46.079425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:46.080391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:46.080391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:46.080391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:46.080391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:46.080391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:46.080391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:46.080391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:46.080391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:46.082912 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 280/564] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:46.084294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924dbb1-8ad9-4d83-ae3b-c42f8158e0fc None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.084582 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924dbb1-8ad9-4d83-ae3b-c42f8158e0fc None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.084861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924dbb1-8ad9-4d83-ae3b-c42f8158e0fc None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.088358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 281/565] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:46.088358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924dbb1-8ad9-4d83-ae3b-c42f8158e0fc None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:46.169442 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:46.169820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:46.185761 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b0f7-6bb5-4c4a-905b-88fa348e7c39 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:46.205709 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924dbb1-8ad9-4d83-ae3b-c42f8158e0fc None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:46.229959 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807ee9c-c3b1-4b13-b60e-711eba36a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:46.231347 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ee9c-c3b1-4b13-b60e-711eba36a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.231746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ee9c-c3b1-4b13-b60e-711eba36a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.232117 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ee9c-c3b1-4b13-b60e-711eba36a7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.233034 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807ee9c-c3b1-4b13-b60e-711eba36a7c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:46.233438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807ee9c-c3b1-4b13-b60e-711eba36a7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:46.235001 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807ee9c-c3b1-4b13-b60e-711eba36a7c6 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:46.242912 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f6df2-57c3-429a-bb85-91239c1a522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:46.243710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f6df2-57c3-429a-bb85-91239c1a522a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.244139 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 285/566] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:46.244870 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807ee9c-c3b1-4b13-b60e-711eba36a7c6 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:46.249695 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f6df2-57c3-429a-bb85-91239c1a522a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.249695 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f6df2-57c3-429a-bb85-91239c1a522a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.261944 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f6df2-57c3-429a-bb85-91239c1a522a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:46.263490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f6df2-57c3-429a-bb85-91239c1a522a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-549f6df2-57c3-429a-bb85-91239c1a522a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:46.281570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:46.282645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:46.283661 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:46.283661 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:46.283661 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:46.283661 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:46.283661 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 282/567] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:46.284629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f07ba-9523-4e4f-8f02-2bbd970dda7f None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.284629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f07ba-9523-4e4f-8f02-2bbd970dda7f None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.284629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f07ba-9523-4e4f-8f02-2bbd970dda7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.304538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-973f07ba-9523-4e4f-8f02-2bbd970dda7f None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:46.308353 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-973f07ba-9523-4e4f-8f02-2bbd970dda7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:46.365912 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807ee9c-c3b1-4b13-b60e-711eba36a7c6 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:46.401770 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850d886-e4e4-4344-ae1c-74b7111a0b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:46.402984 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d886-e4e4-4344-ae1c-74b7111a0b4f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.403264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d886-e4e4-4344-ae1c-74b7111a0b4f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.403531 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d886-e4e4-4344-ae1c-74b7111a0b4f None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.414818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 283/568] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:46.415313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850d886-e4e4-4344-ae1c-74b7111a0b4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:46.415313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850d886-e4e4-4344-ae1c-74b7111a0b4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:46.415509 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f07ba-9523-4e4f-8f02-2bbd970dda7f None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:46.415601 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850d886-e4e4-4344-ae1c-74b7111a0b4f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:46.428566 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 286/569] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:46.429541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850d886-e4e4-4344-ae1c-74b7111a0b4f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:46.440725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:46.470274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:46.521291 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f07ba-9523-4e4f-8f02-2bbd970dda7f None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:46.539316 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850d886-e4e4-4344-ae1c-74b7111a0b4f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:46.558229 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9f87e-5be1-4033-ac90-9abb75270f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:46.559056 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9f87e-5be1-4033-ac90-9abb75270f60 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.559337 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9f87e-5be1-4033-ac90-9abb75270f60 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.559610 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9f87e-5be1-4033-ac90-9abb75270f60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.569656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9f87e-5be1-4033-ac90-9abb75270f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:46.571117 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9f87e-5be1-4033-ac90-9abb75270f60 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:46.573883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230cb69-5382-4156-aa72-da1cd49dc1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:46.574733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230cb69-5382-4156-aa72-da1cd49dc1f9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.575018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230cb69-5382-4156-aa72-da1cd49dc1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.575292 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230cb69-5382-4156-aa72-da1cd49dc1f9 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.576021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230cb69-5382-4156-aa72-da1cd49dc1f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:46.576326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230cb69-5382-4156-aa72-da1cd49dc1f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:46.577722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230cb69-5382-4156-aa72-da1cd49dc1f9 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:46.589063 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 287/570] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:46.590378 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230cb69-5382-4156-aa72-da1cd49dc1f9 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-edd9f87e-5be1-4033-ac90-9abb75270f60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:46.591909 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:46.592892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:46.593907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:46.593907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:46.593907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:46.593907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:46.593907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 284/571] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:46.593907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9f87e-5be1-4033-ac90-9abb75270f60 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:46.660491 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:46.694199 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230cb69-5382-4156-aa72-da1cd49dc1f9 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:46.694373 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9f87e-5be1-4033-ac90-9abb75270f60 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:46.696021 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:46.729890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17751d2-c034-49af-be49-aa30d9e6ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:46.730880 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17751d2-c034-49af-be49-aa30d9e6ce12 None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.731165 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17751d2-c034-49af-be49-aa30d9e6ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.731441 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17751d2-c034-49af-be49-aa30d9e6ce12 None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/e0b88c1582c849349cc441446f6cca20/roles/2c04974ce949479c8b4826c59fb652b3` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.731585 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f4dd5-6256-4853-bf09-5c80d2b0e437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:46.732400 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f4dd5-6256-4853-bf09-5c80d2b0e437 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.732674 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f4dd5-6256-4853-bf09-5c80d2b0e437 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.732942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f4dd5-6256-4853-bf09-5c80d2b0e437 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.744331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f4dd5-6256-4853-bf09-5c80d2b0e437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:46.746500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17751d2-c034-49af-be49-aa30d9e6ce12 None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=e0b88c1582c849349cc441446f6cca20, role_id=2c04974ce949479c8b4826c59fb652b3)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:46.747979 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17751d2-c034-49af-be49-aa30d9e6ce12 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-c38f4dd5-6256-4853-bf09-5c80d2b0e437 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:46.752200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:46.753446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:46.754482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 285/572] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:46.755975 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ce2fd-2090-4a91-ba7b-ddc97606fafe None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.756267 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ce2fd-2090-4a91-ba7b-ddc97606fafe None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.756544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ce2fd-2090-4a91-ba7b-ddc97606fafe None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.757943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 286/573] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:46.758662 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ce2fd-2090-4a91-ba7b-ddc97606fafe None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:46.810212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 288/574] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:03:46 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/e0b88c1582c849349cc441446f6cca20/roles/2c04974ce949479c8b4826c59fb652b3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:46.811151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17751d2-c034-49af-be49-aa30d9e6ce12 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:46.872933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ce2fd-2090-4a91-ba7b-ddc97606fafe None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:46.915041 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db8d89-99e0-4dc6-86a2-b761d5fd3281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:46.916151 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db8d89-99e0-4dc6-86a2-b761d5fd3281 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:46.916441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db8d89-99e0-4dc6-86a2-b761d5fd3281 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:46.916729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db8d89-99e0-4dc6-86a2-b761d5fd3281 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:46.924603 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db8d89-99e0-4dc6-86a2-b761d5fd3281 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:46.926175 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db8d89-99e0-4dc6-86a2-b761d5fd3281 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-51db8d89-99e0-4dc6-86a2-b761d5fd3281 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:46.941855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:46.943017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:46.944016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:46.944016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:46.944016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:46.944016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:46.944016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:46.944016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:46.944016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:46.944016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:46.944016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 287/575] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:46.944016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db8d89-99e0-4dc6-86a2-b761d5fd3281 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:46.959382 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17751d2-c034-49af-be49-aa30d9e6ce12 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:46.972056 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:46.980914 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:47.007360 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51e838-5061-47d2-9f2d-c1f7c8450d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:47.012273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e838-5061-47d2-9f2d-c1f7c8450d40 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:47.012273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e838-5061-47d2-9f2d-c1f7c8450d40 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:47.012273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e838-5061-47d2-9f2d-c1f7c8450d40 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:47.012273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e838-5061-47d2-9f2d-c1f7c8450d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:47.012273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e838-5061-47d2-9f2d-c1f7c8450d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:47.012273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e838-5061-47d2-9f2d-c1f7c8450d40 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:47.025626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 289/576] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:47.027962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ef183-7fc5-41a6-8fcd-d2fd1f13a9b7 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:47.028453 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ef183-7fc5-41a6-8fcd-d2fd1f13a9b7 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:47.029143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ef183-7fc5-41a6-8fcd-d2fd1f13a9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:47.047503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-559ef183-7fc5-41a6-8fcd-d2fd1f13a9b7 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:47.048735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-559ef183-7fc5-41a6-8fcd-d2fd1f13a9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:47.063821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db8d89-99e0-4dc6-86a2-b761d5fd3281 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:47.101094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aa639-66cd-4baa-8f19-6340ba565610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:47.101926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa639-66cd-4baa-8f19-6340ba565610 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:47.102396 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa639-66cd-4baa-8f19-6340ba565610 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:47.102723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa639-66cd-4baa-8f19-6340ba565610 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:47.103462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3aa639-66cd-4baa-8f19-6340ba565610 None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:47.103772 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3aa639-66cd-4baa-8f19-6340ba565610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:47.105137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3aa639-66cd-4baa-8f19-6340ba565610 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:47.118683 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 288/577] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:47.118683 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aa639-66cd-4baa-8f19-6340ba565610 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:47.125039 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 290/578] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:47.129462 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ef183-7fc5-41a6-8fcd-d2fd1f13a9b7 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:47.222334 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:47.238004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aa639-66cd-4baa-8f19-6340ba565610 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:47.250343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ef183-7fc5-41a6-8fcd-d2fd1f13a9b7 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:47.261426 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:47.277738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3b0e-729e-4394-8b6e-0c07f8b6bea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:47.278387 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3b0e-729e-4394-8b6e-0c07f8b6bea4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:47.278699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3b0e-729e-4394-8b6e-0c07f8b6bea4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:47.278964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3b0e-729e-4394-8b6e-0c07f8b6bea4 None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:47.279846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3b0e-729e-4394-8b6e-0c07f8b6bea4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:47.280155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3b0e-729e-4394-8b6e-0c07f8b6bea4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:47.281603 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3b0e-729e-4394-8b6e-0c07f8b6bea4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:47.291534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbbf0e-ee69-4b31-8a85-60e7c3ebae33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:47.292370 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbbf0e-ee69-4b31-8a85-60e7c3ebae33 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:47.292679 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbbf0e-ee69-4b31-8a85-60e7c3ebae33 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:47.293533 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbbf0e-ee69-4b31-8a85-60e7c3ebae33 None admin] PATH_INFO: `/v3/users/glance` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:47.295532 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 289/579] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:47.296570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3b0e-729e-4394-8b6e-0c07f8b6bea4 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:47.307684 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbbf0e-ee69-4b31-8a85-60e7c3ebae33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:47.309179 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbbf0e-ee69-4b31-8a85-60e7c3ebae33 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-a3fbbf0e-ee69-4b31-8a85-60e7c3ebae33 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:47.324671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:47.325886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:47.327079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:47.327079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:47.327079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:47.327079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:47.327079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:47.327079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:47.327079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:47.327079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:47.327079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:03:47.327079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:47.327079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 291/580] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:47.327748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbbf0e-ee69-4b31-8a85-60e7c3ebae33 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:47.416732 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3b0e-729e-4394-8b6e-0c07f8b6bea4 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:47.440779 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbbf0e-ee69-4b31-8a85-60e7c3ebae33 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:47.455289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03e74-cfbb-40cd-84f1-32f428e774b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:47.456210 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03e74-cfbb-40cd-84f1-32f428e774b1 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:47.456605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03e74-cfbb-40cd-84f1-32f428e774b1 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:47.456886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03e74-cfbb-40cd-84f1-32f428e774b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:47.469055 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef03e74-cfbb-40cd-84f1-32f428e774b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:47.470799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef03e74-cfbb-40cd-84f1-32f428e774b1 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:47.473702 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:47.477837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957ad8-33ae-4edc-8a66-4bb54cbb205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:47.478655 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957ad8-33ae-4edc-8a66-4bb54cbb205c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:47.478937 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957ad8-33ae-4edc-8a66-4bb54cbb205c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:47.479207 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957ad8-33ae-4edc-8a66-4bb54cbb205c None admin] PATH_INFO: `/v3/roles/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-9ef03e74-cfbb-40cd-84f1-32f428e774b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:47.489898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:47.491273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:47.492645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:47.492645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:47.492645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:47.492645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:47.492891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af957ad8-33ae-4edc-8a66-4bb54cbb205c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:47.495368 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 290/581] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:47.496258 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03e74-cfbb-40cd-84f1-32f428e774b1 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-af957ad8-33ae-4edc-8a66-4bb54cbb205c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:47.497846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:47.499111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:47.500512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:47.502752 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 292/582] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:47.503900 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957ad8-33ae-4edc-8a66-4bb54cbb205c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:47.536436 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:47.612208 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03e74-cfbb-40cd-84f1-32f428e774b1 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:47.614704 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957ad8-33ae-4edc-8a66-4bb54cbb205c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:47.648504 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99eecd1-e4dd-47c9-914e-963d9250e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:47.649162 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eecd1-e4dd-47c9-914e-963d9250e460 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:47.649441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eecd1-e4dd-47c9-914e-963d9250e460 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:47.649713 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eecd1-e4dd-47c9-914e-963d9250e460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:47.650543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99eecd1-e4dd-47c9-914e-963d9250e460 None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=78d1f9ebc22a412db074e8aae5db8e9b) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:47.650675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9f0bd-07fd-4b4f-9540-e868d7c5b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:47.650892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99eecd1-e4dd-47c9-914e-963d9250e460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:47.651339 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9f0bd-07fd-4b4f-9540-e868d7c5b4ba None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:47.651622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9f0bd-07fd-4b4f-9540-e868d7c5b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:47.651897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9f0bd-07fd-4b4f-9540-e868d7c5b4ba None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:47.652328 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99eecd1-e4dd-47c9-914e-963d9250e460 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:47.652775 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9f0bd-07fd-4b4f-9540-e868d7c5b4ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:47.653088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9f0bd-07fd-4b4f-9540-e868d7c5b4ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:47.654525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9f0bd-07fd-4b4f-9540-e868d7c5b4ba None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:47.666960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 291/583] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:47 2022] GET /identity/v3/role_assignments?user.id=78d1f9ebc22a412db074e8aae5db8e9b&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:47.666960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99eecd1-e4dd-47c9-914e-963d9250e460 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:47.686588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 293/584] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:03:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:47.688247 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9f0bd-07fd-4b4f-9540-e868d7c5b4ba None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:47.741051 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:47.809839 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99eecd1-e4dd-47c9-914e-963d9250e460 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:47.827253 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:47.846949 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9f0bd-07fd-4b4f-9540-e868d7c5b4ba None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:47.865546 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd16f9-45ba-41a4-b22a-aa45dc3e6732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:47.866928 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd16f9-45ba-41a4-b22a-aa45dc3e6732 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:47.867862 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd16f9-45ba-41a4-b22a-aa45dc3e6732 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:47.868689 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd16f9-45ba-41a4-b22a-aa45dc3e6732 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:47.869786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd16f9-45ba-41a4-b22a-aa45dc3e6732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:47.870463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd16f9-45ba-41a4-b22a-aa45dc3e6732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:47.873128 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd16f9-45ba-41a4-b22a-aa45dc3e6732 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:47.889941 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 292/585] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:47.890643 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd16f9-45ba-41a4-b22a-aa45dc3e6732 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:47.904376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3c0df-0738-42dc-8f93-fd5863b09fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:47.905450 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3c0df-0738-42dc-8f93-fd5863b09fa3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:47.905891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3c0df-0738-42dc-8f93-fd5863b09fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:47.906344 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3c0df-0738-42dc-8f93-fd5863b09fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:47.907368 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3c0df-0738-42dc-8f93-fd5863b09fa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:47.907847 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3c0df-0738-42dc-8f93-fd5863b09fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:47.909404 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3c0df-0738-42dc-8f93-fd5863b09fa3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:47.921160 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 294/586] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:47.927101 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3c0df-0738-42dc-8f93-fd5863b09fa3 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:48.013672 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd16f9-45ba-41a4-b22a-aa45dc3e6732 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:48.036684 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:48.044922 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3c0df-0738-42dc-8f93-fd5863b09fa3 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:48.053257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf5ab4-c91f-48c6-9452-2e42e2a2df4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:48.054404 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf5ab4-c91f-48c6-9452-2e42e2a2df4e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:48.054895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf5ab4-c91f-48c6-9452-2e42e2a2df4e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:48.055325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf5ab4-c91f-48c6-9452-2e42e2a2df4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:48.070473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf5ab4-c91f-48c6-9452-2e42e2a2df4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:48.072954 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf5ab4-c91f-48c6-9452-2e42e2a2df4e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:48.084285 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a58a-3e0d-4f9e-baaf-7252c607e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:48.085248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a58a-3e0d-4f9e-baaf-7252c607e5ab None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:48.085591 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a58a-3e0d-4f9e-baaf-7252c607e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:48.085932 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a58a-3e0d-4f9e-baaf-7252c607e5ab None admin] PATH_INFO: `/v3/users/neutron` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:48.094338 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929a58a-3e0d-4f9e-baaf-7252c607e5ab None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:48.095959 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929a58a-3e0d-4f9e-baaf-7252c607e5ab None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-b3cf5ab4-c91f-48c6-9452-2e42e2a2df4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:48.097354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:48.098529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:48.099602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:48.099602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:48.099602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:48.099602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:48.101298 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 293/587] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:48.101927 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf5ab4-c91f-48c6-9452-2e42e2a2df4e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-0929a58a-3e0d-4f9e-baaf-7252c607e5ab None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:48.114537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:48.115686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:48.116748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:48.116748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:48.116748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:48.116748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:48.116748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:48.116748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:48.116748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:48.116748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:48.116748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:03:48.116748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:48.116748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 295/588] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:48.117403 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a58a-3e0d-4f9e-baaf-7252c607e5ab None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:48.129663 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:48.254165 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a58a-3e0d-4f9e-baaf-7252c607e5ab None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:48.255960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf5ab4-c91f-48c6-9452-2e42e2a2df4e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:48.298371 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee515242-d163-4861-9427-110cd558ccae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:48.299081 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee515242-d163-4861-9427-110cd558ccae None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:48.299440 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee515242-d163-4861-9427-110cd558ccae None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:48.299791 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee515242-d163-4861-9427-110cd558ccae None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:48.300608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee515242-d163-4861-9427-110cd558ccae None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:48.300999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee515242-d163-4861-9427-110cd558ccae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:48.302226 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a941f-a6fa-4100-93b8-335969568988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:48.302830 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee515242-d163-4861-9427-110cd558ccae None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:48.303054 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a941f-a6fa-4100-93b8-335969568988 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:48.303340 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a941f-a6fa-4100-93b8-335969568988 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:48.303618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a941f-a6fa-4100-93b8-335969568988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:48.315821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a941f-a6fa-4100-93b8-335969568988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:48.317294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a941f-a6fa-4100-93b8-335969568988 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:48.321447 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 296/589] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:48.322363 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee515242-d163-4861-9427-110cd558ccae None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-828a941f-a6fa-4100-93b8-335969568988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:48.337037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:48.338087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:48.339122 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:48.339122 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:48.339122 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:48.339122 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:48.339122 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 294/590] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:48.343959 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a941f-a6fa-4100-93b8-335969568988 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:48.372174 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:48.398043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:48.438201 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee515242-d163-4861-9427-110cd558ccae None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:48.459177 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a941f-a6fa-4100-93b8-335969568988 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:48.476410 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa1f3e-f34e-4015-bb45-0ded544c5ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:48.477097 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1f3e-f34e-4015-bb45-0ded544c5ac4 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:48.477756 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1f3e-f34e-4015-bb45-0ded544c5ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:48.477756 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1f3e-f34e-4015-bb45-0ded544c5ac4 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:48.478598 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa1f3e-f34e-4015-bb45-0ded544c5ac4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:48.479037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa1f3e-f34e-4015-bb45-0ded544c5ac4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:48.480944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa1f3e-f34e-4015-bb45-0ded544c5ac4 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:48.501327 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fbc40-6320-45a2-b4b6-fe3b3f754aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:48.501564 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 297/591] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 20:03:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:48.502515 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa1f3e-f34e-4015-bb45-0ded544c5ac4 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:48.503124 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fbc40-6320-45a2-b4b6-fe3b3f754aca None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:48.503569 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fbc40-6320-45a2-b4b6-fe3b3f754aca None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:48.504011 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fbc40-6320-45a2-b4b6-fe3b3f754aca None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:48.512510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fbc40-6320-45a2-b4b6-fe3b3f754aca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:48.514317 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fbc40-6320-45a2-b4b6-fe3b3f754aca None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-4b6fbc40-6320-45a2-b4b6-fe3b3f754aca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:48.531588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:48.533764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:48.535580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:48.535580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:48.535580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:48.535580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:48.535580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:48.535580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:48.535580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:48.535580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:48.538388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 295/592] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:48.539475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fbc40-6320-45a2-b4b6-fe3b3f754aca None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:48.625451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa1f3e-f34e-4015-bb45-0ded544c5ac4 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:48.636453 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:48.655665 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fbc40-6320-45a2-b4b6-fe3b3f754aca None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:48.658219 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:48.666098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bedaf9-9693-4343-9e4c-f6eb25d0a420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:48.666866 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bedaf9-9693-4343-9e4c-f6eb25d0a420 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:48.667160 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bedaf9-9693-4343-9e4c-f6eb25d0a420 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:48.667441 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bedaf9-9693-4343-9e4c-f6eb25d0a420 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:48.668772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bedaf9-9693-4343-9e4c-f6eb25d0a420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:48.669341 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bedaf9-9693-4343-9e4c-f6eb25d0a420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:48.670473 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bedaf9-9693-4343-9e4c-f6eb25d0a420 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:48.688878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 298/593] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:48.688878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bedaf9-9693-4343-9e4c-f6eb25d0a420 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:48.703679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff841d-719c-47d1-9add-20d49e018269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:48.704809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff841d-719c-47d1-9add-20d49e018269 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:48.705106 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff841d-719c-47d1-9add-20d49e018269 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:48.705387 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff841d-719c-47d1-9add-20d49e018269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:48.721650 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff841d-719c-47d1-9add-20d49e018269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:48.723155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff841d-719c-47d1-9add-20d49e018269 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-11ff841d-719c-47d1-9add-20d49e018269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:48.746964 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:48.748048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:48.749138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:48.749138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:48.749138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:48.749138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:48.749138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 296/594] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:48.749994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff841d-719c-47d1-9add-20d49e018269 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:48.827699 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bedaf9-9693-4343-9e4c-f6eb25d0a420 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:48.869263 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff841d-719c-47d1-9add-20d49e018269 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:48.875329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130383a2-16ab-4365-8505-41bb821037ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:48.876400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130383a2-16ab-4365-8505-41bb821037ce None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:48.876916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130383a2-16ab-4365-8505-41bb821037ce None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:48.877400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130383a2-16ab-4365-8505-41bb821037ce None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:48.879105 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130383a2-16ab-4365-8505-41bb821037ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:48.879710 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130383a2-16ab-4365-8505-41bb821037ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:48.881970 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130383a2-16ab-4365-8505-41bb821037ce None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:48.901430 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 299/595] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:48.904062 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130383a2-16ab-4365-8505-41bb821037ce None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:48.918500 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9d30b-5e27-48be-9e4f-781ee8b8e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:48.919354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d30b-5e27-48be-9e4f-781ee8b8e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:48.919637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d30b-5e27-48be-9e4f-781ee8b8e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:48.919931 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d30b-5e27-48be-9e4f-781ee8b8e4d7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:48.923260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:48.930033 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9d30b-5e27-48be-9e4f-781ee8b8e4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:48.931968 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9d30b-5e27-48be-9e4f-781ee8b8e4d7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-52f9d30b-5e27-48be-9e4f-781ee8b8e4d7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:48.949626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:48.950788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:48.951861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:48.951861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:48.951861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:48.951861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:48.951861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:48.951861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:48.951861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:48.951861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:48.951861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:03:48.951861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:48.954828 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 297/596] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:48.956072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9d30b-5e27-48be-9e4f-781ee8b8e4d7 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:48.974852 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:49.036956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130383a2-16ab-4365-8505-41bb821037ce None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:49.075697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4f339-e374-424f-baa0-b92b323c3f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:49.076764 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4f339-e374-424f-baa0-b92b323c3f86 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:49.077278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4f339-e374-424f-baa0-b92b323c3f86 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:49.077780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4f339-e374-424f-baa0-b92b323c3f86 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:49.078779 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4f339-e374-424f-baa0-b92b323c3f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:49.079309 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4f339-e374-424f-baa0-b92b323c3f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:49.080971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4f339-e374-424f-baa0-b92b323c3f86 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:49.094077 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 300/597] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:49.095493 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4f339-e374-424f-baa0-b92b323c3f86 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:49.097119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9d30b-5e27-48be-9e4f-781ee8b8e4d7 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:49.142452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15c702-4a0a-46d2-b13b-34dc0a2bf378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:49.143294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c702-4a0a-46d2-b13b-34dc0a2bf378 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:49.143578 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c702-4a0a-46d2-b13b-34dc0a2bf378 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:49.143852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c702-4a0a-46d2-b13b-34dc0a2bf378 None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/537c1b1095ce482a8d1f5fd95bd98db5/roles/2c04974ce949479c8b4826c59fb652b3` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:49.159764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15c702-4a0a-46d2-b13b-34dc0a2bf378 None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=537c1b1095ce482a8d1f5fd95bd98db5, role_id=2c04974ce949479c8b4826c59fb652b3)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:49.161221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15c702-4a0a-46d2-b13b-34dc0a2bf378 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:49.203262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4f339-e374-424f-baa0-b92b323c3f86 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:49.215160 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:49.227147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 298/598] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:03:48 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/537c1b1095ce482a8d1f5fd95bd98db5/roles/2c04974ce949479c8b4826c59fb652b3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:49.228213 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15c702-4a0a-46d2-b13b-34dc0a2bf378 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:49.250675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c92cc7-6c4a-4fa4-9033-d466289ed4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:49.251395 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c92cc7-6c4a-4fa4-9033-d466289ed4a2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:49.251721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c92cc7-6c4a-4fa4-9033-d466289ed4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:49.252082 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c92cc7-6c4a-4fa4-9033-d466289ed4a2 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:49.252983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c92cc7-6c4a-4fa4-9033-d466289ed4a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:49.253251 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c92cc7-6c4a-4fa4-9033-d466289ed4a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:49.255005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c92cc7-6c4a-4fa4-9033-d466289ed4a2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:49.281405 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 301/599] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:03:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:49.281405 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658333a-0d23-45c9-9111-8a15d209adc5 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:49.281405 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658333a-0d23-45c9-9111-8a15d209adc5 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:49.281405 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658333a-0d23-45c9-9111-8a15d209adc5 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:49.284903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 302/600] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:49.285883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658333a-0d23-45c9-9111-8a15d209adc5 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:49.324844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:49.393080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15c702-4a0a-46d2-b13b-34dc0a2bf378 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:49.441137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90bd45-09d3-4dc2-ba63-d330c6ce611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:49.442319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90bd45-09d3-4dc2-ba63-d330c6ce611b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:49.442319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90bd45-09d3-4dc2-ba63-d330c6ce611b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:49.442527 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90bd45-09d3-4dc2-ba63-d330c6ce611b None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:49.450933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658333a-0d23-45c9-9111-8a15d209adc5 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:49.452407 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90bd45-09d3-4dc2-ba63-d330c6ce611b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:49.453885 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90bd45-09d3-4dc2-ba63-d330c6ce611b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-7c90bd45-09d3-4dc2-ba63-d330c6ce611b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:49.470696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:49.472359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:49.473475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:49.473475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:49.473475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:49.473475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:49.473475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:49.473475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:49.473475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:49.473475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:49.473475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 299/601] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:49.474008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfee64-5103-421e-8b91-4d1561a67fc4 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:49.474081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfee64-5103-421e-8b91-4d1561a67fc4 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:49.474715 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfee64-5103-421e-8b91-4d1561a67fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:49.493188 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-72cfee64-5103-421e-8b91-4d1561a67fc4 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:49.494442 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-72cfee64-5103-421e-8b91-4d1561a67fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:49.500378 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b629b28-dee7-441c-9de6-1e770c2dacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:49.501926 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629b28-dee7-441c-9de6-1e770c2dacb9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:49.502431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629b28-dee7-441c-9de6-1e770c2dacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:49.502971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629b28-dee7-441c-9de6-1e770c2dacb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:49.517501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b629b28-dee7-441c-9de6-1e770c2dacb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:49.519224 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b629b28-dee7-441c-9de6-1e770c2dacb9 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-8b629b28-dee7-441c-9de6-1e770c2dacb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:49.540008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:49.541080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:49.542088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:49.542088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:49.542088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:49.542088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:49.546531 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 303/602] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:49.547447 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b629b28-dee7-441c-9de6-1e770c2dacb9 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:49.568621 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:49.577046 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 300/603] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:49.578162 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfee64-5103-421e-8b91-4d1561a67fc4 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:49.619919 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:49.688788 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b629b28-dee7-441c-9de6-1e770c2dacb9 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:49.723329 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfee64-5103-421e-8b91-4d1561a67fc4 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:49.727773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece02ec-f719-4000-81be-903c91f54c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:49.728588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece02ec-f719-4000-81be-903c91f54c49 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:49.728972 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece02ec-f719-4000-81be-903c91f54c49 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:49.729348 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece02ec-f719-4000-81be-903c91f54c49 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:49.730334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece02ec-f719-4000-81be-903c91f54c49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:49.730776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece02ec-f719-4000-81be-903c91f54c49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:49.732340 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece02ec-f719-4000-81be-903c91f54c49 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:49.750064 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 304/604] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:49.751425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece02ec-f719-4000-81be-903c91f54c49 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:49.765135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1a69-97e4-4a6f-b054-34c461be0519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:49.766032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1a69-97e4-4a6f-b054-34c461be0519 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:49.766467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1a69-97e4-4a6f-b054-34c461be0519 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:49.766937 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1a69-97e4-4a6f-b054-34c461be0519 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:49.767705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1a69-97e4-4a6f-b054-34c461be0519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:49.768154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1a69-97e4-4a6f-b054-34c461be0519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:49.769726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1a69-97e4-4a6f-b054-34c461be0519 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:49.783153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 301/605] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:49.784105 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1a69-97e4-4a6f-b054-34c461be0519 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:49.867021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:49.888053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece02ec-f719-4000-81be-903c91f54c49 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:49.898446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:49.906479 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1a69-97e4-4a6f-b054-34c461be0519 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:49.937177 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0349f2-8a07-472b-bfb5-0d5b311394b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:49.937983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0349f2-8a07-472b-bfb5-0d5b311394b9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:49.938278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0349f2-8a07-472b-bfb5-0d5b311394b9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:49.938554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0349f2-8a07-472b-bfb5-0d5b311394b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:49.946902 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623a1d6-c45d-4443-8ddd-035e32c15775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:49.948148 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623a1d6-c45d-4443-8ddd-035e32c15775 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:49.948643 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623a1d6-c45d-4443-8ddd-035e32c15775 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:49.949757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623a1d6-c45d-4443-8ddd-035e32c15775 None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/d42b12ce8488404d8ae10a4fefcdddb4/roles/2c04974ce949479c8b4826c59fb652b3` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:49.951721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0349f2-8a07-472b-bfb5-0d5b311394b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-bd0349f2-8a07-472b-bfb5-0d5b311394b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:49.959968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:49.960999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:49.961976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:49.969833 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 305/606] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:49.969833 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0349f2-8a07-472b-bfb5-0d5b311394b9 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:49.971428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623a1d6-c45d-4443-8ddd-035e32c15775 None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=d42b12ce8488404d8ae10a4fefcdddb4, role_id=2c04974ce949479c8b4826c59fb652b3)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:49.975532 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623a1d6-c45d-4443-8ddd-035e32c15775 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:50.054914 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 302/607] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:03:49 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/d42b12ce8488404d8ae10a4fefcdddb4/roles/2c04974ce949479c8b4826c59fb652b3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:50.056020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623a1d6-c45d-4443-8ddd-035e32c15775 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:50.092593 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0349f2-8a07-472b-bfb5-0d5b311394b9 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:50.146195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6295-2d43-4ad6-ad1e-db6e29d115ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:50.147451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6295-2d43-4ad6-ad1e-db6e29d115ad None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:50.147985 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6295-2d43-4ad6-ad1e-db6e29d115ad None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:50.149118 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6295-2d43-4ad6-ad1e-db6e29d115ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:50.154853 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:50.161696 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c6295-2d43-4ad6-ad1e-db6e29d115ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:50.164273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c6295-2d43-4ad6-ad1e-db6e29d115ad None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-f78c6295-2d43-4ad6-ad1e-db6e29d115ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:50.183686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:50.184916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:50.185950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:50.185950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:50.185950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:50.185950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:50.185950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:50.185950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:50.185950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:50.185950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:50.188937 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 306/608] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:50.190758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea342b-8b99-408b-9ce8-ad2d35875691 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:50.191213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea342b-8b99-408b-9ce8-ad2d35875691 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:50.191689 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea342b-8b99-408b-9ce8-ad2d35875691 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:50.193850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 307/609] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:50.194874 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea342b-8b99-408b-9ce8-ad2d35875691 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:50.219790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623a1d6-c45d-4443-8ddd-035e32c15775 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:50.261216 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ace89-4f80-4ab3-b1b7-abf8e4d6ec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:50.262101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ace89-4f80-4ab3-b1b7-abf8e4d6ec08 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:50.262489 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ace89-4f80-4ab3-b1b7-abf8e4d6ec08 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:50.262873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ace89-4f80-4ab3-b1b7-abf8e4d6ec08 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:50.263733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ace89-4f80-4ab3-b1b7-abf8e4d6ec08 None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:50.264187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ace89-4f80-4ab3-b1b7-abf8e4d6ec08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:50.265627 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ace89-4f80-4ab3-b1b7-abf8e4d6ec08 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:50.279804 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 303/610] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:50.280945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5213918-c3c7-44c8-ac17-d085fc4c9920 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:50.281230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5213918-c3c7-44c8-ac17-d085fc4c9920 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:50.281509 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5213918-c3c7-44c8-ac17-d085fc4c9920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:50.301052 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-d5213918-c3c7-44c8-ac17-d085fc4c9920 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:50.303300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-d5213918-c3c7-44c8-ac17-d085fc4c9920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:50.304811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:50.329220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea342b-8b99-408b-9ce8-ad2d35875691 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:50.368518 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b56b9-4baa-4ead-a0bb-5c867dfab2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:50.369238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b56b9-4baa-4ead-a0bb-5c867dfab2dc None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:50.369519 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b56b9-4baa-4ead-a0bb-5c867dfab2dc None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:50.369788 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b56b9-4baa-4ead-a0bb-5c867dfab2dc None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:50.371930 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b56b9-4baa-4ead-a0bb-5c867dfab2dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:50.371930 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b56b9-4baa-4ead-a0bb-5c867dfab2dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:50.374504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b56b9-4baa-4ead-a0bb-5c867dfab2dc None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:50.384243 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 304/611] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:50.386052 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5213918-c3c7-44c8-ac17-d085fc4c9920 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:50.398001 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 308/612] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:50.404420 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b56b9-4baa-4ead-a0bb-5c867dfab2dc None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:50.485483 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:50.508865 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5213918-c3c7-44c8-ac17-d085fc4c9920 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:50.540455 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b56b9-4baa-4ead-a0bb-5c867dfab2dc None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:50.549940 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed99be9-0ff9-40c1-bdca-1d3f93fff0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:50.550872 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed99be9-0ff9-40c1-bdca-1d3f93fff0aa None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:50.551218 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed99be9-0ff9-40c1-bdca-1d3f93fff0aa None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:50.551810 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed99be9-0ff9-40c1-bdca-1d3f93fff0aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:50.559908 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:50.564696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed99be9-0ff9-40c1-bdca-1d3f93fff0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:50.566267 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed99be9-0ff9-40c1-bdca-1d3f93fff0aa None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:50.585508 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0b340-18e4-45a9-9fc1-74f7e8100467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:50.586779 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0b340-18e4-45a9-9fc1-74f7e8100467 None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-3ed99be9-0ff9-40c1-bdca-1d3f93fff0aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:50.587094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:50.588057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:50.589063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:50.589063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:50.589063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:50.589063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:50.590063 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0b340-18e4-45a9-9fc1-74f7e8100467 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:50.590569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0b340-18e4-45a9-9fc1-74f7e8100467 None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/c771be7b66514ef99680f64fb486e205/roles/2c04974ce949479c8b4826c59fb652b3` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:50.593262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 305/613] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:50.594169 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed99be9-0ff9-40c1-bdca-1d3f93fff0aa None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:50.610021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0b340-18e4-45a9-9fc1-74f7e8100467 None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=c771be7b66514ef99680f64fb486e205, role_id=2c04974ce949479c8b4826c59fb652b3)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:50.612054 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0b340-18e4-45a9-9fc1-74f7e8100467 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:50.689078 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 309/614] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:03:50 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/c771be7b66514ef99680f64fb486e205/roles/2c04974ce949479c8b4826c59fb652b3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:50.691141 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0b340-18e4-45a9-9fc1-74f7e8100467 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:50.726218 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed99be9-0ff9-40c1-bdca-1d3f93fff0aa None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:50.795517 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53ddb1-f340-48c7-962b-f1ecbe7a0b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:50.796252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53ddb1-f340-48c7-962b-f1ecbe7a0b02 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:50.796534 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53ddb1-f340-48c7-962b-f1ecbe7a0b02 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:50.796815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53ddb1-f340-48c7-962b-f1ecbe7a0b02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:50.814109 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53ddb1-f340-48c7-962b-f1ecbe7a0b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-aa53ddb1-f340-48c7-962b-f1ecbe7a0b02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:50.826776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:50.827917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:50.828886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 306/615] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:50.835412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53ddb1-f340-48c7-962b-f1ecbe7a0b02 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:50.837686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0b340-18e4-45a9-9fc1-74f7e8100467 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:50.852211 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:50.920824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:50.924026 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe37765-876b-460f-8785-689699d4351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:50.924911 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37765-876b-460f-8785-689699d4351a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:50.925516 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37765-876b-460f-8785-689699d4351a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:50.925892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37765-876b-460f-8785-689699d4351a None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:50.927064 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe37765-876b-460f-8785-689699d4351a None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:50.927477 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe37765-876b-460f-8785-689699d4351a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:50.928979 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe37765-876b-460f-8785-689699d4351a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:50.948365 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 310/616] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:50.954057 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe37765-876b-460f-8785-689699d4351a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:50.988960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53ddb1-f340-48c7-962b-f1ecbe7a0b02 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:51.040574 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254868-ffda-478e-8d9b-ccae5b5e99db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:51.041363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254868-ffda-478e-8d9b-ccae5b5e99db None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:51.041726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254868-ffda-478e-8d9b-ccae5b5e99db None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:51.042079 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254868-ffda-478e-8d9b-ccae5b5e99db None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:51.042988 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2254868-ffda-478e-8d9b-ccae5b5e99db None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:51.043373 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2254868-ffda-478e-8d9b-ccae5b5e99db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:51.044891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2254868-ffda-478e-8d9b-ccae5b5e99db None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:51.057154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 307/617] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:51.067610 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254868-ffda-478e-8d9b-ccae5b5e99db None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:51.080598 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe37765-876b-460f-8785-689699d4351a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:51.116040 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2c90-699c-4c45-a308-113578935ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:51.116967 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2c90-699c-4c45-a308-113578935ead None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:51.117331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2c90-699c-4c45-a308-113578935ead None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:51.117686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2c90-699c-4c45-a308-113578935ead None admin] PATH_INFO: `/v3/users/nova` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:51.133228 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef2c90-699c-4c45-a308-113578935ead None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:51.141081 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef2c90-699c-4c45-a308-113578935ead None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-e3ef2c90-699c-4c45-a308-113578935ead None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:51.174982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:51.176330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:51.177890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:51.177890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:51.177890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:51.177890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:51.177890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:51.177890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:51.177890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:51.177890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:51.177890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:03:51.177890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:51.177890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 311/618] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:03:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:03:51.181951 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2c90-699c-4c45-a308-113578935ead None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:51.203652 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254868-ffda-478e-8d9b-ccae5b5e99db None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:51.226508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:51.253395 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4363f-418d-4ee2-bbed-811a08f29fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:51.256175 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4363f-418d-4ee2-bbed-811a08f29fbe None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:51.257558 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4363f-418d-4ee2-bbed-811a08f29fbe None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:51.257946 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4363f-418d-4ee2-bbed-811a08f29fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:51.258983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:51.285004 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4363f-418d-4ee2-bbed-811a08f29fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:51.291677 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4363f-418d-4ee2-bbed-811a08f29fbe None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-dec4363f-418d-4ee2-bbed-811a08f29fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:51.334750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:51.335911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:51.337137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:51.337137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:51.337137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:51.337137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:51.339173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 308/619] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:51.347743 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4363f-418d-4ee2-bbed-811a08f29fbe None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:51.397682 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2c90-699c-4c45-a308-113578935ead None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:51.436400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcdc50-d991-4af5-8866-689dbe21fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:51.437085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcdc50-d991-4af5-8866-689dbe21fc30 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:51.437367 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcdc50-d991-4af5-8866-689dbe21fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:51.437643 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcdc50-d991-4af5-8866-689dbe21fc30 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:51.438512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcdc50-d991-4af5-8866-689dbe21fc30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:51.438857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcdc50-d991-4af5-8866-689dbe21fc30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:51.440321 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcdc50-d991-4af5-8866-689dbe21fc30 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:51.460295 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 312/620] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:03:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:03:51.466005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcdc50-d991-4af5-8866-689dbe21fc30 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:51.508901 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4363f-418d-4ee2-bbed-811a08f29fbe None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:51.547369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49d286-b460-44e1-a3ed-727290064d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:51.548040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49d286-b460-44e1-a3ed-727290064d30 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:51.548321 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49d286-b460-44e1-a3ed-727290064d30 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:51.548770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49d286-b460-44e1-a3ed-727290064d30 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:51.549679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49d286-b460-44e1-a3ed-727290064d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:51.549993 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49d286-b460-44e1-a3ed-727290064d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:51.551424 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49d286-b460-44e1-a3ed-727290064d30 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:51.566375 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 309/621] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:51.571731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49d286-b460-44e1-a3ed-727290064d30 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:51.620317 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:51.632641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcdc50-d991-4af5-8866-689dbe21fc30 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:51.633069 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:51.686931 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf6af1-e598-45e2-8329-a98b1de78a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:51.687613 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf6af1-e598-45e2-8329-a98b1de78a2c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:51.687892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf6af1-e598-45e2-8329-a98b1de78a2c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:51.688167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf6af1-e598-45e2-8329-a98b1de78a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:51.802515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49d286-b460-44e1-a3ed-727290064d30 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:51.818667 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf6af1-e598-45e2-8329-a98b1de78a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:51.820307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf6af1-e598-45e2-8329-a98b1de78a2c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:51.868809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621290d4-40ac-48e8-a700-63f22c2bb7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:51.869614 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621290d4-40ac-48e8-a700-63f22c2bb7f9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:51.869896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621290d4-40ac-48e8-a700-63f22c2bb7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:51.870169 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621290d4-40ac-48e8-a700-63f22c2bb7f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:51.880411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621290d4-40ac-48e8-a700-63f22c2bb7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:51.881788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621290d4-40ac-48e8-a700-63f22c2bb7f9 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-621290d4-40ac-48e8-a700-63f22c2bb7f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:51.901907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:51.903332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 310/622] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:03:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e704-bfb4-4b9b-807c-9b36684102aa None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:51.908126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e704-bfb4-4b9b-807c-9b36684102aa None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:51.909088 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e704-bfb4-4b9b-807c-9b36684102aa None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:51.909088 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 311/623] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:51.913361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525e704-bfb4-4b9b-807c-9b36684102aa None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:51.944578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:51.963045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 313/624] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:51.964772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb1bed-870b-4335-835d-e26cceb07073 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:51.965064 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb1bed-870b-4335-835d-e26cceb07073 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:51.965341 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb1bed-870b-4335-835d-e26cceb07073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:51.983884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-b8fb1bed-870b-4335-835d-e26cceb07073 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:51.985100 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-b8fb1bed-870b-4335-835d-e26cceb07073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:52.011076 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:52.030112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525e704-bfb4-4b9b-807c-9b36684102aa None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:52.066676 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 314/625] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:52.066676 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb1bed-870b-4335-835d-e26cceb07073 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:52.082810 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2a4d7-a5fc-4004-bf17-8adbaf78b829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:52.083900 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2a4d7-a5fc-4004-bf17-8adbaf78b829 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:52.084455 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2a4d7-a5fc-4004-bf17-8adbaf78b829 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:52.084947 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2a4d7-a5fc-4004-bf17-8adbaf78b829 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:52.086099 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2a4d7-a5fc-4004-bf17-8adbaf78b829 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:52.086701 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2a4d7-a5fc-4004-bf17-8adbaf78b829 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:52.094969 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2a4d7-a5fc-4004-bf17-8adbaf78b829 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:52.126013 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 312/626] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:03:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:52.127343 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2a4d7-a5fc-4004-bf17-8adbaf78b829 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:52.171293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb1bed-870b-4335-835d-e26cceb07073 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:52.209061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a8523-384a-4c9a-8ac7-6a010bf60c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:52.212866 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a8523-384a-4c9a-8ac7-6a010bf60c83 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:52.213167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a8523-384a-4c9a-8ac7-6a010bf60c83 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:52.213720 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a8523-384a-4c9a-8ac7-6a010bf60c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:52.227079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:52.231621 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a8523-384a-4c9a-8ac7-6a010bf60c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:52.233135 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a8523-384a-4c9a-8ac7-6a010bf60c83 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:52.241404 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2a4d7-a5fc-4004-bf17-8adbaf78b829 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-470a8523-384a-4c9a-8ac7-6a010bf60c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:52.252722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:52.260328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:52.261312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:52.261312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:52.261312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:52.261312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:52.261312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 315/627] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:52.261312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a8523-384a-4c9a-8ac7-6a010bf60c83 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:52.292130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57492189-ad57-49e7-a4e7-51e9a2e7a24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:52.292975 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57492189-ad57-49e7-a4e7-51e9a2e7a24b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:52.293258 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57492189-ad57-49e7-a4e7-51e9a2e7a24b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:52.293846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57492189-ad57-49e7-a4e7-51e9a2e7a24b None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:52.315706 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57492189-ad57-49e7-a4e7-51e9a2e7a24b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-57492189-ad57-49e7-a4e7-51e9a2e7a24b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:52.327781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:52.328910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:52.329827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:52.332225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 313/628] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:52.332860 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57492189-ad57-49e7-a4e7-51e9a2e7a24b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:52.337301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:52.377775 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a8523-384a-4c9a-8ac7-6a010bf60c83 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:52.416018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c0e9-56cc-44e1-a49b-824b91f69132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:52.416831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c0e9-56cc-44e1-a49b-824b91f69132 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:52.417115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c0e9-56cc-44e1-a49b-824b91f69132 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:52.417391 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c0e9-56cc-44e1-a49b-824b91f69132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:52.432584 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0c0e9-56cc-44e1-a49b-824b91f69132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:52.435216 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0c0e9-56cc-44e1-a49b-824b91f69132 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:52.459646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57492189-ad57-49e7-a4e7-51e9a2e7a24b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-57b0c0e9-56cc-44e1-a49b-824b91f69132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:52.460772 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:52.461693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:52.462692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:52.462692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:52.462692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:52.462692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:52.463601 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 316/629] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:52.464038 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c0e9-56cc-44e1-a49b-824b91f69132 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:52.500115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:52.502244 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235d468-ff8c-4cf2-82a5-9093220c49a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:52.503246 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235d468-ff8c-4cf2-82a5-9093220c49a6 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:52.503795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235d468-ff8c-4cf2-82a5-9093220c49a6 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:52.504286 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235d468-ff8c-4cf2-82a5-9093220c49a6 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:52.505280 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235d468-ff8c-4cf2-82a5-9093220c49a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:52.505794 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235d468-ff8c-4cf2-82a5-9093220c49a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:52.507426 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235d468-ff8c-4cf2-82a5-9093220c49a6 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:52.526679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 314/630] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:52.529063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235d468-ff8c-4cf2-82a5-9093220c49a6 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:52.599645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:52.609483 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c0e9-56cc-44e1-a49b-824b91f69132 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:52.647880 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235d468-ff8c-4cf2-82a5-9093220c49a6 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:52.659024 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b32904-33b1-4a7e-bd80-bf5dd3ea6776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:52.660004 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b32904-33b1-4a7e-bd80-bf5dd3ea6776 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:52.660289 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b32904-33b1-4a7e-bd80-bf5dd3ea6776 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:52.660723 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b32904-33b1-4a7e-bd80-bf5dd3ea6776 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:52.661485 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b32904-33b1-4a7e-bd80-bf5dd3ea6776 None admin] RBAC: Adding query filter params (name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:52.661789 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b32904-33b1-4a7e-bd80-bf5dd3ea6776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:52.663269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b32904-33b1-4a7e-bd80-bf5dd3ea6776 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:52.674793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 317/631] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:52.674793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b32904-33b1-4a7e-bd80-bf5dd3ea6776 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:52.689679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d70b4-4b69-4a68-b110-3a49c5d6aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:52.690577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d70b4-4b69-4a68-b110-3a49c5d6aee8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:52.690912 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d70b4-4b69-4a68-b110-3a49c5d6aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:52.691380 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d70b4-4b69-4a68-b110-3a49c5d6aee8 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:52.692101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d70b4-4b69-4a68-b110-3a49c5d6aee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:52.692408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d70b4-4b69-4a68-b110-3a49c5d6aee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:52.693768 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d70b4-4b69-4a68-b110-3a49c5d6aee8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:52.706114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 315/632] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:52.707441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2e6e4-883b-4ad0-95ad-75415865f9f7 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:52.707729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2e6e4-883b-4ad0-95ad-75415865f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:52.708003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2e6e4-883b-4ad0-95ad-75415865f9f7 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:52.710640 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 316/633] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:52.710640 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2e6e4-883b-4ad0-95ad-75415865f9f7 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:52.772281 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:52.797204 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b32904-33b1-4a7e-bd80-bf5dd3ea6776 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:52.825241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2e6e4-883b-4ad0-95ad-75415865f9f7 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:52.839177 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683a90e-0094-4199-8f87-b593d4d48573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:52.840879 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a90e-0094-4199-8f87-b593d4d48573 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:52.841320 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a90e-0094-4199-8f87-b593d4d48573 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:52.841773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a90e-0094-4199-8f87-b593d4d48573 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:52.848985 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683a90e-0094-4199-8f87-b593d4d48573 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:52.850007 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:52.850437 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683a90e-0094-4199-8f87-b593d4d48573 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:52.861934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aab3b0-f923-4631-9297-6b603731f797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:52.862773 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aab3b0-f923-4631-9297-6b603731f797 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:52.863056 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aab3b0-f923-4631-9297-6b603731f797 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:52.863327 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aab3b0-f923-4631-9297-6b603731f797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-6683a90e-0094-4199-8f87-b593d4d48573 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:52.865693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:52.866956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:52.868090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:52.868090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:52.868090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:52.868090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:52.868090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:52.868090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:52.868090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:52.868090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:52.868090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 318/634] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:52.872339 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683a90e-0094-4199-8f87-b593d4d48573 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:52.877690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aab3b0-f923-4631-9297-6b603731f797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:52.879979 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aab3b0-f923-4631-9297-6b603731f797 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-d6aab3b0-f923-4631-9297-6b603731f797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:52.899068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:52.900268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:52.901635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:52.901635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:52.901635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:52.901635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:52.901635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 317/635] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:52.904419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8103-3ad3-4cd0-a82e-9e5ff566f0ef None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:52.904872 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8103-3ad3-4cd0-a82e-9e5ff566f0ef None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:52.905755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8103-3ad3-4cd0-a82e-9e5ff566f0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:52.924001 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-46dd8103-3ad3-4cd0-a82e-9e5ff566f0ef None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:52.925203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-46dd8103-3ad3-4cd0-a82e-9e5ff566f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:52.987267 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683a90e-0094-4199-8f87-b593d4d48573 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:52.998807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 318/636] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:52.999649 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8103-3ad3-4cd0-a82e-9e5ff566f0ef None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:53.040815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2116535-f340-4fd7-bdd2-b986faa96140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:53.041632 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116535-f340-4fd7-bdd2-b986faa96140 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:53.041912 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116535-f340-4fd7-bdd2-b986faa96140 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:53.042258 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116535-f340-4fd7-bdd2-b986faa96140 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:53.049913 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2116535-f340-4fd7-bdd2-b986faa96140 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:53.051442 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2116535-f340-4fd7-bdd2-b986faa96140 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:53.055191 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-d2116535-f340-4fd7-bdd2-b986faa96140 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:53.068623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:53.076143 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:53.077161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:53.077161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:53.077161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:53.077161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:53.077161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:53.077161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:53.077161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:53.077161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:53.077161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 319/637] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:53.077161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2116535-f340-4fd7-bdd2-b986faa96140 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:53.122081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8103-3ad3-4cd0-a82e-9e5ff566f0ef None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:53.124744 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:53.160950 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec5c8b-00ee-452c-9b02-8622306ad02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:53.161887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5c8b-00ee-452c-9b02-8622306ad02a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:53.162177 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5c8b-00ee-452c-9b02-8622306ad02a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:53.162458 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5c8b-00ee-452c-9b02-8622306ad02a None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:53.163292 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec5c8b-00ee-452c-9b02-8622306ad02a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:53.163606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec5c8b-00ee-452c-9b02-8622306ad02a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:53.165042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec5c8b-00ee-452c-9b02-8622306ad02a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:53.177321 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 319/638] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:53.178131 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec5c8b-00ee-452c-9b02-8622306ad02a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:53.186941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2116535-f340-4fd7-bdd2-b986faa96140 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:53.230868 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7b313-ad73-4599-aaa3-75eb49a1b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:53.231642 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b313-ad73-4599-aaa3-75eb49a1b365 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:53.231991 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b313-ad73-4599-aaa3-75eb49a1b365 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:53.232333 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b313-ad73-4599-aaa3-75eb49a1b365 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:53.233138 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7b313-ad73-4599-aaa3-75eb49a1b365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:53.233453 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7b313-ad73-4599-aaa3-75eb49a1b365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:53.234863 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7b313-ad73-4599-aaa3-75eb49a1b365 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:53.248804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 320/639] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:53.249673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7b313-ad73-4599-aaa3-75eb49a1b365 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:53.290632 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec5c8b-00ee-452c-9b02-8622306ad02a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:53.312674 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:53.326104 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303822-7608-47cc-a728-9228aae6125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:53.326931 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303822-7608-47cc-a728-9228aae6125d None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:53.327210 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303822-7608-47cc-a728-9228aae6125d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:53.327482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303822-7608-47cc-a728-9228aae6125d None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:53.338069 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8303822-7608-47cc-a728-9228aae6125d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-a8303822-7608-47cc-a728-9228aae6125d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:53.346796 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:53.348037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 320/640] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:53.349510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303822-7608-47cc-a728-9228aae6125d None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:53.360114 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7b313-ad73-4599-aaa3-75eb49a1b365 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:53.375548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:53.394468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345bc0e-d6d4-4384-9c9e-82afffad998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:53.395165 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345bc0e-d6d4-4384-9c9e-82afffad998e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:53.395449 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345bc0e-d6d4-4384-9c9e-82afffad998e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:53.395725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345bc0e-d6d4-4384-9c9e-82afffad998e None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:53.396527 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345bc0e-d6d4-4384-9c9e-82afffad998e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:53.396840 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345bc0e-d6d4-4384-9c9e-82afffad998e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:53.398452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345bc0e-d6d4-4384-9c9e-82afffad998e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:53.411218 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 321/641] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:53.412508 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9db59-1ebe-4b3f-815f-4827bb04445e None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:53.412791 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9db59-1ebe-4b3f-815f-4827bb04445e None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:53.413065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9db59-1ebe-4b3f-815f-4827bb04445e None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:53.414299 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 322/642] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:53.415019 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9db59-1ebe-4b3f-815f-4827bb04445e None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:53.456623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303822-7608-47cc-a728-9228aae6125d None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:53.491870 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2f9a-f596-421d-98cb-b63e875161aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:53.492943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2f9a-f596-421d-98cb-b63e875161aa None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:53.493239 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2f9a-f596-421d-98cb-b63e875161aa None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:53.493516 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2f9a-f596-421d-98cb-b63e875161aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:53.494361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b2f9a-f596-421d-98cb-b63e875161aa None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=e0b88c1582c849349cc441446f6cca20) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:53.495071 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b2f9a-f596-421d-98cb-b63e875161aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:53.496665 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b2f9a-f596-421d-98cb-b63e875161aa None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:53.502687 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 321/643] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:53 2022] GET /identity/v3/role_assignments?user.id=e0b88c1582c849349cc441446f6cca20&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:53.503408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2f9a-f596-421d-98cb-b63e875161aa None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:53.519542 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9db59-1ebe-4b3f-815f-4827bb04445e None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:53.543699 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:53.560370 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14099b59-8a87-46b7-b4c7-422d35c9a700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:53.562414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14099b59-8a87-46b7-b4c7-422d35c9a700 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:53.562728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14099b59-8a87-46b7-b4c7-422d35c9a700 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:53.563007 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14099b59-8a87-46b7-b4c7-422d35c9a700 None admin] PATH_INFO: `/v3/users/glance` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:53.573558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14099b59-8a87-46b7-b4c7-422d35c9a700 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:53.575247 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14099b59-8a87-46b7-b4c7-422d35c9a700 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-14099b59-8a87-46b7-b4c7-422d35c9a700 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:53.591059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:53.592413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:53.593721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:53.593721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:53.593721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:53.593721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:53.593721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:53.593721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:53.593721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:53.593721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:53.593721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:03:53.593721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:53.594721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 323/644] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:53.595548 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14099b59-8a87-46b7-b4c7-422d35c9a700 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:53.632006 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:53.645140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2f9a-f596-421d-98cb-b63e875161aa None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:53.689892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd35bf-5234-4d7a-adeb-17e6cba7febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:53.690644 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd35bf-5234-4d7a-adeb-17e6cba7febc None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:53.690887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd35bf-5234-4d7a-adeb-17e6cba7febc None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:53.691167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd35bf-5234-4d7a-adeb-17e6cba7febc None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:53.691927 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd35bf-5234-4d7a-adeb-17e6cba7febc None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:53.692238 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd35bf-5234-4d7a-adeb-17e6cba7febc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:53.693615 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd35bf-5234-4d7a-adeb-17e6cba7febc None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:53.704060 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 322/645] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:53.705351 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed937d-1b4d-4b60-8d07-660eceb3f0fe None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:53.705645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed937d-1b4d-4b60-8d07-660eceb3f0fe None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:53.705929 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed937d-1b4d-4b60-8d07-660eceb3f0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:53.723202 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14099b59-8a87-46b7-b4c7-422d35c9a700 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:53.724192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-59ed937d-1b4d-4b60-8d07-660eceb3f0fe None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:53.725554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-59ed937d-1b4d-4b60-8d07-660eceb3f0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:53.767809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7a263-caeb-4689-b3b6-9b32f975a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:53.768630 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7a263-caeb-4689-b3b6-9b32f975a2ec None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:53.768913 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7a263-caeb-4689-b3b6-9b32f975a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:53.769291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7a263-caeb-4689-b3b6-9b32f975a2ec None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/78d1f9ebc22a412db074e8aae5db8e9b/roles/2c04974ce949479c8b4826c59fb652b3` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:53.787951 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7a263-caeb-4689-b3b6-9b32f975a2ec None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=78d1f9ebc22a412db074e8aae5db8e9b, role_id=2c04974ce949479c8b4826c59fb652b3)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:53.789736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7a263-caeb-4689-b3b6-9b32f975a2ec None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:53.805524 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 323/646] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:53.807346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed937d-1b4d-4b60-8d07-660eceb3f0fe None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:53.861371 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 324/647] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:03:53 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/78d1f9ebc22a412db074e8aae5db8e9b/roles/2c04974ce949479c8b4826c59fb652b3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:03:53.862241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7a263-caeb-4689-b3b6-9b32f975a2ec None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:53.905930 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:53.924709 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:53.957732 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed937d-1b4d-4b60-8d07-660eceb3f0fe None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:54.003452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7a263-caeb-4689-b3b6-9b32f975a2ec None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:54.014803 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e898c-ecec-4672-b261-5ad7e5a577c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:54.016489 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e898c-ecec-4672-b261-5ad7e5a577c9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:54.017042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e898c-ecec-4672-b261-5ad7e5a577c9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:54.018119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e898c-ecec-4672-b261-5ad7e5a577c9 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:54.019742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e898c-ecec-4672-b261-5ad7e5a577c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:54.020356 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e898c-ecec-4672-b261-5ad7e5a577c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:54.023342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e898c-ecec-4672-b261-5ad7e5a577c9 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:54.046194 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823e9b0-4144-47e3-a381-ca8199037967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:54.047274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823e9b0-4144-47e3-a381-ca8199037967 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:54.047599 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823e9b0-4144-47e3-a381-ca8199037967 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:54.048011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823e9b0-4144-47e3-a381-ca8199037967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:54.050915 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 324/648] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:03:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:54.052890 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e898c-ecec-4672-b261-5ad7e5a577c9 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:54.062933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823e9b0-4144-47e3-a381-ca8199037967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:54.065324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823e9b0-4144-47e3-a381-ca8199037967 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-b823e9b0-4144-47e3-a381-ca8199037967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:54.088195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:54.089274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:54.090427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:54.090427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:54.090427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:54.090427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:54.090427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 325/649] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:54.090427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823e9b0-4144-47e3-a381-ca8199037967 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:54.186551 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e898c-ecec-4672-b261-5ad7e5a577c9 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:54.217189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:54.231679 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823e9b0-4144-47e3-a381-ca8199037967 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:54.243679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d933e-bf30-411d-bcc6-9e2ad5255156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:54.244878 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d933e-bf30-411d-bcc6-9e2ad5255156 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:54.245241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d933e-bf30-411d-bcc6-9e2ad5255156 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:54.245593 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d933e-bf30-411d-bcc6-9e2ad5255156 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:54.255844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:54.262424 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d933e-bf30-411d-bcc6-9e2ad5255156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:54.281235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483a495-4b44-4c45-8c00-f3683066b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:54.281235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483a495-4b44-4c45-8c00-f3683066b467 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:54.281235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483a495-4b44-4c45-8c00-f3683066b467 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:54.281235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483a495-4b44-4c45-8c00-f3683066b467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-a14d933e-bf30-411d-bcc6-9e2ad5255156 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:54.281664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:54.282791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 325/650] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:54.283752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d933e-bf30-411d-bcc6-9e2ad5255156 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:54.364107 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483a495-4b44-4c45-8c00-f3683066b467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:54.366147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483a495-4b44-4c45-8c00-f3683066b467 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:54.417063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d933e-bf30-411d-bcc6-9e2ad5255156 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:54.467467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3750f89-63a8-4032-a7c8-77410cda62eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:54.468427 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3750f89-63a8-4032-a7c8-77410cda62eb None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:54.468712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3750f89-63a8-4032-a7c8-77410cda62eb None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:54.468990 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3750f89-63a8-4032-a7c8-77410cda62eb None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:54.469989 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3750f89-63a8-4032-a7c8-77410cda62eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:54.470300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3750f89-63a8-4032-a7c8-77410cda62eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:54.471222 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:54.473138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3750f89-63a8-4032-a7c8-77410cda62eb None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:54.488480 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 326/651] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:54.489338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3750f89-63a8-4032-a7c8-77410cda62eb None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:54.506787 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 326/652] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:54.507720 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483a495-4b44-4c45-8c00-f3683066b467 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:54.566397 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:54.623401 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483a495-4b44-4c45-8c00-f3683066b467 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:54.627529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3750f89-63a8-4032-a7c8-77410cda62eb None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:54.663656 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf0954-c303-4ed7-bd35-79b6428e3f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:54.664473 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf0954-c303-4ed7-bd35-79b6428e3f3d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:54.664894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf0954-c303-4ed7-bd35-79b6428e3f3d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:54.665115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf0954-c303-4ed7-bd35-79b6428e3f3d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:54.674013 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf0954-c303-4ed7-bd35-79b6428e3f3d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:54.675555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf0954-c303-4ed7-bd35-79b6428e3f3d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:54.676866 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51ca6a-e29e-4925-b7b8-6a10f4290fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:54.677547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ca6a-e29e-4925-b7b8-6a10f4290fb8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:54.677825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ca6a-e29e-4925-b7b8-6a10f4290fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:54.678094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51ca6a-e29e-4925-b7b8-6a10f4290fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:54.678957 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51ca6a-e29e-4925-b7b8-6a10f4290fb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:54.679269 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51ca6a-e29e-4925-b7b8-6a10f4290fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:54.680712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51ca6a-e29e-4925-b7b8-6a10f4290fb8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:54.690214 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 327/653] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:54.691194 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51ca6a-e29e-4925-b7b8-6a10f4290fb8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-b3bf0954-c303-4ed7-bd35-79b6428e3f3d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:54.697884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:54.699037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:54.700123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:54.700123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:54.700123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:54.700123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:54.700123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:54.700123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:54.700123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:54.700123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:54.700123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:03:54.700123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:54.703348 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 327/654] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:54.704785 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf0954-c303-4ed7-bd35-79b6428e3f3d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:54.755008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:54.828408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51ca6a-e29e-4925-b7b8-6a10f4290fb8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:54.833621 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf0954-c303-4ed7-bd35-79b6428e3f3d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:54.851144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:54.866684 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8296e91-74c0-46b4-b847-0e2537a03cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:54.867816 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296e91-74c0-46b4-b847-0e2537a03cfb None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:54.867923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296e91-74c0-46b4-b847-0e2537a03cfb None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:54.868186 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296e91-74c0-46b4-b847-0e2537a03cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:54.880388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8296e91-74c0-46b4-b847-0e2537a03cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:54.881849 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8296e91-74c0-46b4-b847-0e2537a03cfb None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:54.887748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d57611-b7be-469f-9b97-7f1b6b911e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:54.888831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d57611-b7be-469f-9b97-7f1b6b911e75 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:54.889349 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d57611-b7be-469f-9b97-7f1b6b911e75 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:54.889858 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d57611-b7be-469f-9b97-7f1b6b911e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-b8296e91-74c0-46b4-b847-0e2537a03cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:54.901666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:54.903268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:54.904273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:54.904273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:54.904273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:54.904273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:54.905982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d57611-b7be-469f-9b97-7f1b6b911e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:54.908260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 328/655] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:54.908563 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d57611-b7be-469f-9b97-7f1b6b911e75 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:54.909148 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8296e91-74c0-46b4-b847-0e2537a03cfb None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-e8d57611-b7be-469f-9b97-7f1b6b911e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:54.935895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:54.937018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:54.937996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:54.937996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:54.937996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:54.937996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:54.940601 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 328/656] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:54.942284 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d57611-b7be-469f-9b97-7f1b6b911e75 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:55.024192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8296e91-74c0-46b4-b847-0e2537a03cfb None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:55.061571 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a68816-2ffd-4d0a-b271-5e386ecbed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:55.062340 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a68816-2ffd-4d0a-b271-5e386ecbed9f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:55.062783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a68816-2ffd-4d0a-b271-5e386ecbed9f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:55.063235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a68816-2ffd-4d0a-b271-5e386ecbed9f None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:55.064143 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a68816-2ffd-4d0a-b271-5e386ecbed9f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:55.064565 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a68816-2ffd-4d0a-b271-5e386ecbed9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:55.066169 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a68816-2ffd-4d0a-b271-5e386ecbed9f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:55.080664 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:55.088311 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 329/657] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 20:03:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:55.089145 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a68816-2ffd-4d0a-b271-5e386ecbed9f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:55.091795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d57611-b7be-469f-9b97-7f1b6b911e75 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:55.129262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:55.131754 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f9ad-e3bf-466c-8578-e225a975f3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:55.132580 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f9ad-e3bf-466c-8578-e225a975f3d6 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:55.133011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f9ad-e3bf-466c-8578-e225a975f3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:55.133388 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f9ad-e3bf-466c-8578-e225a975f3d6 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:55.134224 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f9ad-e3bf-466c-8578-e225a975f3d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:55.134658 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f9ad-e3bf-466c-8578-e225a975f3d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:55.136997 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f9ad-e3bf-466c-8578-e225a975f3d6 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:55.153816 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 329/658] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:55.156431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f9ad-e3bf-466c-8578-e225a975f3d6 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:55.235260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a68816-2ffd-4d0a-b271-5e386ecbed9f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:55.273467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dbbb3-346c-43d3-bc59-3237dacfcdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:55.286346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dbbb3-346c-43d3-bc59-3237dacfcdaf None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:55.286346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dbbb3-346c-43d3-bc59-3237dacfcdaf None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:55.286346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dbbb3-346c-43d3-bc59-3237dacfcdaf None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:55.286346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41dbbb3-346c-43d3-bc59-3237dacfcdaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:55.286346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41dbbb3-346c-43d3-bc59-3237dacfcdaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:55.286813 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f9ad-e3bf-466c-8578-e225a975f3d6 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:55.286895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41dbbb3-346c-43d3-bc59-3237dacfcdaf None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:55.293801 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 330/659] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:55.295175 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dbbb3-346c-43d3-bc59-3237dacfcdaf None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:55.322214 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514674-9473-4d9e-8b9a-ba05cc7a4124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:55.325310 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514674-9473-4d9e-8b9a-ba05cc7a4124 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:55.325310 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514674-9473-4d9e-8b9a-ba05cc7a4124 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:55.325310 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514674-9473-4d9e-8b9a-ba05cc7a4124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:55.359369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:55.413259 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:55.419508 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4514674-9473-4d9e-8b9a-ba05cc7a4124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:55.421100 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4514674-9473-4d9e-8b9a-ba05cc7a4124 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:55.424862 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dbbb3-346c-43d3-bc59-3237dacfcdaf None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:55.462742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472eb08b-a690-4d1d-9a29-527ba2e7ed16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:55.463840 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eb08b-a690-4d1d-9a29-527ba2e7ed16 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:55.464294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eb08b-a690-4d1d-9a29-527ba2e7ed16 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:55.465259 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eb08b-a690-4d1d-9a29-527ba2e7ed16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:55.472747 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472eb08b-a690-4d1d-9a29-527ba2e7ed16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:55.474393 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472eb08b-a690-4d1d-9a29-527ba2e7ed16 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-472eb08b-a690-4d1d-9a29-527ba2e7ed16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:55.489537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:55.490837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:55.492080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:55.492080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:55.492080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:55.492080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:55.492080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:55.492080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:55.492080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:55.492080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:55.494277 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 331/660] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:55.495315 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472eb08b-a690-4d1d-9a29-527ba2e7ed16 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:55.545875 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 330/661] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:55.546881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514674-9473-4d9e-8b9a-ba05cc7a4124 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:55.609357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472eb08b-a690-4d1d-9a29-527ba2e7ed16 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:55.610678 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:55.647150 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c5249-b4cf-4c62-9199-b6d272575a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:55.648284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c5249-b4cf-4c62-9199-b6d272575a88 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:55.648787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c5249-b4cf-4c62-9199-b6d272575a88 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:55.649267 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c5249-b4cf-4c62-9199-b6d272575a88 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:55.659320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c5249-b4cf-4c62-9199-b6d272575a88 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:55.660284 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514674-9473-4d9e-8b9a-ba05cc7a4124 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:55.661325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c5249-b4cf-4c62-9199-b6d272575a88 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-1f6c5249-b4cf-4c62-9199-b6d272575a88 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:55.678029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:55.679630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:55.680678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:55.680678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:55.680678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:55.680678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:55.680678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:55.680678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:55.680678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:55.680678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:55.680678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:03:55.680678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:55.683663 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 332/662] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:55.684832 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c5249-b4cf-4c62-9199-b6d272575a88 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:55.698496 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495347c6-e3c8-4176-97e8-241f34e37fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:55.699836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495347c6-e3c8-4176-97e8-241f34e37fde None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:55.700152 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495347c6-e3c8-4176-97e8-241f34e37fde None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:55.700699 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:55.701253 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495347c6-e3c8-4176-97e8-241f34e37fde None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:55.701963 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495347c6-e3c8-4176-97e8-241f34e37fde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:55.702276 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495347c6-e3c8-4176-97e8-241f34e37fde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:55.703756 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495347c6-e3c8-4176-97e8-241f34e37fde None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:55.718020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 331/663] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:55.718890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495347c6-e3c8-4176-97e8-241f34e37fde None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:55.804842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c5249-b4cf-4c62-9199-b6d272575a88 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:55.845757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a7019-886e-4fe4-ab15-77f881f69814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:55.846744 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495347c6-e3c8-4176-97e8-241f34e37fde None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:55.847550 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a7019-886e-4fe4-ab15-77f881f69814 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:55.848313 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a7019-886e-4fe4-ab15-77f881f69814 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:55.848807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a7019-886e-4fe4-ab15-77f881f69814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:55.863531 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:55.865718 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a7019-886e-4fe4-ab15-77f881f69814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:55.867924 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a7019-886e-4fe4-ab15-77f881f69814 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:55.888481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529f11f-bb2e-4604-ac4b-1649bfde87a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:55.889154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f11f-bb2e-4604-ac4b-1649bfde87a3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:55.889495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f11f-bb2e-4604-ac4b-1649bfde87a3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:55.889776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f11f-bb2e-4604-ac4b-1649bfde87a3 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:55.890705 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529f11f-bb2e-4604-ac4b-1649bfde87a3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:55.891024 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529f11f-bb2e-4604-ac4b-1649bfde87a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:55.892635 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529f11f-bb2e-4604-ac4b-1649bfde87a3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-f28a7019-886e-4fe4-ab15-77f881f69814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:55.893295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:55.894275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:55.895312 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:55.895312 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:55.895312 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:55.895312 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:55.898323 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 333/664] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:55.899341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a7019-886e-4fe4-ab15-77f881f69814 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:55.919246 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 332/665] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:03:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:55.920264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529f11f-bb2e-4604-ac4b-1649bfde87a3 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:55.983400 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:56.028170 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a7019-886e-4fe4-ab15-77f881f69814 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:56.032046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529f11f-bb2e-4604-ac4b-1649bfde87a3 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:56.067337 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642a475-4921-4097-af57-9313724dffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:56.068105 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642a475-4921-4097-af57-9313724dffd2 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.068456 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642a475-4921-4097-af57-9313724dffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.068803 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642a475-4921-4097-af57-9313724dffd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.069718 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642a475-4921-4097-af57-9313724dffd2 None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=537c1b1095ce482a8d1f5fd95bd98db5) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:56.070107 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642a475-4921-4097-af57-9313724dffd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:56.071740 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642a475-4921-4097-af57-9313724dffd2 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:56.075653 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788ee03-3a56-4fe4-9986-1dc31397770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:56.076320 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788ee03-3a56-4fe4-9986-1dc31397770a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.076615 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788ee03-3a56-4fe4-9986-1dc31397770a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.076958 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788ee03-3a56-4fe4-9986-1dc31397770a None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.077599 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788ee03-3a56-4fe4-9986-1dc31397770a None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:56.077965 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788ee03-3a56-4fe4-9986-1dc31397770a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:56.087209 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 334/666] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:55 2022] GET /identity/v3/role_assignments?user.id=537c1b1095ce482a8d1f5fd95bd98db5&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:56.087209 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642a475-4921-4097-af57-9313724dffd2 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:56.087495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788ee03-3a56-4fe4-9986-1dc31397770a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:56.099727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 333/667] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:56.101226 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcfda0-bef8-4656-a5dc-78fe2f28cb89 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.101515 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcfda0-bef8-4656-a5dc-78fe2f28cb89 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.101854 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcfda0-bef8-4656-a5dc-78fe2f28cb89 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.103582 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 334/668] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:56.104760 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcfda0-bef8-4656-a5dc-78fe2f28cb89 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:56.144880 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:56.233518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642a475-4921-4097-af57-9313724dffd2 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:56.240978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcfda0-bef8-4656-a5dc-78fe2f28cb89 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:56.267180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:56.277924 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2fcc4-daf6-4c9b-80d1-4732b8a0a319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:56.278768 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2fcc4-daf6-4c9b-80d1-4732b8a0a319 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.279054 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2fcc4-daf6-4c9b-80d1-4732b8a0a319 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.279330 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2fcc4-daf6-4c9b-80d1-4732b8a0a319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.281015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27964f94-c5c5-4bd2-82c2-b737c370d7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:56.281826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27964f94-c5c5-4bd2-82c2-b737c370d7a3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.282112 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27964f94-c5c5-4bd2-82c2-b737c370d7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.282382 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27964f94-c5c5-4bd2-82c2-b737c370d7a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.290258 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27964f94-c5c5-4bd2-82c2-b737c370d7a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:56.291754 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27964f94-c5c5-4bd2-82c2-b737c370d7a3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-27964f94-c5c5-4bd2-82c2-b737c370d7a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:56.308608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:56.309734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:56.312021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:56.312021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:56.312021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:56.312021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:56.312021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:56.312021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:56.312021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:56.312021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:56.312021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 335/669] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:56.312021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03063-4f4d-4a52-bee9-7e63db1a36c4 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.312021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03063-4f4d-4a52-bee9-7e63db1a36c4 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.312694 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03063-4f4d-4a52-bee9-7e63db1a36c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.329125 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-28b03063-4f4d-4a52-bee9-7e63db1a36c4 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:56.330334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-28b03063-4f4d-4a52-bee9-7e63db1a36c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:56.363630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2fcc4-daf6-4c9b-80d1-4732b8a0a319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:56.365447 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2fcc4-daf6-4c9b-80d1-4732b8a0a319 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:56.409625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 336/670] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:56.411605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329390ab-2d93-4d1a-abcc-2ee8200e346f None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.412084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329390ab-2d93-4d1a-abcc-2ee8200e346f None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.412547 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329390ab-2d93-4d1a-abcc-2ee8200e346f None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.414019 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 337/671] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:56.414976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329390ab-2d93-4d1a-abcc-2ee8200e346f None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:56.444946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:56.488053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 335/672] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:56.489365 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496018b-5d60-4aa7-90f5-fb2f40d737af None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.489682 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496018b-5d60-4aa7-90f5-fb2f40d737af None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.489971 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496018b-5d60-4aa7-90f5-fb2f40d737af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.507436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-b496018b-5d60-4aa7-90f5-fb2f40d737af None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:56.508735 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-b496018b-5d60-4aa7-90f5-fb2f40d737af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:56.531461 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:56.539573 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329390ab-2d93-4d1a-abcc-2ee8200e346f None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:56.579963 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c0adc-a7e3-4258-aaa6-300dbd8bbfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:56.580625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0adc-a7e3-4258-aaa6-300dbd8bbfa1 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.580942 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0adc-a7e3-4258-aaa6-300dbd8bbfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.581172 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0adc-a7e3-4258-aaa6-300dbd8bbfa1 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.581961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c0adc-a7e3-4258-aaa6-300dbd8bbfa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:56.582267 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c0adc-a7e3-4258-aaa6-300dbd8bbfa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:56.590955 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 336/673] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:56.590955 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496018b-5d60-4aa7-90f5-fb2f40d737af None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:56.591198 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c0adc-a7e3-4258-aaa6-300dbd8bbfa1 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:56.601640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 338/674] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:56.602530 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c0adc-a7e3-4258-aaa6-300dbd8bbfa1 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:56.692199 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:56.702795 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496018b-5d60-4aa7-90f5-fb2f40d737af None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:56.711558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c0adc-a7e3-4258-aaa6-300dbd8bbfa1 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:56.740366 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465db3-f637-4ec5-b0ed-279167cd3eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:56.741177 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465db3-f637-4ec5-b0ed-279167cd3eda None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.741487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465db3-f637-4ec5-b0ed-279167cd3eda None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.741733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465db3-f637-4ec5-b0ed-279167cd3eda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.752323 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9e868-5145-4b8d-86d5-e7dd04afbb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:56.753193 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9e868-5145-4b8d-86d5-e7dd04afbb08 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.753328 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2465db3-f637-4ec5-b0ed-279167cd3eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:56.753542 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9e868-5145-4b8d-86d5-e7dd04afbb08 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.753736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9e868-5145-4b8d-86d5-e7dd04afbb08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-a2465db3-f637-4ec5-b0ed-279167cd3eda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:56.760986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:56.762063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:56.763032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 337/675] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:03:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:56.763835 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465db3-f637-4ec5-b0ed-279167cd3eda None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:56.771659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9e868-5145-4b8d-86d5-e7dd04afbb08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:56.773597 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9e868-5145-4b8d-86d5-e7dd04afbb08 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:56.784516 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-6fb9e868-5145-4b8d-86d5-e7dd04afbb08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:56.793169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:56.794558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:56.800495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:56.800495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:56.800495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:56.800495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:56.800495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 339/676] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:56.800495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9e868-5145-4b8d-86d5-e7dd04afbb08 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:56.880381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465db3-f637-4ec5-b0ed-279167cd3eda None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:56.906021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9e868-5145-4b8d-86d5-e7dd04afbb08 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:56.917415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6800d1a-717d-4b57-9cd5-061b740777c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:56.918643 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6800d1a-717d-4b57-9cd5-061b740777c1 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.918933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6800d1a-717d-4b57-9cd5-061b740777c1 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.920366 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6800d1a-717d-4b57-9cd5-061b740777c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.921234 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6800d1a-717d-4b57-9cd5-061b740777c1 None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=d42b12ce8488404d8ae10a4fefcdddb4) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:56.921549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6800d1a-717d-4b57-9cd5-061b740777c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:56.923016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6800d1a-717d-4b57-9cd5-061b740777c1 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:56.929677 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 338/677] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:56 2022] GET /identity/v3/role_assignments?user.id=d42b12ce8488404d8ae10a4fefcdddb4&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:56.930499 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6800d1a-717d-4b57-9cd5-061b740777c1 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:56.947857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55ed5a-bf04-4f90-ae38-33dcd0c4ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:56.949753 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55ed5a-bf04-4f90-ae38-33dcd0c4ab8d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:56.950260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55ed5a-bf04-4f90-ae38-33dcd0c4ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:56.950796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55ed5a-bf04-4f90-ae38-33dcd0c4ab8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:56.953756 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:56.965907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55ed5a-bf04-4f90-ae38-33dcd0c4ab8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-6d55ed5a-bf04-4f90-ae38-33dcd0c4ab8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:03:56.974834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:56.975941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:03:56.976881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:56.980409 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 340/678] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:03:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:56.981713 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55ed5a-bf04-4f90-ae38-33dcd0c4ab8d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:57.068227 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:57.093457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6800d1a-717d-4b57-9cd5-061b740777c1 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:57.117485 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55ed5a-bf04-4f90-ae38-33dcd0c4ab8d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:57.142672 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b9f75-2568-4c95-8b34-f6cead43cd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:57.143731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b9f75-2568-4c95-8b34-f6cead43cd26 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:57.144247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b9f75-2568-4c95-8b34-f6cead43cd26 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:57.144745 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b9f75-2568-4c95-8b34-f6cead43cd26 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:57.145809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b9f75-2568-4c95-8b34-f6cead43cd26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:57.146372 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b9f75-2568-4c95-8b34-f6cead43cd26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:57.147996 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b9f75-2568-4c95-8b34-f6cead43cd26 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:57.157441 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab004a5a-1e94-4147-afb7-0bf00c315ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:57.158104 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004a5a-1e94-4147-afb7-0bf00c315ffb None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:57.158386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004a5a-1e94-4147-afb7-0bf00c315ffb None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:57.158691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004a5a-1e94-4147-afb7-0bf00c315ffb None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:57.159521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab004a5a-1e94-4147-afb7-0bf00c315ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:57.159718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab004a5a-1e94-4147-afb7-0bf00c315ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:57.164330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab004a5a-1e94-4147-afb7-0bf00c315ffb None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:57.164494 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 339/679] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:03:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:57.164494 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b9f75-2568-4c95-8b34-f6cead43cd26 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:57.175695 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 341/680] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:57.176872 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab004a5a-1e94-4147-afb7-0bf00c315ffb None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:57.248634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:57.295337 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b9f75-2568-4c95-8b34-f6cead43cd26 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:57.300446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab004a5a-1e94-4147-afb7-0bf00c315ffb None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:57.341392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54c233-6753-4fd3-a033-8768daf20d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:57.342623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54c233-6753-4fd3-a033-8768daf20d1a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:57.343262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54c233-6753-4fd3-a033-8768daf20d1a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:57.343637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54c233-6753-4fd3-a033-8768daf20d1a None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:57.345112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54c233-6753-4fd3-a033-8768daf20d1a None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:57.345670 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54c233-6753-4fd3-a033-8768daf20d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:57.348082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54c233-6753-4fd3-a033-8768daf20d1a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:57.354835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371058f-3097-460d-b5a9-0e7a923ef959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:57.357125 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371058f-3097-460d-b5a9-0e7a923ef959 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:57.357588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371058f-3097-460d-b5a9-0e7a923ef959 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:57.358306 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371058f-3097-460d-b5a9-0e7a923ef959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:57.360337 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 340/681] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:03:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:57.361208 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54c233-6753-4fd3-a033-8768daf20d1a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:57.365770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:57.375276 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371058f-3097-460d-b5a9-0e7a923ef959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:57.377782 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371058f-3097-460d-b5a9-0e7a923ef959 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-2371058f-3097-460d-b5a9-0e7a923ef959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:57.397554 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:57.398803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:57.399905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:57.399905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:57.399905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:57.399905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:57.406282 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 342/682] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:57.407460 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371058f-3097-460d-b5a9-0e7a923ef959 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:57.474206 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54c233-6753-4fd3-a033-8768daf20d1a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:57.512173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a511a84-8bac-4448-ab1f-1520760f999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:57.512946 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a511a84-8bac-4448-ab1f-1520760f999c None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:57.513225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a511a84-8bac-4448-ab1f-1520760f999c None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:57.513497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a511a84-8bac-4448-ab1f-1520760f999c None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:57.521225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a511a84-8bac-4448-ab1f-1520760f999c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:57.522793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a511a84-8bac-4448-ab1f-1520760f999c None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:57.525489 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371058f-3097-460d-b5a9-0e7a923ef959 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:57.533889 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-4a511a84-8bac-4448-ab1f-1520760f999c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:57.539256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:57.540497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:57.541821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:57.541821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:57.541821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:57.541821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:57.541821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:57.541821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:57.541821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:57.541821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:57.541821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 341/683] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:57.541821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a511a84-8bac-4448-ab1f-1520760f999c None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:57.568282 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee419a70-fd90-4639-b70b-82953b710783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:57.569477 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419a70-fd90-4639-b70b-82953b710783 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:57.569942 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419a70-fd90-4639-b70b-82953b710783 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:57.570414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419a70-fd90-4639-b70b-82953b710783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:57.584109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee419a70-fd90-4639-b70b-82953b710783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:57.585961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee419a70-fd90-4639-b70b-82953b710783 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-ee419a70-fd90-4639-b70b-82953b710783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:57.605919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:57.606976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:57.607971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:57.607971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:57.607971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:57.607971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:57.610288 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 343/684] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:57.611483 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee419a70-fd90-4639-b70b-82953b710783 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:57.627353 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:57.671672 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a511a84-8bac-4448-ab1f-1520760f999c None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:57.711792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fd5c0-af65-4d4b-ac01-bd70e4dcb95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:57.712487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd5c0-af65-4d4b-ac01-bd70e4dcb95d None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:57.712769 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd5c0-af65-4d4b-ac01-bd70e4dcb95d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:57.713030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd5c0-af65-4d4b-ac01-bd70e4dcb95d None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:57.713778 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fd5c0-af65-4d4b-ac01-bd70e4dcb95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:57.714083 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fd5c0-af65-4d4b-ac01-bd70e4dcb95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:57.715597 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fd5c0-af65-4d4b-ac01-bd70e4dcb95d None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:57.731120 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 342/685] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:57.731120 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fd5c0-af65-4d4b-ac01-bd70e4dcb95d None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:57.854911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fd5c0-af65-4d4b-ac01-bd70e4dcb95d None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:57.874227 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee419a70-fd90-4639-b70b-82953b710783 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:57.882739 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:57.896291 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b928857-32a6-4f08-b779-4e7598ab4c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:57.897249 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928857-32a6-4f08-b779-4e7598ab4c78 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:57.897824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928857-32a6-4f08-b779-4e7598ab4c78 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:57.898638 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928857-32a6-4f08-b779-4e7598ab4c78 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:57.899652 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b928857-32a6-4f08-b779-4e7598ab4c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:57.900247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b928857-32a6-4f08-b779-4e7598ab4c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:57.901792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b928857-32a6-4f08-b779-4e7598ab4c78 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:57.919084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02f82-bc8f-4a14-ae4f-370b9d8aabfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:57.920386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02f82-bc8f-4a14-ae4f-370b9d8aabfd None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:57.920976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02f82-bc8f-4a14-ae4f-370b9d8aabfd None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:57.921455 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02f82-bc8f-4a14-ae4f-370b9d8aabfd None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:57.922506 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a02f82-bc8f-4a14-ae4f-370b9d8aabfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:57.923080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a02f82-bc8f-4a14-ae4f-370b9d8aabfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:57.924529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 343/686] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:57.924992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a02f82-bc8f-4a14-ae4f-370b9d8aabfd None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:57.925953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b928857-32a6-4f08-b779-4e7598ab4c78 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:57.941478 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 344/687] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:57.942908 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02f82-bc8f-4a14-ae4f-370b9d8aabfd None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:57.971054 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:58.075109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02f82-bc8f-4a14-ae4f-370b9d8aabfd None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:58.116498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9f1f4-e63d-49e1-98ab-29ea8d634f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:58.118003 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f1f4-e63d-49e1-98ab-29ea8d634f45 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:58.118744 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f1f4-e63d-49e1-98ab-29ea8d634f45 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:58.119260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f1f4-e63d-49e1-98ab-29ea8d634f45 None admin] PATH_INFO: `/v3/users/swift` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:58.129133 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9f1f4-e63d-49e1-98ab-29ea8d634f45 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:58.131088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9f1f4-e63d-49e1-98ab-29ea8d634f45 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-b4f9f1f4-e63d-49e1-98ab-29ea8d634f45 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:58.147795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:58.148929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:58.149961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:58.149961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:58.149961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:58.149961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:58.149961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:58.149961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:58.149961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:58.149961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:58.149961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:03:58.149961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:58.152803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 345/688] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:03:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:58.153990 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9f1f4-e63d-49e1-98ab-29ea8d634f45 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:58.205069 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b928857-32a6-4f08-b779-4e7598ab4c78 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:58.244362 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:58.246848 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faa783-0e57-4bf0-9844-7c6e5813af3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:58.247657 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faa783-0e57-4bf0-9844-7c6e5813af3a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:58.247932 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faa783-0e57-4bf0-9844-7c6e5813af3a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:58.248202 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faa783-0e57-4bf0-9844-7c6e5813af3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:58.258072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faa783-0e57-4bf0-9844-7c6e5813af3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:58.259590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faa783-0e57-4bf0-9844-7c6e5813af3a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:58.273717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9f1f4-e63d-49e1-98ab-29ea8d634f45 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-42faa783-0e57-4bf0-9844-7c6e5813af3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:03:58.279787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:58.281015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:58.282066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:58.282066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:58.282066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:03:58.282066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:03:58.282066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:03:58.282066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:03:58.282066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:03:58.282066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:03:58.282066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:03:58.282066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:58.286178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 344/689] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:03:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:58.287324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faa783-0e57-4bf0-9844-7c6e5813af3a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:58.333891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8a7f-46b8-4ac9-909b-a06aab0a48fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:58.335074 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8a7f-46b8-4ac9-909b-a06aab0a48fe None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:58.335599 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8a7f-46b8-4ac9-909b-a06aab0a48fe None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:58.336093 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8a7f-46b8-4ac9-909b-a06aab0a48fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:58.337198 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c8a7f-46b8-4ac9-909b-a06aab0a48fe None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=c771be7b66514ef99680f64fb486e205) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:58.337745 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c8a7f-46b8-4ac9-909b-a06aab0a48fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:58.340254 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c8a7f-46b8-4ac9-909b-a06aab0a48fe None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:58.347971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 346/690] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:03:58 2022] GET /identity/v3/role_assignments?user.id=c771be7b66514ef99680f64fb486e205&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:58.349223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8a7f-46b8-4ac9-909b-a06aab0a48fe None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:58.352268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:58.420912 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faa783-0e57-4bf0-9844-7c6e5813af3a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:58.462167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423d6bf-70f7-4a7c-bfad-f6af572828d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:58.463186 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423d6bf-70f7-4a7c-bfad-f6af572828d5 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:58.463653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423d6bf-70f7-4a7c-bfad-f6af572828d5 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:58.464192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423d6bf-70f7-4a7c-bfad-f6af572828d5 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:58.465978 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423d6bf-70f7-4a7c-bfad-f6af572828d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:58.466725 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423d6bf-70f7-4a7c-bfad-f6af572828d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:58.468774 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423d6bf-70f7-4a7c-bfad-f6af572828d5 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:58.468964 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8a7f-46b8-4ac9-909b-a06aab0a48fe None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:58.490962 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 345/691] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:03:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:58.493868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76804211-4bbd-4c43-a5e2-0996195524bd None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:58.494160 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76804211-4bbd-4c43-a5e2-0996195524bd None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:58.494543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76804211-4bbd-4c43-a5e2-0996195524bd None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:58.497062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 346/692] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:03:58.497452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76804211-4bbd-4c43-a5e2-0996195524bd None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:58.520904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d4e29-614c-4df5-a6c7-7b74d4950a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:58.521609 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4e29-614c-4df5-a6c7-7b74d4950a8e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:58.521898 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4e29-614c-4df5-a6c7-7b74d4950a8e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:58.522194 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4e29-614c-4df5-a6c7-7b74d4950a8e None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:58.523089 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d4e29-614c-4df5-a6c7-7b74d4950a8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:58.523405 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d4e29-614c-4df5-a6c7-7b74d4950a8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:58.524927 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d4e29-614c-4df5-a6c7-7b74d4950a8e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:58.541993 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:58.547274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 347/693] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:03:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:58.548735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9ced-f453-4d0a-a349-86ba6bbd89c6 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:58.549027 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9ced-f453-4d0a-a349-86ba6bbd89c6 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:58.549313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9ced-f453-4d0a-a349-86ba6bbd89c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:58.567968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-ee1f9ced-f453-4d0a-a349-86ba6bbd89c6 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:58.569215 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-ee1f9ced-f453-4d0a-a349-86ba6bbd89c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:58.663381 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 348/694] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:03:58.664276 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f9ced-f453-4d0a-a349-86ba6bbd89c6 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:58.687858 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76804211-4bbd-4c43-a5e2-0996195524bd None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:58.689902 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:58.738846 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb78c5-a30e-4b68-87eb-0b5f9e528aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:58.740340 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb78c5-a30e-4b68-87eb-0b5f9e528aec None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:58.740840 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb78c5-a30e-4b68-87eb-0b5f9e528aec None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:58.741456 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb78c5-a30e-4b68-87eb-0b5f9e528aec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:58.812085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f9ced-f453-4d0a-a349-86ba6bbd89c6 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:58.830940 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb78c5-a30e-4b68-87eb-0b5f9e528aec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:58.833017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb78c5-a30e-4b68-87eb-0b5f9e528aec None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:58.853188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:58.860376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421a79-d3d5-4bf9-93a1-c7bffb1af622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:58.861058 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421a79-d3d5-4bf9-93a1-c7bffb1af622 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:58.869992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421a79-d3d5-4bf9-93a1-c7bffb1af622 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:58.869992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421a79-d3d5-4bf9-93a1-c7bffb1af622 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:58.962960 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421a79-d3d5-4bf9-93a1-c7bffb1af622 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:58.964680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421a79-d3d5-4bf9-93a1-c7bffb1af622 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:58.967931 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 347/695] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:58.969678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb78c5-a30e-4b68-87eb-0b5f9e528aec None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:58.974008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:59.087612 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 349/696] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:03:59.089015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421a79-d3d5-4bf9-93a1-c7bffb1af622 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:59.106373 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb78c5-a30e-4b68-87eb-0b5f9e528aec None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:59.130962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:59.153320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1d3af-0252-4335-b41c-8b0a22a84958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:59.154163 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1d3af-0252-4335-b41c-8b0a22a84958 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:59.154572 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1d3af-0252-4335-b41c-8b0a22a84958 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:59.154875 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1d3af-0252-4335-b41c-8b0a22a84958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:59.170116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1d3af-0252-4335-b41c-8b0a22a84958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:59.171554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1d3af-0252-4335-b41c-8b0a22a84958 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-8ff1d3af-0252-4335-b41c-8b0a22a84958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:59.195187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:59.196248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:59.197256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:59.197256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:59.197256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:59.197256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:59.202823 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 348/697] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:59.203977 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1d3af-0252-4335-b41c-8b0a22a84958 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:59.228099 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421a79-d3d5-4bf9-93a1-c7bffb1af622 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:59.273580 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549152ee-d81a-41ac-965e-3e9ec7b4ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:59.276163 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549152ee-d81a-41ac-965e-3e9ec7b4ac21 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:59.276163 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549152ee-d81a-41ac-965e-3e9ec7b4ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:59.276163 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549152ee-d81a-41ac-965e-3e9ec7b4ac21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:59.276468 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:59.288442 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549152ee-d81a-41ac-965e-3e9ec7b4ac21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:59.290184 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549152ee-d81a-41ac-965e-3e9ec7b4ac21 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-549152ee-d81a-41ac-965e-3e9ec7b4ac21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:59.310291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:59.311700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:59.312906 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:59.312906 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:59.312906 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:59.312906 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:59.318928 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 350/698] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:59.320092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549152ee-d81a-41ac-965e-3e9ec7b4ac21 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:59.333467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1d3af-0252-4335-b41c-8b0a22a84958 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:59.378439 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cc133-f6de-4fb7-99fb-2ecc00fee327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:59.379774 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cc133-f6de-4fb7-99fb-2ecc00fee327 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:59.380295 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cc133-f6de-4fb7-99fb-2ecc00fee327 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:59.380723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cc133-f6de-4fb7-99fb-2ecc00fee327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:59.394543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cc133-f6de-4fb7-99fb-2ecc00fee327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:59.396387 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cc133-f6de-4fb7-99fb-2ecc00fee327 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-744cc133-f6de-4fb7-99fb-2ecc00fee327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:03:59.419048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:59.420369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:59.422211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:03:59.422211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:03:59.422211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:03:59.422211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:03:59.423565 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:59.427062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 349/699] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:59.428205 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cc133-f6de-4fb7-99fb-2ecc00fee327 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:59.445070 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549152ee-d81a-41ac-965e-3e9ec7b4ac21 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:59.490809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af618143-cc16-43e3-84f1-8920efa81562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:59.491696 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af618143-cc16-43e3-84f1-8920efa81562 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:59.492027 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af618143-cc16-43e3-84f1-8920efa81562 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:59.492404 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af618143-cc16-43e3-84f1-8920efa81562 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:59.493251 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af618143-cc16-43e3-84f1-8920efa81562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:59.493655 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af618143-cc16-43e3-84f1-8920efa81562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:59.495216 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af618143-cc16-43e3-84f1-8920efa81562 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:59.508941 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 351/700] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:59.509993 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af618143-cc16-43e3-84f1-8920efa81562 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:59.549924 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cc133-f6de-4fb7-99fb-2ecc00fee327 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:59.558110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:59.587092 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9e4e3-2eef-42c8-afbb-e1ff2b62f64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:59.587759 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e4e3-2eef-42c8-afbb-e1ff2b62f64f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:59.588044 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e4e3-2eef-42c8-afbb-e1ff2b62f64f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:59.588325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e4e3-2eef-42c8-afbb-e1ff2b62f64f None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:59.589055 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9e4e3-2eef-42c8-afbb-e1ff2b62f64f None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:59.589391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9e4e3-2eef-42c8-afbb-e1ff2b62f64f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:59.590781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9e4e3-2eef-42c8-afbb-e1ff2b62f64f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:59.606673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 350/701] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:59.606673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9e4e3-2eef-42c8-afbb-e1ff2b62f64f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:59.630204 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af618143-cc16-43e3-84f1-8920efa81562 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:59.678231 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b13d1b-3d6c-42d7-9849-98472cac960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:59.679457 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b13d1b-3d6c-42d7-9849-98472cac960a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:59.679947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b13d1b-3d6c-42d7-9849-98472cac960a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:59.680417 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b13d1b-3d6c-42d7-9849-98472cac960a None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:59.681728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b13d1b-3d6c-42d7-9849-98472cac960a None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:03:59.682268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b13d1b-3d6c-42d7-9849-98472cac960a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:59.685576 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b13d1b-3d6c-42d7-9849-98472cac960a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:59.700683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 352/702] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:03:59.702397 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7c3b6-29d1-47e5-890a-cb5e36df7d9b None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:59.702933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7c3b6-29d1-47e5-890a-cb5e36df7d9b None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:59.703443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7c3b6-29d1-47e5-890a-cb5e36df7d9b None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:59.709340 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 353/703] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:03:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:59.710583 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7c3b6-29d1-47e5-890a-cb5e36df7d9b None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:59.714364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:59.744223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9e4e3-2eef-42c8-afbb-e1ff2b62f64f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:59.802210 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba065a46-7bf5-4025-ad54-7394736f9793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:59.803022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba065a46-7bf5-4025-ad54-7394736f9793 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:59.803365 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba065a46-7bf5-4025-ad54-7394736f9793 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:59.803710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba065a46-7bf5-4025-ad54-7394736f9793 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:59.804432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba065a46-7bf5-4025-ad54-7394736f9793 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:59.805913 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba065a46-7bf5-4025-ad54-7394736f9793 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:59.840873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7c3b6-29d1-47e5-890a-cb5e36df7d9b None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:59.878558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521852b-d6f5-41db-ade7-98c309f0f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:59.879752 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521852b-d6f5-41db-ade7-98c309f0f05d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:59.880034 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521852b-d6f5-41db-ade7-98c309f0f05d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:59.880361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521852b-d6f5-41db-ade7-98c309f0f05d None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:59.888077 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521852b-d6f5-41db-ade7-98c309f0f05d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:59.894312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521852b-d6f5-41db-ade7-98c309f0f05d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:59.894473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 351/704] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:03:59 2022] POST /identity/v3/users => generated 254 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:03:59.894473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592838-9f7f-46c2-9d5e-2cae8821b42c None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:59.894473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592838-9f7f-46c2-9d5e-2cae8821b42c None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:59.894473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592838-9f7f-46c2-9d5e-2cae8821b42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-2521852b-d6f5-41db-ade7-98c309f0f05d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:03:59.908257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:03:59.909480 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:03:59.910468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:03:59.910468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:03:59.910468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:03:59.910468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:03:59.910468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:03:59.910468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:03:59.910468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:03:59.910468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:03:59.910468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 354/705] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:03:59.910468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521852b-d6f5-41db-ade7-98c309f0f05d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:59.930639 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-df592838-9f7f-46c2-9d5e-2cae8821b42c None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:59.932267 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-df592838-9f7f-46c2-9d5e-2cae8821b42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:59.955892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:00.008874 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:00.030019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 352/706] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:04:00.031509 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df592838-9f7f-46c2-9d5e-2cae8821b42c None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:00.067197 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521852b-d6f5-41db-ade7-98c309f0f05d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:00.115523 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f0a88-dd8c-475b-8757-074d0ecff661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:00.116815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0a88-dd8c-475b-8757-074d0ecff661 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:00.117331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0a88-dd8c-475b-8757-074d0ecff661 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:00.118016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0a88-dd8c-475b-8757-074d0ecff661 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:00.127995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f0a88-dd8c-475b-8757-074d0ecff661 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:00.129821 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f0a88-dd8c-475b-8757-074d0ecff661 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-db6f0a88-dd8c-475b-8757-074d0ecff661 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:00.150692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:00.152989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:00.154300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:00.154300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:00.154300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:00.154300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:00.154300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:00.154300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:00.154300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:00.154300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:00.154300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 355/707] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:00.154300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f0a88-dd8c-475b-8757-074d0ecff661 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:00.174685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df592838-9f7f-46c2-9d5e-2cae8821b42c None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:00.222979 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497d78-9d61-4fed-898d-83e4bd4cb9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:00.222979 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497d78-9d61-4fed-898d-83e4bd4cb9aa None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:00.223525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497d78-9d61-4fed-898d-83e4bd4cb9aa None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:00.223923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497d78-9d61-4fed-898d-83e4bd4cb9aa None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:00.224920 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b497d78-9d61-4fed-898d-83e4bd4cb9aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:00.225365 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b497d78-9d61-4fed-898d-83e4bd4cb9aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:00.230933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b497d78-9d61-4fed-898d-83e4bd4cb9aa None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:00.250222 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 353/708] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:00.254480 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497d78-9d61-4fed-898d-83e4bd4cb9aa None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:00.286747 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:00.344659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f0a88-dd8c-475b-8757-074d0ecff661 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:00.390833 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:00.412368 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb11753-0945-4d02-be01-fdcd265ea35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:00.413363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497d78-9d61-4fed-898d-83e4bd4cb9aa None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:00.414479 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11753-0945-4d02-be01-fdcd265ea35f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:00.415202 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11753-0945-4d02-be01-fdcd265ea35f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:00.415895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11753-0945-4d02-be01-fdcd265ea35f None admin] PATH_INFO: `/v3/services/network` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:00.417319 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb11753-0945-4d02-be01-fdcd265ea35f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:00.421041 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb11753-0945-4d02-be01-fdcd265ea35f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-aeb11753-0945-4d02-be01-fdcd265ea35f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:00.449688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:00.452188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:04:00.454375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:00.457752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fec8f-1e00-4e29-a665-684d0d658317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:00.458582 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fec8f-1e00-4e29-a665-684d0d658317 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:00.459016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fec8f-1e00-4e29-a665-684d0d658317 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:00.459388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fec8f-1e00-4e29-a665-684d0d658317 None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:00.459817 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 356/709] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:00 2022] GET /identity/v3/services/network => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:00.460710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fec8f-1e00-4e29-a665-684d0d658317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:00.461121 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fec8f-1e00-4e29-a665-684d0d658317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:00.461956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb11753-0945-4d02-be01-fdcd265ea35f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:00.462898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fec8f-1e00-4e29-a665-684d0d658317 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:00.477648 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 354/710] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:00.483693 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fec8f-1e00-4e29-a665-684d0d658317 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:00.565320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:00.600747 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fec8f-1e00-4e29-a665-684d0d658317 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:00.640157 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c624d-36b5-49e9-980a-ffc932eeb17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:00.640886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c624d-36b5-49e9-980a-ffc932eeb17b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:00.641265 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c624d-36b5-49e9-980a-ffc932eeb17b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:00.641635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c624d-36b5-49e9-980a-ffc932eeb17b None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:00.642449 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c624d-36b5-49e9-980a-ffc932eeb17b None admin] RBAC: Adding query filter params (name=network) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:00.644622 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c624d-36b5-49e9-980a-ffc932eeb17b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:00.645428 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c624d-36b5-49e9-980a-ffc932eeb17b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:00.650813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 355/711] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:00.652394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c624d-36b5-49e9-980a-ffc932eeb17b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:00.659121 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb11753-0945-4d02-be01-fdcd265ea35f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:00.726146 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140413a-b07f-47d8-abd2-d2594f1c31a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:00.727610 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140413a-b07f-47d8-abd2-d2594f1c31a1 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:00.728320 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140413a-b07f-47d8-abd2-d2594f1c31a1 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:00.729038 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140413a-b07f-47d8-abd2-d2594f1c31a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:00.731450 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140413a-b07f-47d8-abd2-d2594f1c31a1 None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=78d1f9ebc22a412db074e8aae5db8e9b) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:00.732227 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140413a-b07f-47d8-abd2-d2594f1c31a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:00.735190 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140413a-b07f-47d8-abd2-d2594f1c31a1 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:00.747907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 357/712] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:00 2022] GET /identity/v3/role_assignments?user.id=78d1f9ebc22a412db074e8aae5db8e9b&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:00.749623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140413a-b07f-47d8-abd2-d2594f1c31a1 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:00.770724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c624d-36b5-49e9-980a-ffc932eeb17b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:00.820323 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c1ee3-6e8f-4f4a-9d01-b56023839fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:00.821409 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c1ee3-6e8f-4f4a-9d01-b56023839fd4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:00.821873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c1ee3-6e8f-4f4a-9d01-b56023839fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:00.822936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c1ee3-6e8f-4f4a-9d01-b56023839fd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:00.824645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c1ee3-6e8f-4f4a-9d01-b56023839fd4 None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=e0b88c1582c849349cc441446f6cca20) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:00.825183 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c1ee3-6e8f-4f4a-9d01-b56023839fd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:00.828067 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c1ee3-6e8f-4f4a-9d01-b56023839fd4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:00.833010 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:00.836303 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:00.837307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 356/713] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:00 2022] GET /identity/v3/role_assignments?user.id=e0b88c1582c849349cc441446f6cca20&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec0563-44e6-45e2-b1fa-370dfc68db3e None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:00.889758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec0563-44e6-45e2-b1fa-370dfc68db3e None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:00.890048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec0563-44e6-45e2-b1fa-370dfc68db3e None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:00.896128 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 357/714] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:04:00.898092 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fae8-c157-4e2b-a110-bf850b55ba51 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:00.898382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fae8-c157-4e2b-a110-bf850b55ba51 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:00.898708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fae8-c157-4e2b-a110-bf850b55ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:00.920051 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-3e93fae8-c157-4e2b-a110-bf850b55ba51 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:00.920948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140413a-b07f-47d8-abd2-d2594f1c31a1 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:00.921350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-3e93fae8-c157-4e2b-a110-bf850b55ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:00.985398 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae19ed-12e0-49ec-8253-67a0ebb2b199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:00.986098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae19ed-12e0-49ec-8253-67a0ebb2b199 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:00.986383 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae19ed-12e0-49ec-8253-67a0ebb2b199 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:00.987757 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae19ed-12e0-49ec-8253-67a0ebb2b199 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:00.988561 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae19ed-12e0-49ec-8253-67a0ebb2b199 None admin] RBAC: Adding query filter params (type=network) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:00.988920 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae19ed-12e0-49ec-8253-67a0ebb2b199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:00.990397 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae19ed-12e0-49ec-8253-67a0ebb2b199 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:01.007407 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 358/715] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:01.026816 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 358/716] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:04:01.046491 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae19ed-12e0-49ec-8253-67a0ebb2b199 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:01.187017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae19ed-12e0-49ec-8253-67a0ebb2b199 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:01.204881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:01.241646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0755331-7d67-4f97-a245-b7a256f48b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:01.242892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0755331-7d67-4f97-a245-b7a256f48b00 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:01.243376 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0755331-7d67-4f97-a245-b7a256f48b00 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:01.243812 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0755331-7d67-4f97-a245-b7a256f48b00 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:01.244664 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0755331-7d67-4f97-a245-b7a256f48b00 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:01.246940 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0755331-7d67-4f97-a245-b7a256f48b00 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-c0755331-7d67-4f97-a245-b7a256f48b00 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:01.261634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:01.263008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:04:01.264136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:01.270789 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 359/717] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 20:04:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:01.273791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93fae8-c157-4e2b-a110-bf850b55ba51 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:01.436203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93fae8-c157-4e2b-a110-bf850b55ba51 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:01.468457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:01.475657 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d5c23-9d0e-4249-8760-e51de0224562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:01.476447 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d5c23-9d0e-4249-8760-e51de0224562 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:01.476887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d5c23-9d0e-4249-8760-e51de0224562 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:01.477232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d5c23-9d0e-4249-8760-e51de0224562 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:01.478196 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d5c23-9d0e-4249-8760-e51de0224562 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:01.478572 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d5c23-9d0e-4249-8760-e51de0224562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:01.480563 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d5c23-9d0e-4249-8760-e51de0224562 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:01.494432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 359/718] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:04:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:01.496519 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0755331-7d67-4f97-a245-b7a256f48b00 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:01.621507 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0755331-7d67-4f97-a245-b7a256f48b00 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:01.666270 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41201e60-8be9-4b06-a8b2-f6276dd861fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:01.666986 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41201e60-8be9-4b06-a8b2-f6276dd861fc None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:01.667270 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41201e60-8be9-4b06-a8b2-f6276dd861fc None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:01.667648 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41201e60-8be9-4b06-a8b2-f6276dd861fc None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:01.668840 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41201e60-8be9-4b06-a8b2-f6276dd861fc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:01.669150 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41201e60-8be9-4b06-a8b2-f6276dd861fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:01.670794 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41201e60-8be9-4b06-a8b2-f6276dd861fc None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:01.682720 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 360/719] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:04:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:02.926993 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1101-48ee-4b26-9ff7-4c62bf32e10a None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:02.928066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1101-48ee-4b26-9ff7-4c62bf32e10a None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:02.928586 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1101-48ee-4b26-9ff7-4c62bf32e10a None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:02.930516 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 360/720] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:02.936383 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48935401-77cc-4341-b21f-5a438975327c None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:02.937324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48935401-77cc-4341-b21f-5a438975327c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:02.937848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48935401-77cc-4341-b21f-5a438975327c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:02.961233 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-48935401-77cc-4341-b21f-5a438975327c None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:02.962842 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-48935401-77cc-4341-b21f-5a438975327c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:03.001720 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:03.051122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 361/721] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:04:03.075044 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d1101-48ee-4b26-9ff7-4c62bf32e10a None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:03.234390 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d1101-48ee-4b26-9ff7-4c62bf32e10a None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:03.283474 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdf11f-87dc-45c9-be83-7c50362c7037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:03.284287 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf11f-87dc-45c9-be83-7c50362c7037 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:03.284566 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf11f-87dc-45c9-be83-7c50362c7037 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:03.284867 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf11f-87dc-45c9-be83-7c50362c7037 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:03.299966 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdf11f-87dc-45c9-be83-7c50362c7037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-e4cdf11f-87dc-45c9-be83-7c50362c7037 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:03.308708 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:03.311492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:03.312422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 361/722] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:04:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:03.315925 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48935401-77cc-4341-b21f-5a438975327c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:03.479344 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48935401-77cc-4341-b21f-5a438975327c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:03.535382 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f4d27-1142-4ba8-acff-e01c3ea9f58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:03.536079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f4d27-1142-4ba8-acff-e01c3ea9f58d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:03.536367 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f4d27-1142-4ba8-acff-e01c3ea9f58d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:03.536651 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f4d27-1142-4ba8-acff-e01c3ea9f58d None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:03.537428 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f4d27-1142-4ba8-acff-e01c3ea9f58d None admin] RBAC: Adding query filter params (name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:03.537742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f4d27-1142-4ba8-acff-e01c3ea9f58d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:03.539188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f4d27-1142-4ba8-acff-e01c3ea9f58d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:03.551001 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 362/723] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:04:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:03.556722 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdf11f-87dc-45c9-be83-7c50362c7037 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:03.693478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:03.762555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdf11f-87dc-45c9-be83-7c50362c7037 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:03.806564 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee08d9f-fd18-4e15-9bac-7f51e7240d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:03.807829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08d9f-fd18-4e15-9bac-7f51e7240d74 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:03.808873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08d9f-fd18-4e15-9bac-7f51e7240d74 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:03.809367 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08d9f-fd18-4e15-9bac-7f51e7240d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:03.821246 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee08d9f-fd18-4e15-9bac-7f51e7240d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:03.823084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee08d9f-fd18-4e15-9bac-7f51e7240d74 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:03.844255 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521c3d-c206-4775-b22a-2bc64fc2a7a0 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:03.844609 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521c3d-c206-4775-b22a-2bc64fc2a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:03.844827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521c3d-c206-4775-b22a-2bc64fc2a7a0 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:03.846482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 363/724] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-4ee08d9f-fd18-4e15-9bac-7f51e7240d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:03.850746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:03.851736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:03.852723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:03.852723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:03.852723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:03.852723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:03.852983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b26c52-77e5-44fb-b44b-fe6b2a2a4da2 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:03.852983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b26c52-77e5-44fb-b44b-fe6b2a2a4da2 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:03.852983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b26c52-77e5-44fb-b44b-fe6b2a2a4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:03.858871 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 362/725] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:03.867861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee08d9f-fd18-4e15-9bac-7f51e7240d74 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:03.891608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-67b26c52-77e5-44fb-b44b-fe6b2a2a4da2 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:03.892877 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-67b26c52-77e5-44fb-b44b-fe6b2a2a4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:03.954278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:04.018774 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 364/726] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:04:04.020061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b83ef-53c8-4fe2-a00d-48cb16b61b28 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.020365 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b83ef-53c8-4fe2-a00d-48cb16b61b28 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.020639 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b83ef-53c8-4fe2-a00d-48cb16b61b28 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.022162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 365/727] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:04.036104 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf898c-c0ad-47ac-9fac-1aa777938248 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.036416 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf898c-c0ad-47ac-9fac-1aa777938248 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.036669 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf898c-c0ad-47ac-9fac-1aa777938248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.058175 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee08d9f-fd18-4e15-9bac-7f51e7240d74 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:04.060445 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-ffdf898c-c0ad-47ac-9fac-1aa777938248 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:04.062623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-ffdf898c-c0ad-47ac-9fac-1aa777938248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:04.067267 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:04.103325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddb657-4dd7-4c73-b3a9-26c585520db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:04.104636 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddb657-4dd7-4c73-b3a9-26c585520db7 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.105374 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddb657-4dd7-4c73-b3a9-26c585520db7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.105826 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddb657-4dd7-4c73-b3a9-26c585520db7 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.106782 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddb657-4dd7-4c73-b3a9-26c585520db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:04.107282 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddb657-4dd7-4c73-b3a9-26c585520db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:04.108943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddb657-4dd7-4c73-b3a9-26c585520db7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:04.127175 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 363/728] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:04.128285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddb657-4dd7-4c73-b3a9-26c585520db7 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:04.160192 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 366/729] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:04:04.162187 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f4b86-e95b-4864-af75-45c8191f0ca0 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.162933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f4b86-e95b-4864-af75-45c8191f0ca0 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.163650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f4b86-e95b-4864-af75-45c8191f0ca0 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.166302 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 367/730] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:04.168128 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f4b86-e95b-4864-af75-45c8191f0ca0 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:04.261399 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddb657-4dd7-4c73-b3a9-26c585520db7 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:04.288831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:04.298529 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f4b86-e95b-4864-af75-45c8191f0ca0 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:04.301201 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507e6f6-7119-4542-9494-6598a660e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:04.302734 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507e6f6-7119-4542-9494-6598a660e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.310010 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507e6f6-7119-4542-9494-6598a660e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.310010 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507e6f6-7119-4542-9494-6598a660e6e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.314875 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507e6f6-7119-4542-9494-6598a660e6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-0507e6f6-7119-4542-9494-6598a660e6e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:04.322710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:04.323807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:04.324755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 364/731] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:04.325544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530c1e-2b3a-45a1-a8f3-09caf505c25d None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.325544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530c1e-2b3a-45a1-a8f3-09caf505c25d None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.325697 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530c1e-2b3a-45a1-a8f3-09caf505c25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.378757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-df530c1e-2b3a-45a1-a8f3-09caf505c25d None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:04.379969 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-df530c1e-2b3a-45a1-a8f3-09caf505c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:04.401638 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:04.404980 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217660-d77d-4ad3-b5df-a1170d0c0811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:04.406402 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217660-d77d-4ad3-b5df-a1170d0c0811 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.406727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217660-d77d-4ad3-b5df-a1170d0c0811 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.407006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217660-d77d-4ad3-b5df-a1170d0c0811 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.416632 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb217660-d77d-4ad3-b5df-a1170d0c0811 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:04.419121 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb217660-d77d-4ad3-b5df-a1170d0c0811 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-cb217660-d77d-4ad3-b5df-a1170d0c0811 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:04.440045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:04.441195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 368/732] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:04:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:04.442318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217660-d77d-4ad3-b5df-a1170d0c0811 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:04.466095 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 365/733] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:04:04.475744 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530c1e-2b3a-45a1-a8f3-09caf505c25d None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:04.557992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217660-d77d-4ad3-b5df-a1170d0c0811 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:04.601570 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbaad5-7453-46ef-bd47-37168954c7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:04.602373 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbaad5-7453-46ef-bd47-37168954c7ee None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.602703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbaad5-7453-46ef-bd47-37168954c7ee None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.602960 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbaad5-7453-46ef-bd47-37168954c7ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.609612 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530c1e-2b3a-45a1-a8f3-09caf505c25d None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:04.615881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbaad5-7453-46ef-bd47-37168954c7ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-eefbaad5-7453-46ef-bd47-37168954c7ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:04.624434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:04.625481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:04.626438 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 369/734] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:04.627278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbaad5-7453-46ef-bd47-37168954c7ee None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:04.643555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:04.651530 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4aaec-349d-465e-92f9-8427dd91a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:04.652227 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4aaec-349d-465e-92f9-8427dd91a693 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.653310 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4aaec-349d-465e-92f9-8427dd91a693 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.653310 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4aaec-349d-465e-92f9-8427dd91a693 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.653722 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4aaec-349d-465e-92f9-8427dd91a693 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:04.654029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4aaec-349d-465e-92f9-8427dd91a693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:04.655414 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4aaec-349d-465e-92f9-8427dd91a693 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:04.663868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 366/735] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:04:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:04.665242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4aaec-349d-465e-92f9-8427dd91a693 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:04.684948 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:04.733724 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbaad5-7453-46ef-bd47-37168954c7ee None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:04.767249 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4aaec-349d-465e-92f9-8427dd91a693 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:04.768686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdd237-62d1-4a25-93d8-7cf4bd15cb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:04.769392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdd237-62d1-4a25-93d8-7cf4bd15cb07 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.769676 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdd237-62d1-4a25-93d8-7cf4bd15cb07 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.769950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdd237-62d1-4a25-93d8-7cf4bd15cb07 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.770820 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdd237-62d1-4a25-93d8-7cf4bd15cb07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:04.771129 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdd237-62d1-4a25-93d8-7cf4bd15cb07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:04.772621 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdd237-62d1-4a25-93d8-7cf4bd15cb07 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:04.791029 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 370/736] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:04:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:04.792331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3bcdc-7d51-48f3-85f6-370e4f23a0be None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.793152 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3bcdc-7d51-48f3-85f6-370e4f23a0be None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.793427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3bcdc-7d51-48f3-85f6-370e4f23a0be None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.794719 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 371/737] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:04.795372 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3bcdc-7d51-48f3-85f6-370e4f23a0be None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:04.807497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfe46e-c20a-4342-a927-4717d384b00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:04.808320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfe46e-c20a-4342-a927-4717d384b00d None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.809047 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfe46e-c20a-4342-a927-4717d384b00d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.809313 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfe46e-c20a-4342-a927-4717d384b00d None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.810047 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfe46e-c20a-4342-a927-4717d384b00d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:04.811551 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfe46e-c20a-4342-a927-4717d384b00d None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:04.869223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:04.899193 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3bcdc-7d51-48f3-85f6-370e4f23a0be None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:04.932932 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfc8b-300f-4cd2-b5dd-4b08a5568cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:04.933622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfc8b-300f-4cd2-b5dd-4b08a5568cfb None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:04.933904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfc8b-300f-4cd2-b5dd-4b08a5568cfb None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:04.934179 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfc8b-300f-4cd2-b5dd-4b08a5568cfb None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:04.934959 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dfc8b-300f-4cd2-b5dd-4b08a5568cfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:04.935262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dfc8b-300f-4cd2-b5dd-4b08a5568cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:04.936658 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dfc8b-300f-4cd2-b5dd-4b08a5568cfb None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:04.946026 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 372/738] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:04:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:04.946931 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfc8b-300f-4cd2-b5dd-4b08a5568cfb None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:04.959515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 367/739] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:04:04 2022] POST /identity/v3/services => generated 240 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:04.960469 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfe46e-c20a-4342-a927-4717d384b00d None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:05.068119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:05.086209 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfc8b-300f-4cd2-b5dd-4b08a5568cfb None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:05.110786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfe46e-c20a-4342-a927-4717d384b00d None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:05.125461 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310250b-de93-4820-9283-a4e0fc2c6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:05.126351 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310250b-de93-4820-9283-a4e0fc2c6b55 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:05.126667 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310250b-de93-4820-9283-a4e0fc2c6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:05.126940 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310250b-de93-4820-9283-a4e0fc2c6b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:05.129365 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:05.139897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310250b-de93-4820-9283-a4e0fc2c6b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:05.141404 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310250b-de93-4820-9283-a4e0fc2c6b55 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:05.159097 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc18622-d4df-441c-966a-af213f909605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:05.159847 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc18622-d4df-441c-966a-af213f909605 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:05.160198 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc18622-d4df-441c-966a-af213f909605 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:05.160532 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc18622-d4df-441c-966a-af213f909605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-a310250b-de93-4820-9283-a4e0fc2c6b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:05.161053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:05.162203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:05.163462 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:05.163462 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:05.163462 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:05.163462 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:05.163462 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 373/740] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:05.164099 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c795e-ffc2-4e63-8164-65de6f1abd31 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:05.164389 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c795e-ffc2-4e63-8164-65de6f1abd31 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:05.164666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c795e-ffc2-4e63-8164-65de6f1abd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:05.184703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-749c795e-ffc2-4e63-8164-65de6f1abd31 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:05.185916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-749c795e-ffc2-4e63-8164-65de6f1abd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:05.253671 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc18622-d4df-441c-966a-af213f909605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:05.255446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc18622-d4df-441c-966a-af213f909605 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:05.259832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 374/741] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:05 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:04:05.260854 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c795e-ffc2-4e63-8164-65de6f1abd31 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:05.350123 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:05.385726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 368/742] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:04 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:04:05.385726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc18622-d4df-441c-966a-af213f909605 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:05.391375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c795e-ffc2-4e63-8164-65de6f1abd31 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:05.411551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:05.430969 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e39d8-c93a-4754-85df-89ce841f0d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:05.432111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e39d8-c93a-4754-85df-89ce841f0d66 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:05.432488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e39d8-c93a-4754-85df-89ce841f0d66 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:05.432859 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e39d8-c93a-4754-85df-89ce841f0d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:05.446199 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e39d8-c93a-4754-85df-89ce841f0d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:05.448576 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e39d8-c93a-4754-85df-89ce841f0d66 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-af4e39d8-c93a-4754-85df-89ce841f0d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:05.468103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:05.469269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:05.475176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:05.475176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:05.475176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:05.475176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:05.475176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 375/743] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:05.475176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e39d8-c93a-4754-85df-89ce841f0d66 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:05.519118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc18622-d4df-441c-966a-af213f909605 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:05.575968 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bcd1d-1b58-46a9-8232-e422088d0538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:05.576641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bcd1d-1b58-46a9-8232-e422088d0538 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:05.577711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bcd1d-1b58-46a9-8232-e422088d0538 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:05.577711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bcd1d-1b58-46a9-8232-e422088d0538 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:05.578375 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bcd1d-1b58-46a9-8232-e422088d0538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:05.579010 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bcd1d-1b58-46a9-8232-e422088d0538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:05.580398 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bcd1d-1b58-46a9-8232-e422088d0538 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:05.601733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 369/744] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:05.603150 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bcd1d-1b58-46a9-8232-e422088d0538 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:05.614760 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e39d8-c93a-4754-85df-89ce841f0d66 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:05.653427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b5a83-cc03-43f9-bc5b-0e5ec88a4b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:05.654082 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b5a83-cc03-43f9-bc5b-0e5ec88a4b45 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:05.654365 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b5a83-cc03-43f9-bc5b-0e5ec88a4b45 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:05.654662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b5a83-cc03-43f9-bc5b-0e5ec88a4b45 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:05.655395 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b5a83-cc03-43f9-bc5b-0e5ec88a4b45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:05.656770 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b5a83-cc03-43f9-bc5b-0e5ec88a4b45 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:05.663632 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:05.734640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 376/745] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:04:05 2022] POST /identity/v3/services => generated 251 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:05.734640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b5a83-cc03-43f9-bc5b-0e5ec88a4b45 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:05.769334 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bcd1d-1b58-46a9-8232-e422088d0538 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:05.771773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:05.823017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571b08a-4afa-43bc-bb3e-0b5e9b1eb12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:05.824525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571b08a-4afa-43bc-bb3e-0b5e9b1eb12a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:05.824886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571b08a-4afa-43bc-bb3e-0b5e9b1eb12a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:05.825167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571b08a-4afa-43bc-bb3e-0b5e9b1eb12a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:05.838414 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571b08a-4afa-43bc-bb3e-0b5e9b1eb12a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:05.841083 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571b08a-4afa-43bc-bb3e-0b5e9b1eb12a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-4571b08a-4afa-43bc-bb3e-0b5e9b1eb12a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:05.866112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:05.867392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:05.868583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:05.868583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:05.868583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:05.868583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:05.871363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 370/746] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:05.872809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571b08a-4afa-43bc-bb3e-0b5e9b1eb12a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:05.877432 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b5a83-cc03-43f9-bc5b-0e5ec88a4b45 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:05.923861 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99ed5b-0c71-47d5-b4bc-a20e9e79705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:05.925208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99ed5b-0c71-47d5-b4bc-a20e9e79705d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:05.925760 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99ed5b-0c71-47d5-b4bc-a20e9e79705d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:05.926218 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99ed5b-0c71-47d5-b4bc-a20e9e79705d None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:05.927420 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99ed5b-0c71-47d5-b4bc-a20e9e79705d None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:05.927820 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99ed5b-0c71-47d5-b4bc-a20e9e79705d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:05.929488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99ed5b-0c71-47d5-b4bc-a20e9e79705d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:05.945347 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 377/747] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:05.946142 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99ed5b-0c71-47d5-b4bc-a20e9e79705d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:05.998742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:06.030058 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571b08a-4afa-43bc-bb3e-0b5e9b1eb12a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:06.080656 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:06.088767 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34857d28-dafe-47a5-9efe-85350c719db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:06.090366 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34857d28-dafe-47a5-9efe-85350c719db1 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:06.090681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34857d28-dafe-47a5-9efe-85350c719db1 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:06.090963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34857d28-dafe-47a5-9efe-85350c719db1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:06.096530 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99ed5b-0c71-47d5-b4bc-a20e9e79705d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:06.101114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34857d28-dafe-47a5-9efe-85350c719db1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:06.102684 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34857d28-dafe-47a5-9efe-85350c719db1 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-34857d28-dafe-47a5-9efe-85350c719db1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:06.123289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:06.124394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:06.125432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:06.125432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:06.125432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:06.125432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:06.125432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:06.125432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:06.125432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:06.125432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:06.125432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:04:06.125432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:06.125432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 371/748] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:04:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:06.126075 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34857d28-dafe-47a5-9efe-85350c719db1 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:06.139043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c166ee-b2f2-4a22-a4e0-58f209bb7f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:06.139782 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c166ee-b2f2-4a22-a4e0-58f209bb7f92 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:06.140066 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c166ee-b2f2-4a22-a4e0-58f209bb7f92 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:06.140345 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c166ee-b2f2-4a22-a4e0-58f209bb7f92 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:06.141167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c166ee-b2f2-4a22-a4e0-58f209bb7f92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:06.141482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c166ee-b2f2-4a22-a4e0-58f209bb7f92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:06.143067 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c166ee-b2f2-4a22-a4e0-58f209bb7f92 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:06.157478 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 378/749] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:06.158461 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c166ee-b2f2-4a22-a4e0-58f209bb7f92 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:06.275024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34857d28-dafe-47a5-9efe-85350c719db1 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:06.300660 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c166ee-b2f2-4a22-a4e0-58f209bb7f92 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:06.322052 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b6073-ce18-45e2-85c2-59c4940e4b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:06.323941 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b6073-ce18-45e2-85c2-59c4940e4b01 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:06.324426 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b6073-ce18-45e2-85c2-59c4940e4b01 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:06.324931 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b6073-ce18-45e2-85c2-59c4940e4b01 None admin] PATH_INFO: `/v3/users/swift` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:06.335745 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b6073-ce18-45e2-85c2-59c4940e4b01 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:06.338483 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b6073-ce18-45e2-85c2-59c4940e4b01 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:06.356136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153028e-2240-49d1-93b9-67865f1a3c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-0b2b6073-ce18-45e2-85c2-59c4940e4b01 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:06.356381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:06.357370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:06.358444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:06.358444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:06.358444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:06.358444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:06.358444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:06.358444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:06.358444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:06.358444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:06.358444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:04:06.358444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:06.360153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153028e-2240-49d1-93b9-67865f1a3c5f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:06.360656 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153028e-2240-49d1-93b9-67865f1a3c5f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:06.361107 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153028e-2240-49d1-93b9-67865f1a3c5f None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:06.362209 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153028e-2240-49d1-93b9-67865f1a3c5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:06.362367 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 372/750] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:04:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:06.362559 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153028e-2240-49d1-93b9-67865f1a3c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:06.363271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b6073-ce18-45e2-85c2-59c4940e4b01 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:06.364087 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153028e-2240-49d1-93b9-67865f1a3c5f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:06.368398 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:06.393826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 379/751] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:04:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:06.394873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153028e-2240-49d1-93b9-67865f1a3c5f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:06.407407 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:06.500837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b6073-ce18-45e2-85c2-59c4940e4b01 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:06.513189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153028e-2240-49d1-93b9-67865f1a3c5f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:06.540833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54548dee-3b5f-4053-a3d3-ccc5d2ecc2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:06.543126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548dee-3b5f-4053-a3d3-ccc5d2ecc2de None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:06.543845 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548dee-3b5f-4053-a3d3-ccc5d2ecc2de None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:06.544297 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548dee-3b5f-4053-a3d3-ccc5d2ecc2de None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:06.551032 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283c4c4-7a7d-4569-8435-b036ddddd0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:06.551786 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283c4c4-7a7d-4569-8435-b036ddddd0a4 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:06.552397 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283c4c4-7a7d-4569-8435-b036ddddd0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:06.552817 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283c4c4-7a7d-4569-8435-b036ddddd0a4 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:06.553653 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283c4c4-7a7d-4569-8435-b036ddddd0a4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:06.554045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283c4c4-7a7d-4569-8435-b036ddddd0a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:06.554361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54548dee-3b5f-4053-a3d3-ccc5d2ecc2de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:06.555750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283c4c4-7a7d-4569-8435-b036ddddd0a4 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:06.556362 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54548dee-3b5f-4053-a3d3-ccc5d2ecc2de None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-54548dee-3b5f-4053-a3d3-ccc5d2ecc2de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:06.576171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:06.577518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:06.578757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:06.578757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:06.578757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:06.578757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:06.578757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:06.578757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:06.578757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:06.578757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:06.580065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 380/752] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:04:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:06.581133 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283c4c4-7a7d-4569-8435-b036ddddd0a4 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:06.581344 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 373/753] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:06.582476 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54548dee-3b5f-4053-a3d3-ccc5d2ecc2de None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:06.660446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:06.671217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:06.708245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54548dee-3b5f-4053-a3d3-ccc5d2ecc2de None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:06.724674 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283c4c4-7a7d-4569-8435-b036ddddd0a4 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:06.752980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ed60-ed93-448a-b89b-ab43b30f5dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:06.753824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ed60-ed93-448a-b89b-ab43b30f5dc5 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:06.754210 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ed60-ed93-448a-b89b-ab43b30f5dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:06.755003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ed60-ed93-448a-b89b-ab43b30f5dc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:06.773811 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b786fe-7a7a-4068-97bc-355cb05cd1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:06.775526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b786fe-7a7a-4068-97bc-355cb05cd1c8 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:06.775991 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b786fe-7a7a-4068-97bc-355cb05cd1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:06.776437 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b786fe-7a7a-4068-97bc-355cb05cd1c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:06.792457 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b786fe-7a7a-4068-97bc-355cb05cd1c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:06.795603 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b786fe-7a7a-4068-97bc-355cb05cd1c8 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-b1b786fe-7a7a-4068-97bc-355cb05cd1c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:06.821962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:06.823241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:06.824523 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:06.824523 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:06.824523 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:06.824523 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:06.830810 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 381/754] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:06.831934 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b786fe-7a7a-4068-97bc-355cb05cd1c8 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:06.837413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4ed60-ed93-448a-b89b-ab43b30f5dc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:06.839066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4ed60-ed93-448a-b89b-ab43b30f5dc5 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:06.912612 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:06.961548 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b786fe-7a7a-4068-97bc-355cb05cd1c8 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:06.968536 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 374/755] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:04:06.969629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ed60-ed93-448a-b89b-ab43b30f5dc5 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:06.986261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:07.009954 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3b2ee-93cc-4031-aa2d-60f81afac86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:07.011807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3b2ee-93cc-4031-aa2d-60f81afac86a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:07.012284 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3b2ee-93cc-4031-aa2d-60f81afac86a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:07.012749 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3b2ee-93cc-4031-aa2d-60f81afac86a None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:07.013786 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3b2ee-93cc-4031-aa2d-60f81afac86a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:07.014623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3b2ee-93cc-4031-aa2d-60f81afac86a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:07.017498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3b2ee-93cc-4031-aa2d-60f81afac86a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:07.035193 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 382/756] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:07.036341 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3b2ee-93cc-4031-aa2d-60f81afac86a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:07.102676 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ed60-ed93-448a-b89b-ab43b30f5dc5 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:07.146334 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12ca17-88d6-4ab6-8bfd-b27ecdbc6ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:07.147491 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ca17-88d6-4ab6-8bfd-b27ecdbc6ab1 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:07.147940 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ca17-88d6-4ab6-8bfd-b27ecdbc6ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:07.148377 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ca17-88d6-4ab6-8bfd-b27ecdbc6ab1 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:07.149325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12ca17-88d6-4ab6-8bfd-b27ecdbc6ab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:07.149820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12ca17-88d6-4ab6-8bfd-b27ecdbc6ab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:07.151455 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12ca17-88d6-4ab6-8bfd-b27ecdbc6ab1 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:07.170787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 375/757] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:07.171970 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12ca17-88d6-4ab6-8bfd-b27ecdbc6ab1 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:07.188997 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3b2ee-93cc-4031-aa2d-60f81afac86a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:07.201704 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:07.239740 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf45b2-cdfb-4fc5-8852-e641bcc5f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:07.241101 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf45b2-cdfb-4fc5-8852-e641bcc5f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:07.241387 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf45b2-cdfb-4fc5-8852-e641bcc5f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:07.241666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf45b2-cdfb-4fc5-8852-e641bcc5f4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:07.258591 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf45b2-cdfb-4fc5-8852-e641bcc5f4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:07.260592 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf45b2-cdfb-4fc5-8852-e641bcc5f4e2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-fedf45b2-cdfb-4fc5-8852-e641bcc5f4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:07.285703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:07.286835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:07.287836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:07.287836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:07.287836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:07.287836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:07.287836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 383/758] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:07.288591 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf45b2-cdfb-4fc5-8852-e641bcc5f4e2 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:07.304784 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12ca17-88d6-4ab6-8bfd-b27ecdbc6ab1 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:07.332035 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:07.347182 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e295bb5-5606-4ac6-acf0-79f8b3ce9482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:07.347947 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295bb5-5606-4ac6-acf0-79f8b3ce9482 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:07.348233 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295bb5-5606-4ac6-acf0-79f8b3ce9482 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:07.348512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295bb5-5606-4ac6-acf0-79f8b3ce9482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:07.349358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e295bb5-5606-4ac6-acf0-79f8b3ce9482 None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=68ef674a83cd467dba60206f2caea39f) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:07.349673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e295bb5-5606-4ac6-acf0-79f8b3ce9482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:07.351129 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e295bb5-5606-4ac6-acf0-79f8b3ce9482 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:07.362692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 376/759] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:07 2022] GET /identity/v3/role_assignments?user.id=68ef674a83cd467dba60206f2caea39f&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:07.362692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e295bb5-5606-4ac6-acf0-79f8b3ce9482 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:07.437176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf45b2-cdfb-4fc5-8852-e641bcc5f4e2 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:07.504631 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:07.514951 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a62e3-d7ed-4a0d-b510-3b80fc7be97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:07.518330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a62e3-d7ed-4a0d-b510-3b80fc7be97e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:07.518330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a62e3-d7ed-4a0d-b510-3b80fc7be97e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:07.518330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a62e3-d7ed-4a0d-b510-3b80fc7be97e None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:07.523741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e295bb5-5606-4ac6-acf0-79f8b3ce9482 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:07.524866 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a62e3-d7ed-4a0d-b510-3b80fc7be97e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:07.526408 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a62e3-d7ed-4a0d-b510-3b80fc7be97e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-6c0a62e3-d7ed-4a0d-b510-3b80fc7be97e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:07.544741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:07.545826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:07.546857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:07.546857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:07.546857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:07.546857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:07.546857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:07.546857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:07.546857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:07.546857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:07.546857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 384/760] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:07.547875 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bac520-5783-4e66-98bc-e050bc972b01 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:07.549640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bac520-5783-4e66-98bc-e050bc972b01 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:07.549640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bac520-5783-4e66-98bc-e050bc972b01 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:07.549971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 385/761] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:07.555140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bac520-5783-4e66-98bc-e050bc972b01 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:07.572423 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c7d5d-fb81-45ba-a08f-73adb36cfbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:07.573561 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c7d5d-fb81-45ba-a08f-73adb36cfbb3 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:07.573992 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c7d5d-fb81-45ba-a08f-73adb36cfbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:07.574359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c7d5d-fb81-45ba-a08f-73adb36cfbb3 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:07.575999 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c7d5d-fb81-45ba-a08f-73adb36cfbb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:07.576415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c7d5d-fb81-45ba-a08f-73adb36cfbb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:07.578473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c7d5d-fb81-45ba-a08f-73adb36cfbb3 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:07.593578 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 377/762] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:07.599293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d482-2a45-410d-8ee2-9b098c3fd8dc None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:07.599293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d482-2a45-410d-8ee2-9b098c3fd8dc None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:07.599293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d482-2a45-410d-8ee2-9b098c3fd8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:07.615905 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-3cb4d482-2a45-410d-8ee2-9b098c3fd8dc None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:07.617130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-3cb4d482-2a45-410d-8ee2-9b098c3fd8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:07.685817 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:07.698043 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 378/763] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:07.699568 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4d482-2a45-410d-8ee2-9b098c3fd8dc None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:07.705422 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bac520-5783-4e66-98bc-e050bc972b01 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:07.755361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474359af-9c05-4781-aecb-b9cb968b40e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:07.756091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474359af-9c05-4781-aecb-b9cb968b40e8 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:07.756380 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474359af-9c05-4781-aecb-b9cb968b40e8 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:07.756773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474359af-9c05-4781-aecb-b9cb968b40e8 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:07.757616 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474359af-9c05-4781-aecb-b9cb968b40e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:07.757929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474359af-9c05-4781-aecb-b9cb968b40e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:07.759658 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474359af-9c05-4781-aecb-b9cb968b40e8 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:07.774555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 386/764] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:07.779933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474359af-9c05-4781-aecb-b9cb968b40e8 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:07.801662 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:07.829497 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4d482-2a45-410d-8ee2-9b098c3fd8dc None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:07.880713 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbe298-c0bd-4458-b921-1782ff69bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:07.881664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe298-c0bd-4458-b921-1782ff69bef5 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:07.881949 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe298-c0bd-4458-b921-1782ff69bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:07.882509 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe298-c0bd-4458-b921-1782ff69bef5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:07.892576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbe298-c0bd-4458-b921-1782ff69bef5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:07.894707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbe298-c0bd-4458-b921-1782ff69bef5 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-68fbe298-c0bd-4458-b921-1782ff69bef5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:07.914997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:07.916274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:07.918035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:07.918035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:07.918035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:07.918035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:07.918035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:07.918035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:07.918035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:07.918035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:07.918035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 379/765] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:07.918771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbe298-c0bd-4458-b921-1782ff69bef5 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:07.923440 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474359af-9c05-4781-aecb-b9cb968b40e8 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:07.960860 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2466d-aca3-4a2e-8d0c-219aece30841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:07.961796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2466d-aca3-4a2e-8d0c-219aece30841 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:07.962179 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2466d-aca3-4a2e-8d0c-219aece30841 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:07.962553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2466d-aca3-4a2e-8d0c-219aece30841 None admin] PATH_INFO: `/v3/services/network` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:07.963374 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2466d-aca3-4a2e-8d0c-219aece30841 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:07.965494 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2466d-aca3-4a2e-8d0c-219aece30841 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-1ea2466d-aca3-4a2e-8d0c-219aece30841 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:07.979223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:07.980732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:04:07.981897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:07.988846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 387/766] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:07 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:07.989976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2466d-aca3-4a2e-8d0c-219aece30841 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:08.021157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:08.060410 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbe298-c0bd-4458-b921-1782ff69bef5 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:08.113808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc73d0-eb30-48f6-9f13-9df621bb0ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:08.115487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc73d0-eb30-48f6-9f13-9df621bb0ac5 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:08.116028 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc73d0-eb30-48f6-9f13-9df621bb0ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:08.116520 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc73d0-eb30-48f6-9f13-9df621bb0ac5 None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/e0b88c1582c849349cc441446f6cca20/roles/38e07a16dc8b4306be7688b9d5cd626b` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:08.120270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc73d0-eb30-48f6-9f13-9df621bb0ac5 None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=e0b88c1582c849349cc441446f6cca20, role_id=38e07a16dc8b4306be7688b9d5cd626b)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:08.123451 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc73d0-eb30-48f6-9f13-9df621bb0ac5 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:08.130313 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:08.150624 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2466d-aca3-4a2e-8d0c-219aece30841 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:08.199798 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274fd0a-3015-409c-88b1-3954fe41946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:08.200521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274fd0a-3015-409c-88b1-3954fe41946b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:08.200789 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274fd0a-3015-409c-88b1-3954fe41946b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:08.201031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274fd0a-3015-409c-88b1-3954fe41946b None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:08.201850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274fd0a-3015-409c-88b1-3954fe41946b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:08.202167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274fd0a-3015-409c-88b1-3954fe41946b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:08.218803 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 380/767] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:04:07 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/e0b88c1582c849349cc441446f6cca20/roles/38e07a16dc8b4306be7688b9d5cd626b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:04:08.218803 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc73d0-eb30-48f6-9f13-9df621bb0ac5 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:08.219104 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274fd0a-3015-409c-88b1-3954fe41946b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:08.252333 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 388/768] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:08.258258 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274fd0a-3015-409c-88b1-3954fe41946b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:08.385337 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:08.393897 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc73d0-eb30-48f6-9f13-9df621bb0ac5 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:08.429218 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274fd0a-3015-409c-88b1-3954fe41946b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:08.438683 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07b4c7-79c7-4cb5-bb0c-ee5b347e4b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:08.439854 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07b4c7-79c7-4cb5-bb0c-ee5b347e4b58 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:08.440487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07b4c7-79c7-4cb5-bb0c-ee5b347e4b58 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:08.441017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07b4c7-79c7-4cb5-bb0c-ee5b347e4b58 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:08.442045 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07b4c7-79c7-4cb5-bb0c-ee5b347e4b58 None admin] RBAC: Adding query filter params (name=network) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:08.442658 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07b4c7-79c7-4cb5-bb0c-ee5b347e4b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:08.444635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07b4c7-79c7-4cb5-bb0c-ee5b347e4b58 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:08.452052 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 381/769] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:08.453938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e7fc-30e0-44eb-ad0c-26075a3f104f None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:08.454477 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e7fc-30e0-44eb-ad0c-26075a3f104f None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:08.455019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e7fc-30e0-44eb-ad0c-26075a3f104f None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:08.457698 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 382/770] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:08.458945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430e7fc-30e0-44eb-ad0c-26075a3f104f None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:08.484200 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78107df-a5f8-4cc7-b9af-66254d4425cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:08.484793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78107df-a5f8-4cc7-b9af-66254d4425cd None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:08.485111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78107df-a5f8-4cc7-b9af-66254d4425cd None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:08.485391 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78107df-a5f8-4cc7-b9af-66254d4425cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:08.486245 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78107df-a5f8-4cc7-b9af-66254d4425cd None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=78d1f9ebc22a412db074e8aae5db8e9b) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:08.486558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78107df-a5f8-4cc7-b9af-66254d4425cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:08.488050 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78107df-a5f8-4cc7-b9af-66254d4425cd None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:08.495286 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 389/771] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:08 2022] GET /identity/v3/role_assignments?user.id=78d1f9ebc22a412db074e8aae5db8e9b&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:08.497179 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6f19-64b0-4857-8196-4a0807939319 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:08.497487 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6f19-64b0-4857-8196-4a0807939319 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:08.497750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6f19-64b0-4857-8196-4a0807939319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:08.520714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-d9ad6f19-64b0-4857-8196-4a0807939319 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:08.522727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-d9ad6f19-64b0-4857-8196-4a0807939319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:08.539834 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:08.616579 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430e7fc-30e0-44eb-ad0c-26075a3f104f None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:08.665863 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 390/772] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:08.689094 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad6f19-64b0-4857-8196-4a0807939319 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:08.693476 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df928a-6b0f-4fb5-b3c2-b4179c564c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:08.694587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df928a-6b0f-4fb5-b3c2-b4179c564c57 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:08.695141 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df928a-6b0f-4fb5-b3c2-b4179c564c57 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:08.695654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df928a-6b0f-4fb5-b3c2-b4179c564c57 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:08.696634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df928a-6b0f-4fb5-b3c2-b4179c564c57 None admin] RBAC: Adding query filter params (type=network) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:08.702643 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df928a-6b0f-4fb5-b3c2-b4179c564c57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:08.704868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df928a-6b0f-4fb5-b3c2-b4179c564c57 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:08.713647 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 383/773] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:08.720441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df928a-6b0f-4fb5-b3c2-b4179c564c57 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:08.772602 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:08.823814 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad6f19-64b0-4857-8196-4a0807939319 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:08.864111 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df928a-6b0f-4fb5-b3c2-b4179c564c57 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:08.895511 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:08.901745 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883fa01-d9a3-42f6-95e3-211ea866b93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:08.902578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883fa01-d9a3-42f6-95e3-211ea866b93d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:08.902896 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883fa01-d9a3-42f6-95e3-211ea866b93d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:08.903178 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883fa01-d9a3-42f6-95e3-211ea866b93d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:08.903851 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883fa01-d9a3-42f6-95e3-211ea866b93d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:08.905304 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883fa01-d9a3-42f6-95e3-211ea866b93d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:08.910104 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6e485-184d-4157-900c-0f1d52f8cafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:08.912049 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e485-184d-4157-900c-0f1d52f8cafb None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:08.912049 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e485-184d-4157-900c-0f1d52f8cafb None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:08.912049 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e485-184d-4157-900c-0f1d52f8cafb None admin] PATH_INFO: `/v3/endpoints` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:08.913357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6e485-184d-4157-900c-0f1d52f8cafb None admin] RBAC: Adding query filter params (interface=public, service_id=098d7b1b0c7049b8bb67b0fb4ce840f5, region_id=RegionOne) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:08.913919 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6e485-184d-4157-900c-0f1d52f8cafb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:08.915635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6e485-184d-4157-900c-0f1d52f8cafb None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:08.925809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 384/774] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:04:08 2022] GET /identity/v3/endpoints?service_id=098d7b1b0c7049b8bb67b0fb4ce840f5&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:08.931824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6e485-184d-4157-900c-0f1d52f8cafb None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-2883fa01-d9a3-42f6-95e3-211ea866b93d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:08.943746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:08.944909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:08.945873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 391/775] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 20:04:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:08.951799 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883fa01-d9a3-42f6-95e3-211ea866b93d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:09.065310 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6e485-184d-4157-900c-0f1d52f8cafb None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:09.112654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6926fa-d9b1-4e4b-a01d-90ff125a675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:09.114040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6926fa-d9b1-4e4b-a01d-90ff125a675c None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:09.115010 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6926fa-d9b1-4e4b-a01d-90ff125a675c None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:09.117977 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6926fa-d9b1-4e4b-a01d-90ff125a675c None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:09.119045 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6926fa-d9b1-4e4b-a01d-90ff125a675c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:09.120819 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6926fa-d9b1-4e4b-a01d-90ff125a675c None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:09.139357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 385/776] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:04:08 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:09.190283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883fa01-d9a3-42f6-95e3-211ea866b93d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:09.231303 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:09.243150 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efc1e1-5143-4225-a58e-137425ead431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:09.244010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc1e1-5143-4225-a58e-137425ead431 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:09.257364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc1e1-5143-4225-a58e-137425ead431 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:09.257364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc1e1-5143-4225-a58e-137425ead431 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:09.257364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efc1e1-5143-4225-a58e-137425ead431 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:09.257364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efc1e1-5143-4225-a58e-137425ead431 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:09.257364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efc1e1-5143-4225-a58e-137425ead431 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:09.257364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 392/777] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:04:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:09.259027 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6926fa-d9b1-4e4b-a01d-90ff125a675c None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:09.348630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:09.416424 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6926fa-d9b1-4e4b-a01d-90ff125a675c None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:09.456864 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae102f9-edfc-4495-876c-3a6b133ef2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:09.457551 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae102f9-edfc-4495-876c-3a6b133ef2d7 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:09.457833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae102f9-edfc-4495-876c-3a6b133ef2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:09.458133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae102f9-edfc-4495-876c-3a6b133ef2d7 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:09.458861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae102f9-edfc-4495-876c-3a6b133ef2d7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:09.459183 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae102f9-edfc-4495-876c-3a6b133ef2d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:09.460601 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae102f9-edfc-4495-876c-3a6b133ef2d7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:09.467696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 386/778] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:04:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:09.473484 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efc1e1-5143-4225-a58e-137425ead431 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:09.620290 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efc1e1-5143-4225-a58e-137425ead431 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:09.661189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a30135-8c1d-40a2-8035-d39830e391ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:09.661873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30135-8c1d-40a2-8035-d39830e391ad None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:09.662204 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30135-8c1d-40a2-8035-d39830e391ad None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:09.662490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30135-8c1d-40a2-8035-d39830e391ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:09.668146 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a30135-8c1d-40a2-8035-d39830e391ad None admin] RBAC: Adding query filter params (interface=public, service_id=1d70239fe09741258ca9806d77200385, region_id=RegionOne) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:09.668529 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a30135-8c1d-40a2-8035-d39830e391ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:09.669905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a30135-8c1d-40a2-8035-d39830e391ad None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:09.679117 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 393/779] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:04:09 2022] GET /identity/v3/endpoints?service_id=1d70239fe09741258ca9806d77200385&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:09.685473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae102f9-edfc-4495-876c-3a6b133ef2d7 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:09.883368 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae102f9-edfc-4495-876c-3a6b133ef2d7 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:09.913500 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:09.943374 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf9c4f-5a66-4008-a468-e9a6b4226e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:09.944053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf9c4f-5a66-4008-a468-e9a6b4226e9c None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:09.944302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf9c4f-5a66-4008-a468-e9a6b4226e9c None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:09.944570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf9c4f-5a66-4008-a468-e9a6b4226e9c None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:09.945281 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf9c4f-5a66-4008-a468-e9a6b4226e9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:09.946707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf9c4f-5a66-4008-a468-e9a6b4226e9c None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:09.953338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 387/780] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:04:09 2022] GET /identity/v3/services => generated 772 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:10.044007 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed2dcb-5908-4e74-967a-4179faff9d73 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:10.044378 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed2dcb-5908-4e74-967a-4179faff9d73 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:10.044588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed2dcb-5908-4e74-967a-4179faff9d73 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:10.046364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 394/781] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:10.052502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4e71e-81fa-4773-bef1-961251601b0e None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:10.053257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4e71e-81fa-4773-bef1-961251601b0e None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:10.053775 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4e71e-81fa-4773-bef1-961251601b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:10.072946 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-82a4e71e-81fa-4773-bef1-961251601b0e None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:10.075269 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-82a4e71e-81fa-4773-bef1-961251601b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:10.173695 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 388/782] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:10.205121 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed2dcb-5908-4e74-967a-4179faff9d73 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:10.291471 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:10.360409 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed2dcb-5908-4e74-967a-4179faff9d73 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:10.409288 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c42a0-9638-4bdb-896e-3bbc24645aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:10.410104 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c42a0-9638-4bdb-896e-3bbc24645aec None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:10.410386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c42a0-9638-4bdb-896e-3bbc24645aec None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:10.410692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c42a0-9638-4bdb-896e-3bbc24645aec None admin] PATH_INFO: `/v3/roles/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:10.422782 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c42a0-9638-4bdb-896e-3bbc24645aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-b27c42a0-9638-4bdb-896e-3bbc24645aec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:10.431098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:10.433725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:10.437166 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 395/783] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:04:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:10.446875 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4e71e-81fa-4773-bef1-961251601b0e None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:10.579339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4e71e-81fa-4773-bef1-961251601b0e None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:10.602777 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:10.644896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4fd9c-f465-46ca-b2de-5a91fcd2f8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:10.645589 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fd9c-f465-46ca-b2de-5a91fcd2f8b3 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:10.645870 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fd9c-f465-46ca-b2de-5a91fcd2f8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:10.646146 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fd9c-f465-46ca-b2de-5a91fcd2f8b3 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:10.646943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4fd9c-f465-46ca-b2de-5a91fcd2f8b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:10.647252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4fd9c-f465-46ca-b2de-5a91fcd2f8b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:10.648630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4fd9c-f465-46ca-b2de-5a91fcd2f8b3 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:10.662591 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 389/784] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:04:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:10.668417 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c42a0-9638-4bdb-896e-3bbc24645aec None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:10.790740 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c42a0-9638-4bdb-896e-3bbc24645aec None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:10.830423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:10.870468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddf683-dfe4-49c1-bd2e-125b9ca54dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:10.871729 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddf683-dfe4-49c1-bd2e-125b9ca54dff None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:10.872273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddf683-dfe4-49c1-bd2e-125b9ca54dff None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:10.872799 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddf683-dfe4-49c1-bd2e-125b9ca54dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:10.895752 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddf683-dfe4-49c1-bd2e-125b9ca54dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:10.897925 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddf683-dfe4-49c1-bd2e-125b9ca54dff None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-22ddf683-dfe4-49c1-bd2e-125b9ca54dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:10.923541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:10.924631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:10.925724 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:10.925724 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:10.925724 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:10.925724 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:10.934452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 396/785] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:10.939753 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4fd9c-f465-46ca-b2de-5a91fcd2f8b3 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:11.089871 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce782edc-0f46-4d59-8850-5b5ab15083c0 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:11.090073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce782edc-0f46-4d59-8850-5b5ab15083c0 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:11.090326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce782edc-0f46-4d59-8850-5b5ab15083c0 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:11.092069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 397/786] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:04:11.097529 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03fc2f-e7d9-4447-abe7-553fa0dfd64c None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:11.097830 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03fc2f-e7d9-4447-abe7-553fa0dfd64c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:11.098110 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03fc2f-e7d9-4447-abe7-553fa0dfd64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:11.108808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4fd9c-f465-46ca-b2de-5a91fcd2f8b3 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:11.115884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-0d03fc2f-e7d9-4447-abe7-553fa0dfd64c None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:11.117116 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-0d03fc2f-e7d9-4447-abe7-553fa0dfd64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:11.175729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fe622-0cb7-489c-8314-4433a3616a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:11.176447 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe622-0cb7-489c-8314-4433a3616a2b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:11.176705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe622-0cb7-489c-8314-4433a3616a2b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:11.177248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe622-0cb7-489c-8314-4433a3616a2b None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:11.178017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fe622-0cb7-489c-8314-4433a3616a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:11.178329 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fe622-0cb7-489c-8314-4433a3616a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:11.179808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fe622-0cb7-489c-8314-4433a3616a2b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:11.211654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 390/787] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:11.215120 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fe622-0cb7-489c-8314-4433a3616a2b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:11.240917 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 398/788] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:11.263063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:11.275201 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03fc2f-e7d9-4447-abe7-553fa0dfd64c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:11.382057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fe622-0cb7-489c-8314-4433a3616a2b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:11.435944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:11.440213 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03fc2f-e7d9-4447-abe7-553fa0dfd64c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:11.470193 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c8bfd-4ca2-4c49-a199-15b65784a8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:11.471063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c8bfd-4ca2-4c49-a199-15b65784a8c7 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:11.471347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c8bfd-4ca2-4c49-a199-15b65784a8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:11.471624 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c8bfd-4ca2-4c49-a199-15b65784a8c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:11.478825 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40fedd-805c-4c41-a558-8bdc56c1700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:11.480535 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40fedd-805c-4c41-a558-8bdc56c1700b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:11.480977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40fedd-805c-4c41-a558-8bdc56c1700b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:11.481417 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40fedd-805c-4c41-a558-8bdc56c1700b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:11.489155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c8bfd-4ca2-4c49-a199-15b65784a8c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:11.492141 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c8bfd-4ca2-4c49-a199-15b65784a8c7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:11.512103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40fedd-805c-4c41-a558-8bdc56c1700b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-4a40fedd-805c-4c41-a558-8bdc56c1700b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:11.528546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:11.529665 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:11.530577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-8d0c8bfd-4ca2-4c49-a199-15b65784a8c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:11.532221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:11.533242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:11.535583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:11.535583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:11.535583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:11.535583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:11.535583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:11.535583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:11.535583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:11.535583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:11.535583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:11.535583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:11.535583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 391/789] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:04:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:11.538727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 399/790] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:04:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:11.546703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c8bfd-4ca2-4c49-a199-15b65784a8c7 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:11.548413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40fedd-805c-4c41-a558-8bdc56c1700b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:11.654064 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c8bfd-4ca2-4c49-a199-15b65784a8c7 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:11.655720 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:11.694390 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076865b-2b49-4f39-b7f2-890265b3d145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:11.695154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076865b-2b49-4f39-b7f2-890265b3d145 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:11.695479 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076865b-2b49-4f39-b7f2-890265b3d145 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:11.695759 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076865b-2b49-4f39-b7f2-890265b3d145 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:11.696618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076865b-2b49-4f39-b7f2-890265b3d145 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:11.696931 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076865b-2b49-4f39-b7f2-890265b3d145 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:11.698420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076865b-2b49-4f39-b7f2-890265b3d145 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:11.719896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 392/791] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:04:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:11.721410 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3345cde-78fd-41ff-9772-6339536383b3 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:11.721703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3345cde-78fd-41ff-9772-6339536383b3 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:11.723446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40fedd-805c-4c41-a558-8bdc56c1700b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:11.726424 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3345cde-78fd-41ff-9772-6339536383b3 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:11.728212 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 393/792] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:11.729010 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3345cde-78fd-41ff-9772-6339536383b3 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:11.766741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d40896-7281-4df7-830d-1133fc64ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:11.767567 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40896-7281-4df7-830d-1133fc64ab8a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:11.767859 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40896-7281-4df7-830d-1133fc64ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:11.768138 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40896-7281-4df7-830d-1133fc64ab8a None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:11.769026 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d40896-7281-4df7-830d-1133fc64ab8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:11.769332 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d40896-7281-4df7-830d-1133fc64ab8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:11.770889 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d40896-7281-4df7-830d-1133fc64ab8a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:11.781120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 400/793] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:04:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:11.782551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c956c-a7f5-4f31-b154-018236127136 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:11.782872 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c956c-a7f5-4f31-b154-018236127136 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:11.783209 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c956c-a7f5-4f31-b154-018236127136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:11.802759 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-039c956c-a7f5-4f31-b154-018236127136 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:11.803983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-039c956c-a7f5-4f31-b154-018236127136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:11.825076 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:11.850563 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3345cde-78fd-41ff-9772-6339536383b3 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:11.898943 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 401/794] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:11.899955 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c956c-a7f5-4f31-b154-018236127136 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:11.900260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e660f7-f25d-4068-aa8d-6ab2958943eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:11.901166 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e660f7-f25d-4068-aa8d-6ab2958943eb None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:11.901543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e660f7-f25d-4068-aa8d-6ab2958943eb None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:11.901901 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e660f7-f25d-4068-aa8d-6ab2958943eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:11.915434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e660f7-f25d-4068-aa8d-6ab2958943eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:11.916882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e660f7-f25d-4068-aa8d-6ab2958943eb None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-b7e660f7-f25d-4068-aa8d-6ab2958943eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:11.943165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:11.944852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:11.946072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:11.946072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:11.946072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:11.946072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:11.946072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 394/795] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:11.950916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e660f7-f25d-4068-aa8d-6ab2958943eb None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:11.954800 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:12.047469 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c956c-a7f5-4f31-b154-018236127136 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:12.063363 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e660f7-f25d-4068-aa8d-6ab2958943eb None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:12.087959 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378ac4-1080-4526-a9e1-6b566e500c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:12.089100 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378ac4-1080-4526-a9e1-6b566e500c29 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.090084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378ac4-1080-4526-a9e1-6b566e500c29 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.090584 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378ac4-1080-4526-a9e1-6b566e500c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.101138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbae06b-3b59-43f1-9bbb-dc2187c7aa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:12.102060 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae06b-3b59-43f1-9bbb-dc2187c7aa73 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.102409 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae06b-3b59-43f1-9bbb-dc2187c7aa73 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.102785 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae06b-3b59-43f1-9bbb-dc2187c7aa73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.105616 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378ac4-1080-4526-a9e1-6b566e500c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:12.107503 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378ac4-1080-4526-a9e1-6b566e500c29 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:12.115472 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbae06b-3b59-43f1-9bbb-dc2187c7aa73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-9bbae06b-3b59-43f1-9bbb-dc2187c7aa73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:12.125833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:12.127164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:12.128132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:12.132687 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 395/796] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:04:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-4f378ac4-1080-4526-a9e1-6b566e500c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:12.133154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:12.134120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:12.135222 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:12.135222 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:12.135222 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:12.135222 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:12.135473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbae06b-3b59-43f1-9bbb-dc2187c7aa73 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:12.136437 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 402/797] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:12.137378 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378ac4-1080-4526-a9e1-6b566e500c29 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:12.146203 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:12.215008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:12.260066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbae06b-3b59-43f1-9bbb-dc2187c7aa73 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:12.272596 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378ac4-1080-4526-a9e1-6b566e500c29 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:12.299994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc1ab1-f57f-40d6-9469-97cadbcf4a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:12.300710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc1ab1-f57f-40d6-9469-97cadbcf4a07 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.301054 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc1ab1-f57f-40d6-9469-97cadbcf4a07 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.301720 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc1ab1-f57f-40d6-9469-97cadbcf4a07 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.303025 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc1ab1-f57f-40d6-9469-97cadbcf4a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:12.303340 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc1ab1-f57f-40d6-9469-97cadbcf4a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:12.305460 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc1ab1-f57f-40d6-9469-97cadbcf4a07 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:12.319762 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a21bc-9e5a-4e77-b2f2-e92deaba3e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:12.320823 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 396/798] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:12.321683 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc1ab1-f57f-40d6-9469-97cadbcf4a07 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:12.322059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a21bc-9e5a-4e77-b2f2-e92deaba3e8a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.322944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a21bc-9e5a-4e77-b2f2-e92deaba3e8a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.323603 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a21bc-9e5a-4e77-b2f2-e92deaba3e8a None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.325419 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a21bc-9e5a-4e77-b2f2-e92deaba3e8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:12.326963 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a21bc-9e5a-4e77-b2f2-e92deaba3e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:12.329326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a21bc-9e5a-4e77-b2f2-e92deaba3e8a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:12.347714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 403/799] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:04:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:12.349310 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a21bc-9e5a-4e77-b2f2-e92deaba3e8a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:12.451083 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:12.455547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc1ab1-f57f-40d6-9469-97cadbcf4a07 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:12.489675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a21bc-9e5a-4e77-b2f2-e92deaba3e8a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:12.499318 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:12.512249 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca9786-16bf-4b50-8057-97c57686208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:12.512935 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca9786-16bf-4b50-8057-97c57686208b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.513221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca9786-16bf-4b50-8057-97c57686208b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.513502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca9786-16bf-4b50-8057-97c57686208b None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.514240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca9786-16bf-4b50-8057-97c57686208b None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:12.514551 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca9786-16bf-4b50-8057-97c57686208b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:12.516056 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca9786-16bf-4b50-8057-97c57686208b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:12.533577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 397/800] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:12.534821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d3f5-99a4-44d8-9a17-9ca06c9feb70 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.535119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d3f5-99a4-44d8-9a17-9ca06c9feb70 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.535402 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d3f5-99a4-44d8-9a17-9ca06c9feb70 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.538743 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 398/801] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:12.538886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636286d-4a15-4ab9-9fcf-188a4604cf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:12.538993 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44d3f5-99a4-44d8-9a17-9ca06c9feb70 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:12.539098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636286d-4a15-4ab9-9fcf-188a4604cf75 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.539098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636286d-4a15-4ab9-9fcf-188a4604cf75 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.539098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636286d-4a15-4ab9-9fcf-188a4604cf75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.547255 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636286d-4a15-4ab9-9fcf-188a4604cf75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:12.548738 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636286d-4a15-4ab9-9fcf-188a4604cf75 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-3636286d-4a15-4ab9-9fcf-188a4604cf75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:12.567873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:12.568992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:12.570030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:12.570030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:12.570030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:12.570030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:12.570030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:12.570030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:12.570030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:12.570030 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:12.573981 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 404/802] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:12.574999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636286d-4a15-4ab9-9fcf-188a4604cf75 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:12.672253 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44d3f5-99a4-44d8-9a17-9ca06c9feb70 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:12.699807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636286d-4a15-4ab9-9fcf-188a4604cf75 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:12.709827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478665b-16c8-409a-ba9f-aaab558cf669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:12.710657 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478665b-16c8-409a-ba9f-aaab558cf669 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.710945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478665b-16c8-409a-ba9f-aaab558cf669 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.711231 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478665b-16c8-409a-ba9f-aaab558cf669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.723767 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478665b-16c8-409a-ba9f-aaab558cf669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:12.725253 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478665b-16c8-409a-ba9f-aaab558cf669 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:12.731991 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:12.746550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505cf00-4f21-4e0c-a9f2-6588dbef7295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:12.746550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505cf00-4f21-4e0c-a9f2-6588dbef7295 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.746550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505cf00-4f21-4e0c-a9f2-6588dbef7295 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.746550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505cf00-4f21-4e0c-a9f2-6588dbef7295 None admin] PATH_INFO: `/v3/users/nova` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-6478665b-16c8-409a-ba9f-aaab558cf669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:12.747863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:12.748859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:12.749882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:12.749882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:12.749882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:12.749882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:12.749882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 399/803] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:12.750195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294d5f8-9955-47cf-a3bf-fe4cfba2d2e9 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.750278 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294d5f8-9955-47cf-a3bf-fe4cfba2d2e9 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.750870 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294d5f8-9955-47cf-a3bf-fe4cfba2d2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.757970 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505cf00-4f21-4e0c-a9f2-6588dbef7295 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:12.758828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505cf00-4f21-4e0c-a9f2-6588dbef7295 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:12.769063 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-a294d5f8-9955-47cf-a3bf-fe4cfba2d2e9 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:12.770266 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-a294d5f8-9955-47cf-a3bf-fe4cfba2d2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-e505cf00-4f21-4e0c-a9f2-6588dbef7295 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:12.775268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:12.776334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:12.778017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:12.778017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:12.778017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:12.778017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:12.778017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:12.778017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:12.778017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:12.778017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:12.778017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:04:12.778017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:12.778017 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 405/804] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:04:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:12.779315 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505cf00-4f21-4e0c-a9f2-6588dbef7295 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:12.805440 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:12.848464 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 400/805] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:12.849231 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294d5f8-9955-47cf-a3bf-fe4cfba2d2e9 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:12.885325 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505cf00-4f21-4e0c-a9f2-6588dbef7295 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:12.921441 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954edd-7698-415a-9eb7-037d1bbb3852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:12.922122 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954edd-7698-415a-9eb7-037d1bbb3852 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.922401 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954edd-7698-415a-9eb7-037d1bbb3852 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.922703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954edd-7698-415a-9eb7-037d1bbb3852 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.923531 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06954edd-7698-415a-9eb7-037d1bbb3852 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:12.923845 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06954edd-7698-415a-9eb7-037d1bbb3852 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:12.925418 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06954edd-7698-415a-9eb7-037d1bbb3852 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:12.939041 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 406/806] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:12.939923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954edd-7698-415a-9eb7-037d1bbb3852 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:12.958770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294d5f8-9955-47cf-a3bf-fe4cfba2d2e9 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:12.989445 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:12.993632 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d186c-5341-41b4-a543-dade3136fd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:12.994303 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d186c-5341-41b4-a543-dade3136fd70 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:12.994585 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d186c-5341-41b4-a543-dade3136fd70 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:12.994920 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d186c-5341-41b4-a543-dade3136fd70 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:12.995698 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d186c-5341-41b4-a543-dade3136fd70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:12.996007 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d186c-5341-41b4-a543-dade3136fd70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:12.997448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d186c-5341-41b4-a543-dade3136fd70 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:13.009533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 401/807] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:13.010875 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b57e18-c327-4f80-879d-80a8598a8ffe None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:13.011680 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b57e18-c327-4f80-879d-80a8598a8ffe None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:13.011956 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b57e18-c327-4f80-879d-80a8598a8ffe None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:13.013447 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 402/808] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:13.014653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b57e18-c327-4f80-879d-80a8598a8ffe None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:13.040542 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:13.055763 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954edd-7698-415a-9eb7-037d1bbb3852 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:13.091085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e1327-7a43-479e-b31d-3669f112daec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:13.091755 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1327-7a43-479e-b31d-3669f112daec None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:13.092041 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1327-7a43-479e-b31d-3669f112daec None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:13.092312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1327-7a43-479e-b31d-3669f112daec None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:13.093155 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e1327-7a43-479e-b31d-3669f112daec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:13.093465 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e1327-7a43-479e-b31d-3669f112daec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:13.094943 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e1327-7a43-479e-b31d-3669f112daec None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:13.112281 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 407/809] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:04:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:13.113059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e1327-7a43-479e-b31d-3669f112daec None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:13.121491 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b57e18-c327-4f80-879d-80a8598a8ffe None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:13.155957 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf90a9-1fa2-4ca3-95c7-b3fc0aa405bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:13.156799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf90a9-1fa2-4ca3-95c7-b3fc0aa405bc None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:13.157084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf90a9-1fa2-4ca3-95c7-b3fc0aa405bc None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:13.157392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf90a9-1fa2-4ca3-95c7-b3fc0aa405bc None admin] PATH_INFO: `/v3/services/network` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:13.158050 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf90a9-1fa2-4ca3-95c7-b3fc0aa405bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:13.159463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf90a9-1fa2-4ca3-95c7-b3fc0aa405bc None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-ccbf90a9-1fa2-4ca3-95c7-b3fc0aa405bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:13.173577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:13.180235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:13.181361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 403/810] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:13 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:13.182440 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf90a9-1fa2-4ca3-95c7-b3fc0aa405bc None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:13.221060 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e1327-7a43-479e-b31d-3669f112daec None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:13.460832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:13.460832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaed89f-085b-4e37-b9b3-65bb5bab54e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:13.460832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaed89f-085b-4e37-b9b3-65bb5bab54e4 None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:13.460832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaed89f-085b-4e37-b9b3-65bb5bab54e4 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:13.463431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaed89f-085b-4e37-b9b3-65bb5bab54e4 None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/68ef674a83cd467dba60206f2caea39f/roles/2c04974ce949479c8b4826c59fb652b3` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:13.463431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaed89f-085b-4e37-b9b3-65bb5bab54e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=68ef674a83cd467dba60206f2caea39f, role_id=2c04974ce949479c8b4826c59fb652b3)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:13.463431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaed89f-085b-4e37-b9b3-65bb5bab54e4 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:13.463939 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:13.463939 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf90a9-1fa2-4ca3-95c7-b3fc0aa405bc None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:13.463939 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2496fa5-857a-4f26-971a-676544083801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:13.463939 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2496fa5-857a-4f26-971a-676544083801 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:13.465434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2496fa5-857a-4f26-971a-676544083801 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:13.465434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2496fa5-857a-4f26-971a-676544083801 None admin] PATH_INFO: `/v3/users/swift` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:13.465434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2496fa5-857a-4f26-971a-676544083801 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:13.465434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2496fa5-857a-4f26-971a-676544083801 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:13.465434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-b2496fa5-857a-4f26-971a-676544083801 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:04:13.465434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:13.465434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:13.465434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:13.465434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:13.466758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:13.468783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:13.470869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:13.470869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:13.470869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:13.470869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:04:13.470869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:13.470869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 404/811] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:04:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:13.470869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9f36-e99b-4d20-a15a-ea49c756d669 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:13.470869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9f36-e99b-4d20-a15a-ea49c756d669 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:13.470869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9f36-e99b-4d20-a15a-ea49c756d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:13.472141 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-7b3d9f36-e99b-4d20-a15a-ea49c756d669 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:13.472141 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-7b3d9f36-e99b-4d20-a15a-ea49c756d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:13.472141 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 405/812] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:13.472141 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d9f36-e99b-4d20-a15a-ea49c756d669 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:13.472705 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 408/813] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:04:13 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/68ef674a83cd467dba60206f2caea39f/roles/2c04974ce949479c8b4826c59fb652b3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:04:13.476057 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaed89f-085b-4e37-b9b3-65bb5bab54e4 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:13.550641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:13.588752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d9f36-e99b-4d20-a15a-ea49c756d669 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:13.619491 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaed89f-085b-4e37-b9b3-65bb5bab54e4 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:13.631655 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a6485-de48-4827-badd-845bba1c1339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:13.632340 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a6485-de48-4827-badd-845bba1c1339 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:13.632632 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a6485-de48-4827-badd-845bba1c1339 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:13.632916 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a6485-de48-4827-badd-845bba1c1339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:13.664029 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f062d56-1450-4e91-bdc3-8a2d77205bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:13.664971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062d56-1450-4e91-bdc3-8a2d77205bcb None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:13.665281 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062d56-1450-4e91-bdc3-8a2d77205bcb None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:13.665615 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062d56-1450-4e91-bdc3-8a2d77205bcb None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:13.666562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f062d56-1450-4e91-bdc3-8a2d77205bcb None admin] RBAC: Adding query filter params (name=network) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:13.666562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f062d56-1450-4e91-bdc3-8a2d77205bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:13.668620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f062d56-1450-4e91-bdc3-8a2d77205bcb None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:13.674118 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 409/814] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:13.674949 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f062d56-1450-4e91-bdc3-8a2d77205bcb None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:13.701470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:13.723557 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a6485-de48-4827-badd-845bba1c1339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:13.724941 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a6485-de48-4827-badd-845bba1c1339 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:13.798452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f062d56-1450-4e91-bdc3-8a2d77205bcb None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:13.816068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:13.837473 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f2ae0-bbe2-46ae-aea8-3c800d7a1aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:13.838162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f2ae0-bbe2-46ae-aea8-3c800d7a1aae None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:13.838494 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f2ae0-bbe2-46ae-aea8-3c800d7a1aae None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:13.838806 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f2ae0-bbe2-46ae-aea8-3c800d7a1aae None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:13.840322 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f2ae0-bbe2-46ae-aea8-3c800d7a1aae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:13.840638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f2ae0-bbe2-46ae-aea8-3c800d7a1aae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:13.842225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f2ae0-bbe2-46ae-aea8-3c800d7a1aae None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:13.847904 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 406/815] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:04:13.849131 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a6485-de48-4827-badd-845bba1c1339 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:13.862631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 410/816] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:04:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:13.863524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f2ae0-bbe2-46ae-aea8-3c800d7a1aae None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:13.952341 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:13.968977 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a6485-de48-4827-badd-845bba1c1339 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:13.978178 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f2ae0-bbe2-46ae-aea8-3c800d7a1aae None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:14.007449 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e9ca0-b720-4cbb-a90a-23f62f3ee30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:14.008438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9ca0-b720-4cbb-a90a-23f62f3ee30a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:14.008730 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9ca0-b720-4cbb-a90a-23f62f3ee30a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:14.009009 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9ca0-b720-4cbb-a90a-23f62f3ee30a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:14.009719 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e9ca0-b720-4cbb-a90a-23f62f3ee30a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:14.011869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e9ca0-b720-4cbb-a90a-23f62f3ee30a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:14.019372 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab77c96-e0ba-4908-8789-66b1f8f25ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:14.020045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab77c96-e0ba-4908-8789-66b1f8f25ad3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:14.020329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab77c96-e0ba-4908-8789-66b1f8f25ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:14.020605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab77c96-e0ba-4908-8789-66b1f8f25ad3 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:14.021331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab77c96-e0ba-4908-8789-66b1f8f25ad3 None admin] RBAC: Adding query filter params (type=network) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:14.021636 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab77c96-e0ba-4908-8789-66b1f8f25ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:14.023049 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab77c96-e0ba-4908-8789-66b1f8f25ad3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-a71e9ca0-b720-4cbb-a90a-23f62f3ee30a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:14.025192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:14.026167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:14.027707 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 407/817] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 20:04:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:14.031939 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e9ca0-b720-4cbb-a90a-23f62f3ee30a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:14.033938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 411/818] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:14.033938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab77c96-e0ba-4908-8789-66b1f8f25ad3 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:14.081042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:14.146345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e9ca0-b720-4cbb-a90a-23f62f3ee30a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:14.156741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab77c96-e0ba-4908-8789-66b1f8f25ad3 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:14.186839 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda804-1c4f-46db-9d81-c97af28cc629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:14.187841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda804-1c4f-46db-9d81-c97af28cc629 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:14.188252 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda804-1c4f-46db-9d81-c97af28cc629 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:14.188636 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda804-1c4f-46db-9d81-c97af28cc629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:14.195078 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c024e3-dbc4-447f-bdfd-285b220339f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:14.196189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c024e3-dbc4-447f-bdfd-285b220339f7 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:14.196614 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c024e3-dbc4-447f-bdfd-285b220339f7 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:14.197039 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c024e3-dbc4-447f-bdfd-285b220339f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:14.202683 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda804-1c4f-46db-9d81-c97af28cc629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:14.202683 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda804-1c4f-46db-9d81-c97af28cc629 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:14.217494 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:14.222838 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c024e3-dbc4-447f-bdfd-285b220339f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-79cda804-1c4f-46db-9d81-c97af28cc629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:14.224634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:14.225417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:14.232068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:14.232068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:14.232068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:14.232068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:14.232068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 408/819] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:14.232068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda804-1c4f-46db-9d81-c97af28cc629 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:14.232371 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c024e3-dbc4-447f-bdfd-285b220339f7 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-c7c024e3-dbc4-447f-bdfd-285b220339f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:14.250134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:14.250968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:14.251670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:14.251670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:14.251670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:14.251670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:14.260773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 412/820] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:14.260773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c024e3-dbc4-447f-bdfd-285b220339f7 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:14.337334 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:14.345899 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda804-1c4f-46db-9d81-c97af28cc629 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:14.375421 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c024e3-dbc4-447f-bdfd-285b220339f7 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:14.385047 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e4588-d8e8-49bd-b2d3-1fd37ac22c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:14.386688 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e4588-d8e8-49bd-b2d3-1fd37ac22c6b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:14.386987 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e4588-d8e8-49bd-b2d3-1fd37ac22c6b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:14.387270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e4588-d8e8-49bd-b2d3-1fd37ac22c6b None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:14.388669 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e4588-d8e8-49bd-b2d3-1fd37ac22c6b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:14.388993 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e4588-d8e8-49bd-b2d3-1fd37ac22c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:14.390585 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e4588-d8e8-49bd-b2d3-1fd37ac22c6b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:14.397328 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 409/821] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:04:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:14.398159 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e4588-d8e8-49bd-b2d3-1fd37ac22c6b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:14.417157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295b09d-89ad-49f7-8a41-8d24cb7eb7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:14.418343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b09d-89ad-49f7-8a41-8d24cb7eb7ef None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:14.419099 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b09d-89ad-49f7-8a41-8d24cb7eb7ef None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:14.419614 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b09d-89ad-49f7-8a41-8d24cb7eb7ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:14.420578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295b09d-89ad-49f7-8a41-8d24cb7eb7ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:14.422670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295b09d-89ad-49f7-8a41-8d24cb7eb7ef None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:14.506982 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e4588-d8e8-49bd-b2d3-1fd37ac22c6b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:14.543013 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 413/822] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:04:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:14.544675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295b09d-89ad-49f7-8a41-8d24cb7eb7ef None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:14.559554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48afa35-032c-46d5-a10f-bcc5c40e467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:14.560397 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48afa35-032c-46d5-a10f-bcc5c40e467a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:14.560691 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48afa35-032c-46d5-a10f-bcc5c40e467a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:14.561025 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48afa35-032c-46d5-a10f-bcc5c40e467a None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:14.562459 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48afa35-032c-46d5-a10f-bcc5c40e467a None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:14.563155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48afa35-032c-46d5-a10f-bcc5c40e467a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:14.564812 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48afa35-032c-46d5-a10f-bcc5c40e467a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:14.586659 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 410/823] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:14.586659 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48afa35-032c-46d5-a10f-bcc5c40e467a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:14.612225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:14.653682 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:14.722821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48afa35-032c-46d5-a10f-bcc5c40e467a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:14.743395 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295b09d-89ad-49f7-8a41-8d24cb7eb7ef None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:14.770347 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c369bf0-eaa3-4f4f-b12e-3cff3e929caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:14.770960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c369bf0-eaa3-4f4f-b12e-3cff3e929caf None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:14.771242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c369bf0-eaa3-4f4f-b12e-3cff3e929caf None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:14.771516 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c369bf0-eaa3-4f4f-b12e-3cff3e929caf None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:14.772239 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c369bf0-eaa3-4f4f-b12e-3cff3e929caf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:14.772541 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c369bf0-eaa3-4f4f-b12e-3cff3e929caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:14.775158 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c369bf0-eaa3-4f4f-b12e-3cff3e929caf None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:14.780849 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 411/824] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:04:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:14.781713 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c369bf0-eaa3-4f4f-b12e-3cff3e929caf None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:14.821148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290c7da-f954-4929-8a4b-75a70aa74f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:14.821884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c7da-f954-4929-8a4b-75a70aa74f4a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:14.822182 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c7da-f954-4929-8a4b-75a70aa74f4a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:14.822459 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c7da-f954-4929-8a4b-75a70aa74f4a None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:14.823342 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290c7da-f954-4929-8a4b-75a70aa74f4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:14.823760 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290c7da-f954-4929-8a4b-75a70aa74f4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:14.825276 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290c7da-f954-4929-8a4b-75a70aa74f4a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:14.844696 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 414/825] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:14.845647 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290c7da-f954-4929-8a4b-75a70aa74f4a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:14.877550 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:14.902518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c369bf0-eaa3-4f4f-b12e-3cff3e929caf None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:14.944310 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff8d72-550c-4f62-87f1-bf5ae1c0ee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:14.945116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff8d72-550c-4f62-87f1-bf5ae1c0ee08 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:14.945403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff8d72-550c-4f62-87f1-bf5ae1c0ee08 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:14.945681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff8d72-550c-4f62-87f1-bf5ae1c0ee08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:14.953585 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff8d72-550c-4f62-87f1-bf5ae1c0ee08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:14.955067 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff8d72-550c-4f62-87f1-bf5ae1c0ee08 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:14.964344 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290c7da-f954-4929-8a4b-75a70aa74f4a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-00ff8d72-550c-4f62-87f1-bf5ae1c0ee08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:14.969887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:14.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:14.975382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:14.975382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:14.975382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:14.975382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:14.975382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:14.975382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:14.975382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:14.975382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:14.975382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 412/826] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:14.975382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff8d72-550c-4f62-87f1-bf5ae1c0ee08 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:14.981455 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:15.009118 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee93de0-5042-48ac-8d68-3aea09c23243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:15.009792 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee93de0-5042-48ac-8d68-3aea09c23243 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:15.010075 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee93de0-5042-48ac-8d68-3aea09c23243 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:15.010353 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee93de0-5042-48ac-8d68-3aea09c23243 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:15.011882 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee93de0-5042-48ac-8d68-3aea09c23243 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:15.013410 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee93de0-5042-48ac-8d68-3aea09c23243 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:15.083257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff8d72-550c-4f62-87f1-bf5ae1c0ee08 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:15.098033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 415/827] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:04:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:15.098956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee93de0-5042-48ac-8d68-3aea09c23243 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:15.147761 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e4791-2e37-418b-9c53-b14889662564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:15.149783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e4791-2e37-418b-9c53-b14889662564 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:15.150276 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e4791-2e37-418b-9c53-b14889662564 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:15.150784 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e4791-2e37-418b-9c53-b14889662564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:15.154927 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:15.162079 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e4791-2e37-418b-9c53-b14889662564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:15.165006 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e4791-2e37-418b-9c53-b14889662564 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-ba0e4791-2e37-418b-9c53-b14889662564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:15.187247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:15.188294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:15.189429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:15.189429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:15.189429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:15.189429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:15.189429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:15.189429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:15.189429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:15.189429 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:15.196653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 413/828] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:15.198388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e4791-2e37-418b-9c53-b14889662564 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:15.274898 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee93de0-5042-48ac-8d68-3aea09c23243 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:15.319346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc489c80-6c0e-452f-a385-ac146f27936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:15.320009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc489c80-6c0e-452f-a385-ac146f27936a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:15.320286 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc489c80-6c0e-452f-a385-ac146f27936a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:15.320555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc489c80-6c0e-452f-a385-ac146f27936a None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:15.332418 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc489c80-6c0e-452f-a385-ac146f27936a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:15.332418 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc489c80-6c0e-452f-a385-ac146f27936a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:15.332418 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc489c80-6c0e-452f-a385-ac146f27936a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:15.336354 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 416/829] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:15.342972 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc489c80-6c0e-452f-a385-ac146f27936a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:15.345676 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e4791-2e37-418b-9c53-b14889662564 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:15.375312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:15.386239 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c46ebf-2911-4db5-9f64-6d9fa302696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:15.386956 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46ebf-2911-4db5-9f64-6d9fa302696f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:15.387241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46ebf-2911-4db5-9f64-6d9fa302696f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:15.387517 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46ebf-2911-4db5-9f64-6d9fa302696f None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:15.389804 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c46ebf-2911-4db5-9f64-6d9fa302696f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:15.389804 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c46ebf-2911-4db5-9f64-6d9fa302696f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:15.390131 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c46ebf-2911-4db5-9f64-6d9fa302696f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:15.403446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 414/830] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:15.410034 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c46ebf-2911-4db5-9f64-6d9fa302696f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:15.469835 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:15.472996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc489c80-6c0e-452f-a385-ac146f27936a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:15.511163 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2afb74-29a5-4122-9795-4842f909bd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:15.512742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2afb74-29a5-4122-9795-4842f909bd0a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:15.513029 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2afb74-29a5-4122-9795-4842f909bd0a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:15.513302 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2afb74-29a5-4122-9795-4842f909bd0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:15.514158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2afb74-29a5-4122-9795-4842f909bd0a None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=e0b88c1582c849349cc441446f6cca20) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:15.514470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2afb74-29a5-4122-9795-4842f909bd0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:15.516158 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2afb74-29a5-4122-9795-4842f909bd0a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:15.518462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c46ebf-2911-4db5-9f64-6d9fa302696f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:15.530789 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 417/831] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:15 2022] GET /identity/v3/role_assignments?user.id=e0b88c1582c849349cc441446f6cca20&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:15.564895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce2b4f-2a72-4b67-89d1-b1510f2791d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:15.565817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2b4f-2a72-4b67-89d1-b1510f2791d3 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:15.566095 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2b4f-2a72-4b67-89d1-b1510f2791d3 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:15.566369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2b4f-2a72-4b67-89d1-b1510f2791d3 None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/78d1f9ebc22a412db074e8aae5db8e9b/roles/38e07a16dc8b4306be7688b9d5cd626b` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:15.568600 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce2b4f-2a72-4b67-89d1-b1510f2791d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=78d1f9ebc22a412db074e8aae5db8e9b, role_id=38e07a16dc8b4306be7688b9d5cd626b)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:15.570082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce2b4f-2a72-4b67-89d1-b1510f2791d3 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:15.653262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 415/832] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:04:15 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/78d1f9ebc22a412db074e8aae5db8e9b/roles/38e07a16dc8b4306be7688b9d5cd626b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:04:15.854107 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d9a2c-fc45-4204-9a55-3332ab301cdf None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:15.854651 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d9a2c-fc45-4204-9a55-3332ab301cdf None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:15.854651 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d9a2c-fc45-4204-9a55-3332ab301cdf None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:15.856630 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 418/833] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:15.862522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b11e4-0fbf-42e9-8078-5ea764301775 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:15.862845 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b11e4-0fbf-42e9-8078-5ea764301775 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:15.863130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b11e4-0fbf-42e9-8078-5ea764301775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:15.881777 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-281b11e4-0fbf-42e9-8078-5ea764301775 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:15.883338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-281b11e4-0fbf-42e9-8078-5ea764301775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:15.960577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 416/834] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:15.985244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d9a2c-fc45-4204-9a55-3332ab301cdf None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:16.090167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:16.109942 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d9a2c-fc45-4204-9a55-3332ab301cdf None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:16.148326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb491ca-04ff-4742-ab69-c1d554aa8a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:16.149515 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb491ca-04ff-4742-ab69-c1d554aa8a31 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:16.150045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb491ca-04ff-4742-ab69-c1d554aa8a31 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:16.150520 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb491ca-04ff-4742-ab69-c1d554aa8a31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:16.162777 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb491ca-04ff-4742-ab69-c1d554aa8a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-9cb491ca-04ff-4742-ab69-c1d554aa8a31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:16.171796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:16.172606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:04:16.173313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:16.176022 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 419/835] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:04:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:16.182346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b11e4-0fbf-42e9-8078-5ea764301775 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:16.232465 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:16.294163 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b11e4-0fbf-42e9-8078-5ea764301775 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:16.331672 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d71d82-9d8a-4f5d-b4a7-50e49ff39644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:16.332357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d71d82-9d8a-4f5d-b4a7-50e49ff39644 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:16.332646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d71d82-9d8a-4f5d-b4a7-50e49ff39644 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:16.332926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d71d82-9d8a-4f5d-b4a7-50e49ff39644 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:16.333756 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d71d82-9d8a-4f5d-b4a7-50e49ff39644 None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:16.334070 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d71d82-9d8a-4f5d-b4a7-50e49ff39644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:16.335492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d71d82-9d8a-4f5d-b4a7-50e49ff39644 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:16.346309 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 417/836] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:04:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:16.351766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb491ca-04ff-4742-ab69-c1d554aa8a31 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:16.467285 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb491ca-04ff-4742-ab69-c1d554aa8a31 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:16.505691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c849e-4bf9-41fc-8d59-0995023e0792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:16.506415 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c849e-4bf9-41fc-8d59-0995023e0792 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:16.506723 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c849e-4bf9-41fc-8d59-0995023e0792 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:16.507002 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c849e-4bf9-41fc-8d59-0995023e0792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:16.518908 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c849e-4bf9-41fc-8d59-0995023e0792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:16.520389 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c849e-4bf9-41fc-8d59-0995023e0792 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:16.529632 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-927c849e-4bf9-41fc-8d59-0995023e0792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:16.539526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:16.540294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:16.541074 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:16.541074 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:16.541074 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:16.541074 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:16.541273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 420/837] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:16.547454 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d71d82-9d8a-4f5d-b4a7-50e49ff39644 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:16.686264 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d71d82-9d8a-4f5d-b4a7-50e49ff39644 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:16.699929 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:16.728742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd7361-21a7-4cd9-803f-470b0afef1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:16.729805 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd7361-21a7-4cd9-803f-470b0afef1ee None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:16.730267 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd7361-21a7-4cd9-803f-470b0afef1ee None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:16.730747 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd7361-21a7-4cd9-803f-470b0afef1ee None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:16.731647 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd7361-21a7-4cd9-803f-470b0afef1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:16.732156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd7361-21a7-4cd9-803f-470b0afef1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:16.733689 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd7361-21a7-4cd9-803f-470b0afef1ee None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:16.745968 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 418/838] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:16.758690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c849e-4bf9-41fc-8d59-0995023e0792 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:16.865697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c849e-4bf9-41fc-8d59-0995023e0792 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:16.905887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecca70-dfa2-446a-acf2-94974bc15be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:16.906736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecca70-dfa2-446a-acf2-94974bc15be9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:16.907025 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecca70-dfa2-446a-acf2-94974bc15be9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:16.907300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecca70-dfa2-446a-acf2-94974bc15be9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:16.916600 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecca70-dfa2-446a-acf2-94974bc15be9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:16.918138 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecca70-dfa2-446a-acf2-94974bc15be9 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-d4ecca70-dfa2-446a-acf2-94974bc15be9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:16.934262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:16.935140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:16.935946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:16.935946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:16.935946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:16.935946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:16.935946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:16.935946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:16.935946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:16.935946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:16.935946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:16.935946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:16.935946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 421/839] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:04:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:16.941499 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd7361-21a7-4cd9-803f-470b0afef1ee None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:17.051563 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd7361-21a7-4cd9-803f-470b0afef1ee None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:17.089269 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358c62b-64d9-4c02-be91-a030434faafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:17.090317 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358c62b-64d9-4c02-be91-a030434faafc None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:17.090826 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358c62b-64d9-4c02-be91-a030434faafc None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:17.091299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358c62b-64d9-4c02-be91-a030434faafc None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:17.092388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358c62b-64d9-4c02-be91-a030434faafc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:17.092896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358c62b-64d9-4c02-be91-a030434faafc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:17.094530 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358c62b-64d9-4c02-be91-a030434faafc None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:17.113694 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 419/840] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:04:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:17.118938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecca70-dfa2-446a-acf2-94974bc15be9 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:17.184187 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:17.228589 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecca70-dfa2-446a-acf2-94974bc15be9 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:17.269653 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d63945-898c-4676-9d9e-cd9e5d8be910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:17.270355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d63945-898c-4676-9d9e-cd9e5d8be910 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:17.270664 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d63945-898c-4676-9d9e-cd9e5d8be910 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:17.270949 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d63945-898c-4676-9d9e-cd9e5d8be910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:17.352447 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d63945-898c-4676-9d9e-cd9e5d8be910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:17.353877 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d63945-898c-4676-9d9e-cd9e5d8be910 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:17.417977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:17.464536 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 422/841] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:04:17.470466 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358c62b-64d9-4c02-be91-a030434faafc None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:17.502635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:17.528127 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92accc9-5088-464f-b83a-cfa0888f286b None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:17.528453 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92accc9-5088-464f-b83a-cfa0888f286b None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:17.528815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92accc9-5088-464f-b83a-cfa0888f286b None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:17.530493 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 423/842] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:17.540321 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09234d-1c11-40cf-b2dd-b951f0e0c35d None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:17.540605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09234d-1c11-40cf-b2dd-b951f0e0c35d None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:17.540975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09234d-1c11-40cf-b2dd-b951f0e0c35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:17.564071 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-8a09234d-1c11-40cf-b2dd-b951f0e0c35d None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:17.565775 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-8a09234d-1c11-40cf-b2dd-b951f0e0c35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:17.602568 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358c62b-64d9-4c02-be91-a030434faafc None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:17.643878 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858e12e-7688-4d9e-847e-290b8e97b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:17.645048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858e12e-7688-4d9e-847e-290b8e97b35e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:17.645605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858e12e-7688-4d9e-847e-290b8e97b35e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:17.646118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858e12e-7688-4d9e-847e-290b8e97b35e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:17.658549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858e12e-7688-4d9e-847e-290b8e97b35e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:17.661582 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 424/843] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:17.663645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858e12e-7688-4d9e-847e-290b8e97b35e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:17.682186 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09234d-1c11-40cf-b2dd-b951f0e0c35d None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-1858e12e-7688-4d9e-847e-290b8e97b35e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:17.684817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:17.685599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:17.686360 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:17.686360 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:17.686360 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:17.686360 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:17.689520 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 420/844] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:17.695927 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858e12e-7688-4d9e-847e-290b8e97b35e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:17.794255 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:17.807260 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:17.820897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09234d-1c11-40cf-b2dd-b951f0e0c35d None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:17.828404 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858e12e-7688-4d9e-847e-290b8e97b35e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:17.864885 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f352220-b134-4722-b2f2-205d74a7e1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:17.866024 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f352220-b134-4722-b2f2-205d74a7e1c5 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:17.866950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f352220-b134-4722-b2f2-205d74a7e1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:17.867485 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f352220-b134-4722-b2f2-205d74a7e1c5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:17.868404 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f352220-b134-4722-b2f2-205d74a7e1c5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:17.870188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f352220-b134-4722-b2f2-205d74a7e1c5 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:17.882766 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dda698-0747-4136-a1fc-105ecb83de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:17.883455 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dda698-0747-4136-a1fc-105ecb83de2b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:17.883738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dda698-0747-4136-a1fc-105ecb83de2b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:17.884014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dda698-0747-4136-a1fc-105ecb83de2b None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:17.884770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dda698-0747-4136-a1fc-105ecb83de2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:17.885080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dda698-0747-4136-a1fc-105ecb83de2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:17.887128 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dda698-0747-4136-a1fc-105ecb83de2b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-7f352220-b134-4722-b2f2-205d74a7e1c5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:17.889264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:17.890148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:04:17.890946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:17.893917 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 425/845] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:04:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:17.900785 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f352220-b134-4722-b2f2-205d74a7e1c5 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:17.912672 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 421/846] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:17.913713 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dda698-0747-4136-a1fc-105ecb83de2b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:18.034215 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f352220-b134-4722-b2f2-205d74a7e1c5 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:18.043038 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dda698-0747-4136-a1fc-105ecb83de2b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:18.074448 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178b6a3-402c-4d76-8eb6-680a598c2243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:18.075163 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b6a3-402c-4d76-8eb6-680a598c2243 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.075728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b6a3-402c-4d76-8eb6-680a598c2243 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.076008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b6a3-402c-4d76-8eb6-680a598c2243 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.076734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178b6a3-402c-4d76-8eb6-680a598c2243 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:18.077044 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178b6a3-402c-4d76-8eb6-680a598c2243 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:18.078435 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178b6a3-402c-4d76-8eb6-680a598c2243 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:18.080201 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d82861-c026-490e-b535-50c3ebb29cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:18.080995 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d82861-c026-490e-b535-50c3ebb29cd4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.081276 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d82861-c026-490e-b535-50c3ebb29cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.081548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d82861-c026-490e-b535-50c3ebb29cd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.083233 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 426/847] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:04:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:18.084491 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38449f-6521-4fad-b48f-5e9ce643e635 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.084778 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38449f-6521-4fad-b48f-5e9ce643e635 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.085064 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38449f-6521-4fad-b48f-5e9ce643e635 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.086327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 427/848] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:18.087427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b54e-a3e1-4fea-a531-2275b0b85f26 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.087867 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b54e-a3e1-4fea-a531-2275b0b85f26 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.088027 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b54e-a3e1-4fea-a531-2275b0b85f26 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.090142 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 428/849] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:18.090547 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256b54e-a3e1-4fea-a531-2275b0b85f26 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:18.092294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:18.098997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d82861-c026-490e-b535-50c3ebb29cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:18.100463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d82861-c026-490e-b535-50c3ebb29cd4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:18.111440 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-31d82861-c026-490e-b535-50c3ebb29cd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:18.116386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:18.117155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:18.117895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:18.117895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:18.117895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:18.117895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:18.117895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:18.117895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:18.117895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:18.117895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:18.117895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 422/850] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:18.118874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987839-89d3-4a71-b4b2-322a511ca8e5 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.119155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987839-89d3-4a71-b4b2-322a511ca8e5 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.119440 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987839-89d3-4a71-b4b2-322a511ca8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.135941 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-16987839-89d3-4a71-b4b2-322a511ca8e5 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:18.137138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-16987839-89d3-4a71-b4b2-322a511ca8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:18.205084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256b54e-a3e1-4fea-a531-2275b0b85f26 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:18.209264 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 423/851] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:18.210782 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01e9d6-a75a-41fb-9202-78cb98567989 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.211210 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01e9d6-a75a-41fb-9202-78cb98567989 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.211614 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01e9d6-a75a-41fb-9202-78cb98567989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.238223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-5e01e9d6-a75a-41fb-9202-78cb98567989 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:18.239452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-5e01e9d6-a75a-41fb-9202-78cb98567989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:18.244701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fc3a7-9bc0-479b-88d4-61d0085f9fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:18.245931 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fc3a7-9bc0-479b-88d4-61d0085f9fe3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.246226 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fc3a7-9bc0-479b-88d4-61d0085f9fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.246501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fc3a7-9bc0-479b-88d4-61d0085f9fe3 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.247254 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fc3a7-9bc0-479b-88d4-61d0085f9fe3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:18.247559 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fc3a7-9bc0-479b-88d4-61d0085f9fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:18.248939 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fc3a7-9bc0-479b-88d4-61d0085f9fe3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:18.253722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 429/852] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:04:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:18.254307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fc3a7-9bc0-479b-88d4-61d0085f9fe3 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:18.329665 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 424/853] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:18.330346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01e9d6-a75a-41fb-9202-78cb98567989 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:18.386640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:18.413373 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fc3a7-9bc0-479b-88d4-61d0085f9fe3 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:18.416701 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:18.472066 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1eee1-ddc1-4130-ba27-534027425fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:18.472066 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1eee1-ddc1-4130-ba27-534027425fe5 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.472066 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1eee1-ddc1-4130-ba27-534027425fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.472066 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1eee1-ddc1-4130-ba27-534027425fe5 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.472919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1eee1-ddc1-4130-ba27-534027425fe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:18.473424 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1eee1-ddc1-4130-ba27-534027425fe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:18.475669 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1eee1-ddc1-4130-ba27-534027425fe5 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:18.485053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01e9d6-a75a-41fb-9202-78cb98567989 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:18.491434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 430/854] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:18.494633 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1eee1-ddc1-4130-ba27-534027425fe5 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:18.532820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f7b0-f9a6-4862-8af6-3de12eadb319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:18.533854 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f7b0-f9a6-4862-8af6-3de12eadb319 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.534143 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f7b0-f9a6-4862-8af6-3de12eadb319 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.534423 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f7b0-f9a6-4862-8af6-3de12eadb319 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.535127 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f7b0-f9a6-4862-8af6-3de12eadb319 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:18.536583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f7b0-f9a6-4862-8af6-3de12eadb319 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-e2a2f7b0-f9a6-4862-8af6-3de12eadb319 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:18.561554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:18.563495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:18.564936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 425/855] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 20:04:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:18.566381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f7b0-f9a6-4862-8af6-3de12eadb319 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:18.659939 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1eee1-ddc1-4130-ba27-534027425fe5 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:18.698714 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f7b0-f9a6-4862-8af6-3de12eadb319 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:18.699510 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb495f2-1248-4b0b-99af-ef655349fa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:18.700364 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb495f2-1248-4b0b-99af-ef655349fa0a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.700642 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb495f2-1248-4b0b-99af-ef655349fa0a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.700918 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb495f2-1248-4b0b-99af-ef655349fa0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.711964 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb495f2-1248-4b0b-99af-ef655349fa0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-dcb495f2-1248-4b0b-99af-ef655349fa0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:18.720346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:18.721324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:18.722195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:18.725244 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:18.726532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 431/856] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:04:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:18.727428 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb495f2-1248-4b0b-99af-ef655349fa0a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:18.731321 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:18.742003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e43efc-07db-4689-a68d-31e77e1a95ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:18.746704 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43efc-07db-4689-a68d-31e77e1a95ce None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.746704 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43efc-07db-4689-a68d-31e77e1a95ce None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.746704 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43efc-07db-4689-a68d-31e77e1a95ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.746704 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43efc-07db-4689-a68d-31e77e1a95ce None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=68ef674a83cd467dba60206f2caea39f) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:18.746704 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43efc-07db-4689-a68d-31e77e1a95ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:18.747023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43efc-07db-4689-a68d-31e77e1a95ce None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:18.762692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 426/857] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:18 2022] GET /identity/v3/role_assignments?user.id=68ef674a83cd467dba60206f2caea39f&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:18.762692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e43efc-07db-4689-a68d-31e77e1a95ce None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:18.881965 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb495f2-1248-4b0b-99af-ef655349fa0a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:18.923734 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e43efc-07db-4689-a68d-31e77e1a95ce None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:18.934504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38035249-d866-48f5-9e9d-64e459eac4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:18.935378 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38035249-d866-48f5-9e9d-64e459eac4fd None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.935755 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38035249-d866-48f5-9e9d-64e459eac4fd None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.936132 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38035249-d866-48f5-9e9d-64e459eac4fd None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.936971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38035249-d866-48f5-9e9d-64e459eac4fd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:18.937417 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38035249-d866-48f5-9e9d-64e459eac4fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:18.939006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38035249-d866-48f5-9e9d-64e459eac4fd None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:18.951063 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 432/858] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:04:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:18.952224 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38035249-d866-48f5-9e9d-64e459eac4fd None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:18.973301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea607a6c-6f39-4982-be29-7ce3c497ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:18.974028 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea607a6c-6f39-4982-be29-7ce3c497ca55 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:18.974305 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea607a6c-6f39-4982-be29-7ce3c497ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:18.974583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea607a6c-6f39-4982-be29-7ce3c497ca55 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:18.975406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea607a6c-6f39-4982-be29-7ce3c497ca55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:18.976620 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea607a6c-6f39-4982-be29-7ce3c497ca55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:18.978015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea607a6c-6f39-4982-be29-7ce3c497ca55 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:18.992789 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 427/859] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:04:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:19.001488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea607a6c-6f39-4982-be29-7ce3c497ca55 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:19.039097 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:19.058637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:19.088474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38035249-d866-48f5-9e9d-64e459eac4fd None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:19.139535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea607a6c-6f39-4982-be29-7ce3c497ca55 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:19.140388 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234f004-9ff7-4290-8222-6d422f038040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:19.141506 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f004-9ff7-4290-8222-6d422f038040 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:19.142861 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f004-9ff7-4290-8222-6d422f038040 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:19.143163 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f004-9ff7-4290-8222-6d422f038040 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:19.143909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234f004-9ff7-4290-8222-6d422f038040 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:19.144220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234f004-9ff7-4290-8222-6d422f038040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:19.145722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234f004-9ff7-4290-8222-6d422f038040 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:19.151528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 433/860] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:04:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:19.188139 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56687049-b287-4211-b604-e68ceb5d7f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:19.188882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687049-b287-4211-b604-e68ceb5d7f65 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:19.189164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687049-b287-4211-b604-e68ceb5d7f65 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:19.189437 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687049-b287-4211-b604-e68ceb5d7f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:19.203162 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56687049-b287-4211-b604-e68ceb5d7f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:19.204653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56687049-b287-4211-b604-e68ceb5d7f65 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-56687049-b287-4211-b604-e68ceb5d7f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:19.225014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:19.225793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:19.226549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:19.226549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:19.226549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:19.226549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:19.226785 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 428/861] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:19.233081 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234f004-9ff7-4290-8222-6d422f038040 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:19.353163 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234f004-9ff7-4290-8222-6d422f038040 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:19.387018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:19.392196 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6eb0c-d5fe-4e28-8a69-6059d23ea07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:19.393112 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6eb0c-d5fe-4e28-8a69-6059d23ea07e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:19.393631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6eb0c-d5fe-4e28-8a69-6059d23ea07e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:19.394101 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6eb0c-d5fe-4e28-8a69-6059d23ea07e None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:19.395034 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6eb0c-d5fe-4e28-8a69-6059d23ea07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:19.395575 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6eb0c-d5fe-4e28-8a69-6059d23ea07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:19.397123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6eb0c-d5fe-4e28-8a69-6059d23ea07e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:19.414953 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 434/862] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:19.416619 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56687049-b287-4211-b604-e68ceb5d7f65 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:19.527888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:19.531914 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56687049-b287-4211-b604-e68ceb5d7f65 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:19.573976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cb188-0294-403f-b368-58a5d5ffd996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:19.574814 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb188-0294-403f-b368-58a5d5ffd996 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:19.575103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb188-0294-403f-b368-58a5d5ffd996 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:19.575383 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb188-0294-403f-b368-58a5d5ffd996 None admin] PATH_INFO: `/v3/users/swift` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:19.583541 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cb188-0294-403f-b368-58a5d5ffd996 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:19.585037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cb188-0294-403f-b368-58a5d5ffd996 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-645cb188-0294-403f-b368-58a5d5ffd996 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:19.600673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:19.601535 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:19.602345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:19.602345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:19.602345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:19.602345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:19.602345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:19.602345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:19.602345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:19.602345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:19.602345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:04:19.602345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:19.602345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 429/863] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:04:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:19.609742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6eb0c-d5fe-4e28-8a69-6059d23ea07e None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:19.719120 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6eb0c-d5fe-4e28-8a69-6059d23ea07e None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:19.755375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31433b0-4c21-43ed-9b8e-c7888ff2f5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:19.756409 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31433b0-4c21-43ed-9b8e-c7888ff2f5e5 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:19.756879 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31433b0-4c21-43ed-9b8e-c7888ff2f5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:19.757340 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31433b0-4c21-43ed-9b8e-c7888ff2f5e5 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:19.758476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31433b0-4c21-43ed-9b8e-c7888ff2f5e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:19.758999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31433b0-4c21-43ed-9b8e-c7888ff2f5e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:19.760642 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31433b0-4c21-43ed-9b8e-c7888ff2f5e5 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:19.780919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 435/864] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:04:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:19.786883 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cb188-0294-403f-b368-58a5d5ffd996 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:19.905229 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cb188-0294-403f-b368-58a5d5ffd996 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:19.944963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15512a44-eb80-408d-aa66-83cd0a9097d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:19.945660 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15512a44-eb80-408d-aa66-83cd0a9097d0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:19.945948 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15512a44-eb80-408d-aa66-83cd0a9097d0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:19.946228 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15512a44-eb80-408d-aa66-83cd0a9097d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:19.977539 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:20.022501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15512a44-eb80-408d-aa66-83cd0a9097d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:20.024002 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15512a44-eb80-408d-aa66-83cd0a9097d0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:20.134769 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 430/865] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:04:20.140345 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31433b0-4c21-43ed-9b8e-c7888ff2f5e5 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:20.196619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:20.258374 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31433b0-4c21-43ed-9b8e-c7888ff2f5e5 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:20.304204 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6787e80-9e91-4c9d-82c0-b9e56c5e73ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:20.305012 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6787e80-9e91-4c9d-82c0-b9e56c5e73ce None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:20.305291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6787e80-9e91-4c9d-82c0-b9e56c5e73ce None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:20.305587 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6787e80-9e91-4c9d-82c0-b9e56c5e73ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:20.318374 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6787e80-9e91-4c9d-82c0-b9e56c5e73ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:20.319898 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6787e80-9e91-4c9d-82c0-b9e56c5e73ce None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-f6787e80-9e91-4c9d-82c0-b9e56c5e73ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:20.344897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:20.345766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:20.346670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:20.346670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:20.346670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:20.346670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:20.346670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 436/866] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:20.352999 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15512a44-eb80-408d-aa66-83cd0a9097d0 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:20.434226 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:20.486287 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15512a44-eb80-408d-aa66-83cd0a9097d0 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:20.525536 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048132b-bc30-44ec-9a00-abeb8e379457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:20.526213 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048132b-bc30-44ec-9a00-abeb8e379457 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:20.526525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048132b-bc30-44ec-9a00-abeb8e379457 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:20.526844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048132b-bc30-44ec-9a00-abeb8e379457 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:20.527583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048132b-bc30-44ec-9a00-abeb8e379457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:20.527893 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048132b-bc30-44ec-9a00-abeb8e379457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:20.529274 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048132b-bc30-44ec-9a00-abeb8e379457 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:20.541726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 431/867] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:20.547368 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6787e80-9e91-4c9d-82c0-b9e56c5e73ce None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:20.653212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:20.656978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6787e80-9e91-4c9d-82c0-b9e56c5e73ce None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:20.673221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e490b0-9df2-4fda-b4a1-7fc5586bd527 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:20.673817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e490b0-9df2-4fda-b4a1-7fc5586bd527 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:20.674301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e490b0-9df2-4fda-b4a1-7fc5586bd527 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:20.676172 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 432/868] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:20.681677 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa042e-76da-4864-82dd-068d108f4263 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:20.682212 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa042e-76da-4864-82dd-068d108f4263 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:20.682800 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa042e-76da-4864-82dd-068d108f4263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:20.699577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fa51e-397e-4a44-abb7-c4f2965e0cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:20.700677 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fa51e-397e-4a44-abb7-c4f2965e0cd3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:20.701097 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fa51e-397e-4a44-abb7-c4f2965e0cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:20.701501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fa51e-397e-4a44-abb7-c4f2965e0cd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:20.708686 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-3bfa042e-76da-4864-82dd-068d108f4263 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:20.710167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-3bfa042e-76da-4864-82dd-068d108f4263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:20.712269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fa51e-397e-4a44-abb7-c4f2965e0cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:20.715418 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fa51e-397e-4a44-abb7-c4f2965e0cd3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-926fa51e-397e-4a44-abb7-c4f2965e0cd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:20.735758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:20.736620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:20.737876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:20.737876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:20.737876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:20.737876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:20.737876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:20.737876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:20.737876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:20.737876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:20.737876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 437/869] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:20.743257 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fa51e-397e-4a44-abb7-c4f2965e0cd3 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:20.806709 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 433/870] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:20.830478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa042e-76da-4864-82dd-068d108f4263 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:20.880283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fa51e-397e-4a44-abb7-c4f2965e0cd3 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:20.884215 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:20.926878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac1cba-cd2d-4c8d-9dc8-4de45b815d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:20.927815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac1cba-cd2d-4c8d-9dc8-4de45b815d08 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:20.928093 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac1cba-cd2d-4c8d-9dc8-4de45b815d08 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:20.928366 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac1cba-cd2d-4c8d-9dc8-4de45b815d08 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:20.929167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac1cba-cd2d-4c8d-9dc8-4de45b815d08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:20.929473 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac1cba-cd2d-4c8d-9dc8-4de45b815d08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:20.930948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac1cba-cd2d-4c8d-9dc8-4de45b815d08 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:20.950966 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 438/871] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:20.952547 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac1cba-cd2d-4c8d-9dc8-4de45b815d08 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:20.955940 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa042e-76da-4864-82dd-068d108f4263 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:20.976847 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:20.995479 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ede62-90f7-4500-accb-5f803153f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:20.996642 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ede62-90f7-4500-accb-5f803153f010 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:20.997138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ede62-90f7-4500-accb-5f803153f010 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:20.998190 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ede62-90f7-4500-accb-5f803153f010 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:20.999213 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ede62-90f7-4500-accb-5f803153f010 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:21.000834 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ede62-90f7-4500-accb-5f803153f010 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:21.065262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac1cba-cd2d-4c8d-9dc8-4de45b815d08 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:21.081847 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 434/872] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:04:20 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:04:21.119746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6ed40-e4cb-4d72-8671-15181c5d79a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:21.120963 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ed40-e4cb-4d72-8671-15181c5d79a7 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:21.121285 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ed40-e4cb-4d72-8671-15181c5d79a7 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:21.121556 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ed40-e4cb-4d72-8671-15181c5d79a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:21.122468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ed40-e4cb-4d72-8671-15181c5d79a7 None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=78d1f9ebc22a412db074e8aae5db8e9b) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:21.122812 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ed40-e4cb-4d72-8671-15181c5d79a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:21.124473 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ed40-e4cb-4d72-8671-15181c5d79a7 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:21.132164 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 439/873] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:20 2022] GET /identity/v3/role_assignments?user.id=78d1f9ebc22a412db074e8aae5db8e9b&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:21.372409 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273f28-50a7-46fa-8778-3e62ad54af7f None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:21.372763 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273f28-50a7-46fa-8778-3e62ad54af7f None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:21.372971 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273f28-50a7-46fa-8778-3e62ad54af7f None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:21.374415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 435/874] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:21.380473 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bc29e-88ad-4462-b013-de348a35fca6 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:21.380964 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bc29e-88ad-4462-b013-de348a35fca6 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:21.381056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bc29e-88ad-4462-b013-de348a35fca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:21.399811 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-239bc29e-88ad-4462-b013-de348a35fca6 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:21.401077 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-239bc29e-88ad-4462-b013-de348a35fca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:21.479068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 440/875] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:21 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:21.502800 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273f28-50a7-46fa-8778-3e62ad54af7f None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:21.544882 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1852f7-4ac6-4381-853e-186983756d86 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:21.545192 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1852f7-4ac6-4381-853e-186983756d86 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:21.545443 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1852f7-4ac6-4381-853e-186983756d86 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:21.548287 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 441/876] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:21.552909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ef23b-e440-4f2a-ac98-69a19e97a2e1 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:21.553195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ef23b-e440-4f2a-ac98-69a19e97a2e1 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:21.553476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ef23b-e440-4f2a-ac98-69a19e97a2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:21.576342 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-3f7ef23b-e440-4f2a-ac98-69a19e97a2e1 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:21.578390 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-3f7ef23b-e440-4f2a-ac98-69a19e97a2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:21.582867 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:21.632880 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273f28-50a7-46fa-8778-3e62ad54af7f None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:21.647014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:21.682629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a85e60-8eaf-493c-9a68-1585fa2a2e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:21.682629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a85e60-8eaf-493c-9a68-1585fa2a2e25 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:21.682629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a85e60-8eaf-493c-9a68-1585fa2a2e25 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:21.682629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a85e60-8eaf-493c-9a68-1585fa2a2e25 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:21.683725 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 442/877] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:21 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:21.694372 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a85e60-8eaf-493c-9a68-1585fa2a2e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:21.704900 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ef23b-e440-4f2a-ac98-69a19e97a2e1 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-88a85e60-8eaf-493c-9a68-1585fa2a2e25 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:21.711738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:21.712764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:21.713512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 436/878] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:04:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:21.720991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a85e60-8eaf-493c-9a68-1585fa2a2e25 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:21.834190 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ef23b-e440-4f2a-ac98-69a19e97a2e1 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:21.843195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a85e60-8eaf-493c-9a68-1585fa2a2e25 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:21.877192 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db85769-e2f8-4d14-afe6-bfdc69eae9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:21.878247 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db85769-e2f8-4d14-afe6-bfdc69eae9a0 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:21.878758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db85769-e2f8-4d14-afe6-bfdc69eae9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:21.879227 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db85769-e2f8-4d14-afe6-bfdc69eae9a0 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:21.880152 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db85769-e2f8-4d14-afe6-bfdc69eae9a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:21.881781 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db85769-e2f8-4d14-afe6-bfdc69eae9a0 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:21.890924 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ddad0-264f-4c87-ab71-6957a7363c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:21.891619 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ddad0-264f-4c87-ab71-6957a7363c4b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:21.891906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ddad0-264f-4c87-ab71-6957a7363c4b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:21.892185 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ddad0-264f-4c87-ab71-6957a7363c4b None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:21.892953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ddad0-264f-4c87-ab71-6957a7363c4b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:21.893264 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ddad0-264f-4c87-ab71-6957a7363c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:21.894698 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ddad0-264f-4c87-ab71-6957a7363c4b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:21.905169 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 437/879] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:04:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:21.910976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ddad0-264f-4c87-ab71-6957a7363c4b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:21.948124 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:22.001634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:22.009355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 443/880] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:04:21 2022] POST /identity/v3/services => generated 269 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:04:22.033706 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ddad0-264f-4c87-ab71-6957a7363c4b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:22.084934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124ada-2866-4a3e-8db0-ee703913f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:22.086148 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124ada-2866-4a3e-8db0-ee703913f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:22.086663 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124ada-2866-4a3e-8db0-ee703913f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:22.087245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124ada-2866-4a3e-8db0-ee703913f3c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:22.100096 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b124ada-2866-4a3e-8db0-ee703913f3c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:22.102102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b124ada-2866-4a3e-8db0-ee703913f3c8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-9b124ada-2866-4a3e-8db0-ee703913f3c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:22.124721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:22.125635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:22.126411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:22.126411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:22.126411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:22.126411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:22.128991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 438/881] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:22.136129 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db85769-e2f8-4d14-afe6-bfdc69eae9a0 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:22.260680 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db85769-e2f8-4d14-afe6-bfdc69eae9a0 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:22.300745 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ca10c-0e39-49f5-ad32-875249afab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:22.301695 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ca10c-0e39-49f5-ad32-875249afab1f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:22.302498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ca10c-0e39-49f5-ad32-875249afab1f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:22.302949 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ca10c-0e39-49f5-ad32-875249afab1f None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:22.303984 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ca10c-0e39-49f5-ad32-875249afab1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:22.304483 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ca10c-0e39-49f5-ad32-875249afab1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:22.306151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ca10c-0e39-49f5-ad32-875249afab1f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:22.326341 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 444/882] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:22.328040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124ada-2866-4a3e-8db0-ee703913f3c8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:22.419367 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:22.446435 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124ada-2866-4a3e-8db0-ee703913f3c8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:22.484443 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093bd3d-f4c2-4691-a07a-6eaacbc0de21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:22.485263 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093bd3d-f4c2-4691-a07a-6eaacbc0de21 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:22.485543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093bd3d-f4c2-4691-a07a-6eaacbc0de21 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:22.485818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093bd3d-f4c2-4691-a07a-6eaacbc0de21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:22.493391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093bd3d-f4c2-4691-a07a-6eaacbc0de21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:22.494854 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093bd3d-f4c2-4691-a07a-6eaacbc0de21 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-a093bd3d-f4c2-4691-a07a-6eaacbc0de21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:22.510515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:22.511457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:22.512463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:22.512463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:22.512463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:22.512463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:22.512463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:22.512463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:22.512463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:22.512463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:22.512463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:22.512463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:22.512463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 439/883] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:04:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:22.519517 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ca10c-0e39-49f5-ad32-875249afab1f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:22.588367 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:22.634012 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ca10c-0e39-49f5-ad32-875249afab1f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:22.672934 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af36027-54a6-4cb5-aeb7-e85b41a99c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:22.673943 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af36027-54a6-4cb5-aeb7-e85b41a99c32 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:22.674435 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af36027-54a6-4cb5-aeb7-e85b41a99c32 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:22.674956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af36027-54a6-4cb5-aeb7-e85b41a99c32 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:22.676009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af36027-54a6-4cb5-aeb7-e85b41a99c32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:22.676516 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af36027-54a6-4cb5-aeb7-e85b41a99c32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:22.678439 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af36027-54a6-4cb5-aeb7-e85b41a99c32 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:22.702729 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 445/884] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:04:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:22.705187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093bd3d-f4c2-4691-a07a-6eaacbc0de21 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:22.820750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093bd3d-f4c2-4691-a07a-6eaacbc0de21 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:22.858419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c9a79-e282-41cb-9a94-bdfd55d1da67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:22.859203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c9a79-e282-41cb-9a94-bdfd55d1da67 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:22.859392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c9a79-e282-41cb-9a94-bdfd55d1da67 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:22.859667 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c9a79-e282-41cb-9a94-bdfd55d1da67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:22.869337 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:22.937014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c9a79-e282-41cb-9a94-bdfd55d1da67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:22.938456 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c9a79-e282-41cb-9a94-bdfd55d1da67 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:23.050751 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 440/885] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:22 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:04:23.056778 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af36027-54a6-4cb5-aeb7-e85b41a99c32 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:23.170228 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af36027-54a6-4cb5-aeb7-e85b41a99c32 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:23.190522 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:23.209084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8b0b9-bd87-4890-b54b-147138fd7038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:23.209894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8b0b9-bd87-4890-b54b-147138fd7038 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:23.210172 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8b0b9-bd87-4890-b54b-147138fd7038 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:23.210446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8b0b9-bd87-4890-b54b-147138fd7038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:23.226743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8b0b9-bd87-4890-b54b-147138fd7038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:23.228262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8b0b9-bd87-4890-b54b-147138fd7038 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-e0f8b0b9-bd87-4890-b54b-147138fd7038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:23.248176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:23.249069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:23.250037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:23.250037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:23.250037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:23.250037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:23.250037 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 446/886] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:23.260174 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c9a79-e282-41cb-9a94-bdfd55d1da67 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:23.310406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:23.380349 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c9a79-e282-41cb-9a94-bdfd55d1da67 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:23.424195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e2791-dc89-48ad-b6c0-107a3b107b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:23.424878 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e2791-dc89-48ad-b6c0-107a3b107b24 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:23.425162 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e2791-dc89-48ad-b6c0-107a3b107b24 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:23.425440 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e2791-dc89-48ad-b6c0-107a3b107b24 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:23.426186 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e2791-dc89-48ad-b6c0-107a3b107b24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:23.426492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e2791-dc89-48ad-b6c0-107a3b107b24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:23.428573 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e2791-dc89-48ad-b6c0-107a3b107b24 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:23.443109 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 441/887] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:23.449384 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8b0b9-bd87-4890-b54b-147138fd7038 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:23.466220 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe3a4-3410-4225-9a13-4ed8d6c84dd1 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:23.467076 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe3a4-3410-4225-9a13-4ed8d6c84dd1 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:23.467369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe3a4-3410-4225-9a13-4ed8d6c84dd1 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:23.469729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 442/888] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:23.475550 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b851b8b-33a7-4b4b-9192-11c449f390a2 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:23.475778 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b851b8b-33a7-4b4b-9192-11c449f390a2 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:23.476060 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b851b8b-33a7-4b4b-9192-11c449f390a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:23.496008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-5b851b8b-33a7-4b4b-9192-11c449f390a2 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:23.497335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-5b851b8b-33a7-4b4b-9192-11c449f390a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:23.596431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8b0b9-bd87-4890-b54b-147138fd7038 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:23.648832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c7649-229f-4921-93b0-e0063deadde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:23.649936 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7649-229f-4921-93b0-e0063deadde5 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:23.650649 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7649-229f-4921-93b0-e0063deadde5 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:23.650649 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7649-229f-4921-93b0-e0063deadde5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:23.658871 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c7649-229f-4921-93b0-e0063deadde5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:23.660646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c7649-229f-4921-93b0-e0063deadde5 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-528c7649-229f-4921-93b0-e0063deadde5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:23.678400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:23.687237 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:23.688891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:23.688891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:23.688891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:23.688891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:23.688891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:23.688891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:23.688891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:23.688891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:23.689843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 443/889] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:23.689843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc8401-f183-45be-be43-765ffcb5c763 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:23.689843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc8401-f183-45be-be43-765ffcb5c763 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:23.689843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc8401-f183-45be-be43-765ffcb5c763 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:23.689843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 444/890] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:23.689843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc8401-f183-45be-be43-765ffcb5c763 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:23.690507 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 447/891] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:23.690507 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c4ed-8057-44a2-9243-128429c2a7ac None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:23.694892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c4ed-8057-44a2-9243-128429c2a7ac None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:23.694892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c4ed-8057-44a2-9243-128429c2a7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:23.724604 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-3384c4ed-8057-44a2-9243-128429c2a7ac None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:23.725857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-3384c4ed-8057-44a2-9243-128429c2a7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:23.740365 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:23.771545 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:23.846665 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc8401-f183-45be-be43-765ffcb5c763 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:23.847255 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 448/892] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:23.848478 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c4ed-8057-44a2-9243-128429c2a7ac None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:23.889492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b775d5-a296-4cda-abce-ea4acbdbf913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:23.891062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b775d5-a296-4cda-abce-ea4acbdbf913 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:23.892001 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b775d5-a296-4cda-abce-ea4acbdbf913 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:23.892435 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b775d5-a296-4cda-abce-ea4acbdbf913 None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:23.893721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b775d5-a296-4cda-abce-ea4acbdbf913 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:23.894187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b775d5-a296-4cda-abce-ea4acbdbf913 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:23.896587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b775d5-a296-4cda-abce-ea4acbdbf913 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:23.915337 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 445/893] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:23.917156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b775d5-a296-4cda-abce-ea4acbdbf913 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:23.985296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c4ed-8057-44a2-9243-128429c2a7ac None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:24.025371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:24.029015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1e87c-0ca1-4760-a147-8208545b6499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:24.030015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1e87c-0ca1-4760-a147-8208545b6499 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:24.030449 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1e87c-0ca1-4760-a147-8208545b6499 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:24.030919 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1e87c-0ca1-4760-a147-8208545b6499 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:24.031730 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1e87c-0ca1-4760-a147-8208545b6499 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:24.033360 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1e87c-0ca1-4760-a147-8208545b6499 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:24.037924 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b775d5-a296-4cda-abce-ea4acbdbf913 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-59b1e87c-0ca1-4760-a147-8208545b6499 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:24.046386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:24.047490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:04:24.048425 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:24.050550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 449/894] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:04:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:24.051580 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1e87c-0ca1-4760-a147-8208545b6499 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:24.081389 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d2ebc-18eb-4633-a70d-902e47b16bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:24.082216 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d2ebc-18eb-4633-a70d-902e47b16bb2 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:24.082504 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d2ebc-18eb-4633-a70d-902e47b16bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:24.082815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d2ebc-18eb-4633-a70d-902e47b16bb2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:24.083270 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:24.083489 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d2ebc-18eb-4633-a70d-902e47b16bb2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:24.084889 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d2ebc-18eb-4633-a70d-902e47b16bb2 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-e87d2ebc-18eb-4633-a70d-902e47b16bb2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:24.097545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:24.098492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:24.099910 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 446/895] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:04:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:24.100637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d2ebc-18eb-4633-a70d-902e47b16bb2 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:24.175075 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1e87c-0ca1-4760-a147-8208545b6499 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:24.212757 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512ccdb-28bf-4d23-b9d5-18d211c313b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:24.213546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512ccdb-28bf-4d23-b9d5-18d211c313b2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:24.213923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512ccdb-28bf-4d23-b9d5-18d211c313b2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:24.214278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512ccdb-28bf-4d23-b9d5-18d211c313b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:24.215254 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512ccdb-28bf-4d23-b9d5-18d211c313b2 None admin] RBAC: Adding query filter params (role.id=67f40b8de4bf4007a76e72baba6aba0e, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=68ef674a83cd467dba60206f2caea39f) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:24.215572 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512ccdb-28bf-4d23-b9d5-18d211c313b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:24.217090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512ccdb-28bf-4d23-b9d5-18d211c313b2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:24.223940 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 450/896] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:24 2022] GET /identity/v3/role_assignments?user.id=68ef674a83cd467dba60206f2caea39f&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=67f40b8de4bf4007a76e72baba6aba0e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:24.224641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512ccdb-28bf-4d23-b9d5-18d211c313b2 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:24.249977 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d2ebc-18eb-4633-a70d-902e47b16bb2 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:24.295891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e098f-9e6b-46a1-bbb0-17564b25c89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:24.296582 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e098f-9e6b-46a1-bbb0-17564b25c89b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:24.296866 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e098f-9e6b-46a1-bbb0-17564b25c89b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:24.297144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e098f-9e6b-46a1-bbb0-17564b25c89b None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:24.297887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e098f-9e6b-46a1-bbb0-17564b25c89b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:24.298200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e098f-9e6b-46a1-bbb0-17564b25c89b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:24.299670 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e098f-9e6b-46a1-bbb0-17564b25c89b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:24.315232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 447/897] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:04:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:24.317719 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e098f-9e6b-46a1-bbb0-17564b25c89b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:24.341711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:24.347178 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:24.366913 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512ccdb-28bf-4d23-b9d5-18d211c313b2 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:24.422431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311180f4-fc71-4e3f-bebb-008eefc65bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:24.423540 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311180f4-fc71-4e3f-bebb-008eefc65bac None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:24.424500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311180f4-fc71-4e3f-bebb-008eefc65bac None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:24.424948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311180f4-fc71-4e3f-bebb-008eefc65bac None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:24.426232 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311180f4-fc71-4e3f-bebb-008eefc65bac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:24.426781 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311180f4-fc71-4e3f-bebb-008eefc65bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:24.429473 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311180f4-fc71-4e3f-bebb-008eefc65bac None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:24.439848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 451/898] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:04:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:24.448668 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311180f4-fc71-4e3f-bebb-008eefc65bac None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:24.454824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e098f-9e6b-46a1-bbb0-17564b25c89b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:24.497255 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee5c56-95b2-451e-b3a6-80f1c95b4d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:24.497940 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee5c56-95b2-451e-b3a6-80f1c95b4d2b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:24.498223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee5c56-95b2-451e-b3a6-80f1c95b4d2b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:24.498501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee5c56-95b2-451e-b3a6-80f1c95b4d2b None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:24.499270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee5c56-95b2-451e-b3a6-80f1c95b4d2b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:24.499578 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee5c56-95b2-451e-b3a6-80f1c95b4d2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:24.501143 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee5c56-95b2-451e-b3a6-80f1c95b4d2b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:24.507668 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 448/899] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:04:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:24.514111 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee5c56-95b2-451e-b3a6-80f1c95b4d2b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:24.578631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311180f4-fc71-4e3f-bebb-008eefc65bac None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:24.609078 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:24.623383 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd915c7-f38d-4c84-90f3-e3aaa321ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:24.624060 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd915c7-f38d-4c84-90f3-e3aaa321ea53 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:24.624348 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd915c7-f38d-4c84-90f3-e3aaa321ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:24.624627 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd915c7-f38d-4c84-90f3-e3aaa321ea53 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:24.625365 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd915c7-f38d-4c84-90f3-e3aaa321ea53 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:24.625676 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd915c7-f38d-4c84-90f3-e3aaa321ea53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:24.627147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd915c7-f38d-4c84-90f3-e3aaa321ea53 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:24.630194 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee5c56-95b2-451e-b3a6-80f1c95b4d2b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:24.632491 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 452/900] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:04:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:24.633640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72014b2-b52b-476b-bbbd-d90f931cd577 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:24.633928 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72014b2-b52b-476b-bbbd-d90f931cd577 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:24.634209 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72014b2-b52b-476b-bbbd-d90f931cd577 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:24.638659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 453/901] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:24.644683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2bbe-1fb3-47ce-9023-c93d62a38299 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:24.645055 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2bbe-1fb3-47ce-9023-c93d62a38299 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:24.645423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2bbe-1fb3-47ce-9023-c93d62a38299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:24.669934 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-c3ec2bbe-1fb3-47ce-9023-c93d62a38299 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:24.671660 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-c3ec2bbe-1fb3-47ce-9023-c93d62a38299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:24.686248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:24.691859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dad3c-778b-4910-9caa-f144dbf6ef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:24.698733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dad3c-778b-4910-9caa-f144dbf6ef77 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:24.698733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dad3c-778b-4910-9caa-f144dbf6ef77 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:24.698733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dad3c-778b-4910-9caa-f144dbf6ef77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:24.698733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dad3c-778b-4910-9caa-f144dbf6ef77 None admin] RBAC: Adding query filter params (interface=public, service_id=646596757a9140a1be06ceb10c2ca8ab, region_id=RegionOne) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:24.698733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dad3c-778b-4910-9caa-f144dbf6ef77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:24.698733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dad3c-778b-4910-9caa-f144dbf6ef77 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:24.706812 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 449/902] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:04:24 2022] GET /identity/v3/endpoints?service_id=646596757a9140a1be06ceb10c2ca8ab&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:24.711060 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dad3c-778b-4910-9caa-f144dbf6ef77 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:24.793762 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 454/903] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:24.817032 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec2bbe-1fb3-47ce-9023-c93d62a38299 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:24.843083 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dad3c-778b-4910-9caa-f144dbf6ef77 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:24.887933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf974a3e-7a71-4bda-87b0-13feb1576664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:24.888945 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf974a3e-7a71-4bda-87b0-13feb1576664 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:24.889225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf974a3e-7a71-4bda-87b0-13feb1576664 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:24.889498 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf974a3e-7a71-4bda-87b0-13feb1576664 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:24.890192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf974a3e-7a71-4bda-87b0-13feb1576664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:24.892078 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf974a3e-7a71-4bda-87b0-13feb1576664 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:24.900393 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 450/904] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:04:24 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:04:24.957671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec2bbe-1fb3-47ce-9023-c93d62a38299 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:25.002970 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11ca19-db77-4f57-a091-7e8f1b66b4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:25.003834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11ca19-db77-4f57-a091-7e8f1b66b4a1 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:25.004119 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11ca19-db77-4f57-a091-7e8f1b66b4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:25.004390 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11ca19-db77-4f57-a091-7e8f1b66b4a1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:25.005081 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11ca19-db77-4f57-a091-7e8f1b66b4a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:25.006527 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11ca19-db77-4f57-a091-7e8f1b66b4a1 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-6f11ca19-db77-4f57-a091-7e8f1b66b4a1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:25.021625 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:25.022553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:25.023356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 455/905] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 20:04:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:25.031446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf974a3e-7a71-4bda-87b0-13feb1576664 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:25.063123 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:25.151506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf974a3e-7a71-4bda-87b0-13feb1576664 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:25.190950 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bbf3d-43c6-4dd5-a0f1-15ec3d559caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:25.191685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bbf3d-43c6-4dd5-a0f1-15ec3d559caa None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:25.191971 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bbf3d-43c6-4dd5-a0f1-15ec3d559caa None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:25.192249 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bbf3d-43c6-4dd5-a0f1-15ec3d559caa None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:25.192975 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bbf3d-43c6-4dd5-a0f1-15ec3d559caa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:25.193285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bbf3d-43c6-4dd5-a0f1-15ec3d559caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:25.194706 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bbf3d-43c6-4dd5-a0f1-15ec3d559caa None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:25.201105 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 451/906] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:04:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:25.206465 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11ca19-db77-4f57-a091-7e8f1b66b4a1 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:25.225200 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:25.324831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11ca19-db77-4f57-a091-7e8f1b66b4a1 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:25.364938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b868309-7daf-4b0c-8582-9f954072ab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:25.365623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b868309-7daf-4b0c-8582-9f954072ab75 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:25.365925 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b868309-7daf-4b0c-8582-9f954072ab75 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:25.366201 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b868309-7daf-4b0c-8582-9f954072ab75 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:25.366977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b868309-7daf-4b0c-8582-9f954072ab75 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:25.367286 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b868309-7daf-4b0c-8582-9f954072ab75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:25.368689 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b868309-7daf-4b0c-8582-9f954072ab75 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:25.375000 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 456/907] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:04:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:25.380412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bbf3d-43c6-4dd5-a0f1-15ec3d559caa None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:25.462990 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:25.490954 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bbf3d-43c6-4dd5-a0f1-15ec3d559caa None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:25.531680 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a23285-1cd7-43ff-90c7-5a8938c4e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:25.532352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23285-1cd7-43ff-90c7-5a8938c4e1e6 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:25.532632 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23285-1cd7-43ff-90c7-5a8938c4e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:25.532960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23285-1cd7-43ff-90c7-5a8938c4e1e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:25.533739 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a23285-1cd7-43ff-90c7-5a8938c4e1e6 None admin] RBAC: Adding query filter params (interface=public, service_id=6e779f6fcf2f456f9e979c6a024328e0, region_id=RegionOne) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:25.534049 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a23285-1cd7-43ff-90c7-5a8938c4e1e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:25.535481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a23285-1cd7-43ff-90c7-5a8938c4e1e6 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:25.541645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 452/908] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:04:25 2022] GET /identity/v3/endpoints?service_id=6e779f6fcf2f456f9e979c6a024328e0&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:25.547721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b868309-7daf-4b0c-8582-9f954072ab75 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:25.642418 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:25.672023 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b868309-7daf-4b0c-8582-9f954072ab75 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:25.710524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01264f6b-4cc6-4e80-a90c-77b8701076ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:25.711229 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01264f6b-4cc6-4e80-a90c-77b8701076ca None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:25.711515 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01264f6b-4cc6-4e80-a90c-77b8701076ca None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:25.711835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01264f6b-4cc6-4e80-a90c-77b8701076ca None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:25.712541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01264f6b-4cc6-4e80-a90c-77b8701076ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:25.713962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01264f6b-4cc6-4e80-a90c-77b8701076ca None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:25.720795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 457/909] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:04:25 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:04:26.696540 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd216e7b-5ecb-41b4-af65-3d44c25f23d9 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:26.697061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd216e7b-5ecb-41b4-af65-3d44c25f23d9 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:26.697133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd216e7b-5ecb-41b4-af65-3d44c25f23d9 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:26.698966 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 453/910] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:26.704717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e930c6-20c0-40fe-bac5-a7119127475f None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:26.705180 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e930c6-20c0-40fe-bac5-a7119127475f None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:26.705365 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e930c6-20c0-40fe-bac5-a7119127475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:26.724595 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-09e930c6-20c0-40fe-bac5-a7119127475f None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:26.725818 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-09e930c6-20c0-40fe-bac5-a7119127475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:26.813061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 458/911] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:26.836147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd216e7b-5ecb-41b4-af65-3d44c25f23d9 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:26.967712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd216e7b-5ecb-41b4-af65-3d44c25f23d9 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:27.005650 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc097f7-8dee-4e3c-8f31-a15b07fd4336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:27.006476 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc097f7-8dee-4e3c-8f31-a15b07fd4336 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:27.006788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc097f7-8dee-4e3c-8f31-a15b07fd4336 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:27.007062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc097f7-8dee-4e3c-8f31-a15b07fd4336 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:27.010053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:27.019129 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc097f7-8dee-4e3c-8f31-a15b07fd4336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-8cc097f7-8dee-4e3c-8f31-a15b07fd4336 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:27.028288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:27.033841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:27.034726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 454/912] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:04:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:27.036983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e930c6-20c0-40fe-bac5-a7119127475f None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:27.109304 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f122-ef6a-4337-a8de-1608be82a381 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:27.110088 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f122-ef6a-4337-a8de-1608be82a381 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:27.110647 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f122-ef6a-4337-a8de-1608be82a381 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:27.113954 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 455/913] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:27.119797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac344b-1216-4bf9-8f10-5fd5a196cc6f None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:27.121266 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac344b-1216-4bf9-8f10-5fd5a196cc6f None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:27.121266 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac344b-1216-4bf9-8f10-5fd5a196cc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:27.123448 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:27.141833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-89ac344b-1216-4bf9-8f10-5fd5a196cc6f None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:27.143584 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-89ac344b-1216-4bf9-8f10-5fd5a196cc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:27.175423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e930c6-20c0-40fe-bac5-a7119127475f None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:27.220986 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd6515-7503-4d63-897a-1950ff994345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:27.221632 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd6515-7503-4d63-897a-1950ff994345 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:27.221933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd6515-7503-4d63-897a-1950ff994345 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:27.222192 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd6515-7503-4d63-897a-1950ff994345 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:27.223484 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd6515-7503-4d63-897a-1950ff994345 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:27.223484 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd6515-7503-4d63-897a-1950ff994345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:27.224693 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd6515-7503-4d63-897a-1950ff994345 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:27.234580 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 459/914] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:04:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:27.240281 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd6515-7503-4d63-897a-1950ff994345 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:27.243900 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 456/915] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:27.267449 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac344b-1216-4bf9-8f10-5fd5a196cc6f None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:27.374461 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd6515-7503-4d63-897a-1950ff994345 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:27.404287 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac344b-1216-4bf9-8f10-5fd5a196cc6f None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:27.404744 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:27.410914 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a125ef-bf83-4ab6-a9a2-87e0f2733e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:27.411713 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a125ef-bf83-4ab6-a9a2-87e0f2733e91 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:27.411992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a125ef-bf83-4ab6-a9a2-87e0f2733e91 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:27.412263 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a125ef-bf83-4ab6-a9a2-87e0f2733e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:27.424493 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a125ef-bf83-4ab6-a9a2-87e0f2733e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:27.426085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a125ef-bf83-4ab6-a9a2-87e0f2733e91 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:27.436752 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:27.446340 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71945834-8387-42b7-9d7a-98925eab5fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-81a125ef-bf83-4ab6-a9a2-87e0f2733e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:27.446521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:27.453346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:27.454358 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:27.454358 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:27.454358 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:27.454358 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:27.454598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71945834-8387-42b7-9d7a-98925eab5fbd None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:27.454598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71945834-8387-42b7-9d7a-98925eab5fbd None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:27.454598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71945834-8387-42b7-9d7a-98925eab5fbd None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:27.455248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 460/916] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:27.455315 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71945834-8387-42b7-9d7a-98925eab5fbd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:27.455377 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be676bc5-1d1e-4e44-a594-72ed6db3926f None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:27.455377 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be676bc5-1d1e-4e44-a594-72ed6db3926f None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:27.455377 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be676bc5-1d1e-4e44-a594-72ed6db3926f None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:27.455542 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71945834-8387-42b7-9d7a-98925eab5fbd None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:27.455604 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 461/917] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:27.457298 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722864a4-6031-4518-a61b-07b27aeb1270 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:27.457639 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722864a4-6031-4518-a61b-07b27aeb1270 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:27.457858 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722864a4-6031-4518-a61b-07b27aeb1270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:27.475800 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-722864a4-6031-4518-a61b-07b27aeb1270 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:27.476925 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-722864a4-6031-4518-a61b-07b27aeb1270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:27.546777 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 457/918] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:04:27 2022] POST /identity/v3/services => generated 241 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:04:27.547806 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71945834-8387-42b7-9d7a-98925eab5fbd None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:27.585685 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 462/919] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:27.603331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722864a4-6031-4518-a61b-07b27aeb1270 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:27.676473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71945834-8387-42b7-9d7a-98925eab5fbd None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:27.718171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90567d49-5011-4841-b3db-19e38038b4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:27.719573 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567d49-5011-4841-b3db-19e38038b4f9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:27.720118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567d49-5011-4841-b3db-19e38038b4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:27.720660 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567d49-5011-4841-b3db-19e38038b4f9 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:27.722101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90567d49-5011-4841-b3db-19e38038b4f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:27.722631 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90567d49-5011-4841-b3db-19e38038b4f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:27.724292 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90567d49-5011-4841-b3db-19e38038b4f9 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:27.730650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722864a4-6031-4518-a61b-07b27aeb1270 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:27.742735 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 458/920] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:27.744714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:27.744963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90567d49-5011-4841-b3db-19e38038b4f9 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:27.774453 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4555cb-fddd-4c3b-ac72-e0c399c7edef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:27.777305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4555cb-fddd-4c3b-ac72-e0c399c7edef None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:27.777305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4555cb-fddd-4c3b-ac72-e0c399c7edef None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:27.777305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4555cb-fddd-4c3b-ac72-e0c399c7edef None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:27.777785 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4555cb-fddd-4c3b-ac72-e0c399c7edef None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:27.779207 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4555cb-fddd-4c3b-ac72-e0c399c7edef None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-ea4555cb-fddd-4c3b-ac72-e0c399c7edef None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:27.792327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:27.793293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:27.794098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 463/921] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:04:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:27.800951 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4555cb-fddd-4c3b-ac72-e0c399c7edef None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:27.806455 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:27.892414 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90567d49-5011-4841-b3db-19e38038b4f9 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:27.940697 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4687181-aca0-478f-aa95-3028f1796ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:27.941527 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4687181-aca0-478f-aa95-3028f1796ecf None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:27.941808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4687181-aca0-478f-aa95-3028f1796ecf None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:27.942111 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4687181-aca0-478f-aa95-3028f1796ecf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:27.947853 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4555cb-fddd-4c3b-ac72-e0c399c7edef None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:27.951746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4687181-aca0-478f-aa95-3028f1796ecf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:27.953210 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4687181-aca0-478f-aa95-3028f1796ecf None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-c4687181-aca0-478f-aa95-3028f1796ecf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:27.969488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:27.970412 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:27.971319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:27.971319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:27.971319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:27.971319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:27.971319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:27.971319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:27.971319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:27.971319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:27.971319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:27.971319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:27.971319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 459/922] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:04:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:27.976680 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4687181-aca0-478f-aa95-3028f1796ecf None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:27.998970 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484e081-f0d6-43d8-8bd4-39e393f220f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:27.999975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484e081-f0d6-43d8-8bd4-39e393f220f7 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:28.000497 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484e081-f0d6-43d8-8bd4-39e393f220f7 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:28.000975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484e081-f0d6-43d8-8bd4-39e393f220f7 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:28.002496 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484e081-f0d6-43d8-8bd4-39e393f220f7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:28.003352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484e081-f0d6-43d8-8bd4-39e393f220f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:28.005679 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484e081-f0d6-43d8-8bd4-39e393f220f7 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:28.013862 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 464/923] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:04:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:28.020196 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484e081-f0d6-43d8-8bd4-39e393f220f7 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:28.070717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:28.102078 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4687181-aca0-478f-aa95-3028f1796ecf None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:28.110406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:28.142650 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeef328-c6c4-4580-96ac-03a82b1ae0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:28.143134 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef328-c6c4-4580-96ac-03a82b1ae0a4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:28.143414 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef328-c6c4-4580-96ac-03a82b1ae0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:28.143690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef328-c6c4-4580-96ac-03a82b1ae0a4 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:28.144582 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeef328-c6c4-4580-96ac-03a82b1ae0a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:28.144888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeef328-c6c4-4580-96ac-03a82b1ae0a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:28.146375 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeef328-c6c4-4580-96ac-03a82b1ae0a4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:28.159709 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484e081-f0d6-43d8-8bd4-39e393f220f7 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:28.171021 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 460/924] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:04:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:28.172841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769fd8a-82ee-49b3-8a3f-ba91bb2df93e None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:28.173133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769fd8a-82ee-49b3-8a3f-ba91bb2df93e None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:28.173417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769fd8a-82ee-49b3-8a3f-ba91bb2df93e None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:28.176304 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 461/925] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:28.176304 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769fd8a-82ee-49b3-8a3f-ba91bb2df93e None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:28.202262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b8879-baaa-465e-a32a-03400e807c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:28.202990 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b8879-baaa-465e-a32a-03400e807c93 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:28.203274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b8879-baaa-465e-a32a-03400e807c93 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:28.203549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b8879-baaa-465e-a32a-03400e807c93 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:28.204274 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b8879-baaa-465e-a32a-03400e807c93 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:28.204582 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b8879-baaa-465e-a32a-03400e807c93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:28.206035 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b8879-baaa-465e-a32a-03400e807c93 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:28.215486 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 465/926] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:04:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:28.219728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edc2f1-b93f-47b6-a462-77d2dc28389c None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:28.219728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edc2f1-b93f-47b6-a462-77d2dc28389c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:28.219728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edc2f1-b93f-47b6-a462-77d2dc28389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:28.237407 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-a2edc2f1-b93f-47b6-a462-77d2dc28389c None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:28.238829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-a2edc2f1-b93f-47b6-a462-77d2dc28389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:28.301859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769fd8a-82ee-49b3-8a3f-ba91bb2df93e None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:28.327171 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 466/927] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:28.328150 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edc2f1-b93f-47b6-a462-77d2dc28389c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:28.355661 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a5c11-2cd4-422f-a722-01bdb619e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:28.356797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a5c11-2cd4-422f-a722-01bdb619e1f9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:28.357127 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a5c11-2cd4-422f-a722-01bdb619e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:28.357405 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a5c11-2cd4-422f-a722-01bdb619e1f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:28.369091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a5c11-2cd4-422f-a722-01bdb619e1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:28.371436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a5c11-2cd4-422f-a722-01bdb619e1f9 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:28.373780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-ad2a5c11-2cd4-422f-a722-01bdb619e1f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:28.392324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:28.393411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:28.399425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:28.399425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:28.399425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:28.399425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:28.399425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 462/928] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:28.399425 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a5c11-2cd4-422f-a722-01bdb619e1f9 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:28.420079 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:28.462101 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edc2f1-b93f-47b6-a462-77d2dc28389c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:28.509869 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a798a6-e405-4d31-8a65-50342efcac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:28.510520 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a798a6-e405-4d31-8a65-50342efcac5b None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:28.510924 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a798a6-e405-4d31-8a65-50342efcac5b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:28.511717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a798a6-e405-4d31-8a65-50342efcac5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:28.512479 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a798a6-e405-4d31-8a65-50342efcac5b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:28.513937 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a798a6-e405-4d31-8a65-50342efcac5b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:28.525545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a5c11-2cd4-422f-a722-01bdb619e1f9 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:28.562747 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25c8d2-f6fb-4276-a015-afba65b5b886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:28.563516 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25c8d2-f6fb-4276-a015-afba65b5b886 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:28.563794 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25c8d2-f6fb-4276-a015-afba65b5b886 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:28.564068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25c8d2-f6fb-4276-a015-afba65b5b886 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:28.564724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25c8d2-f6fb-4276-a015-afba65b5b886 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:28.566090 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25c8d2-f6fb-4276-a015-afba65b5b886 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-4f25c8d2-f6fb-4276-a015-afba65b5b886 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:28.579102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:28.580098 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:28.580841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 463/929] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 20:04:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:28.582079 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25c8d2-f6fb-4276-a015-afba65b5b886 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:28.599918 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 467/930] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:04:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:28.608282 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a798a6-e405-4d31-8a65-50342efcac5b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:28.706711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:28.757449 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25c8d2-f6fb-4276-a015-afba65b5b886 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:28.793782 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:28.808243 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557e466-303d-482e-99ca-16b7141e3470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:28.809037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557e466-303d-482e-99ca-16b7141e3470 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:28.809393 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557e466-303d-482e-99ca-16b7141e3470 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:28.809666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557e466-303d-482e-99ca-16b7141e3470 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:28.810417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557e466-303d-482e-99ca-16b7141e3470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:28.811486 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557e466-303d-482e-99ca-16b7141e3470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:28.812174 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557e466-303d-482e-99ca-16b7141e3470 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:28.828755 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 464/931] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:28.831762 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a798a6-e405-4d31-8a65-50342efcac5b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:28.836659 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557e466-303d-482e-99ca-16b7141e3470 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:28.875813 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff6318-95a4-4852-b897-66da4a8e074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:28.876505 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6318-95a4-4852-b897-66da4a8e074a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:28.876790 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6318-95a4-4852-b897-66da4a8e074a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:28.877070 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6318-95a4-4852-b897-66da4a8e074a None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:28.877881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff6318-95a4-4852-b897-66da4a8e074a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:28.878192 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff6318-95a4-4852-b897-66da4a8e074a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:28.879823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff6318-95a4-4852-b897-66da4a8e074a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:28.886881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 468/932] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:04:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:28.892704 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff6318-95a4-4852-b897-66da4a8e074a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:28.969257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557e466-303d-482e-99ca-16b7141e3470 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:29.013280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff6318-95a4-4852-b897-66da4a8e074a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:29.031460 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74eb1a-d5fd-42e4-9f7b-236f98feeb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:29.033210 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74eb1a-d5fd-42e4-9f7b-236f98feeb1f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:29.033970 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74eb1a-d5fd-42e4-9f7b-236f98feeb1f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:29.034741 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74eb1a-d5fd-42e4-9f7b-236f98feeb1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:29.039790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:29.048439 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74eb1a-d5fd-42e4-9f7b-236f98feeb1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:29.055512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74eb1a-d5fd-42e4-9f7b-236f98feeb1f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:29.055638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188245a-27ea-4f36-8409-ce4e2431f8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:29.055638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188245a-27ea-4f36-8409-ce4e2431f8c8 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:29.055638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188245a-27ea-4f36-8409-ce4e2431f8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:29.056107 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188245a-27ea-4f36-8409-ce4e2431f8c8 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:29.056992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188245a-27ea-4f36-8409-ce4e2431f8c8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:29.058205 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188245a-27ea-4f36-8409-ce4e2431f8c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:29.059942 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188245a-27ea-4f36-8409-ce4e2431f8c8 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:29.070841 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 469/933] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:04:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:29.071978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188245a-27ea-4f36-8409-ce4e2431f8c8 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-7f74eb1a-d5fd-42e4-9f7b-236f98feeb1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:29.080549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:29.081462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:29.082406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:29.082406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:29.082406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:29.082406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:29.082406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:29.082406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:29.082406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:29.082406 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:29.086011 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 465/934] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:29.096102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:29.096992 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74eb1a-d5fd-42e4-9f7b-236f98feeb1f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:29.196183 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188245a-27ea-4f36-8409-ce4e2431f8c8 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:29.240901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdf715-ea48-42c1-aaa9-3a1d733f0bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:29.241572 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdf715-ea48-42c1-aaa9-3a1d733f0bf9 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:29.241859 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdf715-ea48-42c1-aaa9-3a1d733f0bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:29.242140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdf715-ea48-42c1-aaa9-3a1d733f0bf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:29.242995 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdf715-ea48-42c1-aaa9-3a1d733f0bf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:29.244668 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdf715-ea48-42c1-aaa9-3a1d733f0bf9 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:29.256043 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74eb1a-d5fd-42e4-9f7b-236f98feeb1f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:29.294721 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc6a5b-3063-47a7-8179-cd63a8f746ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:29.295405 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc6a5b-3063-47a7-8179-cd63a8f746ff None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:29.295757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc6a5b-3063-47a7-8179-cd63a8f746ff None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:29.296028 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc6a5b-3063-47a7-8179-cd63a8f746ff None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:29.296888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc6a5b-3063-47a7-8179-cd63a8f746ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:29.297212 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc6a5b-3063-47a7-8179-cd63a8f746ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:29.298844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc6a5b-3063-47a7-8179-cd63a8f746ff None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:29.316542 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 466/935] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:29.320040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc6a5b-3063-47a7-8179-cd63a8f746ff None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:29.358755 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 470/936] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:04:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:29.403432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:29.458787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc6a5b-3063-47a7-8179-cd63a8f746ff None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:29.510490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09b30d-d929-4cdb-b988-96d22ffdb0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:29.512076 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09b30d-d929-4cdb-b988-96d22ffdb0bd None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:29.512438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09b30d-d929-4cdb-b988-96d22ffdb0bd None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:29.512788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09b30d-d929-4cdb-b988-96d22ffdb0bd None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/68ef674a83cd467dba60206f2caea39f/roles/67f40b8de4bf4007a76e72baba6aba0e` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:29.515478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09b30d-d929-4cdb-b988-96d22ffdb0bd None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=68ef674a83cd467dba60206f2caea39f, role_id=67f40b8de4bf4007a76e72baba6aba0e)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:29.517061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09b30d-d929-4cdb-b988-96d22ffdb0bd None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:29.579341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 467/937] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:04:29 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/68ef674a83cd467dba60206f2caea39f/roles/67f40b8de4bf4007a76e72baba6aba0e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:04:30.129966 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79788603-98e2-48fb-9dbb-6ac473fb601d None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:30.130491 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79788603-98e2-48fb-9dbb-6ac473fb601d None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:30.130761 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79788603-98e2-48fb-9dbb-6ac473fb601d None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:30.132320 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 471/938] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:30.139218 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2651ac-6107-468e-bb14-ccece01fe5da None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:30.139218 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2651ac-6107-468e-bb14-ccece01fe5da None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:30.139218 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2651ac-6107-468e-bb14-ccece01fe5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:30.158033 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-df2651ac-6107-468e-bb14-ccece01fe5da None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:30.159482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-df2651ac-6107-468e-bb14-ccece01fe5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:30.235075 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 468/939] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:30.257846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79788603-98e2-48fb-9dbb-6ac473fb601d None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:30.361879 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:30.396094 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79788603-98e2-48fb-9dbb-6ac473fb601d None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:30.433822 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee47fc0-3a9e-4321-992d-05c5a1015e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:30.435062 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47fc0-3a9e-4321-992d-05c5a1015e41 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:30.435546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47fc0-3a9e-4321-992d-05c5a1015e41 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:30.436015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47fc0-3a9e-4321-992d-05c5a1015e41 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:30.436888 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee47fc0-3a9e-4321-992d-05c5a1015e41 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:30.438550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee47fc0-3a9e-4321-992d-05c5a1015e41 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-cee47fc0-3a9e-4321-992d-05c5a1015e41 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:30.452102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:30.453046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:30.453776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:30.461555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 472/940] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:04:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:30.463287 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2651ac-6107-468e-bb14-ccece01fe5da None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:30.510815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:30.573682 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2651ac-6107-468e-bb14-ccece01fe5da None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:30.618776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65f4cc-e5b0-4535-8e09-99cf0d0ca0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:30.619470 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65f4cc-e5b0-4535-8e09-99cf0d0ca0fc None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:30.619758 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65f4cc-e5b0-4535-8e09-99cf0d0ca0fc None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:30.620079 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65f4cc-e5b0-4535-8e09-99cf0d0ca0fc None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:30.620816 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65f4cc-e5b0-4535-8e09-99cf0d0ca0fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:30.621129 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65f4cc-e5b0-4535-8e09-99cf0d0ca0fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:30.622569 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65f4cc-e5b0-4535-8e09-99cf0d0ca0fc None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:30.628500 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 469/941] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:04:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:30.634321 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee47fc0-3a9e-4321-992d-05c5a1015e41 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:30.746437 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee47fc0-3a9e-4321-992d-05c5a1015e41 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:30.783729 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff32f7-6ba8-4b7b-9b3e-a9e33d11e357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:30.784774 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff32f7-6ba8-4b7b-9b3e-a9e33d11e357 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:30.785326 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff32f7-6ba8-4b7b-9b3e-a9e33d11e357 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:30.785818 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff32f7-6ba8-4b7b-9b3e-a9e33d11e357 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:30.786781 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff32f7-6ba8-4b7b-9b3e-a9e33d11e357 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:30.787288 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff32f7-6ba8-4b7b-9b3e-a9e33d11e357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:30.788868 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff32f7-6ba8-4b7b-9b3e-a9e33d11e357 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:30.798938 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:30.800018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 473/942] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:04:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:30.801634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65f4cc-e5b0-4535-8e09-99cf0d0ca0fc None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:30.929704 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65f4cc-e5b0-4535-8e09-99cf0d0ca0fc None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:30.938545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:30.968711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e09063-f0c8-4265-9354-03568769edd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:30.969376 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e09063-f0c8-4265-9354-03568769edd1 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:30.969655 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e09063-f0c8-4265-9354-03568769edd1 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:30.969929 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e09063-f0c8-4265-9354-03568769edd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:30.970825 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e09063-f0c8-4265-9354-03568769edd1 None admin] RBAC: Adding query filter params (interface=public, service_id=ea26c3e9021548c98a9313cd4ac92ee1, region_id=RegionOne) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:30.971138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e09063-f0c8-4265-9354-03568769edd1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:30.972565 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e09063-f0c8-4265-9354-03568769edd1 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:30.978756 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 470/943] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:04:30 2022] GET /identity/v3/endpoints?service_id=ea26c3e9021548c98a9313cd4ac92ee1&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:30.987542 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff32f7-6ba8-4b7b-9b3e-a9e33d11e357 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:31.099920 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacf8bf-a6b4-4391-89b9-1583abae3be7 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:31.100427 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacf8bf-a6b4-4391-89b9-1583abae3be7 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:31.100919 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacf8bf-a6b4-4391-89b9-1583abae3be7 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:31.109550 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 471/944] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:31.112255 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72f068-285e-4683-9193-463a20bf4bc6 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:31.112732 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72f068-285e-4683-9193-463a20bf4bc6 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:31.113201 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72f068-285e-4683-9193-463a20bf4bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:31.140204 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-8e72f068-285e-4683-9193-463a20bf4bc6 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:31.142064 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-8e72f068-285e-4683-9193-463a20bf4bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:31.146146 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff32f7-6ba8-4b7b-9b3e-a9e33d11e357 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:31.191563 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788697d-23d2-47c3-99a7-52111d6b2121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:31.192296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788697d-23d2-47c3-99a7-52111d6b2121 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:31.192712 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788697d-23d2-47c3-99a7-52111d6b2121 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:31.193134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788697d-23d2-47c3-99a7-52111d6b2121 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:31.193834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788697d-23d2-47c3-99a7-52111d6b2121 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:31.195522 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788697d-23d2-47c3-99a7-52111d6b2121 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:31.203249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 474/945] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:04:30 2022] GET /identity/v3/services => generated 1497 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:04:31.250966 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 472/946] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:31.274483 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788697d-23d2-47c3-99a7-52111d6b2121 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:31.351566 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:31.398423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788697d-23d2-47c3-99a7-52111d6b2121 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:31.439277 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9e8dd-59ff-4181-90bf-17e2d3e07681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:31.439912 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9e8dd-59ff-4181-90bf-17e2d3e07681 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:31.440190 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9e8dd-59ff-4181-90bf-17e2d3e07681 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:31.440464 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9e8dd-59ff-4181-90bf-17e2d3e07681 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:31.441239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9e8dd-59ff-4181-90bf-17e2d3e07681 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:31.442689 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9e8dd-59ff-4181-90bf-17e2d3e07681 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:31.444066 dv-cinder-841302-4-smb devstack@keystone.service[156425]: WARNING keystone.server.flask.common [None req-86b9e8dd-59ff-4181-90bf-17e2d3e07681 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 20:04:31.489393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.sql.core [None req-86b9e8dd-59ff-4181-90bf-17e2d3e07681 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:04:31.489393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 20:04:31.489393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [parameters: {'id': '3797147849f244b599971a1412e8d58f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 20:04:31.489393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=156425) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-86b9e8dd-59ff-4181-90bf-17e2d3e07681 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3797147849f244b599971a1412e8d58f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3797147849f244b599971a1412e8d58f. May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application conn.query(q) May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:04:31.498079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application result.read() May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 20:04:31.498829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application next(self.gen) May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application yield resource May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application next(self.gen) May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise self.value May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application session.commit() May 19 20:04:31.499673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self.session.flush() May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application compat.raise_( May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:04:31.500948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:04:31.501742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application conn.query(q) May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application result.read() May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:04:31.502446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [parameters: {'id': '3797147849f244b599971a1412e8d58f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:31.506015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:31.507892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:31.509956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:31.509956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 20:04:31.509956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 20:04:31.509956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:31.509956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:31.509956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 20:04:31.509956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 20:04:31.509956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3797147849f244b599971a1412e8d58f. May 19 20:04:31.509956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:31.509956 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 475/947] 10.222.0.89 () {60 vars in 1140 bytes} [Thu May 19 20:04:31 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:31.518048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72f068-285e-4683-9193-463a20bf4bc6 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:31.637338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:31.641257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72f068-285e-4683-9193-463a20bf4bc6 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:31.681130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475504c6-90a8-484a-bf17-b079a99b3c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:31.681927 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475504c6-90a8-484a-bf17-b079a99b3c81 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:31.682328 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475504c6-90a8-484a-bf17-b079a99b3c81 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:31.682766 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475504c6-90a8-484a-bf17-b079a99b3c81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:31.690205 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475504c6-90a8-484a-bf17-b079a99b3c81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:31.691676 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475504c6-90a8-484a-bf17-b079a99b3c81 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-475504c6-90a8-484a-bf17-b079a99b3c81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:31.706933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:31.707780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:31.708559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:31.708559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:31.708559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:31.708559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:31.708559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:31.708559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:31.708559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:31.708559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:31.709172 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 473/948] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:31.716265 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9e8dd-59ff-4181-90bf-17e2d3e07681 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:31.752270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54641-5cbb-4c6f-bdd3-8fa4baa32c29 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:31.752609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54641-5cbb-4c6f-bdd3-8fa4baa32c29 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:31.752826 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54641-5cbb-4c6f-bdd3-8fa4baa32c29 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:31.755120 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 474/949] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:31.764860 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22583-e928-4f15-8b82-86f176f57b64 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:31.765375 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22583-e928-4f15-8b82-86f176f57b64 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:31.765880 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22583-e928-4f15-8b82-86f176f57b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:31.789397 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-8ab22583-e928-4f15-8b82-86f176f57b64 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:31.790881 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-8ab22583-e928-4f15-8b82-86f176f57b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:31.849069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9e8dd-59ff-4181-90bf-17e2d3e07681 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:31.872036 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:31.894299 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7579214-c8cf-470d-bbdd-b05e199b893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:31.895249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579214-c8cf-470d-bbdd-b05e199b893e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:31.895697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579214-c8cf-470d-bbdd-b05e199b893e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:31.896112 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579214-c8cf-470d-bbdd-b05e199b893e None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:31.897100 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7579214-c8cf-470d-bbdd-b05e199b893e None admin] RBAC: Adding query filter params (name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:31.897540 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7579214-c8cf-470d-bbdd-b05e199b893e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:31.899032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 475/950] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:31.899649 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7579214-c8cf-470d-bbdd-b05e199b893e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:31.920135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab22583-e928-4f15-8b82-86f176f57b64 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:31.926178 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 476/951] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:32.028244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba23c55-54b5-422f-8165-d81ff50cf6c8 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:32.028588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba23c55-54b5-422f-8165-d81ff50cf6c8 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:32.028855 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba23c55-54b5-422f-8165-d81ff50cf6c8 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:32.030695 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 477/952] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:04:32.036567 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15030d29-1eb2-4e47-9b27-55d0a3841744 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:32.036753 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15030d29-1eb2-4e47-9b27-55d0a3841744 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:32.036959 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15030d29-1eb2-4e47-9b27-55d0a3841744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:32.060210 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab22583-e928-4f15-8b82-86f176f57b64 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:32.061070 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-15030d29-1eb2-4e47-9b27-55d0a3841744 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:32.063081 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-15030d29-1eb2-4e47-9b27-55d0a3841744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:32.070877 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:32.114005 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91040f-fd92-45a6-a1f7-19f750ffe6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:32.115299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91040f-fd92-45a6-a1f7-19f750ffe6a1 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:32.115654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91040f-fd92-45a6-a1f7-19f750ffe6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:32.116000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91040f-fd92-45a6-a1f7-19f750ffe6a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:32.116736 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91040f-fd92-45a6-a1f7-19f750ffe6a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:32.118192 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91040f-fd92-45a6-a1f7-19f750ffe6a1 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-6c91040f-fd92-45a6-a1f7-19f750ffe6a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:32.135508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:32.137024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:04:32.137770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:32.142719 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 476/953] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:32.145121 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91040f-fd92-45a6-a1f7-19f750ffe6a1 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:32.175969 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 478/954] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:32.200631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15030d29-1eb2-4e47-9b27-55d0a3841744 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:32.302888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91040f-fd92-45a6-a1f7-19f750ffe6a1 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:32.341838 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11eaf7-b042-4524-82e6-ed22392c1612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:32.342922 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11eaf7-b042-4524-82e6-ed22392c1612 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:32.342922 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11eaf7-b042-4524-82e6-ed22392c1612 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:32.343211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11eaf7-b042-4524-82e6-ed22392c1612 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:32.344047 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11eaf7-b042-4524-82e6-ed22392c1612 None admin] RBAC: Adding query filter params (name=compute) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:32.344368 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11eaf7-b042-4524-82e6-ed22392c1612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:32.345729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11eaf7-b042-4524-82e6-ed22392c1612 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:32.346577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15030d29-1eb2-4e47-9b27-55d0a3841744 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:32.351550 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 477/955] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:32.358470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:32.364335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11eaf7-b042-4524-82e6-ed22392c1612 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:32.389157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02decb-f15a-46e4-a934-871df3c9463c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:32.390542 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02decb-f15a-46e4-a934-871df3c9463c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:32.390864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02decb-f15a-46e4-a934-871df3c9463c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:32.391145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02decb-f15a-46e4-a934-871df3c9463c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:32.409005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02decb-f15a-46e4-a934-871df3c9463c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:32.411046 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-3a02decb-f15a-46e4-a934-871df3c9463c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:32.423181 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:32.428578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:32.429329 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 479/956] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:04:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:32.431549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02decb-f15a-46e4-a934-871df3c9463c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:32.518919 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11eaf7-b042-4524-82e6-ed22392c1612 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:32.547207 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02decb-f15a-46e4-a934-871df3c9463c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:32.559643 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188afe1-dfcc-4c60-819f-49cdfba52fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:32.560566 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188afe1-dfcc-4c60-819f-49cdfba52fc8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:32.561000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188afe1-dfcc-4c60-819f-49cdfba52fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:32.561450 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188afe1-dfcc-4c60-819f-49cdfba52fc8 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:32.562367 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188afe1-dfcc-4c60-819f-49cdfba52fc8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:32.562858 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188afe1-dfcc-4c60-819f-49cdfba52fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:32.564393 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188afe1-dfcc-4c60-819f-49cdfba52fc8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:32.570181 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 478/957] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:32.596923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6aafd-7f75-4cbc-b40f-2451382283d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:32.597678 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6aafd-7f75-4cbc-b40f-2451382283d2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:32.597958 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6aafd-7f75-4cbc-b40f-2451382283d2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:32.598258 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6aafd-7f75-4cbc-b40f-2451382283d2 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:32.599140 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6aafd-7f75-4cbc-b40f-2451382283d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:32.599454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6aafd-7f75-4cbc-b40f-2451382283d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:32.600920 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6aafd-7f75-4cbc-b40f-2451382283d2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:32.612312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 480/958] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:04:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:32.618296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188afe1-dfcc-4c60-819f-49cdfba52fc8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:32.725045 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:32.747485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188afe1-dfcc-4c60-819f-49cdfba52fc8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:32.791627 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa83516-4189-4bbf-a725-56ee3b7b0db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:32.792540 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa83516-4189-4bbf-a725-56ee3b7b0db8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:32.792823 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa83516-4189-4bbf-a725-56ee3b7b0db8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:32.793155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa83516-4189-4bbf-a725-56ee3b7b0db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:32.805618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa83516-4189-4bbf-a725-56ee3b7b0db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:32.807228 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa83516-4189-4bbf-a725-56ee3b7b0db8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-1aa83516-4189-4bbf-a725-56ee3b7b0db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:32.828307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:32.829156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:32.829943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:32.829943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:32.829943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:32.829943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:32.829943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 479/959] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:32.836420 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6aafd-7f75-4cbc-b40f-2451382283d2 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:32.872881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:32.958536 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6aafd-7f75-4cbc-b40f-2451382283d2 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:32.995566 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a2eeb-50ba-48de-a26c-c77ce1cb6ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:32.996170 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a2eeb-50ba-48de-a26c-c77ce1cb6ee6 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:32.996452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a2eeb-50ba-48de-a26c-c77ce1cb6ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:32.996722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a2eeb-50ba-48de-a26c-c77ce1cb6ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:32.997452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a2eeb-50ba-48de-a26c-c77ce1cb6ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:32.997754 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a2eeb-50ba-48de-a26c-c77ce1cb6ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:32.999183 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a2eeb-50ba-48de-a26c-c77ce1cb6ee6 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:33.013808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 481/960] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:33.019584 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa83516-4189-4bbf-a725-56ee3b7b0db8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:33.149237 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa83516-4189-4bbf-a725-56ee3b7b0db8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:33.191631 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1d476-1c75-4662-898b-874eb6b9854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:33.192558 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1d476-1c75-4662-898b-874eb6b9854e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:33.192845 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1d476-1c75-4662-898b-874eb6b9854e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:33.193122 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1d476-1c75-4662-898b-874eb6b9854e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:33.195944 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:33.203181 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1d476-1c75-4662-898b-874eb6b9854e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:33.204730 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1d476-1c75-4662-898b-874eb6b9854e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-69e1d476-1c75-4662-898b-874eb6b9854e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:33.223413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:33.225113 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:33.226809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:33.226809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:33.226809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:33.226809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:33.226809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:33.226809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:33.226809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:33.226809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:33.226809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:04:33.226809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:33.226809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 480/961] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:04:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:33.247514 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a2eeb-50ba-48de-a26c-c77ce1cb6ee6 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:33.424091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:33.442249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a2eeb-50ba-48de-a26c-c77ce1cb6ee6 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:33.513461 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162d4c3-bcf0-4c77-9d97-63a0adab5ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:33.515081 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162d4c3-bcf0-4c77-9d97-63a0adab5ad2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:33.515852 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162d4c3-bcf0-4c77-9d97-63a0adab5ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:33.516663 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162d4c3-bcf0-4c77-9d97-63a0adab5ad2 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:33.518588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162d4c3-bcf0-4c77-9d97-63a0adab5ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:33.519476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162d4c3-bcf0-4c77-9d97-63a0adab5ad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:33.522645 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162d4c3-bcf0-4c77-9d97-63a0adab5ad2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:33.546879 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 482/962] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:04:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:33.554311 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1d476-1c75-4662-898b-874eb6b9854e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:33.662598 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d99b-a27e-44bf-8093-e18aef7a7a23 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:33.662929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d99b-a27e-44bf-8093-e18aef7a7a23 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:33.663287 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d99b-a27e-44bf-8093-e18aef7a7a23 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:33.666148 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 483/963] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:33.667654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1d476-1c75-4662-898b-874eb6b9854e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:33.671244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1e085-1bb5-4d4b-be08-a0069483160b None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:33.671532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1e085-1bb5-4d4b-be08-a0069483160b None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:33.671806 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1e085-1bb5-4d4b-be08-a0069483160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:33.692401 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-0ee1e085-1bb5-4d4b-be08-a0069483160b None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:33.694173 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-0ee1e085-1bb5-4d4b-be08-a0069483160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:33.708614 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c6bc4-a9e5-4b9d-a693-77db67dd431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:33.709278 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c6bc4-a9e5-4b9d-a693-77db67dd431b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:33.709559 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c6bc4-a9e5-4b9d-a693-77db67dd431b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:33.709834 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c6bc4-a9e5-4b9d-a693-77db67dd431b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:33.780181 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:33.783607 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 484/964] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:33.790177 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c6bc4-a9e5-4b9d-a693-77db67dd431b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:33.791905 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c6bc4-a9e5-4b9d-a693-77db67dd431b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:33.806872 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1e085-1bb5-4d4b-be08-a0069483160b None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:33.907581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 481/965] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:33 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:04:33.912706 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c6bc4-a9e5-4b9d-a693-77db67dd431b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:33.933465 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:33.956586 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1e085-1bb5-4d4b-be08-a0069483160b None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:34.000220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61c372-b639-47d4-8fa6-41c0e7b8d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:34.002099 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61c372-b639-47d4-8fa6-41c0e7b8d22a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:34.002574 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61c372-b639-47d4-8fa6-41c0e7b8d22a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:34.003065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61c372-b639-47d4-8fa6-41c0e7b8d22a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:34.004380 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61c372-b639-47d4-8fa6-41c0e7b8d22a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:34.006299 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61c372-b639-47d4-8fa6-41c0e7b8d22a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-7c61c372-b639-47d4-8fa6-41c0e7b8d22a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:34.023887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:34.024904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:34.025690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:34.029080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 485/966] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:04:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:34.038684 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61c372-b639-47d4-8fa6-41c0e7b8d22a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:34.053309 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:34.062821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c6bc4-a9e5-4b9d-a693-77db67dd431b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:34.117732 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb893db-f872-45e5-bfb9-83140584b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:34.121000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb893db-f872-45e5-bfb9-83140584b96a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:34.121680 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb893db-f872-45e5-bfb9-83140584b96a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:34.122589 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb893db-f872-45e5-bfb9-83140584b96a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:34.155985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb893db-f872-45e5-bfb9-83140584b96a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:34.160043 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb893db-f872-45e5-bfb9-83140584b96a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:34.180189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61c372-b639-47d4-8fa6-41c0e7b8d22a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-8eb893db-f872-45e5-bfb9-83140584b96a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:34.195792 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:34.197829 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:34.200576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:34.200576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:34.200576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:34.200576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:34.200576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 482/967] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:34.205628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb893db-f872-45e5-bfb9-83140584b96a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:34.246804 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd08f1-58f1-4d13-9ca6-eb9321db645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:34.247882 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd08f1-58f1-4d13-9ca6-eb9321db645d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:34.248840 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd08f1-58f1-4d13-9ca6-eb9321db645d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:34.249322 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd08f1-58f1-4d13-9ca6-eb9321db645d None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:34.250244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd08f1-58f1-4d13-9ca6-eb9321db645d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:34.250899 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd08f1-58f1-4d13-9ca6-eb9321db645d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:34.252488 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd08f1-58f1-4d13-9ca6-eb9321db645d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:34.258634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 486/968] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:04:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:34.264172 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd08f1-58f1-4d13-9ca6-eb9321db645d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:34.276801 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:34.403588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd08f1-58f1-4d13-9ca6-eb9321db645d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:34.404225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb893db-f872-45e5-bfb9-83140584b96a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:34.448790 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9b6b3-1253-4aa8-bd2a-593f2c123e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:34.450653 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9b6b3-1253-4aa8-bd2a-593f2c123e4c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:34.451155 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9b6b3-1253-4aa8-bd2a-593f2c123e4c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:34.451913 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9b6b3-1253-4aa8-bd2a-593f2c123e4c None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:34.452862 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9b6b3-1253-4aa8-bd2a-593f2c123e4c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:34.453397 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9b6b3-1253-4aa8-bd2a-593f2c123e4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:34.455887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9b6b3-1253-4aa8-bd2a-593f2c123e4c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:34.463674 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 487/969] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:04:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:34.469794 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9b6b3-1253-4aa8-bd2a-593f2c123e4c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:34.471770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3bcd8-52d7-4a90-aebf-618a1afaf96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:34.472943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3bcd8-52d7-4a90-aebf-618a1afaf96c None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:34.473444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3bcd8-52d7-4a90-aebf-618a1afaf96c None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:34.473946 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3bcd8-52d7-4a90-aebf-618a1afaf96c None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:34.475438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3bcd8-52d7-4a90-aebf-618a1afaf96c None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:34.475996 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3bcd8-52d7-4a90-aebf-618a1afaf96c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:34.478684 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3bcd8-52d7-4a90-aebf-618a1afaf96c None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:34.504474 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 483/970] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:34.507553 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce9c57-5b24-472b-b257-bf146f39966b None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:34.508463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce9c57-5b24-472b-b257-bf146f39966b None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:34.509318 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce9c57-5b24-472b-b257-bf146f39966b None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:34.514209 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 484/971] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:34.515622 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce9c57-5b24-472b-b257-bf146f39966b None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:34.528076 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:34.551381 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:34.586870 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9b6b3-1253-4aa8-bd2a-593f2c123e4c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:34.630724 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ad6c-13e4-458d-8ec8-28bff97ff4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:34.630960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce9c57-5b24-472b-b257-bf146f39966b None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:34.631394 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ad6c-13e4-458d-8ec8-28bff97ff4fe None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:34.631676 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ad6c-13e4-458d-8ec8-28bff97ff4fe None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:34.631953 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ad6c-13e4-458d-8ec8-28bff97ff4fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:34.633895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ad6c-13e4-458d-8ec8-28bff97ff4fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:34.635336 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ad6c-13e4-458d-8ec8-28bff97ff4fe None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:34.667947 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b76ba3-4966-489f-94bb-af10101802b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:34.668727 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b76ba3-4966-489f-94bb-af10101802b8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:34.669006 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b76ba3-4966-489f-94bb-af10101802b8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:34.669307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b76ba3-4966-489f-94bb-af10101802b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:34.676616 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b76ba3-4966-489f-94bb-af10101802b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:34.678316 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b76ba3-4966-489f-94bb-af10101802b8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-a4b76ba3-4966-489f-94bb-af10101802b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:34.693042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:34.695705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:34.696506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:34.696506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:34.696506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:34.696506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:34.696506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:34.696506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:34.696506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:34.696506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:34.696506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 485/972] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:34.696506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf920-7c8f-4fda-b471-b90aac8b21fe None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:34.696506 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf920-7c8f-4fda-b471-b90aac8b21fe None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:34.697050 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf920-7c8f-4fda-b471-b90aac8b21fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:34.714627 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-8cebf920-7c8f-4fda-b471-b90aac8b21fe None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:34.715834 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-8cebf920-7c8f-4fda-b471-b90aac8b21fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:34.731022 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 488/973] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:04:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:34.731022 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ad6c-13e4-458d-8ec8-28bff97ff4fe None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:34.801415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:34.826261 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 486/974] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:34.853324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebf920-7c8f-4fda-b471-b90aac8b21fe None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:34.876597 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ad6c-13e4-458d-8ec8-28bff97ff4fe None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:34.913867 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:34.926412 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50eed36-e1b0-41e9-a779-3f312dba2203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:34.927126 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eed36-e1b0-41e9-a779-3f312dba2203 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:34.927768 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eed36-e1b0-41e9-a779-3f312dba2203 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:34.928162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eed36-e1b0-41e9-a779-3f312dba2203 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:34.929605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50eed36-e1b0-41e9-a779-3f312dba2203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:34.929917 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50eed36-e1b0-41e9-a779-3f312dba2203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:34.931727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50eed36-e1b0-41e9-a779-3f312dba2203 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:34.947792 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 489/975] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:34.954084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50eed36-e1b0-41e9-a779-3f312dba2203 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:35.002129 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebf920-7c8f-4fda-b471-b90aac8b21fe None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:35.053971 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cede9-d3f9-4d5a-8eab-351dc979667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:35.055080 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cede9-d3f9-4d5a-8eab-351dc979667d None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:35.055567 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cede9-d3f9-4d5a-8eab-351dc979667d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:35.056060 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cede9-d3f9-4d5a-8eab-351dc979667d None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:35.056971 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cede9-d3f9-4d5a-8eab-351dc979667d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:35.059536 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cede9-d3f9-4d5a-8eab-351dc979667d None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:35.061129 dv-cinder-841302-4-smb devstack@keystone.service[156426]: WARNING keystone.server.flask.common [None req-9a7cede9-d3f9-4d5a-8eab-351dc979667d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 20:04:35.089305 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50eed36-e1b0-41e9-a779-3f312dba2203 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:35.126843 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1962d7-8363-46f1-a84d-b4fc6479dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:35.127499 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1962d7-8363-46f1-a84d-b4fc6479dd0b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:35.127784 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1962d7-8363-46f1-a84d-b4fc6479dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:35.128104 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1962d7-8363-46f1-a84d-b4fc6479dd0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:35.128891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1962d7-8363-46f1-a84d-b4fc6479dd0b None admin] RBAC: Adding query filter params (role.id=67f40b8de4bf4007a76e72baba6aba0e, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=68ef674a83cd467dba60206f2caea39f) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:35.129198 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1962d7-8363-46f1-a84d-b4fc6479dd0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:35.130638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1962d7-8363-46f1-a84d-b4fc6479dd0b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:35.138107 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 490/976] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:34 2022] GET /identity/v3/role_assignments?user.id=68ef674a83cd467dba60206f2caea39f&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=67f40b8de4bf4007a76e72baba6aba0e => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:35.141319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.sql.core [None req-9a7cede9-d3f9-4d5a-8eab-351dc979667d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:04:35.141319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 20:04:35.141319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [parameters: {'user_id': '8761e863573745dab6691f8f335330ce', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 20:04:35.141319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=156426) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:04:35.160458 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62e59a-35cc-4f5a-aa05-a24ad1877ebc None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:35.160832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62e59a-35cc-4f5a-aa05-a24ad1877ebc None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:35.161016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62e59a-35cc-4f5a-aa05-a24ad1877ebc None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:35.162854 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 491/977] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-9a7cede9-d3f9-4d5a-8eab-351dc979667d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application conn.query(q) May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application result.read() May 19 20:04:35.163240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:04:35.164712 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application next(self.gen) May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application yield resource May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application next(self.gen) May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise self.value May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application session.commit() May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:04:35.165771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self.session.flush() May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application compat.raise_( May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:04:35.166581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:04:35.168799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application conn.query(q) May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application result.read() May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:04:35.170811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [parameters: {'user_id': '8761e863573745dab6691f8f335330ce', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:35.172998 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 20:04:35.175358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 20:04:35.180590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 20:04:35.180590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 20:04:35.180590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:04:35.180590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:04:35.180590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 20:04:35.180590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:35.181498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620b8f3-1969-4339-91d8-1fb85bc12218 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:35.181498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620b8f3-1969-4339-91d8-1fb85bc12218 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:35.181498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620b8f3-1969-4339-91d8-1fb85bc12218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:35.183521 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 487/978] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:04:34 2022] POST /identity/v3/users => generated 160 bytes in 330 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:35.186689 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cede9-d3f9-4d5a-8eab-351dc979667d None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:35.188987 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-7620b8f3-1969-4339-91d8-1fb85bc12218 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:35.190411 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-7620b8f3-1969-4339-91d8-1fb85bc12218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:35.258953 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:35.283138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:35.286942 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 492/979] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:35.314472 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620b8f3-1969-4339-91d8-1fb85bc12218 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:35.355516 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cede9-d3f9-4d5a-8eab-351dc979667d None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:35.405460 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb21f6c-c352-41a7-ac78-f8201a448050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:35.406870 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb21f6c-c352-41a7-ac78-f8201a448050 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:35.407278 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb21f6c-c352-41a7-ac78-f8201a448050 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:35.407656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb21f6c-c352-41a7-ac78-f8201a448050 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:35.419520 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb21f6c-c352-41a7-ac78-f8201a448050 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:35.422361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb21f6c-c352-41a7-ac78-f8201a448050 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-7bb21f6c-c352-41a7-ac78-f8201a448050 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:35.444178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:35.445173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:35.446110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:35.446110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:35.446110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:35.446110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:35.446110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:35.446110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:35.446110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:35.446110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:35.446110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:04:35.446110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:35.446904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620b8f3-1969-4339-91d8-1fb85bc12218 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:35.448007 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 488/980] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:04:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:35.453989 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb21f6c-c352-41a7-ac78-f8201a448050 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:35.488866 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e106e-e296-4055-8f72-6fd3d8f4d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:35.489714 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e106e-e296-4055-8f72-6fd3d8f4d799 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:35.490101 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e106e-e296-4055-8f72-6fd3d8f4d799 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:35.490482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e106e-e296-4055-8f72-6fd3d8f4d799 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:35.491381 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e106e-e296-4055-8f72-6fd3d8f4d799 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:35.492874 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e106e-e296-4055-8f72-6fd3d8f4d799 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:35.568488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb21f6c-c352-41a7-ac78-f8201a448050 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:35.580850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 493/981] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:04:35 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:35.589863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:35.627828 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888b4e2-5b63-454d-b0ad-1467c95e188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:35.628528 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888b4e2-5b63-454d-b0ad-1467c95e188a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:35.628807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888b4e2-5b63-454d-b0ad-1467c95e188a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:35.629082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888b4e2-5b63-454d-b0ad-1467c95e188a None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:35.629915 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888b4e2-5b63-454d-b0ad-1467c95e188a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:35.630279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888b4e2-5b63-454d-b0ad-1467c95e188a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:35.631854 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888b4e2-5b63-454d-b0ad-1467c95e188a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:35.674214 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 489/982] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:04:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:37.125601 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07219dcc-7a80-4e8c-996a-72f406a6e7d7 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:37.126167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07219dcc-7a80-4e8c-996a-72f406a6e7d7 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:37.126167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07219dcc-7a80-4e8c-996a-72f406a6e7d7 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:37.127837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 494/983] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:37.133419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddb43-0f15-4bfd-961e-6018c7584760 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:37.133913 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddb43-0f15-4bfd-961e-6018c7584760 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:37.134082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddb43-0f15-4bfd-961e-6018c7584760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:37.151369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-a06ddb43-0f15-4bfd-961e-6018c7584760 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:37.152892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-a06ddb43-0f15-4bfd-961e-6018c7584760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:37.256733 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 490/984] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:37.278905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07219dcc-7a80-4e8c-996a-72f406a6e7d7 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:37.330297 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:37.392323 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07219dcc-7a80-4e8c-996a-72f406a6e7d7 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:37.430591 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dd075-5827-47c6-bbf6-50a89b23d570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:37.431429 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dd075-5827-47c6-bbf6-50a89b23d570 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:37.431711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dd075-5827-47c6-bbf6-50a89b23d570 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:37.431991 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dd075-5827-47c6-bbf6-50a89b23d570 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:37.432651 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dd075-5827-47c6-bbf6-50a89b23d570 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:37.434066 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dd075-5827-47c6-bbf6-50a89b23d570 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-a34dd075-5827-47c6-bbf6-50a89b23d570 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:37.446703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:37.447622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:37.448454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 495/985] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:04:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:37.455169 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ddb43-0f15-4bfd-961e-6018c7584760 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:37.512384 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d22c-d79e-4ec6-9afb-76cf789c305a None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:37.512689 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d22c-d79e-4ec6-9afb-76cf789c305a None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:37.512939 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d22c-d79e-4ec6-9afb-76cf789c305a None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:37.514472 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 496/986] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:37.519797 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903b272-6083-4e16-ac0c-55ee0bafb1a2 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:37.520085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903b272-6083-4e16-ac0c-55ee0bafb1a2 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:37.520361 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903b272-6083-4e16-ac0c-55ee0bafb1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:37.538793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-5903b272-6083-4e16-ac0c-55ee0bafb1a2 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:37.539990 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-5903b272-6083-4e16-ac0c-55ee0bafb1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:37.561455 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:37.565076 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ddb43-0f15-4bfd-961e-6018c7584760 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:37.608709 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dad50-9bf2-496f-a052-c71078ea14e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:37.609385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dad50-9bf2-496f-a052-c71078ea14e4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:37.609670 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dad50-9bf2-496f-a052-c71078ea14e4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:37.609953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dad50-9bf2-496f-a052-c71078ea14e4 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:37.610710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dad50-9bf2-496f-a052-c71078ea14e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:37.611020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dad50-9bf2-496f-a052-c71078ea14e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:37.612409 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dad50-9bf2-496f-a052-c71078ea14e4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:37.615344 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 497/987] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:37.618654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 491/988] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:04:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:37.623400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903b272-6083-4e16-ac0c-55ee0bafb1a2 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:37.640688 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dad50-9bf2-496f-a052-c71078ea14e4 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:37.661138 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:37.736536 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903b272-6083-4e16-ac0c-55ee0bafb1a2 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:37.755670 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dad50-9bf2-496f-a052-c71078ea14e4 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:37.773441 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c008c-bd00-4661-a8b1-b97c905350b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:37.774117 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c008c-bd00-4661-a8b1-b97c905350b0 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:37.774391 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c008c-bd00-4661-a8b1-b97c905350b0 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:37.774688 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c008c-bd00-4661-a8b1-b97c905350b0 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:37.775410 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c008c-bd00-4661-a8b1-b97c905350b0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:37.775712 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c008c-bd00-4661-a8b1-b97c905350b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:37.777728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c008c-bd00-4661-a8b1-b97c905350b0 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:37.787835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 498/989] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:04:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:37.789388 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c008c-bd00-4661-a8b1-b97c905350b0 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:37.808778 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a3e3f-4ab1-438b-9e02-fd0de514fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:37.810047 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a3e3f-4ab1-438b-9e02-fd0de514fb87 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:37.810372 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a3e3f-4ab1-438b-9e02-fd0de514fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:37.810690 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a3e3f-4ab1-438b-9e02-fd0de514fb87 None admin] PATH_INFO: `/v3/services/image` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:37.811538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a3e3f-4ab1-438b-9e02-fd0de514fb87 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:37.821415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a3e3f-4ab1-438b-9e02-fd0de514fb87 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-663a3e3f-4ab1-438b-9e02-fd0de514fb87 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:37.840335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:37.841388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:37.842153 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 492/990] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 20:04:37 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:37.847728 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a3e3f-4ab1-438b-9e02-fd0de514fb87 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:37.878749 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:37.927244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:37.931032 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c008c-bd00-4661-a8b1-b97c905350b0 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:37.958091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a3e3f-4ab1-438b-9e02-fd0de514fb87 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:37.968510 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa28457-359c-4101-a97e-ad85d1ea7bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:37.969182 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa28457-359c-4101-a97e-ad85d1ea7bcb None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:37.969469 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa28457-359c-4101-a97e-ad85d1ea7bcb None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:37.969745 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa28457-359c-4101-a97e-ad85d1ea7bcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:37.970548 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa28457-359c-4101-a97e-ad85d1ea7bcb None admin] RBAC: Adding query filter params (interface=admin, service_id=ea26c3e9021548c98a9313cd4ac92ee1, region_id=RegionOne) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:37.970900 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa28457-359c-4101-a97e-ad85d1ea7bcb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:37.972291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa28457-359c-4101-a97e-ad85d1ea7bcb None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:37.977848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 499/991] 10.222.0.89 () {56 vars in 1249 bytes} [Thu May 19 20:04:37 2022] GET /identity/v3/endpoints?service_id=ea26c3e9021548c98a9313cd4ac92ee1&interface=admin®ion_id=RegionOne => generated 193 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:37.983482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa28457-359c-4101-a97e-ad85d1ea7bcb None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:38.000618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae2f49-e20b-49cd-be38-b7763c8eb9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:38.001285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae2f49-e20b-49cd-be38-b7763c8eb9fd None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:38.001564 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae2f49-e20b-49cd-be38-b7763c8eb9fd None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:38.001838 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae2f49-e20b-49cd-be38-b7763c8eb9fd None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:38.002551 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae2f49-e20b-49cd-be38-b7763c8eb9fd None admin] RBAC: Adding query filter params (name=image) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:38.002882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae2f49-e20b-49cd-be38-b7763c8eb9fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:38.004264 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae2f49-e20b-49cd-be38-b7763c8eb9fd None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:38.009808 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 493/992] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:38.015732 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae2f49-e20b-49cd-be38-b7763c8eb9fd None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:38.105799 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa28457-359c-4101-a97e-ad85d1ea7bcb None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:38.128335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:38.145954 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae2f49-e20b-49cd-be38-b7763c8eb9fd None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:38.146557 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b23630-a5e6-48fd-8ad5-25a81e4ea134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:38.146932 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b23630-a5e6-48fd-8ad5-25a81e4ea134 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:38.147151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b23630-a5e6-48fd-8ad5-25a81e4ea134 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:38.147367 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b23630-a5e6-48fd-8ad5-25a81e4ea134 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:38.148061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b23630-a5e6-48fd-8ad5-25a81e4ea134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:38.149441 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b23630-a5e6-48fd-8ad5-25a81e4ea134 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:38.156547 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 500/993] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:04:37 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 20:04:38.215307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7f297-90a2-4da8-b600-090e556db64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:38.215934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7f297-90a2-4da8-b600-090e556db64c None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:38.216215 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7f297-90a2-4da8-b600-090e556db64c None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:38.216490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7f297-90a2-4da8-b600-090e556db64c None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:38.220053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7f297-90a2-4da8-b600-090e556db64c None admin] RBAC: Adding query filter params (type=image) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:38.220053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7f297-90a2-4da8-b600-090e556db64c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:38.220053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7f297-90a2-4da8-b600-090e556db64c None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:38.230642 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 494/994] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:38.273083 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678822dd-b371-4303-972b-c86a76022a9d None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:38.273368 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678822dd-b371-4303-972b-c86a76022a9d None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:38.273650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678822dd-b371-4303-972b-c86a76022a9d None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:38.275163 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 501/995] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:38.282101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689d8e6-3af1-4b11-a5de-12b94ec17a20 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:38.282416 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689d8e6-3af1-4b11-a5de-12b94ec17a20 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:38.282730 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689d8e6-3af1-4b11-a5de-12b94ec17a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:38.303214 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-3689d8e6-3af1-4b11-a5de-12b94ec17a20 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:38.304469 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-3689d8e6-3af1-4b11-a5de-12b94ec17a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:38.394366 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 495/996] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:38.417999 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678822dd-b371-4303-972b-c86a76022a9d None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:38.451968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:38.530845 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678822dd-b371-4303-972b-c86a76022a9d None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:38.567690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323bfa9-5002-443e-9a13-8512ef6dedb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:38.568546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323bfa9-5002-443e-9a13-8512ef6dedb4 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:38.568829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323bfa9-5002-443e-9a13-8512ef6dedb4 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:38.569101 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323bfa9-5002-443e-9a13-8512ef6dedb4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:38.569766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323bfa9-5002-443e-9a13-8512ef6dedb4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:38.571189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323bfa9-5002-443e-9a13-8512ef6dedb4 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-9323bfa9-5002-443e-9a13-8512ef6dedb4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:38.583894 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:38.584848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:04:38.585686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:38.590299 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 502/997] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:38.591734 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689d8e6-3af1-4b11-a5de-12b94ec17a20 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:38.688048 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:38.704576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689d8e6-3af1-4b11-a5de-12b94ec17a20 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:38.740914 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179564e6-7cf8-4675-9ecb-bb648c49a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:38.741592 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179564e6-7cf8-4675-9ecb-bb648c49a66b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:38.741879 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179564e6-7cf8-4675-9ecb-bb648c49a66b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:38.742155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179564e6-7cf8-4675-9ecb-bb648c49a66b None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:38.742911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179564e6-7cf8-4675-9ecb-bb648c49a66b None admin] RBAC: Adding query filter params (name=compute) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:38.743221 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179564e6-7cf8-4675-9ecb-bb648c49a66b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:38.744604 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179564e6-7cf8-4675-9ecb-bb648c49a66b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:38.750485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 496/998] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:38.756200 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323bfa9-5002-443e-9a13-8512ef6dedb4 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:38.863085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:38.873671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323bfa9-5002-443e-9a13-8512ef6dedb4 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:38.909233 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc3e03-8c70-4a28-a0c6-1301c3564d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:38.910012 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc3e03-8c70-4a28-a0c6-1301c3564d2c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:38.910303 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc3e03-8c70-4a28-a0c6-1301c3564d2c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:38.910577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc3e03-8c70-4a28-a0c6-1301c3564d2c None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:38.911317 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc3e03-8c70-4a28-a0c6-1301c3564d2c None admin] RBAC: Adding query filter params (type=compute) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:38.911623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc3e03-8c70-4a28-a0c6-1301c3564d2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:38.913067 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc3e03-8c70-4a28-a0c6-1301c3564d2c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:38.923932 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 503/999] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:38.925172 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179564e6-7cf8-4675-9ecb-bb648c49a66b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:39.032096 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179564e6-7cf8-4675-9ecb-bb648c49a66b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:39.068020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49a5fa-34e5-4d7c-abde-c23b1adb75f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:39.068692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49a5fa-34e5-4d7c-abde-c23b1adb75f4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:39.068980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49a5fa-34e5-4d7c-abde-c23b1adb75f4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:39.069257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49a5fa-34e5-4d7c-abde-c23b1adb75f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:39.070047 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49a5fa-34e5-4d7c-abde-c23b1adb75f4 None admin] RBAC: Adding query filter params (interface=public, service_id=d3634f36335b47fea87df7a19e6feef1, region_id=RegionOne) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:39.070361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49a5fa-34e5-4d7c-abde-c23b1adb75f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:39.071784 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49a5fa-34e5-4d7c-abde-c23b1adb75f4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:39.078079 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 497/1000] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:04:38 2022] GET /identity/v3/endpoints?service_id=d3634f36335b47fea87df7a19e6feef1&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:39.084102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc3e03-8c70-4a28-a0c6-1301c3564d2c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:39.210850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc3e03-8c70-4a28-a0c6-1301c3564d2c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:39.249997 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95858d13-c257-48e2-982c-c9430ed25ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:39.250697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95858d13-c257-48e2-982c-c9430ed25ba2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:39.250981 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95858d13-c257-48e2-982c-c9430ed25ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:39.251254 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95858d13-c257-48e2-982c-c9430ed25ba2 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:39.251943 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95858d13-c257-48e2-982c-c9430ed25ba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:39.253314 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95858d13-c257-48e2-982c-c9430ed25ba2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:39.259991 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 504/1001] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:04:39 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:04:40.487112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc0957-41c0-4f36-b125-6ab4e78b2d55 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:40.487598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc0957-41c0-4f36-b125-6ab4e78b2d55 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:40.487956 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc0957-41c0-4f36-b125-6ab4e78b2d55 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:40.490400 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 498/1002] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:40.496829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0cba0-4895-45a0-8df4-d5c7d861a8da None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:40.497296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0cba0-4895-45a0-8df4-d5c7d861a8da None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:40.497371 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0cba0-4895-45a0-8df4-d5c7d861a8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:40.520480 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2d533-62e7-43eb-9463-ea50a3589592 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:40.520794 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2d533-62e7-43eb-9463-ea50a3589592 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:40.520962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-5cd0cba0-4895-45a0-8df4-d5c7d861a8da None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:40.521077 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2d533-62e7-43eb-9463-ea50a3589592 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:40.522156 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-5cd0cba0-4895-45a0-8df4-d5c7d861a8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:40.522724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 499/1003] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:04:40.528547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ea97e-13eb-4433-95cf-570674a0ddcc None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:40.528826 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ea97e-13eb-4433-95cf-570674a0ddcc None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:40.529366 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ea97e-13eb-4433-95cf-570674a0ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:40.538060 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:40.549142 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-5c9ea97e-13eb-4433-95cf-570674a0ddcc None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:40.550357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-5c9ea97e-13eb-4433-95cf-570674a0ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:40.559369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:40.628459 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 505/1004] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:40.640816 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 500/1005] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:40.658099 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0cba0-4895-45a0-8df4-d5c7d861a8da None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:40.664156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ea97e-13eb-4433-95cf-570674a0ddcc None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:40.772756 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ea97e-13eb-4433-95cf-570674a0ddcc None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:40.784524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0cba0-4895-45a0-8df4-d5c7d861a8da None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:40.811104 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbedaf2-c007-43e6-acf6-62e279d3db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:40.812062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbedaf2-c007-43e6-acf6-62e279d3db91 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:40.812349 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbedaf2-c007-43e6-acf6-62e279d3db91 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:40.812754 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbedaf2-c007-43e6-acf6-62e279d3db91 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:40.813361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbedaf2-c007-43e6-acf6-62e279d3db91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:40.814788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbedaf2-c007-43e6-acf6-62e279d3db91 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:40.825452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d496-efe7-4aa3-8663-94e25aa479ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:40.826269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d496-efe7-4aa3-8663-94e25aa479ba None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:40.826550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d496-efe7-4aa3-8663-94e25aa479ba None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:40.826852 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414d496-efe7-4aa3-8663-94e25aa479ba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:40.833500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414d496-efe7-4aa3-8663-94e25aa479ba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:40.833500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414d496-efe7-4aa3-8663-94e25aa479ba None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-a414d496-efe7-4aa3-8663-94e25aa479ba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:40.841549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:40.842988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:40.843831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 506/1006] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:04:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:40.849050 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d496-efe7-4aa3-8663-94e25aa479ba None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:40.865146 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:40.913767 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 501/1007] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:04:40 2022] POST /identity/v3/services => generated 242 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:04:40.981208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414d496-efe7-4aa3-8663-94e25aa479ba None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:41.031463 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bba4d-d1f7-44ab-b4cf-1f5d92716595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:41.032067 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bba4d-d1f7-44ab-b4cf-1f5d92716595 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:41.032343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bba4d-d1f7-44ab-b4cf-1f5d92716595 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:41.032616 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bba4d-d1f7-44ab-b4cf-1f5d92716595 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:41.033401 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bba4d-d1f7-44ab-b4cf-1f5d92716595 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:41.033742 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bba4d-d1f7-44ab-b4cf-1f5d92716595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:41.035149 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bba4d-d1f7-44ab-b4cf-1f5d92716595 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:41.045580 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 507/1008] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:04:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:41.046867 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbedaf2-c007-43e6-acf6-62e279d3db91 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:41.049882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:41.163842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbedaf2-c007-43e6-acf6-62e279d3db91 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:41.199671 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36e6c2-5406-4c3e-a14d-6da36c90f5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:41.200345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e6c2-5406-4c3e-a14d-6da36c90f5e6 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:41.200625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e6c2-5406-4c3e-a14d-6da36c90f5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:41.200900 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e6c2-5406-4c3e-a14d-6da36c90f5e6 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:41.201626 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36e6c2-5406-4c3e-a14d-6da36c90f5e6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:41.201934 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36e6c2-5406-4c3e-a14d-6da36c90f5e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:41.203326 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36e6c2-5406-4c3e-a14d-6da36c90f5e6 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:41.208727 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 502/1009] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:04:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:41.216712 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bba4d-d1f7-44ab-b4cf-1f5d92716595 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:41.291621 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:41.325193 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bba4d-d1f7-44ab-b4cf-1f5d92716595 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:41.360848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09018455-41af-4b1e-9611-f03211afb9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:41.361512 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09018455-41af-4b1e-9611-f03211afb9a0 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:41.361794 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09018455-41af-4b1e-9611-f03211afb9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:41.362069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09018455-41af-4b1e-9611-f03211afb9a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:41.362865 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09018455-41af-4b1e-9611-f03211afb9a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:41.364252 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09018455-41af-4b1e-9611-f03211afb9a0 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:41.435383 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 508/1010] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:04:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:41.591436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e120af-c6b1-4cae-af7d-c8e5284c93a9 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:41.591960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e120af-c6b1-4cae-af7d-c8e5284c93a9 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:41.591960 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e120af-c6b1-4cae-af7d-c8e5284c93a9 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:41.593517 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 503/1011] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:41.599247 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e6835-05b4-4e7f-a6e9-458accd03b0d None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:41.599731 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e6835-05b4-4e7f-a6e9-458accd03b0d None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:41.599830 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e6835-05b4-4e7f-a6e9-458accd03b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:41.618086 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-1e7e6835-05b4-4e7f-a6e9-458accd03b0d None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:41.619437 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-1e7e6835-05b4-4e7f-a6e9-458accd03b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:41.700398 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 509/1012] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:41 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:41.723857 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e120af-c6b1-4cae-af7d-c8e5284c93a9 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:41.795936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:41.834478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e120af-c6b1-4cae-af7d-c8e5284c93a9 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:41.871794 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88bd9a-dc1f-46de-affd-11d4c20cdb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:41.872612 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88bd9a-dc1f-46de-affd-11d4c20cdb8b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:41.872893 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88bd9a-dc1f-46de-affd-11d4c20cdb8b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:41.873167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88bd9a-dc1f-46de-affd-11d4c20cdb8b None admin] PATH_INFO: `/v3/services/compute` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:41.873823 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88bd9a-dc1f-46de-affd-11d4c20cdb8b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:41.875227 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88bd9a-dc1f-46de-affd-11d4c20cdb8b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-9d88bd9a-dc1f-46de-affd-11d4c20cdb8b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:41.887953 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:41.888907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:04:41.889685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:41.894284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 504/1013] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:41.895501 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e6835-05b4-4e7f-a6e9-458accd03b0d None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:41.959728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:42.004477 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e6835-05b4-4e7f-a6e9-458accd03b0d None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:42.041457 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238c9e-c0b7-4bfb-9fad-1afd0cc555a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:42.042178 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238c9e-c0b7-4bfb-9fad-1afd0cc555a2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:42.042458 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238c9e-c0b7-4bfb-9fad-1afd0cc555a2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:42.042765 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238c9e-c0b7-4bfb-9fad-1afd0cc555a2 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:42.043478 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9238c9e-c0b7-4bfb-9fad-1afd0cc555a2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:42.043784 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9238c9e-c0b7-4bfb-9fad-1afd0cc555a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:42.045162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9238c9e-c0b7-4bfb-9fad-1afd0cc555a2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:42.050562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 510/1014] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:42.056368 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88bd9a-dc1f-46de-affd-11d4c20cdb8b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:42.163834 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88bd9a-dc1f-46de-affd-11d4c20cdb8b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:42.196317 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:42.203955 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c295e-3574-46af-9486-f5b424da103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:42.204800 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c295e-3574-46af-9486-f5b424da103d None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:42.205078 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c295e-3574-46af-9486-f5b424da103d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:42.205350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c295e-3574-46af-9486-f5b424da103d None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:42.206070 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c295e-3574-46af-9486-f5b424da103d None admin] RBAC: Adding query filter params (type=compute) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:42.211081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c295e-3574-46af-9486-f5b424da103d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:42.211081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c295e-3574-46af-9486-f5b424da103d None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:42.218625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 505/1015] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:04:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:42.220831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238c9e-c0b7-4bfb-9fad-1afd0cc555a2 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:42.329404 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238c9e-c0b7-4bfb-9fad-1afd0cc555a2 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:42.353570 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:42.366045 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8da81-7693-419f-b314-f07ecb140791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:42.366743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8da81-7693-419f-b314-f07ecb140791 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:42.367026 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8da81-7693-419f-b314-f07ecb140791 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:42.367300 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8da81-7693-419f-b314-f07ecb140791 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:42.368049 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8da81-7693-419f-b314-f07ecb140791 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:42.369431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8da81-7693-419f-b314-f07ecb140791 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:42.440353 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 511/1016] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:04:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:43.436205 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c164-0886-41f7-97ac-15e4c6af42a8 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:43.436753 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c164-0886-41f7-97ac-15e4c6af42a8 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:43.437209 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c164-0886-41f7-97ac-15e4c6af42a8 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:43.439931 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 506/1017] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:43.445837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc168c-5e65-49b3-9ab3-776d1b9edd68 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:43.446369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc168c-5e65-49b3-9ab3-776d1b9edd68 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:43.446369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc168c-5e65-49b3-9ab3-776d1b9edd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:43.466008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-23fc168c-5e65-49b3-9ab3-776d1b9edd68 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:43.467266 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-23fc168c-5e65-49b3-9ab3-776d1b9edd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:43.549127 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 512/1018] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:43.572797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c164-0886-41f7-97ac-15e4c6af42a8 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:43.701588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c164-0886-41f7-97ac-15e4c6af42a8 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:43.740853 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ddf25-b60a-4672-9e31-f0cd905332b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:43.741650 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ddf25-b60a-4672-9e31-f0cd905332b6 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:43.741930 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ddf25-b60a-4672-9e31-f0cd905332b6 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:43.742206 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ddf25-b60a-4672-9e31-f0cd905332b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:43.742888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ddf25-b60a-4672-9e31-f0cd905332b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:43.744273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ddf25-b60a-4672-9e31-f0cd905332b6 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-392ddf25-b60a-4672-9e31-f0cd905332b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:43.756906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:43.757842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:04:43.758641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:43.760024 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 507/1019] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 20:04:43 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:43.764510 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc168c-5e65-49b3-9ab3-776d1b9edd68 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:43.777798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207100bb-934a-4dfe-a265-e8f4e3e2b889 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:43.778094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207100bb-934a-4dfe-a265-e8f4e3e2b889 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:43.778377 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207100bb-934a-4dfe-a265-e8f4e3e2b889 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:43.780062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 508/1020] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:04:43.785487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14da3-72fc-4f07-a491-dc7ff5032e38 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:43.785773 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14da3-72fc-4f07-a491-dc7ff5032e38 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:43.786051 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14da3-72fc-4f07-a491-dc7ff5032e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:43.805430 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-86f14da3-72fc-4f07-a491-dc7ff5032e38 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:43.806628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-86f14da3-72fc-4f07-a491-dc7ff5032e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:43.864882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:43.879378 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc168c-5e65-49b3-9ab3-776d1b9edd68 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:43.880818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 509/1021] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:43.882494 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:43.904732 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f14da3-72fc-4f07-a491-dc7ff5032e38 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:43.926093 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce261f-58e5-4a2e-8a5b-a235d0759269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:43.926093 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce261f-58e5-4a2e-8a5b-a235d0759269 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:43.926093 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce261f-58e5-4a2e-8a5b-a235d0759269 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:43.926093 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce261f-58e5-4a2e-8a5b-a235d0759269 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:43.928541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce261f-58e5-4a2e-8a5b-a235d0759269 None admin] RBAC: Adding query filter params (name=image) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:43.928541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce261f-58e5-4a2e-8a5b-a235d0759269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:43.928541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce261f-58e5-4a2e-8a5b-a235d0759269 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:43.938708 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 513/1022] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:43.941535 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce261f-58e5-4a2e-8a5b-a235d0759269 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:44.025544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f14da3-72fc-4f07-a491-dc7ff5032e38 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:44.061255 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce261f-58e5-4a2e-8a5b-a235d0759269 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:44.067383 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7991ba9-94d9-4d2a-82d9-99f8dd33342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:44.068368 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7991ba9-94d9-4d2a-82d9-99f8dd33342f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:44.068942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7991ba9-94d9-4d2a-82d9-99f8dd33342f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:44.069392 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7991ba9-94d9-4d2a-82d9-99f8dd33342f None admin] PATH_INFO: `/v3/domains/default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:44.071036 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7991ba9-94d9-4d2a-82d9-99f8dd33342f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:44.072623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7991ba9-94d9-4d2a-82d9-99f8dd33342f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:44.075331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 510/1023] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:44.080849 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7991ba9-94d9-4d2a-82d9-99f8dd33342f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:44.105819 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed1d9c-0075-48fd-8e5b-622d1c0daf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:44.106456 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed1d9c-0075-48fd-8e5b-622d1c0daf2f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:44.106770 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed1d9c-0075-48fd-8e5b-622d1c0daf2f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:44.107049 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed1d9c-0075-48fd-8e5b-622d1c0daf2f None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:44.107767 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed1d9c-0075-48fd-8e5b-622d1c0daf2f None admin] RBAC: Adding query filter params (type=image) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:44.108072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed1d9c-0075-48fd-8e5b-622d1c0daf2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:44.109914 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed1d9c-0075-48fd-8e5b-622d1c0daf2f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:44.114984 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 514/1024] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:44.123116 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed1d9c-0075-48fd-8e5b-622d1c0daf2f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:44.156302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:44.163328 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:44.203189 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7991ba9-94d9-4d2a-82d9-99f8dd33342f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:44.243555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed1d9c-0075-48fd-8e5b-622d1c0daf2f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:44.244261 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552da6e7-dacc-423a-9c29-585e75750af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:44.245672 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552da6e7-dacc-423a-9c29-585e75750af6 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:44.245977 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552da6e7-dacc-423a-9c29-585e75750af6 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:44.246265 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552da6e7-dacc-423a-9c29-585e75750af6 None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:44.247066 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552da6e7-dacc-423a-9c29-585e75750af6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:44.248512 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552da6e7-dacc-423a-9c29-585e75750af6 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:44.284673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5c3fb-c94a-4889-ad3a-49c3c4125335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:44.285333 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5c3fb-c94a-4889-ad3a-49c3c4125335 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:44.285612 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5c3fb-c94a-4889-ad3a-49c3c4125335 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:44.285885 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5c3fb-c94a-4889-ad3a-49c3c4125335 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:44.286709 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5c3fb-c94a-4889-ad3a-49c3c4125335 None admin] RBAC: Adding query filter params (interface=public, service_id=294e1a403db342cfa7f5eca90a464192, region_id=RegionOne) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:44.287020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5c3fb-c94a-4889-ad3a-49c3c4125335 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:44.288384 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5c3fb-c94a-4889-ad3a-49c3c4125335 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:44.294827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 515/1025] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:04:44 2022] GET /identity/v3/endpoints?service_id=294e1a403db342cfa7f5eca90a464192&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:44.300174 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5c3fb-c94a-4889-ad3a-49c3c4125335 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:44.341526 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 511/1026] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:04:44 2022] POST /identity/v3/projects => generated 311 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:04:44.409950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:44.417324 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5c3fb-c94a-4889-ad3a-49c3c4125335 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:44.458298 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec195bc-2077-4fdd-9109-87248c8d0bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:44.459103 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec195bc-2077-4fdd-9109-87248c8d0bc0 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:44.459289 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec195bc-2077-4fdd-9109-87248c8d0bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:44.459641 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec195bc-2077-4fdd-9109-87248c8d0bc0 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:44.460350 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec195bc-2077-4fdd-9109-87248c8d0bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:44.461815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec195bc-2077-4fdd-9109-87248c8d0bc0 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:44.478984 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 516/1027] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:04:44 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 20:04:44.875435 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1158124-537b-450b-8ab8-aa8d2b624c1a None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:44.875986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1158124-537b-450b-8ab8-aa8d2b624c1a None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:44.875986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1158124-537b-450b-8ab8-aa8d2b624c1a None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:44.877538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 512/1028] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:44.882880 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc7d73-751f-4112-87ea-40d13c68a6bd None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:44.883174 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc7d73-751f-4112-87ea-40d13c68a6bd None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:44.883455 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc7d73-751f-4112-87ea-40d13c68a6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:44.900624 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-7bfc7d73-751f-4112-87ea-40d13c68a6bd None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:44.902363 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-7bfc7d73-751f-4112-87ea-40d13c68a6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:44.973342 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 517/1029] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:44.997367 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1158124-537b-450b-8ab8-aa8d2b624c1a None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:45.121849 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1158124-537b-450b-8ab8-aa8d2b624c1a None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:45.133606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:45.159923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6807e5-cd36-40a3-85e5-34f62ffea9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:45.160822 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6807e5-cd36-40a3-85e5-34f62ffea9d9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:45.161105 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6807e5-cd36-40a3-85e5-34f62ffea9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:45.161383 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6807e5-cd36-40a3-85e5-34f62ffea9d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:45.173450 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6807e5-cd36-40a3-85e5-34f62ffea9d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-bb6807e5-cd36-40a3-85e5-34f62ffea9d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:45.182022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:45.183294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:45.184293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 513/1030] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:04:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:45.191884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc7d73-751f-4112-87ea-40d13c68a6bd None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:45.304620 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:45.314878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc7d73-751f-4112-87ea-40d13c68a6bd None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:45.352586 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a342d-52df-4fb9-a43d-61a2d1c3427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:45.353271 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a342d-52df-4fb9-a43d-61a2d1c3427f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:45.353560 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a342d-52df-4fb9-a43d-61a2d1c3427f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:45.353835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a342d-52df-4fb9-a43d-61a2d1c3427f None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:45.355335 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a342d-52df-4fb9-a43d-61a2d1c3427f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:45.355646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a342d-52df-4fb9-a43d-61a2d1c3427f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:45.357075 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a342d-52df-4fb9-a43d-61a2d1c3427f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:45.367052 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 518/1031] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:04:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:45.374268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6807e5-cd36-40a3-85e5-34f62ffea9d9 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:45.553278 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6807e5-cd36-40a3-85e5-34f62ffea9d9 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:45.553278 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63305fbc-8012-497f-81ea-0349877ce910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:45.553278 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63305fbc-8012-497f-81ea-0349877ce910 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:45.553278 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63305fbc-8012-497f-81ea-0349877ce910 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:45.553740 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63305fbc-8012-497f-81ea-0349877ce910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:45.553740 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63305fbc-8012-497f-81ea-0349877ce910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:45.553740 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63305fbc-8012-497f-81ea-0349877ce910 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-63305fbc-8012-497f-81ea-0349877ce910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:45.564501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:45.565385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:45.566284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:45.566284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:45.566284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:45.566284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:45.566284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 514/1032] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:45.571801 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a342d-52df-4fb9-a43d-61a2d1c3427f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:45.692683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a342d-52df-4fb9-a43d-61a2d1c3427f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:45.732652 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee304888-ca0e-4eab-badb-77458666dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:45.733336 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee304888-ca0e-4eab-badb-77458666dd1f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:45.733615 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee304888-ca0e-4eab-badb-77458666dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:45.733890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee304888-ca0e-4eab-badb-77458666dd1f None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:45.734662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee304888-ca0e-4eab-badb-77458666dd1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:45.734973 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee304888-ca0e-4eab-badb-77458666dd1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:45.736394 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee304888-ca0e-4eab-badb-77458666dd1f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:45.751759 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 519/1033] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:45.758669 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63305fbc-8012-497f-81ea-0349877ce910 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:45.787239 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:45.881623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63305fbc-8012-497f-81ea-0349877ce910 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:45.917130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837d271-6dbb-4ada-af4c-b8cfaa2727c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:45.917928 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837d271-6dbb-4ada-af4c-b8cfaa2727c4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:45.918215 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837d271-6dbb-4ada-af4c-b8cfaa2727c4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:45.918495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837d271-6dbb-4ada-af4c-b8cfaa2727c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:45.925838 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837d271-6dbb-4ada-af4c-b8cfaa2727c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:45.927307 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837d271-6dbb-4ada-af4c-b8cfaa2727c4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-3837d271-6dbb-4ada-af4c-b8cfaa2727c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:45.942628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:45.943544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:45.944433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:45.944433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:45.944433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:45.944433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:45.944433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:45.944433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:45.944433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:45.944433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:45.944433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:04:45.944433 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:45.949248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 515/1034] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:04:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:45.950622 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee304888-ca0e-4eab-badb-77458666dd1f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:45.974679 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:46.066126 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee304888-ca0e-4eab-badb-77458666dd1f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:46.101336 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5747-dd0a-4d15-bd75-75b054f05fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:46.102015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5747-dd0a-4d15-bd75-75b054f05fab None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:46.102298 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5747-dd0a-4d15-bd75-75b054f05fab None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:46.102578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5747-dd0a-4d15-bd75-75b054f05fab None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:46.103462 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa5747-dd0a-4d15-bd75-75b054f05fab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:46.103775 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa5747-dd0a-4d15-bd75-75b054f05fab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:46.105780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa5747-dd0a-4d15-bd75-75b054f05fab None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:46.125156 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 520/1035] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:04:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:46.130857 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837d271-6dbb-4ada-af4c-b8cfaa2727c4 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:46.223014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:46.242717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837d271-6dbb-4ada-af4c-b8cfaa2727c4 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:46.280013 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef8f40-7133-4de3-8cd3-7dc9e55fa78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:46.280678 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef8f40-7133-4de3-8cd3-7dc9e55fa78b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:46.281092 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef8f40-7133-4de3-8cd3-7dc9e55fa78b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:46.281208 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef8f40-7133-4de3-8cd3-7dc9e55fa78b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:46.353383 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef8f40-7133-4de3-8cd3-7dc9e55fa78b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:46.355438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef8f40-7133-4de3-8cd3-7dc9e55fa78b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:46.440867 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:46.466441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 516/1036] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:46 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:04:46.472895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5747-dd0a-4d15-bd75-75b054f05fab None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:46.562811 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:46.599101 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5747-dd0a-4d15-bd75-75b054f05fab None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:46.637847 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31009309-ad2e-42f0-82b3-3dcb871b4c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:46.638726 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31009309-ad2e-42f0-82b3-3dcb871b4c43 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:46.639010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31009309-ad2e-42f0-82b3-3dcb871b4c43 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:46.639285 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31009309-ad2e-42f0-82b3-3dcb871b4c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:46.651668 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31009309-ad2e-42f0-82b3-3dcb871b4c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:46.653196 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31009309-ad2e-42f0-82b3-3dcb871b4c43 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-31009309-ad2e-42f0-82b3-3dcb871b4c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:46.672780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:46.673703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:46.674524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:46.674524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:46.674524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:46.674524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:46.675552 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 521/1037] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:46.680078 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef8f40-7133-4de3-8cd3-7dc9e55fa78b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:46.761889 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eea5d-a62d-4632-95fd-46b9aad5f156 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:46.762095 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eea5d-a62d-4632-95fd-46b9aad5f156 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:46.762344 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eea5d-a62d-4632-95fd-46b9aad5f156 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:46.766174 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 522/1038] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:04:46.769975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ff7d-5965-454c-99d7-9b502a135074 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:46.770262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ff7d-5965-454c-99d7-9b502a135074 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:46.770541 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ff7d-5965-454c-99d7-9b502a135074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:46.789572 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-50a3ff7d-5965-454c-99d7-9b502a135074 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:46.790827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-50a3ff7d-5965-454c-99d7-9b502a135074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:46.815824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef8f40-7133-4de3-8cd3-7dc9e55fa78b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:46.861870 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815b93-af12-4f1d-a01d-9a610747b32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:46.862543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815b93-af12-4f1d-a01d-9a610747b32d None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:46.862856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815b93-af12-4f1d-a01d-9a610747b32d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:46.863136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815b93-af12-4f1d-a01d-9a610747b32d None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:46.863877 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00815b93-af12-4f1d-a01d-9a610747b32d None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:46.864185 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00815b93-af12-4f1d-a01d-9a610747b32d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:46.865600 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00815b93-af12-4f1d-a01d-9a610747b32d None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:46.866275 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 523/1039] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:46.867671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb1d47-60ba-42d4-bee9-71152b2f9c2b None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:46.867968 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb1d47-60ba-42d4-bee9-71152b2f9c2b None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:46.868247 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb1d47-60ba-42d4-bee9-71152b2f9c2b None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:46.869767 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 524/1040] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:46.875539 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409866-7cd5-47d2-b32b-f349902efc25 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:46.875827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409866-7cd5-47d2-b32b-f349902efc25 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:46.876114 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409866-7cd5-47d2-b32b-f349902efc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:46.879588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 517/1041] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:46.888217 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815b93-af12-4f1d-a01d-9a610747b32d None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:46.903014 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-17409866-7cd5-47d2-b32b-f349902efc25 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:46.904231 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-17409866-7cd5-47d2-b32b-f349902efc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:46.933571 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:46.952711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:46.973369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 525/1042] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:46.974043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17409866-7cd5-47d2-b32b-f349902efc25 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:46.999568 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815b93-af12-4f1d-a01d-9a610747b32d None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:47.035519 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b38141-37b7-4213-b665-5b4bd3414f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:47.036228 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b38141-37b7-4213-b665-5b4bd3414f0e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:47.036508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b38141-37b7-4213-b665-5b4bd3414f0e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:47.036790 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b38141-37b7-4213-b665-5b4bd3414f0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:47.044109 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b38141-37b7-4213-b665-5b4bd3414f0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:47.045544 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b38141-37b7-4213-b665-5b4bd3414f0e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-31b38141-37b7-4213-b665-5b4bd3414f0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:47.060856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:47.061797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:47.062675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:47.062675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:47.062675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:47.062675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:47.062675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:47.062675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:47.062675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:47.062675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:47.062675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 518/1043] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:47.063152 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b38141-37b7-4213-b665-5b4bd3414f0e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:47.082915 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17409866-7cd5-47d2-b32b-f349902efc25 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:47.117802 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26da052-b1ed-4465-beb7-8672aefa48ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:47.118596 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26da052-b1ed-4465-beb7-8672aefa48ec None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:47.118916 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26da052-b1ed-4465-beb7-8672aefa48ec None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:47.119196 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26da052-b1ed-4465-beb7-8672aefa48ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:47.120947 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26da052-b1ed-4465-beb7-8672aefa48ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:47.122383 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26da052-b1ed-4465-beb7-8672aefa48ec None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:47.124066 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 526/1044] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:47.124815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26da052-b1ed-4465-beb7-8672aefa48ec None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:47.164511 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:47.167596 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b38141-37b7-4213-b665-5b4bd3414f0e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:47.177435 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:47.204430 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215fc8f-1aeb-466e-86e9-7122c2a6aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:47.205353 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215fc8f-1aeb-466e-86e9-7122c2a6aa54 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:47.205966 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215fc8f-1aeb-466e-86e9-7122c2a6aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:47.206245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215fc8f-1aeb-466e-86e9-7122c2a6aa54 None admin] PATH_INFO: `/v3/services/image` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:47.206956 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215fc8f-1aeb-466e-86e9-7122c2a6aa54 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:47.208335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215fc8f-1aeb-466e-86e9-7122c2a6aa54 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-9215fc8f-1aeb-466e-86e9-7122c2a6aa54 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:47.220625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:47.221886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:47.224279 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 519/1045] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 20:04:47 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:47.225212 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215fc8f-1aeb-466e-86e9-7122c2a6aa54 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:47.236068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26da052-b1ed-4465-beb7-8672aefa48ec None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:47.273084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4e71-5694-404b-9fcb-e7b60320810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:47.273760 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4e71-5694-404b-9fcb-e7b60320810c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:47.274100 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4e71-5694-404b-9fcb-e7b60320810c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:47.274389 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4e71-5694-404b-9fcb-e7b60320810c None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:47.275236 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af4e71-5694-404b-9fcb-e7b60320810c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:47.277942 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af4e71-5694-404b-9fcb-e7b60320810c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:47.277942 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af4e71-5694-404b-9fcb-e7b60320810c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:47.290345 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 527/1046] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:47.291171 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4e71-5694-404b-9fcb-e7b60320810c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:47.332592 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215fc8f-1aeb-466e-86e9-7122c2a6aa54 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:47.368237 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d933770-cb01-400a-9d02-e276cc098f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:47.368929 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d933770-cb01-400a-9d02-e276cc098f49 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:47.369264 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d933770-cb01-400a-9d02-e276cc098f49 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:47.369750 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d933770-cb01-400a-9d02-e276cc098f49 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:47.370470 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d933770-cb01-400a-9d02-e276cc098f49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:47.371924 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d933770-cb01-400a-9d02-e276cc098f49 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:47.397980 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4e71-5694-404b-9fcb-e7b60320810c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:47.410442 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:47.435067 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210bdca-8a3e-4b52-b24b-9fdc1c4e5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:47.435736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210bdca-8a3e-4b52-b24b-9fdc1c4e5d89 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:47.436016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210bdca-8a3e-4b52-b24b-9fdc1c4e5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:47.436288 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210bdca-8a3e-4b52-b24b-9fdc1c4e5d89 None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:47.437003 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210bdca-8a3e-4b52-b24b-9fdc1c4e5d89 None admin] RBAC: Adding query filter params (name=image) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:47.437345 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210bdca-8a3e-4b52-b24b-9fdc1c4e5d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:47.438771 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210bdca-8a3e-4b52-b24b-9fdc1c4e5d89 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:47.443809 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 528/1047] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:47.444577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210bdca-8a3e-4b52-b24b-9fdc1c4e5d89 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:47.482637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 520/1048] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:04:47 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:47.482637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d933770-cb01-400a-9d02-e276cc098f49 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:47.495540 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:47.567883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210bdca-8a3e-4b52-b24b-9fdc1c4e5d89 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:47.599666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d933770-cb01-400a-9d02-e276cc098f49 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:47.610334 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124e501-a0b1-4136-b1b5-f560f75465e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:47.611100 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124e501-a0b1-4136-b1b5-f560f75465e2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:47.611332 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124e501-a0b1-4136-b1b5-f560f75465e2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:47.611608 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124e501-a0b1-4136-b1b5-f560f75465e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:47.612477 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124e501-a0b1-4136-b1b5-f560f75465e2 None admin] RBAC: Adding query filter params (role.id=67f40b8de4bf4007a76e72baba6aba0e, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=e0b88c1582c849349cc441446f6cca20) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:47.612792 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124e501-a0b1-4136-b1b5-f560f75465e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:47.614309 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124e501-a0b1-4136-b1b5-f560f75465e2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:47.621949 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 529/1049] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:47 2022] GET /identity/v3/role_assignments?user.id=e0b88c1582c849349cc441446f6cca20&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=67f40b8de4bf4007a76e72baba6aba0e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:47.653972 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3917a2f-4c54-41a6-8049-e7ddfcc8fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:47.654716 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3917a2f-4c54-41a6-8049-e7ddfcc8fca0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:47.654999 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3917a2f-4c54-41a6-8049-e7ddfcc8fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:47.655270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3917a2f-4c54-41a6-8049-e7ddfcc8fca0 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:47.656013 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3917a2f-4c54-41a6-8049-e7ddfcc8fca0 None admin] RBAC: Adding query filter params (type=image) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:47.656317 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3917a2f-4c54-41a6-8049-e7ddfcc8fca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:47.657745 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3917a2f-4c54-41a6-8049-e7ddfcc8fca0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:47.669582 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 521/1050] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:47.670942 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124e501-a0b1-4136-b1b5-f560f75465e2 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:47.732794 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:47.815422 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124e501-a0b1-4136-b1b5-f560f75465e2 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:47.862811 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef78828-4e5e-4cd9-8519-0f3a1be6c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:47.863542 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef78828-4e5e-4cd9-8519-0f3a1be6c029 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:47.864018 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef78828-4e5e-4cd9-8519-0f3a1be6c029 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:47.864461 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef78828-4e5e-4cd9-8519-0f3a1be6c029 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:47.865723 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef78828-4e5e-4cd9-8519-0f3a1be6c029 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:47.867881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef78828-4e5e-4cd9-8519-0f3a1be6c029 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:47.949550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 530/1051] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:04:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:04:49.884972 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208923-e858-41a2-aba4-203c34a2bc61 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:49.886377 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208923-e858-41a2-aba4-203c34a2bc61 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:49.886522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208923-e858-41a2-aba4-203c34a2bc61 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:49.888398 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 522/1052] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:49.894648 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05d2f0-03d5-44e4-acdc-a5ea5ea489a7 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:49.895475 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05d2f0-03d5-44e4-acdc-a5ea5ea489a7 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:49.895609 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05d2f0-03d5-44e4-acdc-a5ea5ea489a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:49.914989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-1b05d2f0-03d5-44e4-acdc-a5ea5ea489a7 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:49.916406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-1b05d2f0-03d5-44e4-acdc-a5ea5ea489a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:49.939978 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03499f-378f-4ff0-9072-1d4d27f7b7e7 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:49.940265 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03499f-378f-4ff0-9072-1d4d27f7b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:49.940606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03499f-378f-4ff0-9072-1d4d27f7b7e7 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:49.941922 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 523/1053] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:04:49.948508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677b70-5a93-47f4-a828-21f7474eec64 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:49.948772 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677b70-5a93-47f4-a828-21f7474eec64 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:49.949149 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677b70-5a93-47f4-a828-21f7474eec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:49.969457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-48677b70-5a93-47f4-a828-21f7474eec64 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:49.971359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-48677b70-5a93-47f4-a828-21f7474eec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:50.018653 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 531/1054] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:50.046776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05d2f0-03d5-44e4-acdc-a5ea5ea489a7 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:50.063217 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 524/1055] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:50.074054 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:50.086566 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48677b70-5a93-47f4-a828-21f7474eec64 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:50.106273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:50.179131 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05d2f0-03d5-44e4-acdc-a5ea5ea489a7 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:50.225583 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48677b70-5a93-47f4-a828-21f7474eec64 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:50.237375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726978b-ec40-440d-a07c-9ee4f1955ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:50.238766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726978b-ec40-440d-a07c-9ee4f1955ecb None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:50.239253 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726978b-ec40-440d-a07c-9ee4f1955ecb None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:50.239741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726978b-ec40-440d-a07c-9ee4f1955ecb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:50.255188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726978b-ec40-440d-a07c-9ee4f1955ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-9726978b-ec40-440d-a07c-9ee4f1955ecb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:50.263623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:50.264736 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:50.265578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 532/1056] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:04:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:50.271304 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726978b-ec40-440d-a07c-9ee4f1955ecb None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:50.273101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2d069-d038-493f-bab2-01e27ee262e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:50.274091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2d069-d038-493f-bab2-01e27ee262e4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:50.274391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2d069-d038-493f-bab2-01e27ee262e4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:50.274765 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2d069-d038-493f-bab2-01e27ee262e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:50.289920 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2d069-d038-493f-bab2-01e27ee262e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-30e2d069-d038-493f-bab2-01e27ee262e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:50.299594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:50.300514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:50.301285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 525/1057] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:04:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:50.307745 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2d069-d038-493f-bab2-01e27ee262e4 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:50.384301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:50.409356 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:50.410855 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726978b-ec40-440d-a07c-9ee4f1955ecb None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:50.439965 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2d069-d038-493f-bab2-01e27ee262e4 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:50.451123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7e641-0f08-41ae-93bb-8269a9683e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:50.451814 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7e641-0f08-41ae-93bb-8269a9683e07 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:50.452096 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7e641-0f08-41ae-93bb-8269a9683e07 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:50.452375 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7e641-0f08-41ae-93bb-8269a9683e07 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:50.453160 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7e641-0f08-41ae-93bb-8269a9683e07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:50.453469 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7e641-0f08-41ae-93bb-8269a9683e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:50.454960 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7e641-0f08-41ae-93bb-8269a9683e07 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:50.469619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 533/1058] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:04:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:50.469619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555741c-f9e5-4c0e-a343-64a73c0d580c None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:50.469619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555741c-f9e5-4c0e-a343-64a73c0d580c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:50.469619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555741c-f9e5-4c0e-a343-64a73c0d580c None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:50.469619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 534/1059] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:50.472998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555741c-f9e5-4c0e-a343-64a73c0d580c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:50.488335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a182bf-6d87-4cd1-8784-1b284f9b0701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:50.488588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a182bf-6d87-4cd1-8784-1b284f9b0701 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:50.489284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a182bf-6d87-4cd1-8784-1b284f9b0701 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:50.489284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a182bf-6d87-4cd1-8784-1b284f9b0701 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:50.489908 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a182bf-6d87-4cd1-8784-1b284f9b0701 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:50.490843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a182bf-6d87-4cd1-8784-1b284f9b0701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:50.491719 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a182bf-6d87-4cd1-8784-1b284f9b0701 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:50.507146 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 526/1060] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:04:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:50.507146 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da52b8-6b19-400c-9427-0575eba6eae4 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:50.507146 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da52b8-6b19-400c-9427-0575eba6eae4 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:50.507146 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da52b8-6b19-400c-9427-0575eba6eae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:50.568135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-28da52b8-6b19-400c-9427-0575eba6eae4 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:50.570268 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-28da52b8-6b19-400c-9427-0575eba6eae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:50.626058 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555741c-f9e5-4c0e-a343-64a73c0d580c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:50.646640 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 527/1061] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:50.647484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da52b8-6b19-400c-9427-0575eba6eae4 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:50.667677 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a868bf-d2dd-4462-bc30-aa9390103a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:50.668651 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a868bf-d2dd-4462-bc30-aa9390103a36 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:50.669401 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a868bf-d2dd-4462-bc30-aa9390103a36 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:50.669686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a868bf-d2dd-4462-bc30-aa9390103a36 None admin] PATH_INFO: `/v3/users/0d820634b7e34468bc352d3525f727c1` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:50.681952 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:50.684477 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a868bf-d2dd-4462-bc30-aa9390103a36 None admin] RBAC: Authorizing `identity:get_user(user_id=0d820634b7e34468bc352d3525f727c1)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:50.685936 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a868bf-d2dd-4462-bc30-aa9390103a36 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:50.687682 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 535/1062] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:04:50 2022] GET /identity/v3/users/0d820634b7e34468bc352d3525f727c1 => generated 285 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:50.690976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a868bf-d2dd-4462-bc30-aa9390103a36 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:50.716578 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:50.750837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da52b8-6b19-400c-9427-0575eba6eae4 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:50.787000 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b1c56-f151-4f50-8dcc-bf7daa69fabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:50.787797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b1c56-f151-4f50-8dcc-bf7daa69fabb None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:50.788082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b1c56-f151-4f50-8dcc-bf7daa69fabb None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:50.788359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b1c56-f151-4f50-8dcc-bf7daa69fabb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:50.789351 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a868bf-d2dd-4462-bc30-aa9390103a36 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:50.799016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b1c56-f151-4f50-8dcc-bf7daa69fabb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:50.800498 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b1c56-f151-4f50-8dcc-bf7daa69fabb None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-060b1c56-f151-4f50-8dcc-bf7daa69fabb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:50.819408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:50.820300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:50.821154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:50.821154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:50.821154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:50.821154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:50.821154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 528/1063] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:50.821477 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b1c56-f151-4f50-8dcc-bf7daa69fabb None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:50.826273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105984a6-2a3b-4fd8-bd51-3f2e756911f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:50.826960 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105984a6-2a3b-4fd8-bd51-3f2e756911f5 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:50.827238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105984a6-2a3b-4fd8-bd51-3f2e756911f5 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:50.827508 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105984a6-2a3b-4fd8-bd51-3f2e756911f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:50.896854 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:50.899701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105984a6-2a3b-4fd8-bd51-3f2e756911f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:50.901717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105984a6-2a3b-4fd8-bd51-3f2e756911f5 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:50.931558 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b1c56-f151-4f50-8dcc-bf7daa69fabb None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:50.954117 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:50.973092 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a730c5a-1c9b-4ed6-9c4b-0afcb7d959ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:50.973748 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a730c5a-1c9b-4ed6-9c4b-0afcb7d959ef None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:50.974077 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a730c5a-1c9b-4ed6-9c4b-0afcb7d959ef None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:50.974650 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a730c5a-1c9b-4ed6-9c4b-0afcb7d959ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:51.020811 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 536/1064] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:04:51.021673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105984a6-2a3b-4fd8-bd51-3f2e756911f5 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:51.060241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a730c5a-1c9b-4ed6-9c4b-0afcb7d959ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:51.061706 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a730c5a-1c9b-4ed6-9c4b-0afcb7d959ef None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:51.139952 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:51.143549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105984a6-2a3b-4fd8-bd51-3f2e756911f5 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:51.176865 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 529/1065] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:04:51.178039 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a730c5a-1c9b-4ed6-9c4b-0afcb7d959ef None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:51.185996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf3524-4759-4c61-aa42-6c1330c9439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:51.186701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf3524-4759-4c61-aa42-6c1330c9439b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:51.186987 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf3524-4759-4c61-aa42-6c1330c9439b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:51.187263 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf3524-4759-4c61-aa42-6c1330c9439b None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:51.188003 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf3524-4759-4c61-aa42-6c1330c9439b None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:51.188311 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf3524-4759-4c61-aa42-6c1330c9439b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:51.189705 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf3524-4759-4c61-aa42-6c1330c9439b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:51.196978 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:51.204605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 537/1066] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:51.205369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf3524-4759-4c61-aa42-6c1330c9439b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:51.286323 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a730c5a-1c9b-4ed6-9c4b-0afcb7d959ef None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:51.320744 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf3524-4759-4c61-aa42-6c1330c9439b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:51.323541 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea31bcd-5686-4513-aae4-0893b7b36b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:51.324338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea31bcd-5686-4513-aae4-0893b7b36b2b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:51.324616 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea31bcd-5686-4513-aae4-0893b7b36b2b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:51.324891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea31bcd-5686-4513-aae4-0893b7b36b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:51.334974 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea31bcd-5686-4513-aae4-0893b7b36b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:51.336702 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea31bcd-5686-4513-aae4-0893b7b36b2b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:51.354510 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c2576-e485-47c9-ab95-87d3bd94eaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-9ea31bcd-5686-4513-aae4-0893b7b36b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:51.355342 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:51.356302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:51.357417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:51.357417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:51.357417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:51.357417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:51.357871 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c2576-e485-47c9-ab95-87d3bd94eaae None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:51.357871 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c2576-e485-47c9-ab95-87d3bd94eaae None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:51.357871 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c2576-e485-47c9-ab95-87d3bd94eaae None admin] PATH_INFO: `/v3/projects/487da7fb241644edb658400dc131aaba` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:51.358095 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 530/1067] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:51.358095 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea31bcd-5686-4513-aae4-0893b7b36b2b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:51.358239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c2576-e485-47c9-ab95-87d3bd94eaae None admin] RBAC: Authorizing `identity:get_project(project_id=487da7fb241644edb658400dc131aaba)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:51.358835 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c2576-e485-47c9-ab95-87d3bd94eaae None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:51.365497 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 538/1068] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:04:51 2022] GET /identity/v3/projects/487da7fb241644edb658400dc131aaba => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:51.365497 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c2576-e485-47c9-ab95-87d3bd94eaae None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:51.390348 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:51.431008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:51.465963 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c2576-e485-47c9-ab95-87d3bd94eaae None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:51.467170 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea31bcd-5686-4513-aae4-0893b7b36b2b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:51.500945 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2f51f-d3f3-4efc-83c3-ffe05f73fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:51.501617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f51f-d3f3-4efc-83c3-ffe05f73fe9d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:51.501901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f51f-d3f3-4efc-83c3-ffe05f73fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:51.502178 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f51f-d3f3-4efc-83c3-ffe05f73fe9d None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:51.502946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2f51f-d3f3-4efc-83c3-ffe05f73fe9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:51.503253 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2f51f-d3f3-4efc-83c3-ffe05f73fe9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:51.503381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50a256-07e7-46fc-9cfb-7172a0759efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:51.504134 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50a256-07e7-46fc-9cfb-7172a0759efc None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:51.504416 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50a256-07e7-46fc-9cfb-7172a0759efc None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:51.504649 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2f51f-d3f3-4efc-83c3-ffe05f73fe9d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:51.504786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50a256-07e7-46fc-9cfb-7172a0759efc None admin] PATH_INFO: `/v3/users/nova` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:51.514582 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50a256-07e7-46fc-9cfb-7172a0759efc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:51.516079 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50a256-07e7-46fc-9cfb-7172a0759efc None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:51.518349 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 539/1069] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:51.519229 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2f51f-d3f3-4efc-83c3-ffe05f73fe9d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-3b50a256-07e7-46fc-9cfb-7172a0759efc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:51.543140 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:51.544133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:51.544985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:51.544985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:51.544985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:51.544985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:51.544985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:51.544985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:51.544985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:51.544985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:51.544985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:04:51.544985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:51.544985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 531/1070] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:04:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:51.551452 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50a256-07e7-46fc-9cfb-7172a0759efc None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:51.640445 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:51.658978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2f51f-d3f3-4efc-83c3-ffe05f73fe9d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:51.685270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50a256-07e7-46fc-9cfb-7172a0759efc None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:51.700614 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3a9f1-de7c-4e65-8430-a3332341b1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:51.701285 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3a9f1-de7c-4e65-8430-a3332341b1dd None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:51.701560 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3a9f1-de7c-4e65-8430-a3332341b1dd None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:51.701832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3a9f1-de7c-4e65-8430-a3332341b1dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:51.702709 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3a9f1-de7c-4e65-8430-a3332341b1dd None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=487da7fb241644edb658400dc131aaba, user.id=0d820634b7e34468bc352d3525f727c1) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:51.703023 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3a9f1-de7c-4e65-8430-a3332341b1dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:51.704483 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3a9f1-de7c-4e65-8430-a3332341b1dd None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:51.711089 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 540/1071] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:51 2022] GET /identity/v3/role_assignments?user.id=0d820634b7e34468bc352d3525f727c1&scope.project.id=487da7fb241644edb658400dc131aaba&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:51.731068 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:51.737625 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4171a-ec6b-4d8c-ba58-b656cb9624e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:51.738431 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4171a-ec6b-4d8c-ba58-b656cb9624e2 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:51.748726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4171a-ec6b-4d8c-ba58-b656cb9624e2 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:51.748726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4171a-ec6b-4d8c-ba58-b656cb9624e2 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:51.748726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4171a-ec6b-4d8c-ba58-b656cb9624e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:51.748726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4171a-ec6b-4d8c-ba58-b656cb9624e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:51.748726 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4171a-ec6b-4d8c-ba58-b656cb9624e2 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:51.764858 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 532/1072] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:04:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:51.771049 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3a9f1-de7c-4e65-8430-a3332341b1dd None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:51.913934 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3a9f1-de7c-4e65-8430-a3332341b1dd None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:51.952985 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81068824-e974-4338-a0a7-ae133777c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:51.953790 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81068824-e974-4338-a0a7-ae133777c232 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:51.954073 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81068824-e974-4338-a0a7-ae133777c232 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:51.954347 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81068824-e974-4338-a0a7-ae133777c232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:51.965691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81068824-e974-4338-a0a7-ae133777c232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:51.967235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81068824-e974-4338-a0a7-ae133777c232 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-81068824-e974-4338-a0a7-ae133777c232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:51.987091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:51.988157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:51.994134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:51.994134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:51.994134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:51.994134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:51.994134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 541/1073] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:51.995776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4171a-ec6b-4d8c-ba58-b656cb9624e2 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:52.109711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4171a-ec6b-4d8c-ba58-b656cb9624e2 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:52.147062 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1661de0-f293-4a9d-888d-a48a72410357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:52.148146 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1661de0-f293-4a9d-888d-a48a72410357 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:52.148620 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1661de0-f293-4a9d-888d-a48a72410357 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:52.149090 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1661de0-f293-4a9d-888d-a48a72410357 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:52.150394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1661de0-f293-4a9d-888d-a48a72410357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:52.151016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1661de0-f293-4a9d-888d-a48a72410357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:52.153498 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1661de0-f293-4a9d-888d-a48a72410357 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:52.167824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 533/1074] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:52.173333 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81068824-e974-4338-a0a7-ae133777c232 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:52.177352 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:52.283314 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81068824-e974-4338-a0a7-ae133777c232 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:52.317989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331cd9e-bb86-4860-9da3-8cc12ce6b567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:52.318820 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331cd9e-bb86-4860-9da3-8cc12ce6b567 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:52.319107 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331cd9e-bb86-4860-9da3-8cc12ce6b567 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:52.319384 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331cd9e-bb86-4860-9da3-8cc12ce6b567 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:52.326114 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331cd9e-bb86-4860-9da3-8cc12ce6b567 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:52.327600 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331cd9e-bb86-4860-9da3-8cc12ce6b567 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-3331cd9e-bb86-4860-9da3-8cc12ce6b567 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:52.341727 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:52.342534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:52.343413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:52.343413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:52.343413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:52.343413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:52.343413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:52.343413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:52.343413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:52.343413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:52.343413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 542/1075] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:52.348709 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1661de0-f293-4a9d-888d-a48a72410357 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:52.398416 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:52.450130 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1661de0-f293-4a9d-888d-a48a72410357 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:52.484141 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74e812-8872-4a10-adad-9111ba59f901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:52.484804 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74e812-8872-4a10-adad-9111ba59f901 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:52.485089 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74e812-8872-4a10-adad-9111ba59f901 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:52.485364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74e812-8872-4a10-adad-9111ba59f901 None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:52.486152 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74e812-8872-4a10-adad-9111ba59f901 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:52.486462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74e812-8872-4a10-adad-9111ba59f901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:52.487928 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74e812-8872-4a10-adad-9111ba59f901 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:52.502528 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 534/1076] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:52.508779 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331cd9e-bb86-4860-9da3-8cc12ce6b567 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:52.574303 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:52.611795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331cd9e-bb86-4860-9da3-8cc12ce6b567 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:52.645378 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a1bf1-8697-490c-8f25-1dcb6c0e6436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:52.646262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1bf1-8697-490c-8f25-1dcb6c0e6436 None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:52.646545 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1bf1-8697-490c-8f25-1dcb6c0e6436 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:52.646848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1bf1-8697-490c-8f25-1dcb6c0e6436 None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/e0b88c1582c849349cc441446f6cca20/roles/67f40b8de4bf4007a76e72baba6aba0e` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:52.649080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a1bf1-8697-490c-8f25-1dcb6c0e6436 None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=e0b88c1582c849349cc441446f6cca20, role_id=67f40b8de4bf4007a76e72baba6aba0e)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:52.650529 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a1bf1-8697-490c-8f25-1dcb6c0e6436 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:52.713640 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 543/1077] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:04:52 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/e0b88c1582c849349cc441446f6cca20/roles/67f40b8de4bf4007a76e72baba6aba0e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:04:53.969867 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5f74d-322c-4d9f-abbf-4878c2742b2f None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:53.970395 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5f74d-322c-4d9f-abbf-4878c2742b2f None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:53.970591 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5f74d-322c-4d9f-abbf-4878c2742b2f None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:53.971996 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 535/1078] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:53.977445 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb5fc7-e513-4515-9ddf-c30554e04880 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:53.977876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb5fc7-e513-4515-9ddf-c30554e04880 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:53.978007 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb5fc7-e513-4515-9ddf-c30554e04880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:53.995559 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-6cfb5fc7-e513-4515-9ddf-c30554e04880 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:53.996759 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-6cfb5fc7-e513-4515-9ddf-c30554e04880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:54.074390 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 544/1079] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:54.097236 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5f74d-322c-4d9f-abbf-4878c2742b2f None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:54.201828 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5f74d-322c-4d9f-abbf-4878c2742b2f None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:54.212017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:54.244036 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ace19-2724-4194-b5f3-529b5f774f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:54.245407 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ace19-2724-4194-b5f3-529b5f774f20 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:54.245689 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ace19-2724-4194-b5f3-529b5f774f20 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:54.245963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ace19-2724-4194-b5f3-529b5f774f20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:54.257487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ace19-2724-4194-b5f3-529b5f774f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-931ace19-2724-4194-b5f3-529b5f774f20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:54.265324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:54.266359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:54.267254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 536/1080] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:04:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:54.272661 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb5fc7-e513-4515-9ddf-c30554e04880 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:54.329055 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:54.374449 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb5fc7-e513-4515-9ddf-c30554e04880 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:54.408993 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7c182-a7d7-465b-a998-4270fe9bb67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:54.409664 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7c182-a7d7-465b-a998-4270fe9bb67f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:54.409944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7c182-a7d7-465b-a998-4270fe9bb67f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:54.410225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7c182-a7d7-465b-a998-4270fe9bb67f None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:54.411005 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7c182-a7d7-465b-a998-4270fe9bb67f None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:54.411312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7c182-a7d7-465b-a998-4270fe9bb67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:54.412687 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7c182-a7d7-465b-a998-4270fe9bb67f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:54.421523 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 545/1081] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:04:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:54.427462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ace19-2724-4194-b5f3-529b5f774f20 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:54.535454 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ace19-2724-4194-b5f3-529b5f774f20 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:54.569012 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01968de-244c-4c33-9250-07139ab3290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:54.569886 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01968de-244c-4c33-9250-07139ab3290a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:54.570169 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01968de-244c-4c33-9250-07139ab3290a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:54.570443 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01968de-244c-4c33-9250-07139ab3290a None admin] PATH_INFO: `/v3/users/0d820634b7e34468bc352d3525f727c1` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:54.571675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01968de-244c-4c33-9250-07139ab3290a None admin] RBAC: Authorizing `identity:get_user(user_id=0d820634b7e34468bc352d3525f727c1)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:54.573693 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01968de-244c-4c33-9250-07139ab3290a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:54.575378 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 537/1082] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:04:54 2022] GET /identity/v3/users/0d820634b7e34468bc352d3525f727c1 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:54.581174 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7c182-a7d7-465b-a998-4270fe9bb67f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:54.682741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7c182-a7d7-465b-a998-4270fe9bb67f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:54.699552 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:54.717380 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd5ef7-9c23-4acb-a5f4-0db2838e9acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:54.718246 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5ef7-9c23-4acb-a5f4-0db2838e9acf None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:54.718524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5ef7-9c23-4acb-a5f4-0db2838e9acf None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:54.718827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5ef7-9c23-4acb-a5f4-0db2838e9acf None admin] PATH_INFO: `/v3/projects/487da7fb241644edb658400dc131aaba` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:54.720012 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd5ef7-9c23-4acb-a5f4-0db2838e9acf None admin] RBAC: Authorizing `identity:get_project(project_id=487da7fb241644edb658400dc131aaba)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:54.721444 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd5ef7-9c23-4acb-a5f4-0db2838e9acf None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:54.723208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 546/1083] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:04:54 2022] GET /identity/v3/projects/487da7fb241644edb658400dc131aaba => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:54.729225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01968de-244c-4c33-9250-07139ab3290a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:54.765914 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:54.833662 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01968de-244c-4c33-9250-07139ab3290a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:54.867691 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945a5c5-f31a-4beb-ada4-128bbc489832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:54.868591 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a5c5-f31a-4beb-ada4-128bbc489832 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:54.868872 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a5c5-f31a-4beb-ada4-128bbc489832 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:54.869146 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a5c5-f31a-4beb-ada4-128bbc489832 None admin] PATH_INFO: `/v3/projects/487da7fb241644edb658400dc131aaba/users/0d820634b7e34468bc352d3525f727c1/roles/38e07a16dc8b4306be7688b9d5cd626b` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:54.871853 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945a5c5-f31a-4beb-ada4-128bbc489832 None admin] RBAC: Authorizing `identity:create_grant(project_id=487da7fb241644edb658400dc131aaba, user_id=0d820634b7e34468bc352d3525f727c1, role_id=38e07a16dc8b4306be7688b9d5cd626b)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:54.873380 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945a5c5-f31a-4beb-ada4-128bbc489832 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:54.954069 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 538/1084] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:04:54 2022] PUT /identity/v3/projects/487da7fb241644edb658400dc131aaba/users/0d820634b7e34468bc352d3525f727c1/roles/38e07a16dc8b4306be7688b9d5cd626b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:04:54.964939 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f71b-70d3-4190-afc5-05872d494ea6 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:54.965351 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f71b-70d3-4190-afc5-05872d494ea6 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:54.965673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f71b-70d3-4190-afc5-05872d494ea6 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:54.967243 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 547/1085] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:04:54.973273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b2a1f-f0d1-4fe5-90e7-fb60231c7296 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:54.973835 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b2a1f-f0d1-4fe5-90e7-fb60231c7296 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:54.973987 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b2a1f-f0d1-4fe5-90e7-fb60231c7296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:54.992774 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-ee7b2a1f-f0d1-4fe5-90e7-fb60231c7296 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:54.994045 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-ee7b2a1f-f0d1-4fe5-90e7-fb60231c7296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:55.070323 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 539/1086] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:04:55.097269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f71b-70d3-4190-afc5-05872d494ea6 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:55.208671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f71b-70d3-4190-afc5-05872d494ea6 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:55.248470 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e52894-18d3-4def-8cb3-851ef0d7981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:55.249294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52894-18d3-4def-8cb3-851ef0d7981a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:55.249577 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52894-18d3-4def-8cb3-851ef0d7981a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:55.249853 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52894-18d3-4def-8cb3-851ef0d7981a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:55.260816 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e52894-18d3-4def-8cb3-851ef0d7981a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-f4e52894-18d3-4def-8cb3-851ef0d7981a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:55.269033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:55.269884 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:55.270683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 548/1087] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:04:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:55.276334 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b2a1f-f0d1-4fe5-90e7-fb60231c7296 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:55.303819 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:55.377446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b2a1f-f0d1-4fe5-90e7-fb60231c7296 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:55.412232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d6b7-4c18-4e5b-84e9-3c1f508f0c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:55.412907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d6b7-4c18-4e5b-84e9-3c1f508f0c4f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:55.413194 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d6b7-4c18-4e5b-84e9-3c1f508f0c4f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:55.413472 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d6b7-4c18-4e5b-84e9-3c1f508f0c4f None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:55.414230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6d6b7-4c18-4e5b-84e9-3c1f508f0c4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:55.414538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6d6b7-4c18-4e5b-84e9-3c1f508f0c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:55.415938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6d6b7-4c18-4e5b-84e9-3c1f508f0c4f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:55.424996 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 540/1088] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:04:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:55.430904 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e52894-18d3-4def-8cb3-851ef0d7981a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:55.477691 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:55.535535 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e52894-18d3-4def-8cb3-851ef0d7981a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:55.570539 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c064225-a0be-4cda-8605-4ab04a7225d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:55.571350 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c064225-a0be-4cda-8605-4ab04a7225d4 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:55.571624 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c064225-a0be-4cda-8605-4ab04a7225d4 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:55.571895 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c064225-a0be-4cda-8605-4ab04a7225d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:55.581878 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c064225-a0be-4cda-8605-4ab04a7225d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:55.583631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c064225-a0be-4cda-8605-4ab04a7225d4 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-5c064225-a0be-4cda-8605-4ab04a7225d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:55.601296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:55.602330 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:55.603350 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:55.603350 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:55.603350 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:55.603350 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:55.603350 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 549/1089] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:55.608780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d6b7-4c18-4e5b-84e9-3c1f508f0c4f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:55.696967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:55.709442 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d6b7-4c18-4e5b-84e9-3c1f508f0c4f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:55.742789 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72792e-8d6a-4613-981d-3d6915ace289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:55.743450 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72792e-8d6a-4613-981d-3d6915ace289 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:55.743729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72792e-8d6a-4613-981d-3d6915ace289 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:55.744001 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72792e-8d6a-4613-981d-3d6915ace289 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:55.744746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72792e-8d6a-4613-981d-3d6915ace289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:55.745046 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72792e-8d6a-4613-981d-3d6915ace289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:55.746463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72792e-8d6a-4613-981d-3d6915ace289 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:55.758359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 541/1090] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:55.764506 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c064225-a0be-4cda-8605-4ab04a7225d4 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:55.860657 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:55.866413 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c064225-a0be-4cda-8605-4ab04a7225d4 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:55.900927 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21f214-f8f8-4d1d-8af1-db602bfc89d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:55.902241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21f214-f8f8-4d1d-8af1-db602bfc89d0 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:55.902523 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21f214-f8f8-4d1d-8af1-db602bfc89d0 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:55.902818 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21f214-f8f8-4d1d-8af1-db602bfc89d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:55.910533 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21f214-f8f8-4d1d-8af1-db602bfc89d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:55.912043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21f214-f8f8-4d1d-8af1-db602bfc89d0 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-dd21f214-f8f8-4d1d-8af1-db602bfc89d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:04:55.925807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:55.926698 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:55.927569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:55.927569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:55.927569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:04:55.927569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:04:55.927569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:04:55.927569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:04:55.927569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:04:55.927569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:04:55.927569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:04:55.927569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:04:55.927569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 550/1091] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:04:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:55.933272 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72792e-8d6a-4613-981d-3d6915ace289 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:56.034444 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72792e-8d6a-4613-981d-3d6915ace289 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:56.081687 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0d588-b069-4674-b0dd-e298bee05ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:56.082380 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0d588-b069-4674-b0dd-e298bee05ca7 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:56.082692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0d588-b069-4674-b0dd-e298bee05ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:56.083081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0d588-b069-4674-b0dd-e298bee05ca7 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:56.084118 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0d588-b069-4674-b0dd-e298bee05ca7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:56.084431 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0d588-b069-4674-b0dd-e298bee05ca7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:56.085878 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0d588-b069-4674-b0dd-e298bee05ca7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:56.104052 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 542/1092] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:04:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:56.109856 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21f214-f8f8-4d1d-8af1-db602bfc89d0 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:56.213521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21f214-f8f8-4d1d-8af1-db602bfc89d0 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:56.248191 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cf83d-cc9f-4e11-bf89-50fe3b4e686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:56.248816 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cf83d-cc9f-4e11-bf89-50fe3b4e686d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:56.249105 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cf83d-cc9f-4e11-bf89-50fe3b4e686d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:56.249380 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cf83d-cc9f-4e11-bf89-50fe3b4e686d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:56.275098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:56.319485 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cf83d-cc9f-4e11-bf89-50fe3b4e686d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:56.321050 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cf83d-cc9f-4e11-bf89-50fe3b4e686d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:56.425447 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 551/1093] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:04:56.431877 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0d588-b069-4674-b0dd-e298bee05ca7 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:56.441765 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:56.535606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0d588-b069-4674-b0dd-e298bee05ca7 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:56.570675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173493e-f1ce-4dc2-ba10-b28298c1b7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:56.571402 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173493e-f1ce-4dc2-ba10-b28298c1b7cc None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:56.571686 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173493e-f1ce-4dc2-ba10-b28298c1b7cc None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:56.571963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173493e-f1ce-4dc2-ba10-b28298c1b7cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:56.582301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173493e-f1ce-4dc2-ba10-b28298c1b7cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:56.583807 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173493e-f1ce-4dc2-ba10-b28298c1b7cc None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-3173493e-f1ce-4dc2-ba10-b28298c1b7cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:04:56.601757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:56.602813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:56.604538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:04:56.604538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:04:56.604538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:04:56.604538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:56.604538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 543/1094] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:56.609180 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cf83d-cc9f-4e11-bf89-50fe3b4e686d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:56.665672 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:56.711690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cf83d-cc9f-4e11-bf89-50fe3b4e686d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:56.747034 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bd021-4c35-4dd4-95df-88c51bd9730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:56.747711 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bd021-4c35-4dd4-95df-88c51bd9730c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:56.747993 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bd021-4c35-4dd4-95df-88c51bd9730c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:56.748270 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bd021-4c35-4dd4-95df-88c51bd9730c None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:56.749003 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bd021-4c35-4dd4-95df-88c51bd9730c None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:56.749311 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bd021-4c35-4dd4-95df-88c51bd9730c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:56.750718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bd021-4c35-4dd4-95df-88c51bd9730c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:56.762349 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 552/1095] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:04:56.768015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173493e-f1ce-4dc2-ba10-b28298c1b7cc None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:56.830984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:56.873727 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173493e-f1ce-4dc2-ba10-b28298c1b7cc None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:56.908811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e440-b6e2-44d9-92e5-9cbf47a80442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:56.909602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e440-b6e2-44d9-92e5-9cbf47a80442 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:56.909877 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e440-b6e2-44d9-92e5-9cbf47a80442 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:56.910147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e440-b6e2-44d9-92e5-9cbf47a80442 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:56.917033 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649e440-b6e2-44d9-92e5-9cbf47a80442 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:56.918494 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649e440-b6e2-44d9-92e5-9cbf47a80442 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-e649e440-b6e2-44d9-92e5-9cbf47a80442 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:04:56.933114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:56.933985 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:56.934874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:04:56.934874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:04:56.934874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:04:56.934874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:04:56.934874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:04:56.934874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:04:56.934874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:04:56.934874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:56.934874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 544/1096] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:04:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:04:56.940373 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bd021-4c35-4dd4-95df-88c51bd9730c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:57.046315 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bd021-4c35-4dd4-95df-88c51bd9730c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:57.063393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:57.081526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31780f-5780-49bc-bb76-02ab7a4e4bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:57.081978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31780f-5780-49bc-bb76-02ab7a4e4bd6 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:57.082264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31780f-5780-49bc-bb76-02ab7a4e4bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:57.082563 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31780f-5780-49bc-bb76-02ab7a4e4bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:57.083421 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31780f-5780-49bc-bb76-02ab7a4e4bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:57.083733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31780f-5780-49bc-bb76-02ab7a4e4bd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:57.085167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31780f-5780-49bc-bb76-02ab7a4e4bd6 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:57.097887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 553/1097] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:04:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:57.103862 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e440-b6e2-44d9-92e5-9cbf47a80442 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:57.198797 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ece6-3743-48f6-b7d3-22d01c06a5ab None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:57.199538 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ece6-3743-48f6-b7d3-22d01c06a5ab None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:57.199538 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ece6-3743-48f6-b7d3-22d01c06a5ab None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:57.200937 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 554/1098] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:04:57.205851 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e613f6-d26a-46e7-bb27-c6136deb4cf8 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:57.206138 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e613f6-d26a-46e7-bb27-c6136deb4cf8 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:57.206416 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e613f6-d26a-46e7-bb27-c6136deb4cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:57.207533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e440-b6e2-44d9-92e5-9cbf47a80442 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:57.225210 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:57.226498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-f1e613f6-d26a-46e7-bb27-c6136deb4cf8 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:04:57.227741 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-f1e613f6-d26a-46e7-bb27-c6136deb4cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:04:57.242525 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685884a8-3605-4463-a14a-e6362a9fc088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:57.246499 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685884a8-3605-4463-a14a-e6362a9fc088 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:57.246499 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685884a8-3605-4463-a14a-e6362a9fc088 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:57.246499 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685884a8-3605-4463-a14a-e6362a9fc088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:57.246499 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685884a8-3605-4463-a14a-e6362a9fc088 None admin] RBAC: Adding query filter params (role.id=67f40b8de4bf4007a76e72baba6aba0e, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=e0b88c1582c849349cc441446f6cca20) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:57.246499 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685884a8-3605-4463-a14a-e6362a9fc088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:57.247159 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685884a8-3605-4463-a14a-e6362a9fc088 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:57.253018 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 545/1099] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:57 2022] GET /identity/v3/role_assignments?user.id=e0b88c1582c849349cc441446f6cca20&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=67f40b8de4bf4007a76e72baba6aba0e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:57.306585 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 555/1100] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:04:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:04:57.333006 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685884a8-3605-4463-a14a-e6362a9fc088 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:57.442641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685884a8-3605-4463-a14a-e6362a9fc088 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:57.477266 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb582dc-3035-4a8a-a107-d87decf4c47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:57.478116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb582dc-3035-4a8a-a107-d87decf4c47e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:57.478404 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb582dc-3035-4a8a-a107-d87decf4c47e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:57.478729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb582dc-3035-4a8a-a107-d87decf4c47e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:57.490475 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb582dc-3035-4a8a-a107-d87decf4c47e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-ceb582dc-3035-4a8a-a107-d87decf4c47e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:04:57.498815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:04:57.499836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:04:57.500646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 546/1101] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:04:57.506272 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e613f6-d26a-46e7-bb27-c6136deb4cf8 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:57.610517 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e613f6-d26a-46e7-bb27-c6136deb4cf8 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:57.617987 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:57.645826 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd50a7-45f7-4acc-ac7d-ca05b67e7f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:57.646498 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd50a7-45f7-4acc-ac7d-ca05b67e7f00 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:57.646810 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd50a7-45f7-4acc-ac7d-ca05b67e7f00 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:57.647088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd50a7-45f7-4acc-ac7d-ca05b67e7f00 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:57.647881 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd50a7-45f7-4acc-ac7d-ca05b67e7f00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:57.648225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd50a7-45f7-4acc-ac7d-ca05b67e7f00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:57.649581 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd50a7-45f7-4acc-ac7d-ca05b67e7f00 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:57.659323 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 556/1102] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:57.665296 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb582dc-3035-4a8a-a107-d87decf4c47e None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:57.715054 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:57.774874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb582dc-3035-4a8a-a107-d87decf4c47e None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:57.810586 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cab653-ef18-4e07-90ca-e758e549af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:57.811485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cab653-ef18-4e07-90ca-e758e549af9f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:57.811765 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cab653-ef18-4e07-90ca-e758e549af9f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:57.812042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cab653-ef18-4e07-90ca-e758e549af9f None admin] PATH_INFO: `/v3/users/0d820634b7e34468bc352d3525f727c1` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:57.813235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cab653-ef18-4e07-90ca-e758e549af9f None admin] RBAC: Authorizing `identity:get_user(user_id=0d820634b7e34468bc352d3525f727c1)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:57.814717 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cab653-ef18-4e07-90ca-e758e549af9f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:57.816383 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 547/1103] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:04:57 2022] GET /identity/v3/users/0d820634b7e34468bc352d3525f727c1 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:57.822475 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd50a7-45f7-4acc-ac7d-ca05b67e7f00 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:57.930301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd50a7-45f7-4acc-ac7d-ca05b67e7f00 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:57.966720 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbf7e0-6e15-48d0-8f4e-ad0cc2c08da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:57.967384 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbf7e0-6e15-48d0-8f4e-ad0cc2c08da1 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:57.967670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbf7e0-6e15-48d0-8f4e-ad0cc2c08da1 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:57.967955 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbf7e0-6e15-48d0-8f4e-ad0cc2c08da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:58.006320 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:58.041903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbf7e0-6e15-48d0-8f4e-ad0cc2c08da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:58.043409 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbf7e0-6e15-48d0-8f4e-ad0cc2c08da1 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:58.149382 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 557/1104] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:04:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:04:58.155554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cab653-ef18-4e07-90ca-e758e549af9f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:58.259277 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cab653-ef18-4e07-90ca-e758e549af9f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:58.269771 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:58.293779 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03af082-bc16-48f3-a1e3-5f841a11d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:58.294696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af082-bc16-48f3-a1e3-5f841a11d83d None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:58.294982 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af082-bc16-48f3-a1e3-5f841a11d83d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:58.295260 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af082-bc16-48f3-a1e3-5f841a11d83d None admin] PATH_INFO: `/v3/projects/487da7fb241644edb658400dc131aaba` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:58.296454 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03af082-bc16-48f3-a1e3-5f841a11d83d None admin] RBAC: Authorizing `identity:get_project(project_id=487da7fb241644edb658400dc131aaba)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:58.297893 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03af082-bc16-48f3-a1e3-5f841a11d83d None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:58.299645 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 548/1105] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:04:58 2022] GET /identity/v3/projects/487da7fb241644edb658400dc131aaba => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:04:58.306159 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbf7e0-6e15-48d0-8f4e-ad0cc2c08da1 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:04:58.372705 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:58.405429 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbf7e0-6e15-48d0-8f4e-ad0cc2c08da1 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:04:58.439890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b60db-3743-435c-9d83-7de2e70e881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:04:58.440529 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b60db-3743-435c-9d83-7de2e70e881e None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:04:58.440821 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b60db-3743-435c-9d83-7de2e70e881e None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:04:58.441089 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b60db-3743-435c-9d83-7de2e70e881e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:04:58.441922 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b60db-3743-435c-9d83-7de2e70e881e None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=487da7fb241644edb658400dc131aaba, user.id=0d820634b7e34468bc352d3525f727c1) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:04:58.442229 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b60db-3743-435c-9d83-7de2e70e881e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:04:58.443739 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b60db-3743-435c-9d83-7de2e70e881e None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:04:58.449560 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 558/1106] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:04:58 2022] GET /identity/v3/role_assignments?user.id=0d820634b7e34468bc352d3525f727c1&scope.project.id=487da7fb241644edb658400dc131aaba&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:00.708731 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52bbc3-3d00-48cb-bd44-ddb689f83941 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:00.709293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52bbc3-3d00-48cb-bd44-ddb689f83941 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:00.709293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52bbc3-3d00-48cb-bd44-ddb689f83941 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:00.710730 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 549/1107] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:00.715958 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff30bd-3a48-4e90-bc7d-f4c4f9c769f9 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:00.716385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff30bd-3a48-4e90-bc7d-f4c4f9c769f9 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:00.716492 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff30bd-3a48-4e90-bc7d-f4c4f9c769f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:00.733033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-acff30bd-3a48-4e90-bc7d-f4c4f9c769f9 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:00.734207 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-acff30bd-3a48-4e90-bc7d-f4c4f9c769f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:00.801029 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 559/1108] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:00.828195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52bbc3-3d00-48cb-bd44-ddb689f83941 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:00.930986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52bbc3-3d00-48cb-bd44-ddb689f83941 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:00.966546 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0531fd4-183c-487c-a197-7711eaff1626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:00.967305 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0531fd4-183c-487c-a197-7711eaff1626 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:00.967586 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0531fd4-183c-487c-a197-7711eaff1626 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:00.967858 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0531fd4-183c-487c-a197-7711eaff1626 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:00.969071 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0531fd4-183c-487c-a197-7711eaff1626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:00.970517 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0531fd4-183c-487c-a197-7711eaff1626 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:00.972200 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 550/1109] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:05:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:00.978157 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff30bd-3a48-4e90-bc7d-f4c4f9c769f9 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:01.039988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:01.079268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff30bd-3a48-4e90-bc7d-f4c4f9c769f9 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:01.114096 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93290-456c-4085-bbc7-3419c9bf9c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:01.114799 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93290-456c-4085-bbc7-3419c9bf9c3c None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:01.115084 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93290-456c-4085-bbc7-3419c9bf9c3c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:01.115362 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93290-456c-4085-bbc7-3419c9bf9c3c None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:01.116083 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93290-456c-4085-bbc7-3419c9bf9c3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:01.117525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93290-456c-4085-bbc7-3419c9bf9c3c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:01.227534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 560/1110] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:05:00 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:05:03.535651 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5003b-79b8-4997-9b37-0caa5a146b1a None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:03.536151 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5003b-79b8-4997-9b37-0caa5a146b1a None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:03.536151 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5003b-79b8-4997-9b37-0caa5a146b1a None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:03.537507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 551/1111] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:03.543422 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4c6b-76bb-43c0-b510-345e510ae01a None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:03.543852 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4c6b-76bb-43c0-b510-345e510ae01a None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:03.543978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4c6b-76bb-43c0-b510-345e510ae01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:03.561535 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-a4eb4c6b-76bb-43c0-b510-345e510ae01a None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:03.562762 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-a4eb4c6b-76bb-43c0-b510-345e510ae01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:03.630773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 561/1112] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:03.654222 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5003b-79b8-4997-9b37-0caa5a146b1a None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:03.702083 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:03.755711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5003b-79b8-4997-9b37-0caa5a146b1a None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:03.789958 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da896a-a76f-49f6-8478-aff0eafb52cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:03.790768 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da896a-a76f-49f6-8478-aff0eafb52cb None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:03.791057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da896a-a76f-49f6-8478-aff0eafb52cb None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:03.791887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da896a-a76f-49f6-8478-aff0eafb52cb None admin] PATH_INFO: `/v3/roles/4876e759b9504964a874992dc66b6df1` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:03.793376 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da896a-a76f-49f6-8478-aff0eafb52cb None admin] RBAC: Authorizing `identity:get_role(role_id=4876e759b9504964a874992dc66b6df1)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:03.794793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da896a-a76f-49f6-8478-aff0eafb52cb None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:03.796179 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 552/1113] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:03 2022] GET /identity/v3/roles/4876e759b9504964a874992dc66b6df1 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:03.802000 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb4c6b-76bb-43c0-b510-345e510ae01a None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:03.851211 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:03.902775 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb4c6b-76bb-43c0-b510-345e510ae01a None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:03.938371 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4d571-a59f-4acf-a472-8a898fee41cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:03.939282 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d571-a59f-4acf-a472-8a898fee41cc None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:03.939595 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d571-a59f-4acf-a472-8a898fee41cc None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:03.939886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d571-a59f-4acf-a472-8a898fee41cc None admin] PATH_INFO: `/v3/users/c9f97e2e7d05462595b2f85a71aa6403` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:03.953644 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4d571-a59f-4acf-a472-8a898fee41cc None admin] RBAC: Authorizing `identity:get_user(user_id=c9f97e2e7d05462595b2f85a71aa6403)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:03.955154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4d571-a59f-4acf-a472-8a898fee41cc None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:03.956864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 562/1114] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:03 2022] GET /identity/v3/users/c9f97e2e7d05462595b2f85a71aa6403 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:03.962784 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da896a-a76f-49f6-8478-aff0eafb52cb None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:04.063364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da896a-a76f-49f6-8478-aff0eafb52cb None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:04.078054 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:04.098499 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17f48c-991b-447e-b534-63fd6e03f5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:04.099312 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17f48c-991b-447e-b534-63fd6e03f5c0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:04.099597 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17f48c-991b-447e-b534-63fd6e03f5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:04.099877 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17f48c-991b-447e-b534-63fd6e03f5c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:04.177614 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17f48c-991b-447e-b534-63fd6e03f5c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:04.179357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17f48c-991b-447e-b534-63fd6e03f5c0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:04.279197 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 553/1115] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:05:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:05:04.285302 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4d571-a59f-4acf-a472-8a898fee41cc None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:04.387937 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4d571-a59f-4acf-a472-8a898fee41cc None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:04.394975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:04.422631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5268d-dd95-49fa-a49f-fc6d7c47a872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:04.423514 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5268d-dd95-49fa-a49f-fc6d7c47a872 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:04.423796 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5268d-dd95-49fa-a49f-fc6d7c47a872 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:04.424072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5268d-dd95-49fa-a49f-fc6d7c47a872 None admin] PATH_INFO: `/v3/projects/487da7fb241644edb658400dc131aaba` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:04.425259 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5268d-dd95-49fa-a49f-fc6d7c47a872 None admin] RBAC: Authorizing `identity:get_project(project_id=487da7fb241644edb658400dc131aaba)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:04.426733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5268d-dd95-49fa-a49f-fc6d7c47a872 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:04.428707 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 563/1116] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:05:04 2022] GET /identity/v3/projects/487da7fb241644edb658400dc131aaba => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:04.434990 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17f48c-991b-447e-b534-63fd6e03f5c0 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:04.450016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:04.536595 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17f48c-991b-447e-b534-63fd6e03f5c0 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:04.570833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b4c52-6aaf-43e4-b086-7c287b563dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:04.571485 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4c52-6aaf-43e4-b086-7c287b563dcf None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:04.571770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4c52-6aaf-43e4-b086-7c287b563dcf None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:04.572050 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4c52-6aaf-43e4-b086-7c287b563dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:04.573710 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b4c52-6aaf-43e4-b086-7c287b563dcf None admin] RBAC: Adding query filter params (role.id=4876e759b9504964a874992dc66b6df1, scope.project.id=487da7fb241644edb658400dc131aaba, user.id=c9f97e2e7d05462595b2f85a71aa6403) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:04.574102 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b4c52-6aaf-43e4-b086-7c287b563dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:04.575574 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b4c52-6aaf-43e4-b086-7c287b563dcf None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:04.581156 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 554/1117] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:05:04 2022] GET /identity/v3/role_assignments?user.id=c9f97e2e7d05462595b2f85a71aa6403&scope.project.id=487da7fb241644edb658400dc131aaba&role.id=4876e759b9504964a874992dc66b6df1 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:06.803812 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11669-1148-4abc-b5a0-2898ee2998e1 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:06.804373 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11669-1148-4abc-b5a0-2898ee2998e1 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:06.804373 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11669-1148-4abc-b5a0-2898ee2998e1 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:06.805740 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 564/1118] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:06.811669 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f19c20-9556-49ab-b8e9-85ffd84be02f None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:06.812060 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f19c20-9556-49ab-b8e9-85ffd84be02f None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:06.812223 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f19c20-9556-49ab-b8e9-85ffd84be02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:06.829461 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-91f19c20-9556-49ab-b8e9-85ffd84be02f None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:06.830673 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-91f19c20-9556-49ab-b8e9-85ffd84be02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:06.897086 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 555/1119] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:06.919482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a11669-1148-4abc-b5a0-2898ee2998e1 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:07.023979 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a11669-1148-4abc-b5a0-2898ee2998e1 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:07.059549 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24e0f1-b7c0-4d06-a581-fdad09ab86ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:07.060392 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24e0f1-b7c0-4d06-a581-fdad09ab86ff None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:07.060671 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24e0f1-b7c0-4d06-a581-fdad09ab86ff None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:07.060949 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24e0f1-b7c0-4d06-a581-fdad09ab86ff None admin] PATH_INFO: `/v3/roles/4876e759b9504964a874992dc66b6df1` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:07.062433 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24e0f1-b7c0-4d06-a581-fdad09ab86ff None admin] RBAC: Authorizing `identity:get_role(role_id=4876e759b9504964a874992dc66b6df1)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:07.063851 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24e0f1-b7c0-4d06-a581-fdad09ab86ff None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:07.065244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 565/1120] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:06 2022] GET /identity/v3/roles/4876e759b9504964a874992dc66b6df1 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:07.071172 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f19c20-9556-49ab-b8e9-85ffd84be02f None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:07.081389 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:07.170966 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f19c20-9556-49ab-b8e9-85ffd84be02f None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:07.205178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fe302-6c51-42a2-bf52-399efae9537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:07.206042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fe302-6c51-42a2-bf52-399efae9537d None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:07.206324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fe302-6c51-42a2-bf52-399efae9537d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:07.206599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fe302-6c51-42a2-bf52-399efae9537d None admin] PATH_INFO: `/v3/users/c9f97e2e7d05462595b2f85a71aa6403` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:07.207819 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fe302-6c51-42a2-bf52-399efae9537d None admin] RBAC: Authorizing `identity:get_user(user_id=c9f97e2e7d05462595b2f85a71aa6403)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:07.209269 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fe302-6c51-42a2-bf52-399efae9537d None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:07.210948 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 556/1121] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:07 2022] GET /identity/v3/users/c9f97e2e7d05462595b2f85a71aa6403 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:07.216935 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24e0f1-b7c0-4d06-a581-fdad09ab86ff None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:07.261471 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:07.320815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24e0f1-b7c0-4d06-a581-fdad09ab86ff None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:07.355163 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641edff-4cab-4ff5-8a6b-b165145fb7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:07.356007 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641edff-4cab-4ff5-8a6b-b165145fb7e7 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:07.356288 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641edff-4cab-4ff5-8a6b-b165145fb7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:07.356560 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641edff-4cab-4ff5-8a6b-b165145fb7e7 None admin] PATH_INFO: `/v3/projects/487da7fb241644edb658400dc131aaba` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:07.357747 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641edff-4cab-4ff5-8a6b-b165145fb7e7 None admin] RBAC: Authorizing `identity:get_project(project_id=487da7fb241644edb658400dc131aaba)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:07.359234 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641edff-4cab-4ff5-8a6b-b165145fb7e7 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:07.360959 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 566/1122] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:05:07 2022] GET /identity/v3/projects/487da7fb241644edb658400dc131aaba => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:07.367541 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fe302-6c51-42a2-bf52-399efae9537d None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:07.448350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:07.471240 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fe302-6c51-42a2-bf52-399efae9537d None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:07.505833 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b2b35-63de-4b0e-9d95-f2643c804e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:07.506722 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b2b35-63de-4b0e-9d95-f2643c804e65 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:07.507008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b2b35-63de-4b0e-9d95-f2643c804e65 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:07.507285 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b2b35-63de-4b0e-9d95-f2643c804e65 None admin] PATH_INFO: `/v3/projects/487da7fb241644edb658400dc131aaba/users/c9f97e2e7d05462595b2f85a71aa6403/roles/4876e759b9504964a874992dc66b6df1` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:07.509508 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b2b35-63de-4b0e-9d95-f2643c804e65 None admin] RBAC: Authorizing `identity:create_grant(project_id=487da7fb241644edb658400dc131aaba, user_id=c9f97e2e7d05462595b2f85a71aa6403, role_id=4876e759b9504964a874992dc66b6df1)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:07.511078 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b2b35-63de-4b0e-9d95-f2643c804e65 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:07.631488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 557/1123] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:05:07 2022] PUT /identity/v3/projects/487da7fb241644edb658400dc131aaba/users/c9f97e2e7d05462595b2f85a71aa6403/roles/4876e759b9504964a874992dc66b6df1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:05:09.857923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048ec3-e187-4316-88b1-47659237cfc9 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:09.858449 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048ec3-e187-4316-88b1-47659237cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:09.858449 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048ec3-e187-4316-88b1-47659237cfc9 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:09.859871 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 567/1124] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:09.865007 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d294c-bae2-47c9-8878-665a441ca47b None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:09.865472 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d294c-bae2-47c9-8878-665a441ca47b None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:09.865598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d294c-bae2-47c9-8878-665a441ca47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:09.882650 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-299d294c-bae2-47c9-8878-665a441ca47b None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:09.883866 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-299d294c-bae2-47c9-8878-665a441ca47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:09.951689 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 558/1125] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:09.974813 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c048ec3-e187-4316-88b1-47659237cfc9 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:10.076239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c048ec3-e187-4316-88b1-47659237cfc9 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:10.086337 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:10.109794 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ebb7a-8d56-4432-a1d3-339d1053734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:10.110580 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ebb7a-8d56-4432-a1d3-339d1053734c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:10.110892 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ebb7a-8d56-4432-a1d3-339d1053734c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:10.111168 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ebb7a-8d56-4432-a1d3-339d1053734c None admin] PATH_INFO: `/v3/roles/4876e759b9504964a874992dc66b6df1` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:10.112664 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ebb7a-8d56-4432-a1d3-339d1053734c None admin] RBAC: Authorizing `identity:get_role(role_id=4876e759b9504964a874992dc66b6df1)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:10.114048 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ebb7a-8d56-4432-a1d3-339d1053734c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:10.115544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 568/1126] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:09 2022] GET /identity/v3/roles/4876e759b9504964a874992dc66b6df1 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:10.122119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d294c-bae2-47c9-8878-665a441ca47b None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:10.186840 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:10.220803 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d294c-bae2-47c9-8878-665a441ca47b None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:10.255189 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d08c-2dac-4059-bc2d-09761bd362cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:10.256049 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d08c-2dac-4059-bc2d-09761bd362cf None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:10.256325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d08c-2dac-4059-bc2d-09761bd362cf None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:10.256591 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d08c-2dac-4059-bc2d-09761bd362cf None admin] PATH_INFO: `/v3/users/c9f97e2e7d05462595b2f85a71aa6403` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:10.257767 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197d08c-2dac-4059-bc2d-09761bd362cf None admin] RBAC: Authorizing `identity:get_user(user_id=c9f97e2e7d05462595b2f85a71aa6403)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:10.259217 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197d08c-2dac-4059-bc2d-09761bd362cf None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:10.260913 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 559/1127] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:10 2022] GET /identity/v3/users/c9f97e2e7d05462595b2f85a71aa6403 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:10.266913 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ebb7a-8d56-4432-a1d3-339d1053734c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:10.366683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ebb7a-8d56-4432-a1d3-339d1053734c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:10.399419 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddee03-da66-44bd-88b3-707c3094a990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:10.400062 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddee03-da66-44bd-88b3-707c3094a990 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:10.400343 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddee03-da66-44bd-88b3-707c3094a990 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:10.401147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddee03-da66-44bd-88b3-707c3094a990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:10.447407 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:10.468964 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddee03-da66-44bd-88b3-707c3094a990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:10.470423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddee03-da66-44bd-88b3-707c3094a990 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:10.568171 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 569/1128] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:05:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:05:10.574207 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d08c-2dac-4059-bc2d-09761bd362cf None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:10.671492 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d08c-2dac-4059-bc2d-09761bd362cf None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:10.704709 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a26a5-7c2c-4d4f-80c5-1f959983a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:10.705542 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a26a5-7c2c-4d4f-80c5-1f959983a47a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:10.705819 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a26a5-7c2c-4d4f-80c5-1f959983a47a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:10.706088 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a26a5-7c2c-4d4f-80c5-1f959983a47a None admin] PATH_INFO: `/v3/projects/487da7fb241644edb658400dc131aaba` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:10.707281 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a26a5-7c2c-4d4f-80c5-1f959983a47a None admin] RBAC: Authorizing `identity:get_project(project_id=487da7fb241644edb658400dc131aaba)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:10.708685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a26a5-7c2c-4d4f-80c5-1f959983a47a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:10.710358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 560/1129] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:05:10 2022] GET /identity/v3/projects/487da7fb241644edb658400dc131aaba => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:10.719675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddee03-da66-44bd-88b3-707c3094a990 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:10.812191 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:10.833167 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddee03-da66-44bd-88b3-707c3094a990 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:10.866855 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31258d3-093c-44a7-976d-07ec81421321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:10.867494 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31258d3-093c-44a7-976d-07ec81421321 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:10.867766 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31258d3-093c-44a7-976d-07ec81421321 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:10.868035 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31258d3-093c-44a7-976d-07ec81421321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:10.868865 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31258d3-093c-44a7-976d-07ec81421321 None admin] RBAC: Adding query filter params (role.id=4876e759b9504964a874992dc66b6df1, scope.project.id=487da7fb241644edb658400dc131aaba, user.id=c9f97e2e7d05462595b2f85a71aa6403) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:10.869189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31258d3-093c-44a7-976d-07ec81421321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:10.870642 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31258d3-093c-44a7-976d-07ec81421321 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:10.876440 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 570/1130] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:05:10 2022] GET /identity/v3/role_assignments?user.id=c9f97e2e7d05462595b2f85a71aa6403&scope.project.id=487da7fb241644edb658400dc131aaba&role.id=4876e759b9504964a874992dc66b6df1 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:13.120567 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c63bcd-349f-48f0-9bcc-b755fc34f6ef None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:13.121131 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c63bcd-349f-48f0-9bcc-b755fc34f6ef None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:13.121233 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c63bcd-349f-48f0-9bcc-b755fc34f6ef None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:13.123495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 561/1131] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:13.129217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d608bf2-601c-422f-be99-17dd6cc9d73a None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:13.129661 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d608bf2-601c-422f-be99-17dd6cc9d73a None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:13.129760 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d608bf2-601c-422f-be99-17dd6cc9d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:13.146674 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-2d608bf2-601c-422f-be99-17dd6cc9d73a None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:13.147865 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-2d608bf2-601c-422f-be99-17dd6cc9d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:13.215697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 571/1132] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:05:13.240561 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c63bcd-349f-48f0-9bcc-b755fc34f6ef None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:13.243571 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:13.344642 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c63bcd-349f-48f0-9bcc-b755fc34f6ef None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:13.378490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8dd89-ace6-4ce0-917a-6b8c989d96df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:13.379251 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8dd89-ace6-4ce0-917a-6b8c989d96df None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:13.379619 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8dd89-ace6-4ce0-917a-6b8c989d96df None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:13.379903 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8dd89-ace6-4ce0-917a-6b8c989d96df None admin] PATH_INFO: `/v3/domains/default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:13.381097 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8dd89-ace6-4ce0-917a-6b8c989d96df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:13.382539 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8dd89-ace6-4ce0-917a-6b8c989d96df None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:13.384199 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 562/1133] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:05:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:13.390110 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d608bf2-601c-422f-be99-17dd6cc9d73a None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:13.461689 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:13.491598 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d608bf2-601c-422f-be99-17dd6cc9d73a None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:13.526137 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5c591-1252-449b-a587-84420cf88f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:13.526823 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5c591-1252-449b-a587-84420cf88f3b None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:13.527106 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5c591-1252-449b-a587-84420cf88f3b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:13.527379 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5c591-1252-449b-a587-84420cf88f3b None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:13.528088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5c591-1252-449b-a587-84420cf88f3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:13.529550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5c591-1252-449b-a587-84420cf88f3b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:13.639416 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 572/1134] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:05:13 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:05:15.910055 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7249de-e1e5-45f7-bad7-cbacc86f8320 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:15.910629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7249de-e1e5-45f7-bad7-cbacc86f8320 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:15.910629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7249de-e1e5-45f7-bad7-cbacc86f8320 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:15.912019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 563/1135] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:15.918107 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beda61-390e-4781-bf47-1640bcb5ed1c None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:15.918522 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beda61-390e-4781-bf47-1640bcb5ed1c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:15.918765 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beda61-390e-4781-bf47-1640bcb5ed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:15.936303 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-33beda61-390e-4781-bf47-1640bcb5ed1c None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:15.937500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-33beda61-390e-4781-bf47-1640bcb5ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:16.003039 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 573/1136] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:16.028249 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7249de-e1e5-45f7-bad7-cbacc86f8320 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:16.103216 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:16.136873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7249de-e1e5-45f7-bad7-cbacc86f8320 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:16.178283 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098d9a5-f2f6-4dff-991e-d5d9cb856100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:16.179149 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098d9a5-f2f6-4dff-991e-d5d9cb856100 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:16.179437 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098d9a5-f2f6-4dff-991e-d5d9cb856100 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:16.179723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098d9a5-f2f6-4dff-991e-d5d9cb856100 None admin] PATH_INFO: `/v3/domains/default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:16.181030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098d9a5-f2f6-4dff-991e-d5d9cb856100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:16.183283 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098d9a5-f2f6-4dff-991e-d5d9cb856100 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:16.185263 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 564/1137] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:05:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:16.191888 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33beda61-390e-4781-bf47-1640bcb5ed1c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:16.248080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:16.293490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33beda61-390e-4781-bf47-1640bcb5ed1c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:16.330020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a292b-a913-4e51-8ad1-24e7cd76d732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:16.330732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a292b-a913-4e51-8ad1-24e7cd76d732 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:16.331011 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a292b-a913-4e51-8ad1-24e7cd76d732 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:16.331283 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a292b-a913-4e51-8ad1-24e7cd76d732 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:16.331988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a292b-a913-4e51-8ad1-24e7cd76d732 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:16.333426 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a292b-a913-4e51-8ad1-24e7cd76d732 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:16.456380 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 574/1138] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:05:16 2022] POST /identity/v3/users => generated 286 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:05:18.718633 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3e118-b645-440c-ad43-f89ccca95c1a None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:18.719248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3e118-b645-440c-ad43-f89ccca95c1a None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:18.719248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3e118-b645-440c-ad43-f89ccca95c1a None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:18.720602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 565/1139] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:18.726129 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd837c7-3bc8-4e8c-9b01-0c7773bec840 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:18.726911 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd837c7-3bc8-4e8c-9b01-0c7773bec840 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:18.726911 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd837c7-3bc8-4e8c-9b01-0c7773bec840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:18.745591 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-ecd837c7-3bc8-4e8c-9b01-0c7773bec840 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:18.746839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-ecd837c7-3bc8-4e8c-9b01-0c7773bec840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:18.815734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 575/1140] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:18.840022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3e118-b645-440c-ad43-f89ccca95c1a None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:18.943793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3e118-b645-440c-ad43-f89ccca95c1a None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:18.976849 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c3a66-c3a2-4b5d-a144-6ef1b560d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:18.977571 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c3a66-c3a2-4b5d-a144-6ef1b560d613 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:18.977852 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c3a66-c3a2-4b5d-a144-6ef1b560d613 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:18.978126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c3a66-c3a2-4b5d-a144-6ef1b560d613 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:18.985436 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:18.989277 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c3a66-c3a2-4b5d-a144-6ef1b560d613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-941c3a66-c3a2-4b5d-a144-6ef1b560d613 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:05:18.997522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:05:19.004242 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:05:19.005289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 566/1141] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:05:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:05:19.006161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd837c7-3bc8-4e8c-9b01-0c7773bec840 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:19.045715 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:19.103151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd837c7-3bc8-4e8c-9b01-0c7773bec840 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:19.138303 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31e2c6-2f0a-487c-a7da-64b22779c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:19.138998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31e2c6-2f0a-487c-a7da-64b22779c2b4 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:19.139278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31e2c6-2f0a-487c-a7da-64b22779c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:19.139548 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31e2c6-2f0a-487c-a7da-64b22779c2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:19.140295 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31e2c6-2f0a-487c-a7da-64b22779c2b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:19.140598 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31e2c6-2f0a-487c-a7da-64b22779c2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:19.141969 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31e2c6-2f0a-487c-a7da-64b22779c2b4 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:19.149993 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 576/1142] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:05:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:19.155882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c3a66-c3a2-4b5d-a144-6ef1b560d613 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:19.256814 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c3a66-c3a2-4b5d-a144-6ef1b560d613 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:19.291216 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df6bc5-cfa4-4c25-8823-ec66e627f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:19.292711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df6bc5-cfa4-4c25-8823-ec66e627f367 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:19.292990 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df6bc5-cfa4-4c25-8823-ec66e627f367 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:19.293264 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df6bc5-cfa4-4c25-8823-ec66e627f367 None admin] PATH_INFO: `/v3/users/343f9fdd30a44aacba1bef53a3402cff` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:19.306776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df6bc5-cfa4-4c25-8823-ec66e627f367 None admin] RBAC: Authorizing `identity:get_user(user_id=343f9fdd30a44aacba1bef53a3402cff)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:19.308464 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df6bc5-cfa4-4c25-8823-ec66e627f367 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:19.309860 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 567/1143] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:19 2022] GET /identity/v3/users/343f9fdd30a44aacba1bef53a3402cff => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:19.315632 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31e2c6-2f0a-487c-a7da-64b22779c2b4 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:19.414967 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31e2c6-2f0a-487c-a7da-64b22779c2b4 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:19.416506 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:19.448988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2fa69-9b94-4412-91c2-228562e9d9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:19.449631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2fa69-9b94-4412-91c2-228562e9d9dc None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:19.449911 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2fa69-9b94-4412-91c2-228562e9d9dc None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:19.450185 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2fa69-9b94-4412-91c2-228562e9d9dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:19.522053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2fa69-9b94-4412-91c2-228562e9d9dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:19.523476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2fa69-9b94-4412-91c2-228562e9d9dc None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:19.621660 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 577/1144] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:05:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:05:19.627786 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df6bc5-cfa4-4c25-8823-ec66e627f367 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:19.683742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:19.727087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df6bc5-cfa4-4c25-8823-ec66e627f367 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:19.761335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1cae4-5a85-41cf-959d-a4db7050354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:19.762515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1cae4-5a85-41cf-959d-a4db7050354d None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:19.762827 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1cae4-5a85-41cf-959d-a4db7050354d None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:19.763103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1cae4-5a85-41cf-959d-a4db7050354d None admin] PATH_INFO: `/v3/projects/efd77f1e6b7e43a8b7d4529e4c4e2fc7` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:19.764312 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1cae4-5a85-41cf-959d-a4db7050354d None admin] RBAC: Authorizing `identity:get_project(project_id=efd77f1e6b7e43a8b7d4529e4c4e2fc7)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:19.765745 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1cae4-5a85-41cf-959d-a4db7050354d None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:19.767501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 568/1145] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:05:19 2022] GET /identity/v3/projects/efd77f1e6b7e43a8b7d4529e4c4e2fc7 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:19.773701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2fa69-9b94-4412-91c2-228562e9d9dc None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:19.775934 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:19.874490 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2fa69-9b94-4412-91c2-228562e9d9dc None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:19.908768 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee62cf3-cf2e-4761-84ee-c06288d5cfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:19.909412 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62cf3-cf2e-4761-84ee-c06288d5cfd0 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:19.909695 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62cf3-cf2e-4761-84ee-c06288d5cfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:19.909971 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62cf3-cf2e-4761-84ee-c06288d5cfd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:19.910839 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee62cf3-cf2e-4761-84ee-c06288d5cfd0 None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=efd77f1e6b7e43a8b7d4529e4c4e2fc7, user.id=343f9fdd30a44aacba1bef53a3402cff) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:19.911154 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee62cf3-cf2e-4761-84ee-c06288d5cfd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:19.912593 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee62cf3-cf2e-4761-84ee-c06288d5cfd0 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:19.918116 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 578/1146] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:05:19 2022] GET /identity/v3/role_assignments?user.id=343f9fdd30a44aacba1bef53a3402cff&scope.project.id=efd77f1e6b7e43a8b7d4529e4c4e2fc7&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:22.116262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f2a51-2302-45e9-9d5a-dd21ba915705 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:22.116824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f2a51-2302-45e9-9d5a-dd21ba915705 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:22.116824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f2a51-2302-45e9-9d5a-dd21ba915705 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:22.118176 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 569/1147] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:22.123590 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02196879-24e1-4828-be7d-c589a8959529 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:22.124015 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02196879-24e1-4828-be7d-c589a8959529 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:22.124151 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02196879-24e1-4828-be7d-c589a8959529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:22.141369 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-02196879-24e1-4828-be7d-c589a8959529 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:22.142576 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-02196879-24e1-4828-be7d-c589a8959529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:22.202897 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:22.210430 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 579/1148] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:05:22.233980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f2a51-2302-45e9-9d5a-dd21ba915705 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:22.335546 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f2a51-2302-45e9-9d5a-dd21ba915705 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:22.358555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:22.368977 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2acf0-1e0f-4b83-8c09-f15ce4ffb713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:22.369729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2acf0-1e0f-4b83-8c09-f15ce4ffb713 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:22.370590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2acf0-1e0f-4b83-8c09-f15ce4ffb713 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:22.370933 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2acf0-1e0f-4b83-8c09-f15ce4ffb713 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:22.384361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2acf0-1e0f-4b83-8c09-f15ce4ffb713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-f4d2acf0-1e0f-4b83-8c09-f15ce4ffb713 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:05:22.399923 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:05:22.400991 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:05:22.401980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 570/1149] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:05:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:05:22.407419 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02196879-24e1-4828-be7d-c589a8959529 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:22.506553 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02196879-24e1-4828-be7d-c589a8959529 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:22.540793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09102858-3ccd-4b91-9b00-2b158f317965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:22.541453 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09102858-3ccd-4b91-9b00-2b158f317965 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:22.541758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09102858-3ccd-4b91-9b00-2b158f317965 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:22.542042 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09102858-3ccd-4b91-9b00-2b158f317965 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:22.542824 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09102858-3ccd-4b91-9b00-2b158f317965 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:22.543137 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09102858-3ccd-4b91-9b00-2b158f317965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:22.544521 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09102858-3ccd-4b91-9b00-2b158f317965 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:22.552905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 580/1150] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:05:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:22.559661 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2acf0-1e0f-4b83-8c09-f15ce4ffb713 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:22.658890 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2acf0-1e0f-4b83-8c09-f15ce4ffb713 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:22.692974 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958cd0b-9314-4835-9810-3296e1658a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:22.693841 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958cd0b-9314-4835-9810-3296e1658a4f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:22.694124 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958cd0b-9314-4835-9810-3296e1658a4f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:22.694401 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958cd0b-9314-4835-9810-3296e1658a4f None admin] PATH_INFO: `/v3/users/343f9fdd30a44aacba1bef53a3402cff` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:22.695629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958cd0b-9314-4835-9810-3296e1658a4f None admin] RBAC: Authorizing `identity:get_user(user_id=343f9fdd30a44aacba1bef53a3402cff)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:22.697217 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958cd0b-9314-4835-9810-3296e1658a4f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:22.698906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 571/1151] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:22 2022] GET /identity/v3/users/343f9fdd30a44aacba1bef53a3402cff => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:05:22.704669 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09102858-3ccd-4b91-9b00-2b158f317965 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:22.764309 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:22.805720 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09102858-3ccd-4b91-9b00-2b158f317965 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:22.838977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8aaf35-3448-4754-8921-486ad32bf574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:22.839830 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aaf35-3448-4754-8921-486ad32bf574 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:22.840107 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aaf35-3448-4754-8921-486ad32bf574 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:22.840377 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aaf35-3448-4754-8921-486ad32bf574 None admin] PATH_INFO: `/v3/projects/efd77f1e6b7e43a8b7d4529e4c4e2fc7` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:22.841552 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8aaf35-3448-4754-8921-486ad32bf574 None admin] RBAC: Authorizing `identity:get_project(project_id=efd77f1e6b7e43a8b7d4529e4c4e2fc7)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:22.843341 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8aaf35-3448-4754-8921-486ad32bf574 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:22.845051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 581/1152] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:05:22 2022] GET /identity/v3/projects/efd77f1e6b7e43a8b7d4529e4c4e2fc7 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:22.851017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958cd0b-9314-4835-9810-3296e1658a4f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:22.904041 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:22.952225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958cd0b-9314-4835-9810-3296e1658a4f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:22.985245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2b3fe-56b5-40ae-9573-8668e0cf669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:22.986127 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2b3fe-56b5-40ae-9573-8668e0cf669a None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:22.986400 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2b3fe-56b5-40ae-9573-8668e0cf669a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:22.986696 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2b3fe-56b5-40ae-9573-8668e0cf669a None admin] PATH_INFO: `/v3/projects/efd77f1e6b7e43a8b7d4529e4c4e2fc7/users/343f9fdd30a44aacba1bef53a3402cff/roles/38e07a16dc8b4306be7688b9d5cd626b` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:22.988698 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2b3fe-56b5-40ae-9573-8668e0cf669a None admin] RBAC: Authorizing `identity:create_grant(project_id=efd77f1e6b7e43a8b7d4529e4c4e2fc7, user_id=343f9fdd30a44aacba1bef53a3402cff, role_id=38e07a16dc8b4306be7688b9d5cd626b)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:22.990107 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2b3fe-56b5-40ae-9573-8668e0cf669a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:23.083051 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 572/1153] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:05:22 2022] PUT /identity/v3/projects/efd77f1e6b7e43a8b7d4529e4c4e2fc7/users/343f9fdd30a44aacba1bef53a3402cff/roles/38e07a16dc8b4306be7688b9d5cd626b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:05:25.292575 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897f79-7809-4ba2-9c12-ed98d7128438 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:25.293116 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897f79-7809-4ba2-9c12-ed98d7128438 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:25.293116 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897f79-7809-4ba2-9c12-ed98d7128438 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:25.294528 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 582/1154] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:25.299932 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447a5d-0e04-45fb-a939-f07ca7fc39d7 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:25.300365 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447a5d-0e04-45fb-a939-f07ca7fc39d7 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:25.300505 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447a5d-0e04-45fb-a939-f07ca7fc39d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:25.318396 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-7f447a5d-0e04-45fb-a939-f07ca7fc39d7 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:25.319658 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-7f447a5d-0e04-45fb-a939-f07ca7fc39d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:25.386719 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 573/1155] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:25.409576 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90897f79-7809-4ba2-9c12-ed98d7128438 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:25.516606 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90897f79-7809-4ba2-9c12-ed98d7128438 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:25.540816 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:25.549178 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36d76-198b-4c30-974e-53fee70322d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:25.550004 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36d76-198b-4c30-974e-53fee70322d4 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:25.550279 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36d76-198b-4c30-974e-53fee70322d4 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:25.550550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36d76-198b-4c30-974e-53fee70322d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:25.561631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e36d76-198b-4c30-974e-53fee70322d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-f0e36d76-198b-4c30-974e-53fee70322d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:05:25.569212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:05:25.570248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:05:25.571331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 583/1156] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:05:25.577167 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f447a5d-0e04-45fb-a939-f07ca7fc39d7 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:25.619236 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:25.676128 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f447a5d-0e04-45fb-a939-f07ca7fc39d7 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:25.710658 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bbfb3-c6ed-4ba1-a477-ea21ecf8f6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:25.711391 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bbfb3-c6ed-4ba1-a477-ea21ecf8f6ea None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:25.711675 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bbfb3-c6ed-4ba1-a477-ea21ecf8f6ea None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:25.711955 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bbfb3-c6ed-4ba1-a477-ea21ecf8f6ea None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:25.712711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bbfb3-c6ed-4ba1-a477-ea21ecf8f6ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:25.713020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bbfb3-c6ed-4ba1-a477-ea21ecf8f6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:25.714415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bbfb3-c6ed-4ba1-a477-ea21ecf8f6ea None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:25.722547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 574/1157] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:25.728433 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36d76-198b-4c30-974e-53fee70322d4 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:25.827891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36d76-198b-4c30-974e-53fee70322d4 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:25.861647 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510139a-4155-4b90-83a5-4b3c71189983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:25.862505 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510139a-4155-4b90-83a5-4b3c71189983 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:25.862814 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510139a-4155-4b90-83a5-4b3c71189983 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:25.863089 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510139a-4155-4b90-83a5-4b3c71189983 None admin] PATH_INFO: `/v3/users/343f9fdd30a44aacba1bef53a3402cff` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:25.864272 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510139a-4155-4b90-83a5-4b3c71189983 None admin] RBAC: Authorizing `identity:get_user(user_id=343f9fdd30a44aacba1bef53a3402cff)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:25.865718 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510139a-4155-4b90-83a5-4b3c71189983 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:25.867401 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 584/1158] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:25 2022] GET /identity/v3/users/343f9fdd30a44aacba1bef53a3402cff => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:25.873844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bbfb3-c6ed-4ba1-a477-ea21ecf8f6ea None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:25.978453 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bbfb3-c6ed-4ba1-a477-ea21ecf8f6ea None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:25.981365 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:26.014426 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cace2-7d78-40cd-91bc-2bc7ae97224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:26.015287 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cace2-7d78-40cd-91bc-2bc7ae97224f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:26.015818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cace2-7d78-40cd-91bc-2bc7ae97224f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:26.016404 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cace2-7d78-40cd-91bc-2bc7ae97224f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:26.083111 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cace2-7d78-40cd-91bc-2bc7ae97224f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:26.084480 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cace2-7d78-40cd-91bc-2bc7ae97224f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:26.183737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 575/1159] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:05:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:05:26.189794 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510139a-4155-4b90-83a5-4b3c71189983 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:26.248852 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:26.294684 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510139a-4155-4b90-83a5-4b3c71189983 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:26.328340 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d91ae0-43c6-4b78-baa4-2b591cfd2843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:26.329188 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91ae0-43c6-4b78-baa4-2b591cfd2843 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:26.329467 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91ae0-43c6-4b78-baa4-2b591cfd2843 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:26.329735 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91ae0-43c6-4b78-baa4-2b591cfd2843 None admin] PATH_INFO: `/v3/projects/efd77f1e6b7e43a8b7d4529e4c4e2fc7` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:26.330944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d91ae0-43c6-4b78-baa4-2b591cfd2843 None admin] RBAC: Authorizing `identity:get_project(project_id=efd77f1e6b7e43a8b7d4529e4c4e2fc7)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:26.332385 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d91ae0-43c6-4b78-baa4-2b591cfd2843 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:26.334146 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 585/1160] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:05:26 2022] GET /identity/v3/projects/efd77f1e6b7e43a8b7d4529e4c4e2fc7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:26.340728 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cace2-7d78-40cd-91bc-2bc7ae97224f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:26.343847 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:26.449997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cace2-7d78-40cd-91bc-2bc7ae97224f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:26.483636 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aac9f-5ffb-4d9e-a28c-0952886b4975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:26.484281 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aac9f-5ffb-4d9e-a28c-0952886b4975 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:26.484564 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aac9f-5ffb-4d9e-a28c-0952886b4975 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:26.484836 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aac9f-5ffb-4d9e-a28c-0952886b4975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:26.485659 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aac9f-5ffb-4d9e-a28c-0952886b4975 None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=efd77f1e6b7e43a8b7d4529e4c4e2fc7, user.id=343f9fdd30a44aacba1bef53a3402cff) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:26.485966 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aac9f-5ffb-4d9e-a28c-0952886b4975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:26.487416 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aac9f-5ffb-4d9e-a28c-0952886b4975 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:26.493227 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 576/1161] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:05:26 2022] GET /identity/v3/role_assignments?user.id=343f9fdd30a44aacba1bef53a3402cff&scope.project.id=efd77f1e6b7e43a8b7d4529e4c4e2fc7&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:28.820047 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb460c93-42fb-4ac1-87e1-7c3d94c3b99d None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:28.820611 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb460c93-42fb-4ac1-87e1-7c3d94c3b99d None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:28.820611 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb460c93-42fb-4ac1-87e1-7c3d94c3b99d None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:28.821983 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 586/1162] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:28.827883 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c932f4-3eff-4fe4-b17d-f621d0f9ea9c None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:28.828301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c932f4-3eff-4fe4-b17d-f621d0f9ea9c None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:28.828430 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c932f4-3eff-4fe4-b17d-f621d0f9ea9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:28.845415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-43c932f4-3eff-4fe4-b17d-f621d0f9ea9c None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:28.846635 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-43c932f4-3eff-4fe4-b17d-f621d0f9ea9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:28.908382 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:28.915872 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 577/1163] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:28.946058 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb460c93-42fb-4ac1-87e1-7c3d94c3b99d None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:29.048043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb460c93-42fb-4ac1-87e1-7c3d94c3b99d None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:29.070891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:29.082628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebb87e-d69f-4e16-a7d3-de65aa1550f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:29.085630 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebb87e-d69f-4e16-a7d3-de65aa1550f7 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:29.085630 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebb87e-d69f-4e16-a7d3-de65aa1550f7 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:29.085630 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebb87e-d69f-4e16-a7d3-de65aa1550f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:29.152206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebb87e-d69f-4e16-a7d3-de65aa1550f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:29.153733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebb87e-d69f-4e16-a7d3-de65aa1550f7 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:29.253079 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 587/1164] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:05:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:05:29.259143 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c932f4-3eff-4fe4-b17d-f621d0f9ea9c None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:29.357222 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c932f4-3eff-4fe4-b17d-f621d0f9ea9c None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:29.391195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259850ca-e3af-4497-81fc-0823a909f190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:29.391992 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259850ca-e3af-4497-81fc-0823a909f190 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:29.392273 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259850ca-e3af-4497-81fc-0823a909f190 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:29.392549 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259850ca-e3af-4497-81fc-0823a909f190 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:29.399146 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259850ca-e3af-4497-81fc-0823a909f190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:29.400577 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259850ca-e3af-4497-81fc-0823a909f190 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-259850ca-e3af-4497-81fc-0823a909f190 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:05:29.414484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:05:29.415679 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:05:29.416487 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 578/1165] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:05:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:05:29.422311 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebb87e-d69f-4e16-a7d3-de65aa1550f7 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:29.446876 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:29.521316 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebb87e-d69f-4e16-a7d3-de65aa1550f7 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:29.556683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e60001-fdeb-4ab8-81d4-36d064caaac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:29.557932 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60001-fdeb-4ab8-81d4-36d064caaac9 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:29.558211 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60001-fdeb-4ab8-81d4-36d064caaac9 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:29.558482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60001-fdeb-4ab8-81d4-36d064caaac9 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:29.559227 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e60001-fdeb-4ab8-81d4-36d064caaac9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:29.559526 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e60001-fdeb-4ab8-81d4-36d064caaac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:29.560903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e60001-fdeb-4ab8-81d4-36d064caaac9 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:29.568035 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 588/1166] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:05:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:31.794505 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9e43-664a-42ba-86b6-8ed5d0af9121 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:31.795087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9e43-664a-42ba-86b6-8ed5d0af9121 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:31.795187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9e43-664a-42ba-86b6-8ed5d0af9121 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:31.796596 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 579/1167] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:31.801926 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226afdf-f2eb-48d3-b36a-8bfc490b364c None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:31.802355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226afdf-f2eb-48d3-b36a-8bfc490b364c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:31.802525 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226afdf-f2eb-48d3-b36a-8bfc490b364c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:31.820407 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-4226afdf-f2eb-48d3-b36a-8bfc490b364c None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:31.821615 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-4226afdf-f2eb-48d3-b36a-8bfc490b364c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:31.888507 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 589/1168] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:31.911306 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c9e43-664a-42ba-86b6-8ed5d0af9121 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:31.976340 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:32.021262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c9e43-664a-42ba-86b6-8ed5d0af9121 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:32.055236 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48853e4-4efc-4290-9fe7-dd17ceb7cf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:32.055828 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48853e4-4efc-4290-9fe7-dd17ceb7cf13 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:32.056110 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48853e4-4efc-4290-9fe7-dd17ceb7cf13 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:32.056386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48853e4-4efc-4290-9fe7-dd17ceb7cf13 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:32.057169 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48853e4-4efc-4290-9fe7-dd17ceb7cf13 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:32.059174 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48853e4-4efc-4290-9fe7-dd17ceb7cf13 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:32.137906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 580/1169] 10.222.0.89 () {60 vars in 1138 bytes} [Thu May 19 20:05:31 2022] POST /identity/v3/domains => generated 267 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:05:34.387068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7daca-0210-4bdd-925d-75ba47eedd94 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:34.387579 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7daca-0210-4bdd-925d-75ba47eedd94 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:34.387683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7daca-0210-4bdd-925d-75ba47eedd94 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:34.388991 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 590/1170] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:34.394216 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3ad15-3e90-45b5-bed2-2ad186f2edc2 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:34.394579 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3ad15-3e90-45b5-bed2-2ad186f2edc2 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:34.394813 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3ad15-3e90-45b5-bed2-2ad186f2edc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:34.411352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-b3d3ad15-3e90-45b5-bed2-2ad186f2edc2 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:34.412540 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-b3d3ad15-3e90-45b5-bed2-2ad186f2edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:34.478547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 581/1171] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:34.502262 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7daca-0210-4bdd-925d-75ba47eedd94 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:34.521056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:34.608102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7daca-0210-4bdd-925d-75ba47eedd94 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:34.642811 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68431d3-7c82-409d-8945-b1de352384c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:34.644159 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68431d3-7c82-409d-8945-b1de352384c2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:34.644442 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68431d3-7c82-409d-8945-b1de352384c2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:34.644717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68431d3-7c82-409d-8945-b1de352384c2 None admin] PATH_INFO: `/v3/domains/e1bbd35a931549cea381cb0239ac5bb8` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:34.656464 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68431d3-7c82-409d-8945-b1de352384c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e1bbd35a931549cea381cb0239ac5bb8)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:34.657998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68431d3-7c82-409d-8945-b1de352384c2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:34.659752 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 591/1172] 10.222.0.89 () {56 vars in 1183 bytes} [Thu May 19 20:05:34 2022] GET /identity/v3/domains/e1bbd35a931549cea381cb0239ac5bb8 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:34.666739 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3ad15-3e90-45b5-bed2-2ad186f2edc2 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:34.717806 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:34.768914 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3ad15-3e90-45b5-bed2-2ad186f2edc2 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:34.805139 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98060e-c2f9-4982-b801-7fd5fa07fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:34.805799 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98060e-c2f9-4982-b801-7fd5fa07fcb2 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:34.806081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98060e-c2f9-4982-b801-7fd5fa07fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:34.806356 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98060e-c2f9-4982-b801-7fd5fa07fcb2 None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:34.807169 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98060e-c2f9-4982-b801-7fd5fa07fcb2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:34.808636 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98060e-c2f9-4982-b801-7fd5fa07fcb2 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:34.891984 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 582/1173] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:05:34 2022] POST /identity/v3/projects => generated 361 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:05:37.162036 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d555a2-00ee-4289-b6f4-0e77851add7c None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:37.162589 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d555a2-00ee-4289-b6f4-0e77851add7c None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:37.162589 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d555a2-00ee-4289-b6f4-0e77851add7c None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:37.164033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 592/1174] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:37.170040 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003e770-ff4d-4232-ac8d-fcbe282d9ebb None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:37.170462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003e770-ff4d-4232-ac8d-fcbe282d9ebb None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:37.170637 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003e770-ff4d-4232-ac8d-fcbe282d9ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:37.188243 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-0003e770-ff4d-4232-ac8d-fcbe282d9ebb None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:37.189424 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-0003e770-ff4d-4232-ac8d-fcbe282d9ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:37.260605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 583/1175] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:37.286721 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d555a2-00ee-4289-b6f4-0e77851add7c None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:37.372649 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:37.398025 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d555a2-00ee-4289-b6f4-0e77851add7c None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:37.436601 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44006a-cd09-4830-8d97-9659de881d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:37.437387 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44006a-cd09-4830-8d97-9659de881d75 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:37.437663 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44006a-cd09-4830-8d97-9659de881d75 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:37.437931 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44006a-cd09-4830-8d97-9659de881d75 None admin] PATH_INFO: `/v3/domains/e1bbd35a931549cea381cb0239ac5bb8` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:37.439183 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44006a-cd09-4830-8d97-9659de881d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e1bbd35a931549cea381cb0239ac5bb8)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:37.440643 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44006a-cd09-4830-8d97-9659de881d75 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:37.442327 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 593/1176] 10.222.0.89 () {56 vars in 1183 bytes} [Thu May 19 20:05:37 2022] GET /identity/v3/domains/e1bbd35a931549cea381cb0239ac5bb8 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:37.448420 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003e770-ff4d-4232-ac8d-fcbe282d9ebb None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:37.481198 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:37.556546 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003e770-ff4d-4232-ac8d-fcbe282d9ebb None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:37.593082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffde24-998f-481b-8af1-dcecd2bd15e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:37.593768 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffde24-998f-481b-8af1-dcecd2bd15e4 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:37.594054 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffde24-998f-481b-8af1-dcecd2bd15e4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:37.594333 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffde24-998f-481b-8af1-dcecd2bd15e4 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:37.595139 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffde24-998f-481b-8af1-dcecd2bd15e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:37.596581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffde24-998f-481b-8af1-dcecd2bd15e4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:37.668146 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 584/1177] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:05:37 2022] POST /identity/v3/users => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:05:39.951595 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98f70e-e9de-40ea-a6ff-e3a18ef29fb1 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:39.952437 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98f70e-e9de-40ea-a6ff-e3a18ef29fb1 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:39.952590 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98f70e-e9de-40ea-a6ff-e3a18ef29fb1 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:39.954050 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 594/1178] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:39.959766 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364317d8-36b2-4c59-91a0-0e1157d1db70 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:39.960214 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364317d8-36b2-4c59-91a0-0e1157d1db70 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:39.960309 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364317d8-36b2-4c59-91a0-0e1157d1db70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:39.977820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-364317d8-36b2-4c59-91a0-0e1157d1db70 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:39.979057 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-364317d8-36b2-4c59-91a0-0e1157d1db70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:40.045738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 585/1179] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:40.069378 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98f70e-e9de-40ea-a6ff-e3a18ef29fb1 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:40.180002 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98f70e-e9de-40ea-a6ff-e3a18ef29fb1 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:40.214529 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe6af0-84f9-4b2d-9731-858cb258494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:40.215277 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6af0-84f9-4b2d-9731-858cb258494f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:40.215560 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6af0-84f9-4b2d-9731-858cb258494f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:40.215838 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6af0-84f9-4b2d-9731-858cb258494f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:40.227266 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe6af0-84f9-4b2d-9731-858cb258494f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-96fe6af0-84f9-4b2d-9731-858cb258494f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:05:40.234907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:05:40.235962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:05:40.236827 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 595/1180] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:05:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:05:40.242217 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364317d8-36b2-4c59-91a0-0e1157d1db70 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:40.259942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:40.343922 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364317d8-36b2-4c59-91a0-0e1157d1db70 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:40.377725 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51424207-caff-4230-9ebe-082bc840c632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:40.378394 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51424207-caff-4230-9ebe-082bc840c632 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:40.378711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51424207-caff-4230-9ebe-082bc840c632 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:40.378992 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51424207-caff-4230-9ebe-082bc840c632 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:40.379753 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51424207-caff-4230-9ebe-082bc840c632 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:40.380056 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51424207-caff-4230-9ebe-082bc840c632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:40.381419 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51424207-caff-4230-9ebe-082bc840c632 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:40.390054 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 586/1181] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:05:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:40.395882 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe6af0-84f9-4b2d-9731-858cb258494f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:40.399778 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:40.496799 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe6af0-84f9-4b2d-9731-858cb258494f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:40.531096 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c1ca2-cebd-4004-bee8-efd946e8dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:40.531953 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c1ca2-cebd-4004-bee8-efd946e8dc5b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:40.532235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c1ca2-cebd-4004-bee8-efd946e8dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:40.532509 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c1ca2-cebd-4004-bee8-efd946e8dc5b None admin] PATH_INFO: `/v3/users/7540af8dbac04b6d82bef080b648cfd8` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:40.546593 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c1ca2-cebd-4004-bee8-efd946e8dc5b None admin] RBAC: Authorizing `identity:get_user(user_id=7540af8dbac04b6d82bef080b648cfd8)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:40.548091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c1ca2-cebd-4004-bee8-efd946e8dc5b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:40.549762 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 596/1182] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:40 2022] GET /identity/v3/users/7540af8dbac04b6d82bef080b648cfd8 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:40.555830 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51424207-caff-4230-9ebe-082bc840c632 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:40.634763 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:40.657166 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51424207-caff-4230-9ebe-082bc840c632 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:40.692313 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f12f9-58ac-427e-9cb8-3118699e39f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:40.692959 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f12f9-58ac-427e-9cb8-3118699e39f9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:40.693245 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f12f9-58ac-427e-9cb8-3118699e39f9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:40.693526 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f12f9-58ac-427e-9cb8-3118699e39f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:40.760703 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f12f9-58ac-427e-9cb8-3118699e39f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:40.762090 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f12f9-58ac-427e-9cb8-3118699e39f9 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:40.838634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:40.860809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 587/1183] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:05:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:05:40.866923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c1ca2-cebd-4004-bee8-efd946e8dc5b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:40.928070 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:40.967799 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c1ca2-cebd-4004-bee8-efd946e8dc5b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:41.001161 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5f0f6-5067-4ebd-9265-921a8ae60cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:41.002010 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5f0f6-5067-4ebd-9265-921a8ae60cba None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:41.002289 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5f0f6-5067-4ebd-9265-921a8ae60cba None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:41.002564 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5f0f6-5067-4ebd-9265-921a8ae60cba None admin] PATH_INFO: `/v3/projects/a1546d4f1924418daaaca902202031bb` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:41.003773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5f0f6-5067-4ebd-9265-921a8ae60cba None admin] RBAC: Authorizing `identity:get_project(project_id=a1546d4f1924418daaaca902202031bb)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:41.005215 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5f0f6-5067-4ebd-9265-921a8ae60cba None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:41.006962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 597/1184] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:05:40 2022] GET /identity/v3/projects/a1546d4f1924418daaaca902202031bb => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:41.013656 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f12f9-58ac-427e-9cb8-3118699e39f9 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:41.112294 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f12f9-58ac-427e-9cb8-3118699e39f9 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:41.146613 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe662a-36b1-4c8a-81d5-69e4132253a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:41.147291 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe662a-36b1-4c8a-81d5-69e4132253a3 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:41.147575 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe662a-36b1-4c8a-81d5-69e4132253a3 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:41.147855 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe662a-36b1-4c8a-81d5-69e4132253a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:41.148688 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe662a-36b1-4c8a-81d5-69e4132253a3 None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=a1546d4f1924418daaaca902202031bb, user.id=7540af8dbac04b6d82bef080b648cfd8) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:41.149003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe662a-36b1-4c8a-81d5-69e4132253a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:41.150434 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe662a-36b1-4c8a-81d5-69e4132253a3 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:41.155937 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 588/1185] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:05:41 2022] GET /identity/v3/role_assignments?user.id=7540af8dbac04b6d82bef080b648cfd8&scope.project.id=a1546d4f1924418daaaca902202031bb&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:43.360701 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5fb14-bfce-4563-8971-93a29291325a None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:43.361251 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5fb14-bfce-4563-8971-93a29291325a None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:43.361251 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5fb14-bfce-4563-8971-93a29291325a None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:43.362789 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 598/1186] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:43.368222 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45557655-bd85-4d1a-97dc-153750414e29 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:43.368688 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45557655-bd85-4d1a-97dc-153750414e29 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:43.368778 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45557655-bd85-4d1a-97dc-153750414e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:43.386661 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-45557655-bd85-4d1a-97dc-153750414e29 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:43.387896 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-45557655-bd85-4d1a-97dc-153750414e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:43.424176 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:43.455887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 589/1187] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:05:43.481906 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5fb14-bfce-4563-8971-93a29291325a None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:43.591061 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5fb14-bfce-4563-8971-93a29291325a None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:43.619047 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:43.625297 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a5b65-2cfb-47f0-8f00-edbfc1511275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:43.633652 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a5b65-2cfb-47f0-8f00-edbfc1511275 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:43.633652 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a5b65-2cfb-47f0-8f00-edbfc1511275 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:43.633652 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a5b65-2cfb-47f0-8f00-edbfc1511275 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:43.637461 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a5b65-2cfb-47f0-8f00-edbfc1511275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-663a5b65-2cfb-47f0-8f00-edbfc1511275 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:05:43.645065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:05:43.646088 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:05:43.647280 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 599/1188] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:05:43.653423 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45557655-bd85-4d1a-97dc-153750414e29 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:43.756547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45557655-bd85-4d1a-97dc-153750414e29 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:43.791554 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd11b5d-41d9-4431-96b5-00cd7301715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:43.792237 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd11b5d-41d9-4431-96b5-00cd7301715f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:43.792522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd11b5d-41d9-4431-96b5-00cd7301715f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:43.792800 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd11b5d-41d9-4431-96b5-00cd7301715f None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:43.793552 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd11b5d-41d9-4431-96b5-00cd7301715f None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:43.793862 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd11b5d-41d9-4431-96b5-00cd7301715f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:43.795315 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd11b5d-41d9-4431-96b5-00cd7301715f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:43.803782 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 590/1189] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:43.809853 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a5b65-2cfb-47f0-8f00-edbfc1511275 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:43.910248 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a5b65-2cfb-47f0-8f00-edbfc1511275 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:43.943773 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62d79e-53f8-4859-b58a-4deb7dee092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:43.944661 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62d79e-53f8-4859-b58a-4deb7dee092f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:43.944945 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62d79e-53f8-4859-b58a-4deb7dee092f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:43.945222 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62d79e-53f8-4859-b58a-4deb7dee092f None admin] PATH_INFO: `/v3/users/7540af8dbac04b6d82bef080b648cfd8` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:43.946414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62d79e-53f8-4859-b58a-4deb7dee092f None admin] RBAC: Authorizing `identity:get_user(user_id=7540af8dbac04b6d82bef080b648cfd8)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:43.948422 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62d79e-53f8-4859-b58a-4deb7dee092f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:43.950053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 600/1190] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:43 2022] GET /identity/v3/users/7540af8dbac04b6d82bef080b648cfd8 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:43.955879 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd11b5d-41d9-4431-96b5-00cd7301715f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:43.991468 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:44.058917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd11b5d-41d9-4431-96b5-00cd7301715f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:44.094216 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b370903-0ada-4423-b35f-1822b46eb4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:44.095119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b370903-0ada-4423-b35f-1822b46eb4b9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:44.095407 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b370903-0ada-4423-b35f-1822b46eb4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:44.095684 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b370903-0ada-4423-b35f-1822b46eb4b9 None admin] PATH_INFO: `/v3/projects/a1546d4f1924418daaaca902202031bb` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:44.096891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b370903-0ada-4423-b35f-1822b46eb4b9 None admin] RBAC: Authorizing `identity:get_project(project_id=a1546d4f1924418daaaca902202031bb)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:44.098325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b370903-0ada-4423-b35f-1822b46eb4b9 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:44.100094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 591/1191] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:05:43 2022] GET /identity/v3/projects/a1546d4f1924418daaaca902202031bb => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:44.106036 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62d79e-53f8-4859-b58a-4deb7dee092f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:44.165104 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:44.207762 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62d79e-53f8-4859-b58a-4deb7dee092f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:44.241588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc2022-e3ec-4189-9358-6e7de413c4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:44.242481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2022-e3ec-4189-9358-6e7de413c4fe None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:44.242791 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2022-e3ec-4189-9358-6e7de413c4fe None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:44.243068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2022-e3ec-4189-9358-6e7de413c4fe None admin] PATH_INFO: `/v3/projects/a1546d4f1924418daaaca902202031bb/users/7540af8dbac04b6d82bef080b648cfd8/roles/38e07a16dc8b4306be7688b9d5cd626b` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:44.245573 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc2022-e3ec-4189-9358-6e7de413c4fe None admin] RBAC: Authorizing `identity:create_grant(project_id=a1546d4f1924418daaaca902202031bb, user_id=7540af8dbac04b6d82bef080b648cfd8, role_id=38e07a16dc8b4306be7688b9d5cd626b)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:44.247054 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc2022-e3ec-4189-9358-6e7de413c4fe None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:44.324134 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 601/1192] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:05:44 2022] PUT /identity/v3/projects/a1546d4f1924418daaaca902202031bb/users/7540af8dbac04b6d82bef080b648cfd8/roles/38e07a16dc8b4306be7688b9d5cd626b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:05:46.555764 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8a233-fe51-436f-8568-dc841b510f62 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:46.556278 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8a233-fe51-436f-8568-dc841b510f62 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:46.556278 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8a233-fe51-436f-8568-dc841b510f62 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:46.558132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 592/1193] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:05:46.563465 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be10e7-b22f-4276-99b4-c8530013561b None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:46.563891 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be10e7-b22f-4276-99b4-c8530013561b None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:46.563998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be10e7-b22f-4276-99b4-c8530013561b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:46.581308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-38be10e7-b22f-4276-99b4-c8530013561b None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:05:46.582500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-38be10e7-b22f-4276-99b4-c8530013561b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:05:46.648494 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 602/1194] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:05:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:05:46.671989 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8a233-fe51-436f-8568-dc841b510f62 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:46.779439 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8a233-fe51-436f-8568-dc841b510f62 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:46.781010 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:46.816145 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0edfeb-3db4-464d-947e-b2fb6a1ef5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:46.816856 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0edfeb-3db4-464d-947e-b2fb6a1ef5f9 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:46.817133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0edfeb-3db4-464d-947e-b2fb6a1ef5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:46.817402 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0edfeb-3db4-464d-947e-b2fb6a1ef5f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:46.827961 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0edfeb-3db4-464d-947e-b2fb6a1ef5f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-5b0edfeb-3db4-464d-947e-b2fb6a1ef5f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:05:46.835556 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:05:46.836606 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:05:46.837533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:05:46.839094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 593/1195] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:05:46.843344 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be10e7-b22f-4276-99b4-c8530013561b None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:46.891978 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:46.943091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be10e7-b22f-4276-99b4-c8530013561b None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:47.065308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1093e-adf2-4721-a68f-55e823a66f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:47.065308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1093e-adf2-4721-a68f-55e823a66f99 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:47.065308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1093e-adf2-4721-a68f-55e823a66f99 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:47.065308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1093e-adf2-4721-a68f-55e823a66f99 None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:47.065708 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1093e-adf2-4721-a68f-55e823a66f99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:47.065708 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1093e-adf2-4721-a68f-55e823a66f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:47.065708 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1093e-adf2-4721-a68f-55e823a66f99 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:47.065708 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 603/1196] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:47.066005 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0edfeb-3db4-464d-947e-b2fb6a1ef5f9 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:47.110324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0edfeb-3db4-464d-947e-b2fb6a1ef5f9 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:47.147286 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938806e-7f5b-405d-8574-8946e8c6968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:47.148183 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938806e-7f5b-405d-8574-8946e8c6968f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:47.148463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938806e-7f5b-405d-8574-8946e8c6968f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:47.148842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938806e-7f5b-405d-8574-8946e8c6968f None admin] PATH_INFO: `/v3/users/7540af8dbac04b6d82bef080b648cfd8` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:47.150129 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938806e-7f5b-405d-8574-8946e8c6968f None admin] RBAC: Authorizing `identity:get_user(user_id=7540af8dbac04b6d82bef080b648cfd8)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:47.152213 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938806e-7f5b-405d-8574-8946e8c6968f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:47.153951 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 594/1197] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:05:46 2022] GET /identity/v3/users/7540af8dbac04b6d82bef080b648cfd8 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:47.159908 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1093e-adf2-4721-a68f-55e823a66f99 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:47.270990 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1093e-adf2-4721-a68f-55e823a66f99 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:47.283216 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:47.308527 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc859f5-0497-4e32-ae4e-f2a0549f1213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:47.311295 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc859f5-0497-4e32-ae4e-f2a0549f1213 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:47.311295 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc859f5-0497-4e32-ae4e-f2a0549f1213 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:47.311295 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc859f5-0497-4e32-ae4e-f2a0549f1213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:47.383239 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc859f5-0497-4e32-ae4e-f2a0549f1213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:47.384712 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc859f5-0497-4e32-ae4e-f2a0549f1213 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:47.488124 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 604/1198] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:05:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:05:47.495203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938806e-7f5b-405d-8574-8946e8c6968f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:47.526255 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:47.603449 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938806e-7f5b-405d-8574-8946e8c6968f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:47.641489 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa0d21-2028-43e1-8810-b0d972571463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:47.642280 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa0d21-2028-43e1-8810-b0d972571463 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:47.642561 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa0d21-2028-43e1-8810-b0d972571463 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:47.642868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa0d21-2028-43e1-8810-b0d972571463 None admin] PATH_INFO: `/v3/projects/a1546d4f1924418daaaca902202031bb` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:47.644091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa0d21-2028-43e1-8810-b0d972571463 None admin] RBAC: Authorizing `identity:get_project(project_id=a1546d4f1924418daaaca902202031bb)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:47.645543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa0d21-2028-43e1-8810-b0d972571463 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:47.647423 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 595/1199] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:05:47 2022] GET /identity/v3/projects/a1546d4f1924418daaaca902202031bb => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:47.653825 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc859f5-0497-4e32-ae4e-f2a0549f1213 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:05:47.665815 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:47.765745 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc859f5-0497-4e32-ae4e-f2a0549f1213 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:05:47.801576 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493e6a5-9c72-4517-9e60-3dc0f30d3efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:05:47.802261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493e6a5-9c72-4517-9e60-3dc0f30d3efa None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:05:47.802544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493e6a5-9c72-4517-9e60-3dc0f30d3efa None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:05:47.802851 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493e6a5-9c72-4517-9e60-3dc0f30d3efa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:05:47.803946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493e6a5-9c72-4517-9e60-3dc0f30d3efa None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=a1546d4f1924418daaaca902202031bb, user.id=7540af8dbac04b6d82bef080b648cfd8) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:05:47.804254 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493e6a5-9c72-4517-9e60-3dc0f30d3efa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:05:47.805700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493e6a5-9c72-4517-9e60-3dc0f30d3efa None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:05:47.812019 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 605/1200] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:05:47 2022] GET /identity/v3/role_assignments?user.id=7540af8dbac04b6d82bef080b648cfd8&scope.project.id=a1546d4f1924418daaaca902202031bb&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:05:57.635301 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=51 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:05:57.809150 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=63 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:07.433304 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ce05-7efa-4e9f-b55a-8e1fc4a91eaa None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:07.433921 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ce05-7efa-4e9f-b55a-8e1fc4a91eaa None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:07.433921 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ce05-7efa-4e9f-b55a-8e1fc4a91eaa None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:07.435312 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 596/1201] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:07:07.441994 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b0364-081f-40ad-8b04-094c6eb9fa9b None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:07.442532 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b0364-081f-40ad-8b04-094c6eb9fa9b None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:07.442991 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b0364-081f-40ad-8b04-094c6eb9fa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:07.465979 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-a93b0364-081f-40ad-8b04-094c6eb9fa9b None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:07:07.467372 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-a93b0364-081f-40ad-8b04-094c6eb9fa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:07:07.567989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 606/1202] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:07:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:07:07.593396 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5ce05-7efa-4e9f-b55a-8e1fc4a91eaa None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:07.709231 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5ce05-7efa-4e9f-b55a-8e1fc4a91eaa None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:07.747682 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e11d1-294a-4bef-b6d4-ab8adf977de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:07.748502 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e11d1-294a-4bef-b6d4-ab8adf977de1 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:07.748789 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e11d1-294a-4bef-b6d4-ab8adf977de1 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:07.749067 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e11d1-294a-4bef-b6d4-ab8adf977de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:07.760536 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e11d1-294a-4bef-b6d4-ab8adf977de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:07.762023 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e11d1-294a-4bef-b6d4-ab8adf977de1 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-b91e11d1-294a-4bef-b6d4-ab8adf977de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:07.781008 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:07.782211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:07.783547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:07.783547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:07.783547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:07.783547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:07.783547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 597/1203] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:07.788505 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b0364-081f-40ad-8b04-094c6eb9fa9b None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:07.906833 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b0364-081f-40ad-8b04-094c6eb9fa9b None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:07.941033 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:07.947993 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fb3a0-7765-4421-8f5a-479c177537cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:07.948667 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fb3a0-7765-4421-8f5a-479c177537cc None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:07.948950 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fb3a0-7765-4421-8f5a-479c177537cc None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:07.949308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fb3a0-7765-4421-8f5a-479c177537cc None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:07.949964 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fb3a0-7765-4421-8f5a-479c177537cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:07.950266 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fb3a0-7765-4421-8f5a-479c177537cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:07.951713 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fb3a0-7765-4421-8f5a-479c177537cc None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:07.964879 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 607/1204] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:07.970777 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e11d1-294a-4bef-b6d4-ab8adf977de1 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:08.031123 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:08.083322 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e11d1-294a-4bef-b6d4-ab8adf977de1 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:08.133975 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3481d-9351-4fd9-9cad-5b88299056d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:08.134761 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3481d-9351-4fd9-9cad-5b88299056d7 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:08.135053 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3481d-9351-4fd9-9cad-5b88299056d7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:08.135361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3481d-9351-4fd9-9cad-5b88299056d7 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:08.136082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3481d-9351-4fd9-9cad-5b88299056d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:08.137995 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3481d-9351-4fd9-9cad-5b88299056d7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:08.237119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 598/1205] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:07:07 2022] POST /identity/v3/users => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:07:10.615639 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24d29f-4ee7-4244-a5c9-f031367bb2ed None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:10.616315 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24d29f-4ee7-4244-a5c9-f031367bb2ed None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:10.616315 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24d29f-4ee7-4244-a5c9-f031367bb2ed None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:10.618495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 608/1206] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:07:10.626197 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a61a2-8feb-496d-903a-1742c890769c None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:10.626857 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a61a2-8feb-496d-903a-1742c890769c None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:10.627244 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a61a2-8feb-496d-903a-1742c890769c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:10.658336 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-802a61a2-8feb-496d-903a-1742c890769c None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:07:10.660805 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-802a61a2-8feb-496d-903a-1742c890769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:07:10.757265 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 599/1207] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:07:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:07:10.783446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24d29f-4ee7-4244-a5c9-f031367bb2ed None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:10.917046 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24d29f-4ee7-4244-a5c9-f031367bb2ed None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:10.959918 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546fac5-056b-459f-90e5-2d077c30d86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:10.960778 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546fac5-056b-459f-90e5-2d077c30d86c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:10.961189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546fac5-056b-459f-90e5-2d077c30d86c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:10.962040 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546fac5-056b-459f-90e5-2d077c30d86c None admin] PATH_INFO: `/v3/roles/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:10.974977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546fac5-056b-459f-90e5-2d077c30d86c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-4546fac5-056b-459f-90e5-2d077c30d86c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:07:10.982890 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:10.989072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:10.991069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 609/1208] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:07:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:07:10.993169 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a61a2-8feb-496d-903a-1742c890769c None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:11.039943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:11.112470 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a61a2-8feb-496d-903a-1742c890769c None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:11.155077 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605085b4-9c92-44e2-b0b3-483b0134a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:11.155867 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605085b4-9c92-44e2-b0b3-483b0134a41f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:11.156197 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605085b4-9c92-44e2-b0b3-483b0134a41f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:11.156519 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605085b4-9c92-44e2-b0b3-483b0134a41f None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:11.157380 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605085b4-9c92-44e2-b0b3-483b0134a41f None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:11.157757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605085b4-9c92-44e2-b0b3-483b0134a41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:11.159262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605085b4-9c92-44e2-b0b3-483b0134a41f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:11.169791 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 600/1209] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:07:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:11.176172 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546fac5-056b-459f-90e5-2d077c30d86c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:11.268419 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:11.336626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546fac5-056b-459f-90e5-2d077c30d86c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:11.375296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1029a49-0a04-4b02-aa38-d6739267d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:11.376674 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1029a49-0a04-4b02-aa38-d6739267d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:11.377168 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1029a49-0a04-4b02-aa38-d6739267d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:11.377672 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1029a49-0a04-4b02-aa38-d6739267d6e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:11.397915 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1029a49-0a04-4b02-aa38-d6739267d6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:11.400805 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1029a49-0a04-4b02-aa38-d6739267d6e3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-b1029a49-0a04-4b02-aa38-d6739267d6e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:11.437244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:11.438355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:11.439427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:11.439427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:11.439427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:11.439427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:11.439780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 610/1210] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:11.446180 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605085b4-9c92-44e2-b0b3-483b0134a41f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:11.554154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:11.558361 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605085b4-9c92-44e2-b0b3-483b0134a41f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:11.596370 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fff7b9-8ba0-4789-8bc5-138ffbd1dde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:11.597212 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fff7b9-8ba0-4789-8bc5-138ffbd1dde7 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:11.597495 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fff7b9-8ba0-4789-8bc5-138ffbd1dde7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:11.597762 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fff7b9-8ba0-4789-8bc5-138ffbd1dde7 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:11.598496 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fff7b9-8ba0-4789-8bc5-138ffbd1dde7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:11.598837 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fff7b9-8ba0-4789-8bc5-138ffbd1dde7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:11.611139 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fff7b9-8ba0-4789-8bc5-138ffbd1dde7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:11.614254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 601/1211] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:11.624231 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1029a49-0a04-4b02-aa38-d6739267d6e3 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:11.776648 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1029a49-0a04-4b02-aa38-d6739267d6e3 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:11.778437 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:11.814322 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aef84a-d9e8-4db9-a5ac-203d491c67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:11.815150 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aef84a-d9e8-4db9-a5ac-203d491c67b2 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:11.815434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aef84a-d9e8-4db9-a5ac-203d491c67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:11.815717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aef84a-d9e8-4db9-a5ac-203d491c67b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:11.823911 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aef84a-d9e8-4db9-a5ac-203d491c67b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:11.825394 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aef84a-d9e8-4db9-a5ac-203d491c67b2 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-c2aef84a-d9e8-4db9-a5ac-203d491c67b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:07:11.842059 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:11.843873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:11.845637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:11.845637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:11.845637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:07:11.845637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:07:11.845637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:07:11.845637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:07:11.845637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:07:11.845637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:07:11.845637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:11.845637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:11.855201 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 611/1212] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:11.864553 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fff7b9-8ba0-4789-8bc5-138ffbd1dde7 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:11.977479 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fff7b9-8ba0-4789-8bc5-138ffbd1dde7 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:12.016205 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828976-05aa-42e8-aff4-3787fb885bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:12.016893 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828976-05aa-42e8-aff4-3787fb885bd1 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:12.017178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828976-05aa-42e8-aff4-3787fb885bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:12.017455 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828976-05aa-42e8-aff4-3787fb885bd1 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:12.018320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828976-05aa-42e8-aff4-3787fb885bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:12.018659 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828976-05aa-42e8-aff4-3787fb885bd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:12.020119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828976-05aa-42e8-aff4-3787fb885bd1 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:12.040128 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 602/1213] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:07:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:12.050009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aef84a-d9e8-4db9-a5ac-203d491c67b2 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:12.194932 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aef84a-d9e8-4db9-a5ac-203d491c67b2 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:12.237162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1466fa-593c-40b1-b87d-7461706f2f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:12.237830 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1466fa-593c-40b1-b87d-7461706f2f7a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:12.238118 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1466fa-593c-40b1-b87d-7461706f2f7a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:12.238393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1466fa-593c-40b1-b87d-7461706f2f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:12.274789 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:12.317923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1466fa-593c-40b1-b87d-7461706f2f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:12.318751 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1466fa-593c-40b1-b87d-7461706f2f7a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:12.437863 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 612/1214] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:07:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:07:12.447653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828976-05aa-42e8-aff4-3787fb885bd1 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:12.469205 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:12.567101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828976-05aa-42e8-aff4-3787fb885bd1 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:12.607108 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98943f7f-c5dd-4d2c-b12d-ac4b9515a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:12.607839 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98943f7f-c5dd-4d2c-b12d-ac4b9515a70a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:12.608119 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98943f7f-c5dd-4d2c-b12d-ac4b9515a70a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:12.608395 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98943f7f-c5dd-4d2c-b12d-ac4b9515a70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:12.620470 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98943f7f-c5dd-4d2c-b12d-ac4b9515a70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:12.623888 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98943f7f-c5dd-4d2c-b12d-ac4b9515a70a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-98943f7f-c5dd-4d2c-b12d-ac4b9515a70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:12.641605 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:12.648230 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:12.650353 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:12.650353 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:12.650353 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:12.650353 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:12.650353 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 603/1215] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:12.652638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1466fa-593c-40b1-b87d-7461706f2f7a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:12.723753 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:12.765977 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1466fa-593c-40b1-b87d-7461706f2f7a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:12.813886 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12495aaa-385c-4de3-8a6c-f8f125dd77b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:12.814551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12495aaa-385c-4de3-8a6c-f8f125dd77b1 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:12.814857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12495aaa-385c-4de3-8a6c-f8f125dd77b1 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:12.815128 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12495aaa-385c-4de3-8a6c-f8f125dd77b1 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:12.815860 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12495aaa-385c-4de3-8a6c-f8f125dd77b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:12.816163 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12495aaa-385c-4de3-8a6c-f8f125dd77b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:12.817537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12495aaa-385c-4de3-8a6c-f8f125dd77b1 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:12.830347 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 613/1216] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:12.842122 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98943f7f-c5dd-4d2c-b12d-ac4b9515a70a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:12.927014 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:12.965724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98943f7f-c5dd-4d2c-b12d-ac4b9515a70a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:13.007666 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035973f8-6912-44b6-9427-3a9d6bd4f6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:13.015624 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035973f8-6912-44b6-9427-3a9d6bd4f6b2 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:13.015624 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035973f8-6912-44b6-9427-3a9d6bd4f6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:13.015624 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035973f8-6912-44b6-9427-3a9d6bd4f6b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:13.017488 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035973f8-6912-44b6-9427-3a9d6bd4f6b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:13.019041 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035973f8-6912-44b6-9427-3a9d6bd4f6b2 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-035973f8-6912-44b6-9427-3a9d6bd4f6b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:07:13.035087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:13.036926 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:13.038976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:07:13.038976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:07:13.038976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:07:13.038976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:07:13.038976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:07:13.038976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:07:13.038976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:13.038976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:13.038976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 604/1217] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:13.045467 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12495aaa-385c-4de3-8a6c-f8f125dd77b1 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:13.175466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12495aaa-385c-4de3-8a6c-f8f125dd77b1 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:13.206415 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:13.223152 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdaae8-3636-47d3-aadf-68ec7a53e945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:13.224082 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdaae8-3636-47d3-aadf-68ec7a53e945 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:13.224468 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdaae8-3636-47d3-aadf-68ec7a53e945 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:13.224848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdaae8-3636-47d3-aadf-68ec7a53e945 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:13.225858 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdaae8-3636-47d3-aadf-68ec7a53e945 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:13.226273 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdaae8-3636-47d3-aadf-68ec7a53e945 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:13.228621 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdaae8-3636-47d3-aadf-68ec7a53e945 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:13.244500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 614/1218] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:07:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:07:13.251356 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035973f8-6912-44b6-9427-3a9d6bd4f6b2 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:13.368037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035973f8-6912-44b6-9427-3a9d6bd4f6b2 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:13.399809 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:13.406490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8f2a5-87bd-4dd4-b72a-721a140503e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:13.407338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8f2a5-87bd-4dd4-b72a-721a140503e0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:13.407661 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8f2a5-87bd-4dd4-b72a-721a140503e0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:13.407997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8f2a5-87bd-4dd4-b72a-721a140503e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:13.408913 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8f2a5-87bd-4dd4-b72a-721a140503e0 None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=4148ab38693847f8bb2b85ee5be6ba1a) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:13.409270 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8f2a5-87bd-4dd4-b72a-721a140503e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:13.410874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8f2a5-87bd-4dd4-b72a-721a140503e0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:13.418537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 605/1219] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:07:13 2022] GET /identity/v3/role_assignments?user.id=4148ab38693847f8bb2b85ee5be6ba1a&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:07:15.913505 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0339-fa8e-471c-a576-5337f2c0b7ea None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:15.914911 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0339-fa8e-471c-a576-5337f2c0b7ea None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:15.915068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0339-fa8e-471c-a576-5337f2c0b7ea None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:15.917808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 615/1220] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:07:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:07:15.925753 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea745cb-e795-45a7-a087-64abfae35057 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:15.926568 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea745cb-e795-45a7-a087-64abfae35057 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:15.926770 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea745cb-e795-45a7-a087-64abfae35057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:15.946313 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-bea745cb-e795-45a7-a087-64abfae35057 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:07:15.947594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-bea745cb-e795-45a7-a087-64abfae35057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:07:16.027203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 606/1221] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:07:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:07:16.050997 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac0339-fa8e-471c-a576-5337f2c0b7ea None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:16.188144 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac0339-fa8e-471c-a576-5337f2c0b7ea None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:16.240677 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21988ca-1fb8-4d6a-ad64-6e7aba4445af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:16.241898 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21988ca-1fb8-4d6a-ad64-6e7aba4445af None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:16.243014 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21988ca-1fb8-4d6a-ad64-6e7aba4445af None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:16.243440 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21988ca-1fb8-4d6a-ad64-6e7aba4445af None admin] PATH_INFO: `/v3/roles/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:16.261973 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21988ca-1fb8-4d6a-ad64-6e7aba4445af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-d21988ca-1fb8-4d6a-ad64-6e7aba4445af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:07:16.278056 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:16.287666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:16.289901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 616/1222] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:07:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:16.291456 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea745cb-e795-45a7-a087-64abfae35057 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:16.440198 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea745cb-e795-45a7-a087-64abfae35057 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:16.487581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:16.508711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f45ad0-3d20-4528-8db4-97822a36b8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:16.509897 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f45ad0-3d20-4528-8db4-97822a36b8f7 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:16.510401 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f45ad0-3d20-4528-8db4-97822a36b8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:16.510941 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f45ad0-3d20-4528-8db4-97822a36b8f7 None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:16.512650 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f45ad0-3d20-4528-8db4-97822a36b8f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:16.513218 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f45ad0-3d20-4528-8db4-97822a36b8f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:16.516100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f45ad0-3d20-4528-8db4-97822a36b8f7 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:16.538422 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 607/1223] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:16.540924 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21988ca-1fb8-4d6a-ad64-6e7aba4445af None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:16.596226 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:16.689605 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21988ca-1fb8-4d6a-ad64-6e7aba4445af None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:16.751245 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb5394-1561-4c3a-a2aa-ee304fc53aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:16.752071 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb5394-1561-4c3a-a2aa-ee304fc53aa7 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:16.752418 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb5394-1561-4c3a-a2aa-ee304fc53aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:16.752761 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb5394-1561-4c3a-a2aa-ee304fc53aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:16.765859 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb5394-1561-4c3a-a2aa-ee304fc53aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:16.767757 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb5394-1561-4c3a-a2aa-ee304fc53aa7 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-e2cb5394-1561-4c3a-a2aa-ee304fc53aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:16.787646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:16.789454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:16.791246 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:16.791246 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:16.791246 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:16.791246 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:16.791246 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 617/1224] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:16.795641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f45ad0-3d20-4528-8db4-97822a36b8f7 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:16.951873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f45ad0-3d20-4528-8db4-97822a36b8f7 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:17.000194 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c12d7f-a9f6-4d3c-9c91-0d4292991e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:17.001197 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12d7f-a9f6-4d3c-9c91-0d4292991e41 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:17.001695 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12d7f-a9f6-4d3c-9c91-0d4292991e41 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:17.002035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12d7f-a9f6-4d3c-9c91-0d4292991e41 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:17.003264 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c12d7f-a9f6-4d3c-9c91-0d4292991e41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:17.003734 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c12d7f-a9f6-4d3c-9c91-0d4292991e41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:17.005979 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c12d7f-a9f6-4d3c-9c91-0d4292991e41 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:17.026957 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 608/1225] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:17.035857 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb5394-1561-4c3a-a2aa-ee304fc53aa7 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:17.170537 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:17.178388 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb5394-1561-4c3a-a2aa-ee304fc53aa7 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:17.228933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fedda-1baa-422b-865c-bfce40f1d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:17.231051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fedda-1baa-422b-865c-bfce40f1d31f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:17.231051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fedda-1baa-422b-865c-bfce40f1d31f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:17.231051 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fedda-1baa-422b-865c-bfce40f1d31f None admin] PATH_INFO: `/v3/users/placement` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:17.239530 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fedda-1baa-422b-865c-bfce40f1d31f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:17.241022 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fedda-1baa-422b-865c-bfce40f1d31f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-6c0fedda-1baa-422b-865c-bfce40f1d31f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:07:17.256828 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:17.258659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:17.260500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:17.260500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:17.260500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:07:17.260500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:07:17.260500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:07:17.260500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:07:17.260500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:07:17.260500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:07:17.260500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:17.260500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:17.260500 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 618/1226] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:17.264820 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c12d7f-a9f6-4d3c-9c91-0d4292991e41 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:17.351195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:17.415028 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c12d7f-a9f6-4d3c-9c91-0d4292991e41 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:17.457848 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0684a3-e49a-417a-b158-2afd4fd72196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:17.458725 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0684a3-e49a-417a-b158-2afd4fd72196 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:17.459076 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0684a3-e49a-417a-b158-2afd4fd72196 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:17.459417 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0684a3-e49a-417a-b158-2afd4fd72196 None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:17.460364 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0684a3-e49a-417a-b158-2afd4fd72196 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:17.460735 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0684a3-e49a-417a-b158-2afd4fd72196 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:17.463388 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0684a3-e49a-417a-b158-2afd4fd72196 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:17.488468 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 609/1227] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:07:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:17.497264 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fedda-1baa-422b-865c-bfce40f1d31f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:17.611988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fedda-1baa-422b-865c-bfce40f1d31f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:17.654574 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77791a19-fd3d-4825-b78a-4fa6996aaa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:17.655499 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77791a19-fd3d-4825-b78a-4fa6996aaa25 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:17.655820 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77791a19-fd3d-4825-b78a-4fa6996aaa25 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:17.656153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77791a19-fd3d-4825-b78a-4fa6996aaa25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:17.675447 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77791a19-fd3d-4825-b78a-4fa6996aaa25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:17.677961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77791a19-fd3d-4825-b78a-4fa6996aaa25 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-77791a19-fd3d-4825-b78a-4fa6996aaa25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:17.711793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:17.713431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:17.715301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:17.715301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:17.715301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:17.715301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:17.715301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 619/1228] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:17.720244 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0684a3-e49a-417a-b158-2afd4fd72196 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:17.835385 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0684a3-e49a-417a-b158-2afd4fd72196 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:17.838693 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:17.877601 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82688a57-1b29-43d8-830e-b2f844162519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:17.878193 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82688a57-1b29-43d8-830e-b2f844162519 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:17.878471 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82688a57-1b29-43d8-830e-b2f844162519 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:17.878781 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82688a57-1b29-43d8-830e-b2f844162519 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:17.879513 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82688a57-1b29-43d8-830e-b2f844162519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:17.879815 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82688a57-1b29-43d8-830e-b2f844162519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:17.881232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82688a57-1b29-43d8-830e-b2f844162519 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:17.895045 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 610/1229] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:07:17.901270 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77791a19-fd3d-4825-b78a-4fa6996aaa25 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:17.911989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:18.019304 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77791a19-fd3d-4825-b78a-4fa6996aaa25 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:18.066464 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90573590-bae3-44ae-a089-ec1d633f57a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:18.067494 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90573590-bae3-44ae-a089-ec1d633f57a3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:18.067627 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90573590-bae3-44ae-a089-ec1d633f57a3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:18.067910 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90573590-bae3-44ae-a089-ec1d633f57a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:18.077492 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90573590-bae3-44ae-a089-ec1d633f57a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:18.080241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90573590-bae3-44ae-a089-ec1d633f57a3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-90573590-bae3-44ae-a089-ec1d633f57a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:07:18.095864 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:18.097628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:18.099414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:07:18.099414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:07:18.099414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:07:18.099414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:07:18.099414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:07:18.099414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:07:18.099414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:18.099414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:18.099414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 620/1230] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:07:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:18.107994 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82688a57-1b29-43d8-830e-b2f844162519 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:18.270543 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82688a57-1b29-43d8-830e-b2f844162519 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:18.320847 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05851d-b17f-4fb3-aee3-cf24627b8b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:18.321895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05851d-b17f-4fb3-aee3-cf24627b8b0e None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:18.322333 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05851d-b17f-4fb3-aee3-cf24627b8b0e None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:18.322824 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05851d-b17f-4fb3-aee3-cf24627b8b0e None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:18.324138 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05851d-b17f-4fb3-aee3-cf24627b8b0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:18.324650 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05851d-b17f-4fb3-aee3-cf24627b8b0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:18.327191 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05851d-b17f-4fb3-aee3-cf24627b8b0e None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:18.349195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 611/1231] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:07:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:18.356068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90573590-bae3-44ae-a089-ec1d633f57a3 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:18.441544 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:18.485373 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90573590-bae3-44ae-a089-ec1d633f57a3 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:18.527943 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dff54-56d4-415f-b27e-fa2ede608499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:18.528853 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dff54-56d4-415f-b27e-fa2ede608499 None admin] REQUEST_METHOD: `PUT` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:18.529136 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dff54-56d4-415f-b27e-fa2ede608499 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:18.529415 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dff54-56d4-415f-b27e-fa2ede608499 None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/4148ab38693847f8bb2b85ee5be6ba1a/roles/2c04974ce949479c8b4826c59fb652b3` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:18.547562 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dff54-56d4-415f-b27e-fa2ede608499 None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=4148ab38693847f8bb2b85ee5be6ba1a, role_id=2c04974ce949479c8b4826c59fb652b3)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:18.549424 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dff54-56d4-415f-b27e-fa2ede608499 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:18.684578 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 621/1232] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:07:18 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/4148ab38693847f8bb2b85ee5be6ba1a/roles/2c04974ce949479c8b4826c59fb652b3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:07:20.978694 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d7d3-b531-4b77-a201-10d349b21709 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:20.979359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d7d3-b531-4b77-a201-10d349b21709 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:20.979359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d7d3-b531-4b77-a201-10d349b21709 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:20.980663 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 612/1233] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:07:20.986883 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d153-42da-4fd2-b5d6-ed6996c11d9b None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:20.987899 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d153-42da-4fd2-b5d6-ed6996c11d9b None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:20.987899 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d153-42da-4fd2-b5d6-ed6996c11d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:21.005422 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-a9b3d153-42da-4fd2-b5d6-ed6996c11d9b None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:07:21.006687 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-a9b3d153-42da-4fd2-b5d6-ed6996c11d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:07:21.087444 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 622/1234] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:07:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:07:21.115339 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689d7d3-b531-4b77-a201-10d349b21709 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:21.143346 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:21.237987 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689d7d3-b531-4b77-a201-10d349b21709 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:21.274446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913fea4-5506-4e28-bb5b-d8eb6883fe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:21.275330 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913fea4-5506-4e28-bb5b-d8eb6883fe35 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:21.275614 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913fea4-5506-4e28-bb5b-d8eb6883fe35 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:21.275950 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913fea4-5506-4e28-bb5b-d8eb6883fe35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:21.288376 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913fea4-5506-4e28-bb5b-d8eb6883fe35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-1913fea4-5506-4e28-bb5b-d8eb6883fe35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:07:21.297100 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:21.299020 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:21.300629 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 613/1235] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:07:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:07:21.306308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3d153-42da-4fd2-b5d6-ed6996c11d9b None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:21.371965 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:21.432212 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3d153-42da-4fd2-b5d6-ed6996c11d9b None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:21.469925 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e586396-bb6c-4fa0-aa9f-8c14f8c52cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:21.470795 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e586396-bb6c-4fa0-aa9f-8c14f8c52cad None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:21.471177 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e586396-bb6c-4fa0-aa9f-8c14f8c52cad None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:21.471561 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e586396-bb6c-4fa0-aa9f-8c14f8c52cad None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:21.472428 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e586396-bb6c-4fa0-aa9f-8c14f8c52cad None admin] RBAC: Adding query filter params (name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:21.472831 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e586396-bb6c-4fa0-aa9f-8c14f8c52cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:21.474356 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e586396-bb6c-4fa0-aa9f-8c14f8c52cad None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:21.484127 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 623/1236] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:07:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:21.496725 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913fea4-5506-4e28-bb5b-d8eb6883fe35 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:21.586551 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:21.603740 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913fea4-5506-4e28-bb5b-d8eb6883fe35 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:21.641439 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5d485-2f80-4374-98f0-abefcb1a59be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:21.642258 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5d485-2f80-4374-98f0-abefcb1a59be None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:21.642545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5d485-2f80-4374-98f0-abefcb1a59be None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:21.642861 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5d485-2f80-4374-98f0-abefcb1a59be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:21.655468 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5d485-2f80-4374-98f0-abefcb1a59be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:21.657188 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5d485-2f80-4374-98f0-abefcb1a59be None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-c1b5d485-2f80-4374-98f0-abefcb1a59be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:21.678711 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:21.680599 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:21.682465 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:21.682465 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:21.682465 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:21.682465 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:21.682465 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 614/1237] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:21.687346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e586396-bb6c-4fa0-aa9f-8c14f8c52cad None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:21.803317 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e586396-bb6c-4fa0-aa9f-8c14f8c52cad None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:21.813400 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:21.840020 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477809e-46fc-4b9a-817a-1d2f713c388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:21.840692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477809e-46fc-4b9a-817a-1d2f713c388b None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:21.840974 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477809e-46fc-4b9a-817a-1d2f713c388b None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:21.841253 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477809e-46fc-4b9a-817a-1d2f713c388b None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:21.842000 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477809e-46fc-4b9a-817a-1d2f713c388b None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:21.842333 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477809e-46fc-4b9a-817a-1d2f713c388b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:21.843780 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477809e-46fc-4b9a-817a-1d2f713c388b None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:21.861733 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 624/1238] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:21.868482 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5d485-2f80-4374-98f0-abefcb1a59be None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:21.982335 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5d485-2f80-4374-98f0-abefcb1a59be None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:22.032769 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbf02e-9042-43c3-8365-dae94534539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:22.033591 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbf02e-9042-43c3-8365-dae94534539a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:22.033914 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbf02e-9042-43c3-8365-dae94534539a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:22.034196 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbf02e-9042-43c3-8365-dae94534539a None admin] PATH_INFO: `/v3/users/placement` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:22.037464 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:22.043034 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbf02e-9042-43c3-8365-dae94534539a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:22.044547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbf02e-9042-43c3-8365-dae94534539a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-2afbf02e-9042-43c3-8365-dae94534539a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:07:22.061101 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:22.062891 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:22.064843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:22.064843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:22.064843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:07:22.064843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:07:22.064843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:07:22.064843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:07:22.064843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:07:22.064843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:07:22.064843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:22.064843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:22.064843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 615/1239] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:22.070989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477809e-46fc-4b9a-817a-1d2f713c388b None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:22.186235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477809e-46fc-4b9a-817a-1d2f713c388b None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:22.229065 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103441f-644e-49e4-bf78-cd5056d3febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:22.229723 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103441f-644e-49e4-bf78-cd5056d3febf None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:22.230008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103441f-644e-49e4-bf78-cd5056d3febf None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:22.230355 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103441f-644e-49e4-bf78-cd5056d3febf None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:22.231256 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103441f-644e-49e4-bf78-cd5056d3febf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:22.231592 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103441f-644e-49e4-bf78-cd5056d3febf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:22.233074 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103441f-644e-49e4-bf78-cd5056d3febf None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:22.253944 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 625/1240] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:07:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:22.260457 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbf02e-9042-43c3-8365-dae94534539a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:22.386681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbf02e-9042-43c3-8365-dae94534539a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:22.433352 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a0944-5ddf-4546-84f0-fee8abde04de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:22.434019 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a0944-5ddf-4546-84f0-fee8abde04de None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:22.434302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a0944-5ddf-4546-84f0-fee8abde04de None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:22.434580 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a0944-5ddf-4546-84f0-fee8abde04de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:22.503572 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:22.511379 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a0944-5ddf-4546-84f0-fee8abde04de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:22.512879 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a0944-5ddf-4546-84f0-fee8abde04de None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:22.620055 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 616/1241] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:07:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:07:22.628987 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103441f-644e-49e4-bf78-cd5056d3febf None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:22.663223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:22.778581 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103441f-644e-49e4-bf78-cd5056d3febf None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:22.823499 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9f59-eb6b-4cdc-92f2-11506b44bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:22.824414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9f59-eb6b-4cdc-92f2-11506b44bdad None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:22.824697 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9f59-eb6b-4cdc-92f2-11506b44bdad None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:22.824976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9f59-eb6b-4cdc-92f2-11506b44bdad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:22.836836 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d9f59-eb6b-4cdc-92f2-11506b44bdad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:22.838337 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d9f59-eb6b-4cdc-92f2-11506b44bdad None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-483d9f59-eb6b-4cdc-92f2-11506b44bdad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:22.857476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:22.859551 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:22.861619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:22.861619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:22.861619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:22.861619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:22.861619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 626/1242] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:22.866152 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a0944-5ddf-4546-84f0-fee8abde04de None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:22.970818 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:22.976955 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a0944-5ddf-4546-84f0-fee8abde04de None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:23.013588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ffd3d-03db-46ac-b711-5e9e5d7d1db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:23.014284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ffd3d-03db-46ac-b711-5e9e5d7d1db0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:23.014552 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ffd3d-03db-46ac-b711-5e9e5d7d1db0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:23.014864 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ffd3d-03db-46ac-b711-5e9e5d7d1db0 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:23.015609 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ffd3d-03db-46ac-b711-5e9e5d7d1db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:23.015918 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ffd3d-03db-46ac-b711-5e9e5d7d1db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:23.017466 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ffd3d-03db-46ac-b711-5e9e5d7d1db0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:23.031654 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 617/1243] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:23.041399 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9f59-eb6b-4cdc-92f2-11506b44bdad None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:23.164296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:23.192782 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9f59-eb6b-4cdc-92f2-11506b44bdad None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:23.245840 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1117d-6043-425c-9d7d-2c7e1e602616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:23.247321 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1117d-6043-425c-9d7d-2c7e1e602616 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:23.247807 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1117d-6043-425c-9d7d-2c7e1e602616 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:23.248298 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1117d-6043-425c-9d7d-2c7e1e602616 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:23.262646 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1117d-6043-425c-9d7d-2c7e1e602616 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:23.265565 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1117d-6043-425c-9d7d-2c7e1e602616 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-38c1117d-6043-425c-9d7d-2c7e1e602616 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:07:23.293031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:23.294145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:23.295359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:07:23.295359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:07:23.295359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:07:23.295359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:07:23.295359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:07:23.295359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:07:23.295359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:23.295359 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:23.295830 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 627/1244] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:07:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:23.301671 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ffd3d-03db-46ac-b711-5e9e5d7d1db0 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:23.421986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ffd3d-03db-46ac-b711-5e9e5d7d1db0 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:23.464059 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585edf7-444e-4bec-bec5-970e4f0c5c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:23.464941 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585edf7-444e-4bec-bec5-970e4f0c5c57 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:23.465325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585edf7-444e-4bec-bec5-970e4f0c5c57 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:23.465723 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585edf7-444e-4bec-bec5-970e4f0c5c57 None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:23.466742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585edf7-444e-4bec-bec5-970e4f0c5c57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:23.467147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585edf7-444e-4bec-bec5-970e4f0c5c57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:23.468720 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585edf7-444e-4bec-bec5-970e4f0c5c57 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:23.483997 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 618/1245] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:07:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:23.490652 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1117d-6043-425c-9d7d-2c7e1e602616 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:23.621021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1117d-6043-425c-9d7d-2c7e1e602616 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:23.659041 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68916234-7e44-4f71-a588-9ebf214d7fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:23.659700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68916234-7e44-4f71-a588-9ebf214d7fd5 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:23.659981 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68916234-7e44-4f71-a588-9ebf214d7fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:23.660269 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68916234-7e44-4f71-a588-9ebf214d7fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:23.661098 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68916234-7e44-4f71-a588-9ebf214d7fd5 None admin] RBAC: Adding query filter params (role.id=2c04974ce949479c8b4826c59fb652b3, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=4148ab38693847f8bb2b85ee5be6ba1a) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:23.661410 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68916234-7e44-4f71-a588-9ebf214d7fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:23.663071 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68916234-7e44-4f71-a588-9ebf214d7fd5 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:23.671193 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 628/1246] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:07:23 2022] GET /identity/v3/role_assignments?user.id=4148ab38693847f8bb2b85ee5be6ba1a&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=2c04974ce949479c8b4826c59fb652b3 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:26.127922 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac2ff-6529-463d-bf9d-dba711db4e73 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:26.128533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac2ff-6529-463d-bf9d-dba711db4e73 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:26.128533 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac2ff-6529-463d-bf9d-dba711db4e73 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:26.129868 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 619/1247] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:07:26.136589 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201306e-2b42-42f5-8a28-f7cfeb9c6dbb None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:26.139177 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201306e-2b42-42f5-8a28-f7cfeb9c6dbb None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:26.139177 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201306e-2b42-42f5-8a28-f7cfeb9c6dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:26.142353 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:26.155454 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-3201306e-2b42-42f5-8a28-f7cfeb9c6dbb None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:07:26.156660 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-3201306e-2b42-42f5-8a28-f7cfeb9c6dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:07:26.235062 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 629/1248] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:07:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:07:26.260308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac2ff-6529-463d-bf9d-dba711db4e73 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:26.281966 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:26.374015 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac2ff-6529-463d-bf9d-dba711db4e73 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:26.411753 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5776b96-801c-4c04-82a1-393cee3956cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:26.412517 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5776b96-801c-4c04-82a1-393cee3956cf None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:26.412842 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5776b96-801c-4c04-82a1-393cee3956cf None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:26.413162 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5776b96-801c-4c04-82a1-393cee3956cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:26.429283 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5776b96-801c-4c04-82a1-393cee3956cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-d5776b96-801c-4c04-82a1-393cee3956cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:07:26.438187 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:26.439895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:26.441548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 620/1249] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:07:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:26.446582 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201306e-2b42-42f5-8a28-f7cfeb9c6dbb None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:26.558223 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201306e-2b42-42f5-8a28-f7cfeb9c6dbb None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:26.591618 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:26.596996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d69d9-6308-4992-82aa-a03782e69a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:26.597726 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d69d9-6308-4992-82aa-a03782e69a3d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:26.598009 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d69d9-6308-4992-82aa-a03782e69a3d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:26.598281 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d69d9-6308-4992-82aa-a03782e69a3d None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:26.599119 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d69d9-6308-4992-82aa-a03782e69a3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:26.599417 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d69d9-6308-4992-82aa-a03782e69a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:26.600858 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d69d9-6308-4992-82aa-a03782e69a3d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:26.611475 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 630/1250] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:07:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:26.618142 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5776b96-801c-4c04-82a1-393cee3956cf None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:26.702765 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:26.727106 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5776b96-801c-4c04-82a1-393cee3956cf None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:26.763874 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf44bf5-0cab-4513-b70c-40078464fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:26.764677 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf44bf5-0cab-4513-b70c-40078464fea5 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:26.764982 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf44bf5-0cab-4513-b70c-40078464fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:26.765257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf44bf5-0cab-4513-b70c-40078464fea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:26.777355 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf44bf5-0cab-4513-b70c-40078464fea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:26.778935 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf44bf5-0cab-4513-b70c-40078464fea5 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-aaf44bf5-0cab-4513-b70c-40078464fea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:26.799359 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:26.801844 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:26.803084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:26.803084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:26.803084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:26.803084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:26.803084 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 621/1251] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:07:26.807972 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d69d9-6308-4992-82aa-a03782e69a3d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:26.920989 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d69d9-6308-4992-82aa-a03782e69a3d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:26.957969 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197d3dd-f63a-4db2-a1fc-3d3cbf32fc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:26.958538 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197d3dd-f63a-4db2-a1fc-3d3cbf32fc82 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:26.958848 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197d3dd-f63a-4db2-a1fc-3d3cbf32fc82 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:26.959126 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197d3dd-f63a-4db2-a1fc-3d3cbf32fc82 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:26.959869 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197d3dd-f63a-4db2-a1fc-3d3cbf32fc82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:26.960176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197d3dd-f63a-4db2-a1fc-3d3cbf32fc82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:26.961584 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197d3dd-f63a-4db2-a1fc-3d3cbf32fc82 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:26.975171 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 631/1252] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:07:26.981289 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf44bf5-0cab-4513-b70c-40078464fea5 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:27.093185 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf44bf5-0cab-4513-b70c-40078464fea5 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:27.124438 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:27.138547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af45a9-84a9-4499-832b-ff4fdcd1a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:27.139849 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af45a9-84a9-4499-832b-ff4fdcd1a2b8 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:27.140304 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af45a9-84a9-4499-832b-ff4fdcd1a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:27.140806 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af45a9-84a9-4499-832b-ff4fdcd1a2b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:27.155995 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af45a9-84a9-4499-832b-ff4fdcd1a2b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:27.158780 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af45a9-84a9-4499-832b-ff4fdcd1a2b8 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-e5af45a9-84a9-4499-832b-ff4fdcd1a2b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:07:27.189178 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:27.190331 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:27.191441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:27.191441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:27.191441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:07:27.191441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:07:27.191441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:07:27.191441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:07:27.191441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:07:27.191441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:07:27.191441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:27.191441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:27.191441 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 622/1253] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:07:27.197176 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197d3dd-f63a-4db2-a1fc-3d3cbf32fc82 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:27.269998 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:27.317844 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197d3dd-f63a-4db2-a1fc-3d3cbf32fc82 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:27.356558 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec2ba2-e2bc-4626-b1ab-9d0820500766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:27.357414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec2ba2-e2bc-4626-b1ab-9d0820500766 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:27.357793 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec2ba2-e2bc-4626-b1ab-9d0820500766 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:27.358168 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec2ba2-e2bc-4626-b1ab-9d0820500766 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:27.359263 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec2ba2-e2bc-4626-b1ab-9d0820500766 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:27.359686 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec2ba2-e2bc-4626-b1ab-9d0820500766 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:27.361423 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec2ba2-e2bc-4626-b1ab-9d0820500766 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:27.386710 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 632/1254] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:07:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:27.390387 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af45a9-84a9-4499-832b-ff4fdcd1a2b8 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:27.528451 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af45a9-84a9-4499-832b-ff4fdcd1a2b8 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:27.567117 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9b5db-7ad1-46ee-92f4-0a573c3d6a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:27.567810 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9b5db-7ad1-46ee-92f4-0a573c3d6a2b None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:27.568094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9b5db-7ad1-46ee-92f4-0a573c3d6a2b None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:27.568373 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9b5db-7ad1-46ee-92f4-0a573c3d6a2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:27.629393 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:27.644578 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9b5db-7ad1-46ee-92f4-0a573c3d6a2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:27.646093 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9b5db-7ad1-46ee-92f4-0a573c3d6a2b None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:27.759287 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 623/1255] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:07:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:07:27.765865 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec2ba2-e2bc-4626-b1ab-9d0820500766 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:27.889539 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec2ba2-e2bc-4626-b1ab-9d0820500766 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:27.905089 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:27.929313 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ad153-6bab-4f89-b39b-fe2935dd113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:27.931027 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ad153-6bab-4f89-b39b-fe2935dd113d None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:27.931311 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ad153-6bab-4f89-b39b-fe2935dd113d None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:27.931586 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ad153-6bab-4f89-b39b-fe2935dd113d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:27.943069 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ad153-6bab-4f89-b39b-fe2935dd113d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:27.944623 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ad153-6bab-4f89-b39b-fe2935dd113d None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-151ad153-6bab-4f89-b39b-fe2935dd113d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:27.972080 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:27.973261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:27.974346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:27.974346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:27.974346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:27.974346 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:27.974598 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 633/1256] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:07:27.981241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9b5db-7ad1-46ee-92f4-0a573c3d6a2b None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:28.088158 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:28.102262 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9b5db-7ad1-46ee-92f4-0a573c3d6a2b None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:28.139882 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cf511-8ca8-47a6-a14f-21b50edc8ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:28.140870 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cf511-8ca8-47a6-a14f-21b50edc8ff0 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:28.141211 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cf511-8ca8-47a6-a14f-21b50edc8ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:28.141576 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cf511-8ca8-47a6-a14f-21b50edc8ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:28.142411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cf511-8ca8-47a6-a14f-21b50edc8ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:28.142870 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cf511-8ca8-47a6-a14f-21b50edc8ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:28.144539 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cf511-8ca8-47a6-a14f-21b50edc8ff0 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:28.175253 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 624/1257] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:28.182299 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ad153-6bab-4f89-b39b-fe2935dd113d None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:28.306466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ad153-6bab-4f89-b39b-fe2935dd113d None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:28.351980 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa4c5-fa49-4363-9d34-7db21abda1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:28.352888 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa4c5-fa49-4363-9d34-7db21abda1d3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:28.353220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa4c5-fa49-4363-9d34-7db21abda1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:28.353657 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa4c5-fa49-4363-9d34-7db21abda1d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:28.362042 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaa4c5-fa49-4363-9d34-7db21abda1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:28.363749 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaa4c5-fa49-4363-9d34-7db21abda1d3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-32eaa4c5-fa49-4363-9d34-7db21abda1d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:07:28.379225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:28.380837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:28.382748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:07:28.382748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:07:28.382748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:07:28.382748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:07:28.382748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:07:28.382748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:07:28.382748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:28.382748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:28.382748 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 634/1258] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:07:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:28.389330 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cf511-8ca8-47a6-a14f-21b50edc8ff0 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:28.507171 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cf511-8ca8-47a6-a14f-21b50edc8ff0 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:28.545358 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ef932-0e74-438a-8532-6e1cfdaa9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:28.546046 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ef932-0e74-438a-8532-6e1cfdaa9f00 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:28.546330 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ef932-0e74-438a-8532-6e1cfdaa9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:28.546659 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ef932-0e74-438a-8532-6e1cfdaa9f00 None admin] PATH_INFO: `/v3/projects` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:28.547458 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ef932-0e74-438a-8532-6e1cfdaa9f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:28.547769 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ef932-0e74-438a-8532-6e1cfdaa9f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:28.549217 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ef932-0e74-438a-8532-6e1cfdaa9f00 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:28.563374 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 625/1259] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:07:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:28.570114 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa4c5-fa49-4363-9d34-7db21abda1d3 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:28.599740 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:28.684522 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa4c5-fa49-4363-9d34-7db21abda1d3 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:28.722754 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe40d6c-3173-45b7-8931-ffaf10ab2fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:28.723504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe40d6c-3173-45b7-8931-ffaf10ab2fbf None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:28.723789 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe40d6c-3173-45b7-8931-ffaf10ab2fbf None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:28.724067 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe40d6c-3173-45b7-8931-ffaf10ab2fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:28.724923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe40d6c-3173-45b7-8931-ffaf10ab2fbf None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=4148ab38693847f8bb2b85ee5be6ba1a) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:28.725232 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe40d6c-3173-45b7-8931-ffaf10ab2fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:28.726747 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe40d6c-3173-45b7-8931-ffaf10ab2fbf None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:28.732700 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 635/1260] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:07:28 2022] GET /identity/v3/role_assignments?user.id=4148ab38693847f8bb2b85ee5be6ba1a&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:30.998003 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d902f-f9d0-404b-9717-c90769158614 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:30.998564 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d902f-f9d0-404b-9717-c90769158614 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:30.998564 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d902f-f9d0-404b-9717-c90769158614 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:30.999976 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 626/1261] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:07:31.006075 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a0fb2-9bd0-4a59-a9b7-90fa3671d44e None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:31.006566 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a0fb2-9bd0-4a59-a9b7-90fa3671d44e None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:31.006746 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a0fb2-9bd0-4a59-a9b7-90fa3671d44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:31.025719 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-829a0fb2-9bd0-4a59-a9b7-90fa3671d44e None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:07:31.027115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-829a0fb2-9bd0-4a59-a9b7-90fa3671d44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:07:31.101332 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 636/1262] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:07:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:07:31.124653 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d902f-f9d0-404b-9717-c90769158614 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:31.141012 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:31.257312 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d902f-f9d0-404b-9717-c90769158614 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:31.293229 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0609e-e795-439f-9139-a7a36cec5735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:31.294035 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0609e-e795-439f-9139-a7a36cec5735 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:31.294325 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0609e-e795-439f-9139-a7a36cec5735 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:31.294593 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0609e-e795-439f-9139-a7a36cec5735 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:31.306963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0609e-e795-439f-9139-a7a36cec5735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-cea0609e-e795-439f-9139-a7a36cec5735 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:07:31.315936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:31.321017 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:31.322938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 627/1263] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:07:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:31.326465 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a0fb2-9bd0-4a59-a9b7-90fa3671d44e None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:31.347250 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:31.461588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a0fb2-9bd0-4a59-a9b7-90fa3671d44e None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:31.507308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d998e0-23d8-49b8-9fd1-8db5a578921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:31.508769 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d998e0-23d8-49b8-9fd1-8db5a578921a None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:31.509044 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d998e0-23d8-49b8-9fd1-8db5a578921a None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:31.509471 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d998e0-23d8-49b8-9fd1-8db5a578921a None admin] PATH_INFO: `/v3/roles` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:31.510295 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d998e0-23d8-49b8-9fd1-8db5a578921a None admin] RBAC: Adding query filter params (name=admin) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:31.510758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d998e0-23d8-49b8-9fd1-8db5a578921a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:31.517832 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d998e0-23d8-49b8-9fd1-8db5a578921a None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:31.523296 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 637/1264] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:31.530147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0609e-e795-439f-9139-a7a36cec5735 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:31.612692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:31.651407 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0609e-e795-439f-9139-a7a36cec5735 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:31.690302 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840119-4659-49b9-88c3-df3b520dc2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:31.691124 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840119-4659-49b9-88c3-df3b520dc2d4 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:31.691409 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840119-4659-49b9-88c3-df3b520dc2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:31.691685 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840119-4659-49b9-88c3-df3b520dc2d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:31.705514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c840119-4659-49b9-88c3-df3b520dc2d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:31.707032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c840119-4659-49b9-88c3-df3b520dc2d4 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-8c840119-4659-49b9-88c3-df3b520dc2d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:31.727135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:31.728798 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:31.730518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:31.730518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:31.730518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:31.730518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:31.730518 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 628/1265] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:07:31.734546 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d998e0-23d8-49b8-9fd1-8db5a578921a None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:31.830090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:31.852068 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d998e0-23d8-49b8-9fd1-8db5a578921a None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:31.887281 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c078c87-90fb-4412-be64-df7e1a340dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:31.887961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078c87-90fb-4412-be64-df7e1a340dea None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:31.888241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078c87-90fb-4412-be64-df7e1a340dea None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:31.888515 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078c87-90fb-4412-be64-df7e1a340dea None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:31.889357 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c078c87-90fb-4412-be64-df7e1a340dea None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:31.889662 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c078c87-90fb-4412-be64-df7e1a340dea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:31.891112 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c078c87-90fb-4412-be64-df7e1a340dea None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:31.903825 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 638/1266] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:31.913338 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840119-4659-49b9-88c3-df3b520dc2d4 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:32.099917 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840119-4659-49b9-88c3-df3b520dc2d4 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:32.138574 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:32.162588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44ca1d-d832-4510-97e1-bbb496c6a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:32.164072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44ca1d-d832-4510-97e1-bbb496c6a1e5 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:32.164581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44ca1d-d832-4510-97e1-bbb496c6a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:32.165215 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44ca1d-d832-4510-97e1-bbb496c6a1e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:32.181088 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44ca1d-d832-4510-97e1-bbb496c6a1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:32.184016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44ca1d-d832-4510-97e1-bbb496c6a1e5 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-8e44ca1d-d832-4510-97e1-bbb496c6a1e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:07:32.211598 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:32.213299 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:32.216144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:32.216144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:32.216144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:07:32.216144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:07:32.216144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:07:32.216144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:07:32.216144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:07:32.216144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:07:32.216144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:32.216144 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:32.218826 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 629/1267] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:32.223076 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c078c87-90fb-4412-be64-df7e1a340dea None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:32.336040 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c078c87-90fb-4412-be64-df7e1a340dea None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:32.391193 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2493e88-6945-4d58-b496-13dc093dca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:32.392379 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2493e88-6945-4d58-b496-13dc093dca24 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:32.394337 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2493e88-6945-4d58-b496-13dc093dca24 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:32.394337 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2493e88-6945-4d58-b496-13dc093dca24 None admin] PATH_INFO: `/v3/users` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:32.395190 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2493e88-6945-4d58-b496-13dc093dca24 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:32.395722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2493e88-6945-4d58-b496-13dc093dca24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:32.398519 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2493e88-6945-4d58-b496-13dc093dca24 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:32.415975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:32.425534 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 639/1268] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:07:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:32.432074 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44ca1d-d832-4510-97e1-bbb496c6a1e5 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:32.545887 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44ca1d-d832-4510-97e1-bbb496c6a1e5 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:32.585538 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a92903-b162-406b-a572-19eeff601947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:32.586473 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a92903-b162-406b-a572-19eeff601947 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:32.586843 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a92903-b162-406b-a572-19eeff601947 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:32.587229 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a92903-b162-406b-a572-19eeff601947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:32.600255 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a92903-b162-406b-a572-19eeff601947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:32.602291 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a92903-b162-406b-a572-19eeff601947 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-75a92903-b162-406b-a572-19eeff601947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:32.621462 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:32.623136 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:32.624986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:32.624986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:32.624986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:32.624986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:32.624986 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 630/1269] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:32.632787 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2493e88-6945-4d58-b496-13dc093dca24 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:32.796290 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2493e88-6945-4d58-b496-13dc093dca24 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:32.837599 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c296c0d-a365-49c3-8e9e-29af10f9053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:32.838307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296c0d-a365-49c3-8e9e-29af10f9053f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:32.838595 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296c0d-a365-49c3-8e9e-29af10f9053f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:32.838914 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296c0d-a365-49c3-8e9e-29af10f9053f None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:32.839810 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c296c0d-a365-49c3-8e9e-29af10f9053f None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:32.840156 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c296c0d-a365-49c3-8e9e-29af10f9053f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:32.841631 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c296c0d-a365-49c3-8e9e-29af10f9053f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:32.855666 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 640/1270] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:32.865531 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a92903-b162-406b-a572-19eeff601947 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:32.907989 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:32.989563 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a92903-b162-406b-a572-19eeff601947 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:33.029783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8a19a-3fc1-4bfa-acb3-c87e91866f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:33.030737 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a19a-3fc1-4bfa-acb3-c87e91866f12 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:33.031028 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a19a-3fc1-4bfa-acb3-c87e91866f12 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:33.031308 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a19a-3fc1-4bfa-acb3-c87e91866f12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:33.039769 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8a19a-3fc1-4bfa-acb3-c87e91866f12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:33.041277 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8a19a-3fc1-4bfa-acb3-c87e91866f12 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-f7b8a19a-3fc1-4bfa-acb3-c87e91866f12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:07:33.056942 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:33.058484 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:33.060241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:07:33.060241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:07:33.060241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:07:33.060241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:07:33.060241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:07:33.060241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:07:33.060241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:33.060241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:33.060241 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 631/1271] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:33.065555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c296c0d-a365-49c3-8e9e-29af10f9053f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:33.144690 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:33.199014 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c296c0d-a365-49c3-8e9e-29af10f9053f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:33.248539 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69ca57-b415-4e39-b45a-c0d6bab58d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:33.249482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ca57-b415-4e39-b45a-c0d6bab58d7c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:33.249482 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ca57-b415-4e39-b45a-c0d6bab58d7c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:33.249743 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ca57-b415-4e39-b45a-c0d6bab58d7c None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:33.250581 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69ca57-b415-4e39-b45a-c0d6bab58d7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:33.250934 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69ca57-b415-4e39-b45a-c0d6bab58d7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:33.252594 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69ca57-b415-4e39-b45a-c0d6bab58d7c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:33.276929 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 641/1272] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:07:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:07:33.283562 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8a19a-3fc1-4bfa-acb3-c87e91866f12 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:33.420034 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:33.431579 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8a19a-3fc1-4bfa-acb3-c87e91866f12 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:33.471947 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebb4e2-ae91-4f2b-8563-3b2b56fbf429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:33.472903 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebb4e2-ae91-4f2b-8563-3b2b56fbf429 None admin] REQUEST_METHOD: `PUT` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:33.473225 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebb4e2-ae91-4f2b-8563-3b2b56fbf429 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:33.473545 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebb4e2-ae91-4f2b-8563-3b2b56fbf429 None admin] PATH_INFO: `/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/4148ab38693847f8bb2b85ee5be6ba1a/roles/38e07a16dc8b4306be7688b9d5cd626b` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:33.475902 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebb4e2-ae91-4f2b-8563-3b2b56fbf429 None admin] RBAC: Authorizing `identity:create_grant(project_id=105df1a5d94f48d9a328b28b400aab90, user_id=4148ab38693847f8bb2b85ee5be6ba1a, role_id=38e07a16dc8b4306be7688b9d5cd626b)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:33.478011 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebb4e2-ae91-4f2b-8563-3b2b56fbf429 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:33.558962 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 632/1273] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:07:33 2022] PUT /identity/v3/projects/105df1a5d94f48d9a328b28b400aab90/users/4148ab38693847f8bb2b85ee5be6ba1a/roles/38e07a16dc8b4306be7688b9d5cd626b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:07:35.933675 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb23e1-1e83-4d79-8a60-997c181314b9 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:35.934256 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb23e1-1e83-4d79-8a60-997c181314b9 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:35.934256 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb23e1-1e83-4d79-8a60-997c181314b9 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:35.935655 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 642/1274] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:07:35.941459 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9970f4-5be3-422b-b225-8d0a7c944892 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:35.943315 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9970f4-5be3-422b-b225-8d0a7c944892 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:35.943315 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9970f4-5be3-422b-b225-8d0a7c944892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:35.959411 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-ac9970f4-5be3-422b-b225-8d0a7c944892 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:07:35.961155 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-ac9970f4-5be3-422b-b225-8d0a7c944892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:07:36.035378 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 633/1275] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:07:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:07:36.067732 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb23e1-1e83-4d79-8a60-997c181314b9 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:36.195450 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb23e1-1e83-4d79-8a60-997c181314b9 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:36.215485 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:36.235808 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7935af-29ef-4c81-ae18-b50c748e1a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:36.236621 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7935af-29ef-4c81-ae18-b50c748e1a44 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:36.236909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7935af-29ef-4c81-ae18-b50c748e1a44 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:36.237187 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7935af-29ef-4c81-ae18-b50c748e1a44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:36.248519 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7935af-29ef-4c81-ae18-b50c748e1a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-af7935af-29ef-4c81-ae18-b50c748e1a44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:07:36.256393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:36.258006 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:36.259043 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 643/1276] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:07:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:36.264552 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9970f4-5be3-422b-b225-8d0a7c944892 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:36.354895 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:36.374413 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9970f4-5be3-422b-b225-8d0a7c944892 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:36.418507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9813c-2b68-4bcf-9a53-4eb6da05d9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:36.419219 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9813c-2b68-4bcf-9a53-4eb6da05d9fa None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:36.419501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9813c-2b68-4bcf-9a53-4eb6da05d9fa None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:36.419777 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9813c-2b68-4bcf-9a53-4eb6da05d9fa None admin] PATH_INFO: `/v3/roles` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:36.420568 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9813c-2b68-4bcf-9a53-4eb6da05d9fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:36.420879 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9813c-2b68-4bcf-9a53-4eb6da05d9fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:36.422255 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9813c-2b68-4bcf-9a53-4eb6da05d9fa None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:36.431397 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 634/1277] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:36.439682 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7935af-29ef-4c81-ae18-b50c748e1a44 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:36.551031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7935af-29ef-4c81-ae18-b50c748e1a44 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:36.590211 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ade65-455e-4a8e-8ef6-a843465557ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:36.591654 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ade65-455e-4a8e-8ef6-a843465557ec None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:36.592169 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ade65-455e-4a8e-8ef6-a843465557ec None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:36.592682 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ade65-455e-4a8e-8ef6-a843465557ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:36.612397 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ade65-455e-4a8e-8ef6-a843465557ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:36.615406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ade65-455e-4a8e-8ef6-a843465557ec None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-d76ade65-455e-4a8e-8ef6-a843465557ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:36.649217 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:36.650301 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:36.651386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:36.651386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:36.651386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:36.651386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:36.651844 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 644/1278] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:36.657547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9813c-2b68-4bcf-9a53-4eb6da05d9fa None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:36.770907 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9813c-2b68-4bcf-9a53-4eb6da05d9fa None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:36.812038 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1064e31-19e9-4e9d-8382-92c236970228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:36.812651 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1064e31-19e9-4e9d-8382-92c236970228 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:36.812987 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1064e31-19e9-4e9d-8382-92c236970228 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:36.813271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1064e31-19e9-4e9d-8382-92c236970228 None admin] PATH_INFO: `/v3/domains` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:36.814011 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1064e31-19e9-4e9d-8382-92c236970228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:36.814324 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1064e31-19e9-4e9d-8382-92c236970228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:36.815742 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1064e31-19e9-4e9d-8382-92c236970228 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:36.828797 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 635/1279] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:36.835023 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ade65-455e-4a8e-8ef6-a843465557ec None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:36.868144 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:36.940582 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ade65-455e-4a8e-8ef6-a843465557ec None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:36.975865 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb31e54-771e-4458-bf5d-e2962082eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:36.977291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb31e54-771e-4458-bf5d-e2962082eb1f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:36.977569 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb31e54-771e-4458-bf5d-e2962082eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:36.977879 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb31e54-771e-4458-bf5d-e2962082eb1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:36.989814 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb31e54-771e-4458-bf5d-e2962082eb1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:36.991337 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb31e54-771e-4458-bf5d-e2962082eb1f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-5eb31e54-771e-4458-bf5d-e2962082eb1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:07:37.007728 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:37.008923 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:37.010249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:37.010249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:37.010249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:07:37.010249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:07:37.010249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:07:37.010249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:07:37.010249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:07:37.010249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:07:37.010249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:07:37.010249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:37.010249 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 645/1280] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:07:37.014956 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1064e31-19e9-4e9d-8382-92c236970228 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:37.019332 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:37.125374 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1064e31-19e9-4e9d-8382-92c236970228 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:37.160951 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43d52-48fd-4573-9cfd-73c8d6ab4cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:37.161705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43d52-48fd-4573-9cfd-73c8d6ab4cbe None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:37.161993 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43d52-48fd-4573-9cfd-73c8d6ab4cbe None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:37.162314 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43d52-48fd-4573-9cfd-73c8d6ab4cbe None admin] PATH_INFO: `/v3/users` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:37.163348 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43d52-48fd-4573-9cfd-73c8d6ab4cbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:37.164195 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43d52-48fd-4573-9cfd-73c8d6ab4cbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:37.165681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43d52-48fd-4573-9cfd-73c8d6ab4cbe None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:37.185028 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 636/1281] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:07:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:37.191171 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb31e54-771e-4458-bf5d-e2962082eb1f None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:37.292996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:37.303529 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb31e54-771e-4458-bf5d-e2962082eb1f None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:37.341734 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499ef02-22e7-47d4-8f8c-fe89cfbbc184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:37.342481 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499ef02-22e7-47d4-8f8c-fe89cfbbc184 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:37.342834 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499ef02-22e7-47d4-8f8c-fe89cfbbc184 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:37.343164 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499ef02-22e7-47d4-8f8c-fe89cfbbc184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:37.416982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499ef02-22e7-47d4-8f8c-fe89cfbbc184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:37.418397 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499ef02-22e7-47d4-8f8c-fe89cfbbc184 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:37.513763 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:37.525383 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 646/1282] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:07:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:07:37.531509 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43d52-48fd-4573-9cfd-73c8d6ab4cbe None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:37.597073 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:37.637665 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43d52-48fd-4573-9cfd-73c8d6ab4cbe None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:37.676800 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821d1a3-0052-4714-b566-77c6e6ca5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:37.678249 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d1a3-0052-4714-b566-77c6e6ca5a8a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:37.678249 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d1a3-0052-4714-b566-77c6e6ca5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:37.678516 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d1a3-0052-4714-b566-77c6e6ca5a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:37.691756 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821d1a3-0052-4714-b566-77c6e6ca5a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:37.693510 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821d1a3-0052-4714-b566-77c6e6ca5a8a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-7821d1a3-0052-4714-b566-77c6e6ca5a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:07:37.714341 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:37.716602 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:37.717652 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:07:37.717652 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:07:37.717652 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:07:37.717652 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:37.717652 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 637/1283] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:37.722860 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499ef02-22e7-47d4-8f8c-fe89cfbbc184 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:37.844946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499ef02-22e7-47d4-8f8c-fe89cfbbc184 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:37.885566 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2459f5d-0ff7-425c-b11f-bed9a31a05c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:37.886241 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2459f5d-0ff7-425c-b11f-bed9a31a05c5 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:37.886524 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2459f5d-0ff7-425c-b11f-bed9a31a05c5 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:37.891291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2459f5d-0ff7-425c-b11f-bed9a31a05c5 None admin] PATH_INFO: `/v3/domains` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:37.891291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2459f5d-0ff7-425c-b11f-bed9a31a05c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:37.891291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2459f5d-0ff7-425c-b11f-bed9a31a05c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:37.891291 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2459f5d-0ff7-425c-b11f-bed9a31a05c5 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:37.902967 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 647/1284] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:37.909203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821d1a3-0052-4714-b566-77c6e6ca5a8a None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:38.077189 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821d1a3-0052-4714-b566-77c6e6ca5a8a None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:38.091928 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:38.112857 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02f79e-a19c-4fd8-8688-1a52c477521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:38.113664 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02f79e-a19c-4fd8-8688-1a52c477521f None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:38.114681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02f79e-a19c-4fd8-8688-1a52c477521f None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:38.114681 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02f79e-a19c-4fd8-8688-1a52c477521f None admin] PATH_INFO: `/v3/projects/service` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:38.122293 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02f79e-a19c-4fd8-8688-1a52c477521f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:38.123958 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02f79e-a19c-4fd8-8688-1a52c477521f None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application [None req-1f02f79e-a19c-4fd8-8688-1a52c477521f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:07:38.139030 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application with Lock( May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:38.140091 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:38.141061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:07:38.141061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:07:38.141061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:07:38.141061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:07:38.141061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:07:38.141061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:07:38.141061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:07:38.141061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: ERROR keystone.server.flask.application May 19 20:07:38.141061 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 638/1285] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:07:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:38.146478 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2459f5d-0ff7-425c-b11f-bed9a31a05c5 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:38.209414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:38.274083 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2459f5d-0ff7-425c-b11f-bed9a31a05c5 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:38.317102 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ae4bc-e27c-4f4e-8e89-eaa99c1aa7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:38.317907 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae4bc-e27c-4f4e-8e89-eaa99c1aa7e0 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:38.318229 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae4bc-e27c-4f4e-8e89-eaa99c1aa7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:38.318545 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae4bc-e27c-4f4e-8e89-eaa99c1aa7e0 None admin] PATH_INFO: `/v3/projects` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:38.319441 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ae4bc-e27c-4f4e-8e89-eaa99c1aa7e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:38.321495 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ae4bc-e27c-4f4e-8e89-eaa99c1aa7e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:38.322168 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ae4bc-e27c-4f4e-8e89-eaa99c1aa7e0 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:38.345206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 648/1286] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:07:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:38.351164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02f79e-a19c-4fd8-8688-1a52c477521f None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:38.481988 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02f79e-a19c-4fd8-8688-1a52c477521f None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:38.520369 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa67c5-e5f8-4a08-be45-bea7c9307e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:38.521042 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa67c5-e5f8-4a08-be45-bea7c9307e73 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:38.521320 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa67c5-e5f8-4a08-be45-bea7c9307e73 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:38.521594 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa67c5-e5f8-4a08-be45-bea7c9307e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:38.522446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa67c5-e5f8-4a08-be45-bea7c9307e73 None admin] RBAC: Adding query filter params (role.id=38e07a16dc8b4306be7688b9d5cd626b, scope.project.id=105df1a5d94f48d9a328b28b400aab90, user.id=4148ab38693847f8bb2b85ee5be6ba1a) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:38.522788 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa67c5-e5f8-4a08-be45-bea7c9307e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:38.524275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa67c5-e5f8-4a08-be45-bea7c9307e73 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:38.531012 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 639/1287] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:07:38 2022] GET /identity/v3/role_assignments?user.id=4148ab38693847f8bb2b85ee5be6ba1a&scope.project.id=105df1a5d94f48d9a328b28b400aab90&role.id=38e07a16dc8b4306be7688b9d5cd626b => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:40.912717 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1fc3-90fa-4a9c-bafa-33969477d152 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:40.913293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1fc3-90fa-4a9c-bafa-33969477d152 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:40.913293 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1fc3-90fa-4a9c-bafa-33969477d152 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:40.914738 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 649/1288] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:07:40.920405 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b3169-391c-4e12-829a-72159d70348e None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:40.929147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b3169-391c-4e12-829a-72159d70348e None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:40.929147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b3169-391c-4e12-829a-72159d70348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:40.939646 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-b17b3169-391c-4e12-829a-72159d70348e None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:07:40.940919 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-b17b3169-391c-4e12-829a-72159d70348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:07:40.975430 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:41.018616 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 640/1289] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:07:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:07:41.043434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1fc3-90fa-4a9c-bafa-33969477d152 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:41.163135 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1fc3-90fa-4a9c-bafa-33969477d152 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:41.175925 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:41.202979 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edec8a7-5cea-4bab-ae24-3401700d3ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:41.203803 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edec8a7-5cea-4bab-ae24-3401700d3ca7 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:41.204086 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edec8a7-5cea-4bab-ae24-3401700d3ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:41.204362 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edec8a7-5cea-4bab-ae24-3401700d3ca7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:41.205038 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edec8a7-5cea-4bab-ae24-3401700d3ca7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:41.206493 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edec8a7-5cea-4bab-ae24-3401700d3ca7 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-7edec8a7-5cea-4bab-ae24-3401700d3ca7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:41.220650 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:41.222750 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:41.236109 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 650/1290] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:07:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:41.238170 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b3169-391c-4e12-829a-72159d70348e None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:41.342633 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b3169-391c-4e12-829a-72159d70348e None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:41.379639 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566428c-e934-464f-81ed-937dfebbdb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:41.380311 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566428c-e934-464f-81ed-937dfebbdb1c None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:41.380592 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566428c-e934-464f-81ed-937dfebbdb1c None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:41.380867 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566428c-e934-464f-81ed-937dfebbdb1c None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:41.381590 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566428c-e934-464f-81ed-937dfebbdb1c None admin] RBAC: Adding query filter params (name=placement) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:41.381898 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566428c-e934-464f-81ed-937dfebbdb1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:41.383929 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566428c-e934-464f-81ed-937dfebbdb1c None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:41.389415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 641/1291] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:07:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:41.395713 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edec8a7-5cea-4bab-ae24-3401700d3ca7 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:41.506261 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edec8a7-5cea-4bab-ae24-3401700d3ca7 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:41.542394 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5013a61-a62e-44aa-9578-a00ed1849f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:41.543104 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5013a61-a62e-44aa-9578-a00ed1849f6f None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:41.543391 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5013a61-a62e-44aa-9578-a00ed1849f6f None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:41.543670 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5013a61-a62e-44aa-9578-a00ed1849f6f None admin] PATH_INFO: `/v3/services` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:41.544446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5013a61-a62e-44aa-9578-a00ed1849f6f None admin] RBAC: Adding query filter params (type=placement) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:41.544829 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5013a61-a62e-44aa-9578-a00ed1849f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:41.546235 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5013a61-a62e-44aa-9578-a00ed1849f6f None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:41.551464 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 651/1292] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:07:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:43.860375 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fa9a2-cfcc-44d7-b2f5-e03e4624ab0d None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:43.860969 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fa9a2-cfcc-44d7-b2f5-e03e4624ab0d None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:43.860969 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fa9a2-cfcc-44d7-b2f5-e03e4624ab0d None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:43.862514 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 642/1293] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:07:43.872153 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad843edb-8aab-4c50-8a62-1020321a9bdd None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:43.872981 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad843edb-8aab-4c50-8a62-1020321a9bdd None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:43.872981 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad843edb-8aab-4c50-8a62-1020321a9bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:43.891339 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-ad843edb-8aab-4c50-8a62-1020321a9bdd None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:07:43.892655 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-ad843edb-8aab-4c50-8a62-1020321a9bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:07:43.928580 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:43.971598 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 652/1294] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:07:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:07:43.996450 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fa9a2-cfcc-44d7-b2f5-e03e4624ab0d None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:44.032321 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:44.119958 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fa9a2-cfcc-44d7-b2f5-e03e4624ab0d None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:44.161029 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8ae72-f47a-4d0a-8ec0-639bd4bee993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:44.161738 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ae72-f47a-4d0a-8ec0-639bd4bee993 None admin] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:44.162016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ae72-f47a-4d0a-8ec0-639bd4bee993 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:44.162288 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ae72-f47a-4d0a-8ec0-639bd4bee993 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:44.163078 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8ae72-f47a-4d0a-8ec0-639bd4bee993 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:44.165022 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8ae72-f47a-4d0a-8ec0-639bd4bee993 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:44.248668 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 643/1295] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:07:43 2022] POST /identity/v3/services => generated 246 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:07:46.607055 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb140c4-1822-40b0-baf8-430c2da89280 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:46.607726 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb140c4-1822-40b0-baf8-430c2da89280 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:46.607726 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb140c4-1822-40b0-baf8-430c2da89280 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:46.608898 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 653/1296] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:07:46.614775 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d795ea-c8bc-4d46-b34d-937c87f17923 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:46.615584 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d795ea-c8bc-4d46-b34d-937c87f17923 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:46.615584 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d795ea-c8bc-4d46-b34d-937c87f17923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:46.635930 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-e0d795ea-c8bc-4d46-b34d-937c87f17923 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:07:46.637135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-e0d795ea-c8bc-4d46-b34d-937c87f17923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:07:46.732561 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 644/1297] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:07:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:07:46.755955 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb140c4-1822-40b0-baf8-430c2da89280 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:46.870047 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb140c4-1822-40b0-baf8-430c2da89280 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:46.908304 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde6752-f0be-422e-9e42-107f546ae7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:46.909114 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde6752-f0be-422e-9e42-107f546ae7d3 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:46.909386 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde6752-f0be-422e-9e42-107f546ae7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:46.909723 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde6752-f0be-422e-9e42-107f546ae7d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:46.910395 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde6752-f0be-422e-9e42-107f546ae7d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:46.911863 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde6752-f0be-422e-9e42-107f546ae7d3 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-efde6752-f0be-422e-9e42-107f546ae7d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:46.924637 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:46.927617 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:46.929162 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 654/1298] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:07:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:07:46.932705 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d795ea-c8bc-4d46-b34d-937c87f17923 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:46.953402 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:47.056925 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d795ea-c8bc-4d46-b34d-937c87f17923 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:47.094284 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c743d-faaa-4fde-a07a-0d5d5f73ea86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:47.095081 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c743d-faaa-4fde-a07a-0d5d5f73ea86 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:47.095404 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c743d-faaa-4fde-a07a-0d5d5f73ea86 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:47.095729 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c743d-faaa-4fde-a07a-0d5d5f73ea86 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:47.096507 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c743d-faaa-4fde-a07a-0d5d5f73ea86 None admin] RBAC: Adding query filter params (name=placement) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:47.096862 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c743d-faaa-4fde-a07a-0d5d5f73ea86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:47.098389 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c743d-faaa-4fde-a07a-0d5d5f73ea86 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:47.106322 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 645/1299] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:07:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:47.112684 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde6752-f0be-422e-9e42-107f546ae7d3 None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:47.148373 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:47.221123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde6752-f0be-422e-9e42-107f546ae7d3 None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:47.261949 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd7fbf-2025-4735-b7a2-b8265c874298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:47.262672 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7fbf-2025-4735-b7a2-b8265c874298 None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:47.262961 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7fbf-2025-4735-b7a2-b8265c874298 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:47.263246 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7fbf-2025-4735-b7a2-b8265c874298 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:47.264309 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd7fbf-2025-4735-b7a2-b8265c874298 None admin] RBAC: Adding query filter params (interface=public, service_id=96d565f1a31a4f52b6d3ba82db7aa551, region_id=RegionOne) {{(pid=156425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:47.264628 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd7fbf-2025-4735-b7a2-b8265c874298 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:47.266036 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd7fbf-2025-4735-b7a2-b8265c874298 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:47.272277 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 655/1300] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:07:47 2022] GET /identity/v3/endpoints?service_id=96d565f1a31a4f52b6d3ba82db7aa551&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:47.278237 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c743d-faaa-4fde-a07a-0d5d5f73ea86 None admin] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:47.369154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:47.388900 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c743d-faaa-4fde-a07a-0d5d5f73ea86 None admin] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:47.425947 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f419a4-c5cc-405d-900b-d7fa55b8a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:47.426548 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f419a4-c5cc-405d-900b-d7fa55b8a699 None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:47.426871 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f419a4-c5cc-405d-900b-d7fa55b8a699 None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:47.427154 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f419a4-c5cc-405d-900b-d7fa55b8a699 None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:47.427858 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f419a4-c5cc-405d-900b-d7fa55b8a699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:47.430213 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f419a4-c5cc-405d-900b-d7fa55b8a699 None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:47.437946 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 646/1301] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:07:47 2022] GET /identity/v3/services => generated 2191 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:07:49.836771 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa66ff-7d57-4bf1-b3b3-de076b198193 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:49.837331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa66ff-7d57-4bf1-b3b3-de076b198193 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:49.837331 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa66ff-7d57-4bf1-b3b3-de076b198193 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:49.838760 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 656/1302] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:07:49.844593 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45f8d5-4ad6-48ed-a9ae-add0c25a2d52 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:49.845107 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45f8d5-4ad6-48ed-a9ae-add0c25a2d52 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:49.845107 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45f8d5-4ad6-48ed-a9ae-add0c25a2d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:49.863088 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-dd45f8d5-4ad6-48ed-a9ae-add0c25a2d52 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:07:49.864376 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-dd45f8d5-4ad6-48ed-a9ae-add0c25a2d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:07:49.939628 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 647/1303] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:07:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:07:49.964842 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa66ff-7d57-4bf1-b3b3-de076b198193 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:50.080072 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:50.088360 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa66ff-7d57-4bf1-b3b3-de076b198193 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:50.125342 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71192fc1-24d8-40bb-97df-a2b1b995873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:50.126205 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71192fc1-24d8-40bb-97df-a2b1b995873c None admin] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:50.126452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71192fc1-24d8-40bb-97df-a2b1b995873c None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:50.126726 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71192fc1-24d8-40bb-97df-a2b1b995873c None admin] PATH_INFO: `/v3/services/placement` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:50.127393 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71192fc1-24d8-40bb-97df-a2b1b995873c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:50.128790 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71192fc1-24d8-40bb-97df-a2b1b995873c None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application [None req-71192fc1-24d8-40bb-97df-a2b1b995873c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:07:50.141414 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:07:50.145504 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application with Lock( May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self._enter() May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application return self.creator() May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: ERROR keystone.server.flask.application May 19 20:07:50.148092 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 657/1304] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:07:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:07:50.152069 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45f8d5-4ad6-48ed-a9ae-add0c25a2d52 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:50.243448 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:07:50.267727 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45f8d5-4ad6-48ed-a9ae-add0c25a2d52 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:50.304478 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd54029-5177-4e2f-9225-fc0c62b6be8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:50.305415 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54029-5177-4e2f-9225-fc0c62b6be8a None admin] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:50.305694 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54029-5177-4e2f-9225-fc0c62b6be8a None admin] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:50.305963 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54029-5177-4e2f-9225-fc0c62b6be8a None admin] PATH_INFO: `/v3/services` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:50.306743 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd54029-5177-4e2f-9225-fc0c62b6be8a None admin] RBAC: Adding query filter params (name=placement) {{(pid=156426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:07:50.307046 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd54029-5177-4e2f-9225-fc0c62b6be8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:50.308432 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd54029-5177-4e2f-9225-fc0c62b6be8a None admin] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:50.314936 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 648/1305] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:07:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:07:50.321307 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71192fc1-24d8-40bb-97df-a2b1b995873c None admin] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:07:50.433070 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71192fc1-24d8-40bb-97df-a2b1b995873c None admin] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:07:50.471234 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef33a80-9323-4266-b492-44e3b1bce979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd596087257d3471085b47d30599a9a82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:07:50.471905 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33a80-9323-4266-b492-44e3b1bce979 None admin] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:07:50.472189 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33a80-9323-4266-b492-44e3b1bce979 None admin] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:07:50.472466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33a80-9323-4266-b492-44e3b1bce979 None admin] PATH_INFO: `/v3/endpoints` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:07:50.473225 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef33a80-9323-4266-b492-44e3b1bce979 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:07:50.474753 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef33a80-9323-4266-b492-44e3b1bce979 None admin] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:07:50.558194 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 658/1306] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:07:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:08:00.312135 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=30 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:08:00.553070 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:00.410834 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7a8dd-9dab-4093-9ff2-b6cea2e09916 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:00.411806 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7a8dd-9dab-4093-9ff2-b6cea2e09916 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:00.412292 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7a8dd-9dab-4093-9ff2-b6cea2e09916 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:00.414333 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 649/1307] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:00.419368 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf766-ef39-4f59-9053-f6de33e063f4 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:00.419785 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf766-ef39-4f59-9053-f6de33e063f4 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:00.419982 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf766-ef39-4f59-9053-f6de33e063f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:00.598903 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-d03bf766-ef39-4f59-9053-f6de33e063f4 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:00.600063 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-d03bf766-ef39-4f59-9053-f6de33e063f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:00.836312 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 659/1308] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:00.901340 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d70f-9f5f-4430-8ae7-cfd8612b4e65 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:00.901630 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d70f-9f5f-4430-8ae7-cfd8612b4e65 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:00.901906 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d70f-9f5f-4430-8ae7-cfd8612b4e65 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:00.903513 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 650/1309] 10.222.0.89 () {54 vars in 964 bytes} [Thu May 19 20:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:00.910111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e3af5-77b5-40cc-ad23-23f81242fb45 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:00.910396 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e3af5-77b5-40cc-ad23-23f81242fb45 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:00.910706 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e3af5-77b5-40cc-ad23-23f81242fb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:01.028852 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-e66e3af5-77b5-40cc-ad23-23f81242fb45 None None] MFA Rules not processed for user `d42b12ce8488404d8ae10a4fefcdddb4`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:01.030085 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-e66e3af5-77b5-40cc-ad23-23f81242fb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:01.084396 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:01.199360 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 660/1310] 10.222.0.89 () {58 vars in 1061 bytes} [Thu May 19 20:15:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:01.209776 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483d70f-9f5f-4430-8ae7-cfd8612b4e65 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:01.212032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-a483d70f-9f5f-4430-8ae7-cfd8612b4e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:01.368591 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483d70f-9f5f-4430-8ae7-cfd8612b4e65 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:01.455857 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4448d1-e10c-4bd2-b067-914b7b089f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:01.456476 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4448d1-e10c-4bd2-b067-914b7b089f35 service neutron] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:01.482641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4448d1-e10c-4bd2-b067-914b7b089f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:01.482641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4448d1-e10c-4bd2-b067-914b7b089f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:01.482641 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-3e4448d1-e10c-4bd2-b067-914b7b089f35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:01.530817 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:01.605539 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4448d1-e10c-4bd2-b067-914b7b089f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:01.607031 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4448d1-e10c-4bd2-b067-914b7b089f35 service neutron] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:01.627811 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 651/1311] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:04.518664 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def28c7-5198-49c2-bb71-8cf1610f6bd2 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:04.519308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def28c7-5198-49c2-bb71-8cf1610f6bd2 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:04.519308 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def28c7-5198-49c2-bb71-8cf1610f6bd2 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:04.526257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e515c0-3a39-462c-8b66-186d9101447d None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:04.526774 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e515c0-3a39-462c-8b66-186d9101447d None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:04.526848 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e515c0-3a39-462c-8b66-186d9101447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:04.529077 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 661/1312] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:04 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:04.621522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-00e515c0-3a39-462c-8b66-186d9101447d None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:04.622845 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-00e515c0-3a39-462c-8b66-186d9101447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:04.743034 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 652/1313] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:15:04.769099 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def28c7-5198-49c2-bb71-8cf1610f6bd2 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:04.770855 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-8def28c7-5198-49c2-bb71-8cf1610f6bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:04.903692 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def28c7-5198-49c2-bb71-8cf1610f6bd2 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:05.008268 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:05.012846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ec5ae-ce97-45f1-9cd1-a7fbb7d54de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:05.012846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec5ae-ce97-45f1-9cd1-a7fbb7d54de3 service neutron] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:05.012846 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec5ae-ce97-45f1-9cd1-a7fbb7d54de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:05.013244 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec5ae-ce97-45f1-9cd1-a7fbb7d54de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:05.015016 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-130ec5ae-ce97-45f1-9cd1-a7fbb7d54de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:05.160333 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ec5ae-ce97-45f1-9cd1-a7fbb7d54de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:05.162873 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ec5ae-ce97-45f1-9cd1-a7fbb7d54de3 service neutron] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:05.183858 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 662/1314] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:08.091034 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d3fd9-ccba-4827-9dbd-fcede028633d None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:08.091632 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d3fd9-ccba-4827-9dbd-fcede028633d None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:08.091632 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d3fd9-ccba-4827-9dbd-fcede028633d None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:08.092975 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 653/1315] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:08.098294 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b283486-c85a-47e4-a038-5d99b684b5e6 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:08.098739 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b283486-c85a-47e4-a038-5d99b684b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:08.098928 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b283486-c85a-47e4-a038-5d99b684b5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:08.165954 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-9b283486-c85a-47e4-a038-5d99b684b5e6 None None] MFA Rules not processed for user `1ba763318101478b8fd538190a09e314`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:08.167200 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-9b283486-c85a-47e4-a038-5d99b684b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:08.220320 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:08.265406 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 663/1316] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:08.305107 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d3fd9-ccba-4827-9dbd-fcede028633d None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:08.307016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-2e1d3fd9-ccba-4827-9dbd-fcede028633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:08.316823 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:08.414132 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d3fd9-ccba-4827-9dbd-fcede028633d None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:08.489546 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198eddf2-ff2c-4de8-b28b-0d37c157b22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:08.490196 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eddf2-ff2c-4de8-b28b-0d37c157b22a service neutron] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:08.490479 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eddf2-ff2c-4de8-b28b-0d37c157b22a service neutron] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:08.490787 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eddf2-ff2c-4de8-b28b-0d37c157b22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:08.492458 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-198eddf2-ff2c-4de8-b28b-0d37c157b22a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:08.555834 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:08.609925 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198eddf2-ff2c-4de8-b28b-0d37c157b22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:08.611464 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198eddf2-ff2c-4de8-b28b-0d37c157b22a service neutron] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:08.630823 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 654/1317] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:11.660770 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db941d-aa00-4d63-8817-f89940c00272 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:11.661298 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db941d-aa00-4d63-8817-f89940c00272 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:11.661402 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db941d-aa00-4d63-8817-f89940c00272 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:11.662756 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 664/1318] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:11.668946 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2c0e9-a20d-488b-80fe-5f53f1fabbf7 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:11.669354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2c0e9-a20d-488b-80fe-5f53f1fabbf7 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:11.669516 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2c0e9-a20d-488b-80fe-5f53f1fabbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:11.734634 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-dbf2c0e9-a20d-488b-80fe-5f53f1fabbf7 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:11.735864 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-dbf2c0e9-a20d-488b-80fe-5f53f1fabbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:11.832532 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 655/1319] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:11.887118 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c7dda-30e8-4268-8d32-6a6bd5e4cf4f None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:11.887404 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c7dda-30e8-4268-8d32-6a6bd5e4cf4f None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:11.887683 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c7dda-30e8-4268-8d32-6a6bd5e4cf4f None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:11.889076 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 665/1320] 10.222.0.89 () {54 vars in 964 bytes} [Thu May 19 20:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:11.895319 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f94db-2686-4ca4-9261-74cbe829ad89 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:11.895616 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f94db-2686-4ca4-9261-74cbe829ad89 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:11.895899 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f94db-2686-4ca4-9261-74cbe829ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:11.916978 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:11.971728 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-585f94db-2686-4ca4-9261-74cbe829ad89 None None] MFA Rules not processed for user `d42b12ce8488404d8ae10a4fefcdddb4`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:11.974300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-585f94db-2686-4ca4-9261-74cbe829ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:12.052381 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 656/1321] 10.222.0.89 () {58 vars in 1061 bytes} [Thu May 19 20:15:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:12.061659 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c7dda-30e8-4268-8d32-6a6bd5e4cf4f None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:12.063195 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-ec8c7dda-30e8-4268-8d32-6a6bd5e4cf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:12.169091 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c7dda-30e8-4268-8d32-6a6bd5e4cf4f None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:12.247434 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168634e-b34c-4aa3-8cfd-e58b9e3ec76b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:12.248135 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168634e-b34c-4aa3-8cfd-e58b9e3ec76b service neutron] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:12.248426 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168634e-b34c-4aa3-8cfd-e58b9e3ec76b service neutron] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:12.248702 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168634e-b34c-4aa3-8cfd-e58b9e3ec76b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:12.250410 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-5168634e-b34c-4aa3-8cfd-e58b9e3ec76b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:12.257946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:12.365850 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168634e-b34c-4aa3-8cfd-e58b9e3ec76b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:12.367311 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168634e-b34c-4aa3-8cfd-e58b9e3ec76b service neutron] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:12.385279 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 666/1322] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:16.204349 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceed21-f81f-4eec-8deb-d3c7bacfd5d6 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:16.204911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceed21-f81f-4eec-8deb-d3c7bacfd5d6 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:16.204911 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceed21-f81f-4eec-8deb-d3c7bacfd5d6 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:16.206360 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 657/1323] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:16.212316 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17288be-72f0-4ac4-85f5-d4c1061e5178 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:16.212776 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17288be-72f0-4ac4-85f5-d4c1061e5178 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:16.212865 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17288be-72f0-4ac4-85f5-d4c1061e5178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:16.281626 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-a17288be-72f0-4ac4-85f5-d4c1061e5178 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:16.282877 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-a17288be-72f0-4ac4-85f5-d4c1061e5178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:16.342451 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:16.380962 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 667/1324] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:16.417491 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceed21-f81f-4eec-8deb-d3c7bacfd5d6 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:16.419163 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-c4ceed21-f81f-4eec-8deb-d3c7bacfd5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:16.525340 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceed21-f81f-4eec-8deb-d3c7bacfd5d6 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:16.537655 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:16.601480 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065705c-88fe-430f-8b43-8dc194c671c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:16.602208 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065705c-88fe-430f-8b43-8dc194c671c4 service neutron] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:16.602481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065705c-88fe-430f-8b43-8dc194c671c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:16.602782 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065705c-88fe-430f-8b43-8dc194c671c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:16.604537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-b065705c-88fe-430f-8b43-8dc194c671c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:16.716454 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065705c-88fe-430f-8b43-8dc194c671c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:16.717892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065705c-88fe-430f-8b43-8dc194c671c4 service neutron] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:16.736746 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 658/1325] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:19.061843 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea42a9-65ce-4692-bbec-6f197aae5fd5 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:19.062310 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea42a9-65ce-4692-bbec-6f197aae5fd5 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:19.062465 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea42a9-65ce-4692-bbec-6f197aae5fd5 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:19.063976 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 668/1326] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:19.069709 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592ba46-ceea-40d7-b914-cd11b2eea015 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:19.070112 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592ba46-ceea-40d7-b914-cd11b2eea015 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:19.070275 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592ba46-ceea-40d7-b914-cd11b2eea015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:19.124247 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:19.143749 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-8592ba46-ceea-40d7-b914-cd11b2eea015 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:19.145465 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-8592ba46-ceea-40d7-b914-cd11b2eea015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:19.246087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 659/1327] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:19.281635 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea42a9-65ce-4692-bbec-6f197aae5fd5 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:19.283266 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-77ea42a9-65ce-4692-bbec-6f197aae5fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:19.389985 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea42a9-65ce-4692-bbec-6f197aae5fd5 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:19.468744 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8db6-1bd9-47d3-b6be-9cf82c6860cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:19.469405 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8db6-1bd9-47d3-b6be-9cf82c6860cb service neutron] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:19.469689 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8db6-1bd9-47d3-b6be-9cf82c6860cb service neutron] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:19.469967 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8db6-1bd9-47d3-b6be-9cf82c6860cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:19.471673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-c91a8db6-1bd9-47d3-b6be-9cf82c6860cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:19.490797 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:19.587236 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a8db6-1bd9-47d3-b6be-9cf82c6860cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:19.588709 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a8db6-1bd9-47d3-b6be-9cf82c6860cb service neutron] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:19.608877 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 669/1328] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:21.932371 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749e754-6db9-4a69-b0df-cb2525a8a95c None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:21.932920 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749e754-6db9-4a69-b0df-cb2525a8a95c None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:21.932920 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749e754-6db9-4a69-b0df-cb2525a8a95c None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:21.934333 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 660/1329] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:21.939874 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59646a8-254c-4c47-b88b-9f5c5bd72798 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:21.940288 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59646a8-254c-4c47-b88b-9f5c5bd72798 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:21.940422 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59646a8-254c-4c47-b88b-9f5c5bd72798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:22.005074 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-c59646a8-254c-4c47-b88b-9f5c5bd72798 None None] MFA Rules not processed for user `1ba763318101478b8fd538190a09e314`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:22.006206 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-c59646a8-254c-4c47-b88b-9f5c5bd72798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:22.071658 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:22.108729 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 670/1330] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:22.146133 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749e754-6db9-4a69-b0df-cb2525a8a95c None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:22.147768 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-f749e754-6db9-4a69-b0df-cb2525a8a95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:22.253254 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749e754-6db9-4a69-b0df-cb2525a8a95c None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:22.273662 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:22.328350 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde151a-313f-4d41-9e6b-f92523abf241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:22.329037 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde151a-313f-4d41-9e6b-f92523abf241 service neutron] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:22.329291 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde151a-313f-4d41-9e6b-f92523abf241 service neutron] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:22.329564 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde151a-313f-4d41-9e6b-f92523abf241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:22.331261 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-2fde151a-313f-4d41-9e6b-f92523abf241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:22.443663 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde151a-313f-4d41-9e6b-f92523abf241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:22.445094 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde151a-313f-4d41-9e6b-f92523abf241 service neutron] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:22.463483 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 661/1331] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:25.154258 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e50aa5-95df-44ad-bb70-b734827eb182 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:25.154824 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e50aa5-95df-44ad-bb70-b734827eb182 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:25.154824 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e50aa5-95df-44ad-bb70-b734827eb182 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:25.156243 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 671/1332] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:25.162256 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ecb1a-2ad6-4b6c-94c0-41e9b1397c0d None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:25.162724 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ecb1a-2ad6-4b6c-94c0-41e9b1397c0d None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:25.162851 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ecb1a-2ad6-4b6c-94c0-41e9b1397c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:25.226967 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:25.229757 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-dc1ecb1a-2ad6-4b6c-94c0-41e9b1397c0d None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:25.231005 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-dc1ecb1a-2ad6-4b6c-94c0-41e9b1397c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:25.329481 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 662/1333] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:15:25.365959 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e50aa5-95df-44ad-bb70-b734827eb182 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:25.367559 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-c7e50aa5-95df-44ad-bb70-b734827eb182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:25.474811 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e50aa5-95df-44ad-bb70-b734827eb182 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:25.549587 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e0849-5780-4bf3-b8b7-9c82dfdf1c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:25.550234 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e0849-5780-4bf3-b8b7-9c82dfdf1c7d service neutron] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:25.550517 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e0849-5780-4bf3-b8b7-9c82dfdf1c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:25.550845 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e0849-5780-4bf3-b8b7-9c82dfdf1c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:25.552518 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-ce5e0849-5780-4bf3-b8b7-9c82dfdf1c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:25.580004 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:25.664466 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e0849-5780-4bf3-b8b7-9c82dfdf1c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:25.665967 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e0849-5780-4bf3-b8b7-9c82dfdf1c7d service neutron] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:25.684585 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 672/1334] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:27.979869 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1693f7d-cad1-4a7d-8f81-6f0cbbf15959 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:27.980379 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1693f7d-cad1-4a7d-8f81-6f0cbbf15959 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:27.980379 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1693f7d-cad1-4a7d-8f81-6f0cbbf15959 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:27.981714 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 663/1335] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:27.987094 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5c994-d18c-421f-ac6a-dc223ec6e958 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:27.987575 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5c994-d18c-421f-ac6a-dc223ec6e958 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:27.987673 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5c994-d18c-421f-ac6a-dc223ec6e958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:28.053786 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-87a5c994-d18c-421f-ac6a-dc223ec6e958 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:28.055031 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-87a5c994-d18c-421f-ac6a-dc223ec6e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:28.153909 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=100 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:28.177149 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 673/1336] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:28.217644 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1693f7d-cad1-4a7d-8f81-6f0cbbf15959 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:28.219271 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-a1693f7d-cad1-4a7d-8f81-6f0cbbf15959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:28.323408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1693f7d-cad1-4a7d-8f81-6f0cbbf15959 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:28.352982 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:28.397943 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8cbe5-2b68-4b5f-902d-e7e9679041c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:28.398585 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8cbe5-2b68-4b5f-902d-e7e9679041c4 service neutron] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:28.398899 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8cbe5-2b68-4b5f-902d-e7e9679041c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:28.399173 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8cbe5-2b68-4b5f-902d-e7e9679041c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:28.400863 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-f2c8cbe5-2b68-4b5f-902d-e7e9679041c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:28.516405 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8cbe5-2b68-4b5f-902d-e7e9679041c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:28.517873 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8cbe5-2b68-4b5f-902d-e7e9679041c4 service neutron] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:28.536349 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 664/1337] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:31.393388 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba383-5281-4b8e-b759-88029c18c9e3 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:31.394013 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba383-5281-4b8e-b759-88029c18c9e3 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:31.394013 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba383-5281-4b8e-b759-88029c18c9e3 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:31.395378 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 674/1338] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:31.400661 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987bb44-dba3-413f-9bd8-6ada8aa2d245 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:31.401121 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987bb44-dba3-413f-9bd8-6ada8aa2d245 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:31.401219 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987bb44-dba3-413f-9bd8-6ada8aa2d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:31.470980 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-9987bb44-dba3-413f-9bd8-6ada8aa2d245 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:31.472235 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-9987bb44-dba3-413f-9bd8-6ada8aa2d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:31.481408 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:31.578618 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 665/1339] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:31.614412 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cba383-5281-4b8e-b759-88029c18c9e3 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:31.616643 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-56cba383-5281-4b8e-b759-88029c18c9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:31.714849 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cba383-5281-4b8e-b759-88029c18c9e3 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:31.718474 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ec368-b2b4-4604-8a3f-2b18edee7327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:31.719208 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ec368-b2b4-4604-8a3f-2b18edee7327 service neutron] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:31.719492 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ec368-b2b4-4604-8a3f-2b18edee7327 service neutron] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:31.719770 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ec368-b2b4-4604-8a3f-2b18edee7327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:31.729862 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ec368-b2b4-4604-8a3f-2b18edee7327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:31.731341 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ec368-b2b4-4604-8a3f-2b18edee7327 service neutron] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:31.741476 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 675/1340] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:36.418402 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bc230-5702-464d-94e6-5746dfb6ab34 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:36.419016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bc230-5702-464d-94e6-5746dfb6ab34 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:36.419016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bc230-5702-464d-94e6-5746dfb6ab34 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:36.420389 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 666/1341] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:36.426012 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abedef9-bde1-4187-a177-3bbf07159c79 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:36.426424 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abedef9-bde1-4187-a177-3bbf07159c79 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:36.426573 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abedef9-bde1-4187-a177-3bbf07159c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:36.460758 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-4abedef9-bde1-4187-a177-3bbf07159c79 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:36.461952 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-4abedef9-bde1-4187-a177-3bbf07159c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:36.545220 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 676/1342] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:36.584663 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bc230-5702-464d-94e6-5746dfb6ab34 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:36.586596 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-344bc230-5702-464d-94e6-5746dfb6ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:36.600547 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bc230-5702-464d-94e6-5746dfb6ab34 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:36.604203 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ef324-c00a-453b-b66d-66b52ba4596d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:36.604919 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ef324-c00a-453b-b66d-66b52ba4596d service neutron] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:36.605300 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ef324-c00a-453b-b66d-66b52ba4596d service neutron] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:36.605627 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ef324-c00a-453b-b66d-66b52ba4596d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:36.615175 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ef324-c00a-453b-b66d-66b52ba4596d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:36.616870 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ef324-c00a-453b-b66d-66b52ba4596d service neutron] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:36.626864 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 667/1343] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:40.027712 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f388-fcd6-40bb-aead-2b9df02c32d7 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:40.028278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f388-fcd6-40bb-aead-2b9df02c32d7 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:40.028278 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f388-fcd6-40bb-aead-2b9df02c32d7 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:40.029658 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 677/1344] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:40.035591 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000c832-e5f4-4835-ab51-0dbc72fc87fa None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:40.036056 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000c832-e5f4-4835-ab51-0dbc72fc87fa None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:40.036158 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000c832-e5f4-4835-ab51-0dbc72fc87fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:40.054850 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-c000c832-e5f4-4835-ab51-0dbc72fc87fa None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:40.056318 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-c000c832-e5f4-4835-ab51-0dbc72fc87fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:40.064403 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 668/1345] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:15:40.103086 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f388-fcd6-40bb-aead-2b9df02c32d7 None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:40.114550 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f388-fcd6-40bb-aead-2b9df02c32d7 None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:40.118210 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09096b2-4729-4c59-abab-6c3415105a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:40.118889 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09096b2-4729-4c59-abab-6c3415105a20 service neutron] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:40.119173 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09096b2-4729-4c59-abab-6c3415105a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:40.119446 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09096b2-4729-4c59-abab-6c3415105a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:40.129191 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09096b2-4729-4c59-abab-6c3415105a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:40.130738 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09096b2-4729-4c59-abab-6c3415105a20 service neutron] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:40.140603 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 678/1346] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:44.626032 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43da5-a311-4d31-9304-27f9eafa32bd None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:44.626638 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43da5-a311-4d31-9304-27f9eafa32bd None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:44.626638 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43da5-a311-4d31-9304-27f9eafa32bd None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:44.628049 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 669/1347] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:44.633452 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d0ee-43eb-42fa-bc8d-b1c0b2511fa5 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:44.633887 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d0ee-43eb-42fa-bc8d-b1c0b2511fa5 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:44.633996 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d0ee-43eb-42fa-bc8d-b1c0b2511fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:44.652642 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-5041d0ee-43eb-42fa-bc8d-b1c0b2511fa5 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:44.653853 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-5041d0ee-43eb-42fa-bc8d-b1c0b2511fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:44.662427 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 679/1348] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:44.699617 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43da5-a311-4d31-9304-27f9eafa32bd None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:44.711463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43da5-a311-4d31-9304-27f9eafa32bd None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:44.715046 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baa484-f70a-45aa-bc57-cef8d8e18cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42b12ce8488404d8ae10a4fefcdddb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:44.715693 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa484-f70a-45aa-bc57-cef8d8e18cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:44.715977 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa484-f70a-45aa-bc57-cef8d8e18cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:44.716257 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa484-f70a-45aa-bc57-cef8d8e18cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:44.726357 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baa484-f70a-45aa-bc57-cef8d8e18cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:44.727821 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baa484-f70a-45aa-bc57-cef8d8e18cf4 service neutron] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:44.737612 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 670/1349] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:15:50.249115 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db2a8a-d5a2-402c-848f-9cf725597ee2 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:50.250090 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db2a8a-d5a2-402c-848f-9cf725597ee2 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:50.250563 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db2a8a-d5a2-402c-848f-9cf725597ee2 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:50.255145 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 680/1350] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 20:15:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:50.260250 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c32a-6a72-47d2-8b69-65798588a4ad None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:50.261150 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c32a-6a72-47d2-8b69-65798588a4ad None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:50.267194 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c32a-6a72-47d2-8b69-65798588a4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:50.369537 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-ce49c32a-6a72-47d2-8b69-65798588a4ad None None] MFA Rules not processed for user `4148ab38693847f8bb2b85ee5be6ba1a`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:50.370763 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-ce49c32a-6a72-47d2-8b69-65798588a4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:50.430529 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=100 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:50.453214 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 671/1351] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 20:15:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:54.647081 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=98 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:54.925992 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc9500-50a5-4ab5-9ee2-1513cf2cb2a2 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:54.926318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc9500-50a5-4ab5-9ee2-1513cf2cb2a2 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:54.926581 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc9500-50a5-4ab5-9ee2-1513cf2cb2a2 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:54.928101 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 681/1352] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 20:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:54.934137 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e12ed2-441c-4d82-a0f2-b43e473d1133 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:54.934639 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e12ed2-441c-4d82-a0f2-b43e473d1133 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:54.934892 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e12ed2-441c-4d82-a0f2-b43e473d1133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:54.958983 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-51e12ed2-441c-4d82-a0f2-b43e473d1133 None None] MFA Rules not processed for user `4148ab38693847f8bb2b85ee5be6ba1a`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:54.961354 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-51e12ed2-441c-4d82-a0f2-b43e473d1133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:54.970490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 672/1353] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 20:15:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:15:56.525055 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c96d6-eb4e-4a56-9d88-842fdb171ee8 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:56.525588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c96d6-eb4e-4a56-9d88-842fdb171ee8 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:56.525588 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c96d6-eb4e-4a56-9d88-842fdb171ee8 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:56.526933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 682/1354] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 20:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:56.532126 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7337f-ec60-4ff9-b24d-1838dad5730e None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:56.532527 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7337f-ec60-4ff9-b24d-1838dad5730e None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:56.532793 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7337f-ec60-4ff9-b24d-1838dad5730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:56.551819 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-aaf7337f-ec60-4ff9-b24d-1838dad5730e None None] MFA Rules not processed for user `4148ab38693847f8bb2b85ee5be6ba1a`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:56.553072 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-aaf7337f-ec60-4ff9-b24d-1838dad5730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:56.562114 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 673/1355] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 20:15:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:00.776111 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557d985-a385-42b8-993e-598cc4c61d49 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:00.776619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557d985-a385-42b8-993e-598cc4c61d49 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:00.776619 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557d985-a385-42b8-993e-598cc4c61d49 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:00.777948 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 683/1356] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:16:00.783463 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e1626-363c-4519-943e-185de7b5f943 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:00.784489 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e1626-363c-4519-943e-185de7b5f943 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:00.784581 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e1626-363c-4519-943e-185de7b5f943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:00.803041 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-763e1626-363c-4519-943e-185de7b5f943 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:00.804232 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-763e1626-363c-4519-943e-185de7b5f943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:00.812446 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 674/1357] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:00.869186 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e662f1-ad3e-4847-aa31-1510e17633dd None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:00.869912 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e662f1-ad3e-4847-aa31-1510e17633dd None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:00.870350 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e662f1-ad3e-4847-aa31-1510e17633dd None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:00.873448 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 684/1358] 10.222.0.89 () {54 vars in 961 bytes} [Thu May 19 20:16:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:00.881587 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3cf9e-8ca9-4063-bfbd-aad6bd01e8b8 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:00.881881 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3cf9e-8ca9-4063-bfbd-aad6bd01e8b8 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:00.882164 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3cf9e-8ca9-4063-bfbd-aad6bd01e8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:00.936623 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-f2c3cf9e-8ca9-4063-bfbd-aad6bd01e8b8 None None] MFA Rules not processed for user `e0b88c1582c849349cc441446f6cca20`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:00.938036 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-f2c3cf9e-8ca9-4063-bfbd-aad6bd01e8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:01.034859 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 675/1359] 10.222.0.89 () {58 vars in 1058 bytes} [Thu May 19 20:16:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:01.040187 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e662f1-ad3e-4847-aa31-1510e17633dd None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:01.058699 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e662f1-ad3e-4847-aa31-1510e17633dd None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:01.064337 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb678460-ae08-4e8b-b5f8-b2ad81d3532b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b88c1582c849349cc441446f6cca20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:01.065021 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb678460-ae08-4e8b-b5f8-b2ad81d3532b service nova] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:01.065354 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb678460-ae08-4e8b-b5f8-b2ad81d3532b service nova] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:01.065634 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb678460-ae08-4e8b-b5f8-b2ad81d3532b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:01.076063 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb678460-ae08-4e8b-b5f8-b2ad81d3532b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:01.077722 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb678460-ae08-4e8b-b5f8-b2ad81d3532b service nova] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:01.090318 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 685/1360] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:03.590006 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf350d-4ab7-4d7f-98ee-ae1748ed9d03 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:03.590447 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf350d-4ab7-4d7f-98ee-ae1748ed9d03 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:03.590555 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf350d-4ab7-4d7f-98ee-ae1748ed9d03 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:03.592103 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 676/1361] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:03.602243 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f867ad-07a5-4136-98ba-8eaea31c2c38 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:03.602830 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f867ad-07a5-4136-98ba-8eaea31c2c38 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:03.603048 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f867ad-07a5-4136-98ba-8eaea31c2c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:03.623233 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-38f867ad-07a5-4136-98ba-8eaea31c2c38 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:03.624333 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-38f867ad-07a5-4136-98ba-8eaea31c2c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:03.633193 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 686/1362] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:03.679082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf350d-4ab7-4d7f-98ee-ae1748ed9d03 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:03.695783 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf350d-4ab7-4d7f-98ee-ae1748ed9d03 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:03.701570 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e30f9d-feb8-4f0a-8ea2-40cea3e1542d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b88c1582c849349cc441446f6cca20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:03.702227 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e30f9d-feb8-4f0a-8ea2-40cea3e1542d service nova] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:03.702515 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e30f9d-feb8-4f0a-8ea2-40cea3e1542d service nova] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:03.702938 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e30f9d-feb8-4f0a-8ea2-40cea3e1542d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:03.712987 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e30f9d-feb8-4f0a-8ea2-40cea3e1542d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:03.715191 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e30f9d-feb8-4f0a-8ea2-40cea3e1542d service nova] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:03.725749 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 677/1363] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:06.558901 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff2242-a8dd-41f8-85d5-cf3e0c4419d5 None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:06.559431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff2242-a8dd-41f8-85d5-cf3e0c4419d5 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:06.559431 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff2242-a8dd-41f8-85d5-cf3e0c4419d5 None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:06.561053 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 687/1364] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:06.567016 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f00953-77e5-4c2e-ad13-597f63b35a17 None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:06.567490 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f00953-77e5-4c2e-ad13-597f63b35a17 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:06.567588 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f00953-77e5-4c2e-ad13-597f63b35a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:06.587165 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-15f00953-77e5-4c2e-ad13-597f63b35a17 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:06.588386 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-15f00953-77e5-4c2e-ad13-597f63b35a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:06.597691 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 678/1365] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:06.645250 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d137-e926-49b3-b78d-cfd8e6a3f7ea None None] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:06.645576 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d137-e926-49b3-b78d-cfd8e6a3f7ea None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:06.645805 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d137-e926-49b3-b78d-cfd8e6a3f7ea None None] PATH_INFO: `/` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:06.647382 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 688/1366] 10.222.0.89 () {54 vars in 961 bytes} [Thu May 19 20:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:06.653501 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bce866-2659-4605-ae58-009b2c698eae None None] REQUEST_METHOD: `POST` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:06.653804 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bce866-2659-4605-ae58-009b2c698eae None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:06.654349 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bce866-2659-4605-ae58-009b2c698eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:06.676838 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.auth.core [None req-c2bce866-2659-4605-ae58-009b2c698eae None None] MFA Rules not processed for user `e0b88c1582c849349cc441446f6cca20`. Rule list: `[]` (Enabled: `True`). {{(pid=156426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:06.678201 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.fernet_utils [None req-c2bce866-2659-4605-ae58-009b2c698eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:06.689572 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 679/1367] 10.222.0.89 () {58 vars in 1058 bytes} [Thu May 19 20:16:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:06.699123 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94d137-e926-49b3-b78d-cfd8e6a3f7ea None None] Authenticating user token {{(pid=156425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:06.715026 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94d137-e926-49b3-b78d-cfd8e6a3f7ea None None] Validating token access rules against request {{(pid=156425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:06.721988 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afcb89-ed71-45e9-a753-b36ff0e3211c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b88c1582c849349cc441446f6cca20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:06.722771 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afcb89-ed71-45e9-a753-b36ff0e3211c service nova] REQUEST_METHOD: `GET` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:06.723114 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afcb89-ed71-45e9-a753-b36ff0e3211c service nova] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:06.723615 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afcb89-ed71-45e9-a753-b36ff0e3211c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:06.733238 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afcb89-ed71-45e9-a753-b36ff0e3211c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:06.735246 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afcb89-ed71-45e9-a753-b36ff0e3211c service nova] RBAC: Authorization granted {{(pid=156425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:06.746703 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 689/1368] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:07.210692 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a845a-4de3-4609-b874-18c4aca73b60 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:07.211087 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a845a-4de3-4609-b874-18c4aca73b60 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:07.211267 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a845a-4de3-4609-b874-18c4aca73b60 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:07.214116 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 680/1369] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:07.219555 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d262f-aeb2-4d56-9949-d539c91afd43 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:07.219946 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d262f-aeb2-4d56-9949-d539c91afd43 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:07.220147 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d262f-aeb2-4d56-9949-d539c91afd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:07.241638 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-256d262f-aeb2-4d56-9949-d539c91afd43 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:07.242975 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-256d262f-aeb2-4d56-9949-d539c91afd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:07.259130 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 690/1370] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:09.315640 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dfe12-192b-48d7-a741-f7c604034a45 None None] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:09.316147 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dfe12-192b-48d7-a741-f7c604034a45 None None] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:09.316248 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dfe12-192b-48d7-a741-f7c604034a45 None None] PATH_INFO: `/` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:09.317937 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 681/1371] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:09.323281 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262017a-3e60-487b-9361-fbac9e969d31 None None] REQUEST_METHOD: `POST` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:09.323749 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262017a-3e60-487b-9361-fbac9e969d31 None None] SCRIPT_NAME: `/identity` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:09.323837 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262017a-3e60-487b-9361-fbac9e969d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=156425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:09.342556 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.auth.core [None req-9262017a-3e60-487b-9361-fbac9e969d31 None None] MFA Rules not processed for user `d596087257d3471085b47d30599a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=156425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:09.343933 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG keystone.common.fernet_utils [None req-9262017a-3e60-487b-9361-fbac9e969d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=156425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:09.353489 dv-cinder-841302-4-smb devstack@keystone.service[156425]: [pid: 156425|app: 0|req: 691/1372] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:09.398794 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dfe12-192b-48d7-a741-f7c604034a45 None None] Authenticating user token {{(pid=156426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:09.415255 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dfe12-192b-48d7-a741-f7c604034a45 None None] Validating token access rules against request {{(pid=156426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:09.420865 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e1bdd-4e57-4c1b-b6f7-1cb9e56161b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b88c1582c849349cc441446f6cca20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105df1a5d94f48d9a328b28b400aab90', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=156426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:09.421522 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1bdd-4e57-4c1b-b6f7-1cb9e56161b1 service nova] REQUEST_METHOD: `GET` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:09.421804 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1bdd-4e57-4c1b-b6f7-1cb9e56161b1 service nova] SCRIPT_NAME: `/identity` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:09.422082 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1bdd-4e57-4c1b-b6f7-1cb9e56161b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=156426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:09.431950 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e1bdd-4e57-4c1b-b6f7-1cb9e56161b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:09.433552 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e1bdd-4e57-4c1b-b6f7-1cb9e56161b1 service nova] RBAC: Authorization granted {{(pid=156426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:09.444330 dv-cinder-841302-4-smb devstack@keystone.service[156426]: [pid: 156426|app: 0|req: 682/1373] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:19.337008 dv-cinder-841302-4-smb devstack@keystone.service[156425]: DEBUG dbcounter [-] [156425] Writing DB stats keystone:SELECT=21 {{(pid=156425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:19.439345 dv-cinder-841302-4-smb devstack@keystone.service[156426]: DEBUG dbcounter [-] [156426] Writing DB stats keystone:SELECT=82 {{(pid=156426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:30.790298 dv-cinder-841302-4-smb devstack@keystone.service[156411]: Thu May 19 20:16:30 2022 - graceful shutdown triggered... May 19 20:16:30.790372 dv-cinder-841302-4-smb systemd[1]: Stopping Devstack devstack@keystone.service... May 19 20:16:30.791078 dv-cinder-841302-4-smb devstack@keystone.service[156425]: Gracefully killing worker 1 (pid: 156425)... May 19 20:16:30.791467 dv-cinder-841302-4-smb devstack@keystone.service[156426]: Gracefully killing worker 2 (pid: 156426)... May 19 20:16:31.792137 dv-cinder-841302-4-smb devstack@keystone.service[156411]: worker 1 buried after 1 seconds May 19 20:16:31.792137 dv-cinder-841302-4-smb devstack@keystone.service[156411]: worker 2 buried after 1 seconds May 19 20:16:31.792656 dv-cinder-841302-4-smb devstack@keystone.service[156411]: goodbye to uWSGI. May 19 20:16:31.793709 dv-cinder-841302-4-smb systemd[1]: devstack@keystone.service: Succeeded. May 19 20:16:31.794254 dv-cinder-841302-4-smb systemd[1]: Stopped Devstack devstack@keystone.service. May 19 20:23:10.913761 dv-cinder-841302-4-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 20:23:10.924855 dv-cinder-841302-4-smb devstack@keystone.service[220168]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 20:23:10.926931 dv-cinder-841302-4-smb devstack@keystone.service[220168]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 20:23:10 2022] *** May 19 20:23:10.926931 dv-cinder-841302-4-smb devstack@keystone.service[220168]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 20:23:10.926931 dv-cinder-841302-4-smb devstack@keystone.service[220168]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 20:23:10.926931 dv-cinder-841302-4-smb devstack@keystone.service[220168]: nodename: dv-cinder-841302-4-smb May 19 20:23:10.926931 dv-cinder-841302-4-smb devstack@keystone.service[220168]: machine: x86_64 May 19 20:23:10.926931 dv-cinder-841302-4-smb devstack@keystone.service[220168]: clock source: unix May 19 20:23:10.926931 dv-cinder-841302-4-smb devstack@keystone.service[220168]: pcre jit disabled May 19 20:23:10.926931 dv-cinder-841302-4-smb devstack@keystone.service[220168]: detected number of CPU cores: 4 May 19 20:23:10.926931 dv-cinder-841302-4-smb devstack@keystone.service[220168]: current working directory: / May 19 20:23:10.926931 dv-cinder-841302-4-smb devstack@keystone.service[220168]: detected binary path: /usr/bin/uwsgi-core May 19 20:23:10.927924 dv-cinder-841302-4-smb devstack@keystone.service[220168]: your processes number limit is 47680 May 19 20:23:10.927924 dv-cinder-841302-4-smb devstack@keystone.service[220168]: your memory page size is 4096 bytes May 19 20:23:10.927924 dv-cinder-841302-4-smb devstack@keystone.service[220168]: detected max file descriptor number: 2048 May 19 20:23:10.927924 dv-cinder-841302-4-smb devstack@keystone.service[220168]: lock engine: pthread robust mutexes May 19 20:23:10.927924 dv-cinder-841302-4-smb devstack@keystone.service[220168]: thunder lock: enabled May 19 20:23:10.927924 dv-cinder-841302-4-smb devstack@keystone.service[220168]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 20:23:10.927924 dv-cinder-841302-4-smb devstack@keystone.service[220168]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 20:23:10.973224 dv-cinder-841302-4-smb devstack@keystone.service[220168]: Python main interpreter initialized at 0x55d34c7c49c0 May 19 20:23:10.973224 dv-cinder-841302-4-smb devstack@keystone.service[220168]: python threads support enabled May 19 20:23:10.973224 dv-cinder-841302-4-smb devstack@keystone.service[220168]: your server socket listen backlog is limited to 100 connections May 19 20:23:10.973224 dv-cinder-841302-4-smb devstack@keystone.service[220168]: your mercy for graceful operations on workers is 90 seconds May 19 20:23:10.973615 dv-cinder-841302-4-smb devstack@keystone.service[220168]: mapped 403077 bytes (393 KB) for 2 cores May 19 20:23:10.973700 dv-cinder-841302-4-smb devstack@keystone.service[220168]: *** Operational MODE: preforking *** May 19 20:23:10.973908 dv-cinder-841302-4-smb devstack@keystone.service[220168]: *** uWSGI is running in multiple interpreter mode *** May 19 20:23:10.973908 dv-cinder-841302-4-smb devstack@keystone.service[220168]: spawned uWSGI master process (pid: 220168) May 19 20:23:10.974118 dv-cinder-841302-4-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 20:23:10.975556 dv-cinder-841302-4-smb devstack@keystone.service[220168]: spawned uWSGI worker 1 (pid: 220179, cores: 1) May 19 20:23:10.975556 dv-cinder-841302-4-smb devstack@keystone.service[220168]: spawned uWSGI worker 2 (pid: 220180, cores: 1) May 19 20:23:10.975556 dv-cinder-841302-4-smb devstack@keystone.service[220168]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 20:23:16.810760 dv-cinder-841302-4-smb devstack@keystone.service[220179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:23:16.810760 dv-cinder-841302-4-smb devstack@keystone.service[220179]: from cryptography.utils import int_from_bytes May 19 20:23:16.811548 dv-cinder-841302-4-smb devstack@keystone.service[220179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:23:16.811548 dv-cinder-841302-4-smb devstack@keystone.service[220179]: from cryptography.utils import int_from_bytes May 19 20:23:16.811711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:23:16.811711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: from cryptography.utils import int_from_bytes May 19 20:23:16.812199 dv-cinder-841302-4-smb devstack@keystone.service[220180]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:23:16.812199 dv-cinder-841302-4-smb devstack@keystone.service[220180]: from cryptography.utils import int_from_bytes May 19 20:23:16.860467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 20:23:16.860665 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 20:23:16.860827 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] command line args: [] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 20:23:16.861097 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 20:23:16.861196 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 20:23:16.861289 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ================================================================================ {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 20:23:16.861379 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 20:23:16.861512 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] admin_token = **** {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.861622 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] command line args: [] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 20:23:16.861756 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] config_dir = [] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.861869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 20:23:16.861952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.862040 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ================================================================================ {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 20:23:16.862129 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] config_source = [] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.862223 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] admin_token = **** {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.862322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] debug = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.862457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] config_dir = [] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.862556 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.863933 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.863933 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] config_source = [] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.864257 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.864405 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] debug = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.864519 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] insecure_debug = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.864622 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.864743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.864835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.864918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.865005 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] insecure_debug = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.865086 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] list_limit = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.865174 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.865268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] log_config_append = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.865268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.865487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.865582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] log_dir = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.865677 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] list_limit = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.865766 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] log_file = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.865860 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] log_config_append = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.865948 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.866037 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.866037 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] log_dir = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.866251 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.866345 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] log_file = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.866441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.866530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.866648 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.866737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.866881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.866881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.867058 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.867148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.867237 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.867237 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.867545 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.868156 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.868248 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.868345 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.868435 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.868519 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.868607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.868701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.868790 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.868879 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.868967 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.869064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.869153 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] notification_format = cadf {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.869257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.869347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.869436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.869436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] notification_format = cadf {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.869605 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.869694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.869840 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] publish_errors = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.869840 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.870008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.870097 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.870191 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] publish_errors = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.870280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.870368 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.870474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.870564 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.870681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.870774 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.870963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] standard_threads = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.871057 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.871140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] strict_password_check = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.871227 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.871316 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.871410 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] standard_threads = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.871498 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] use_eventlog = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.871586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] strict_password_check = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.871676 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] use_journal = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.871676 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] use_json = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.871849 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.871943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] use_stderr = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.872032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] use_eventlog = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.872130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] use_syslog = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.872218 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] use_journal = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.872312 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] watch_log_file = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.872403 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] use_json = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.872403 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] use_stderr = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.872572 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.872661 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] use_syslog = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.872750 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.872838 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] watch_log_file = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:16.872925 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.873016 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.873106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.873194 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.873282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.873370 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.873458 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.873552 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.873635 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.873722 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.873815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.873955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.874042 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.874136 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.874234 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.874323 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.874411 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.874500 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.874594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.874723 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.874814 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.874976 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.875076 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.875215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.875316 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.875466 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.875564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.875706 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.875802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.875958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.876060 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.876212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.876308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.876453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.876550 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.876688 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.876790 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.876944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.877040 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.877194 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.877289 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.877434 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.877532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.877683 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.877778 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.877916 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.878006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.878148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.878249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.878380 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.878476 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.878630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.878734 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.878889 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.878987 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.879124 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.879219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.879356 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.879440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.879588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.879689 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.879836 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.879925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.880065 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.880151 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.880288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.880385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.880527 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.880623 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.880769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.880865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.881007 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.881108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.881245 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.881332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.881461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.881553 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.881681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.881780 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.881912 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.882007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.882144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.882233 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.882383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.882472 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.882659 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.882771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.882864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.882946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.883113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.883211 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.883348 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.883453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.883586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.883683 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.883824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.883913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.884060 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.884155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.884296 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.884381 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.884520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.884617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.884758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.884848 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.884992 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.885087 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.885229 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.885363 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.885482 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.885599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.885741 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.885836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.885977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.886072 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.886161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.886243 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.886374 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.886483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.886588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.886697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.886874 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.886977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.887111 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.887200 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.887344 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.887440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.887581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.887684 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.887818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.887914 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.888055 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.888151 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.888296 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.888393 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.888538 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.888627 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.888771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.888864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.889000 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.889095 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.889226 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.889315 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.889562 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.889698 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.enabled = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.889793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.889920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.890017 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.890157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.890248 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.890403 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.890499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.enabled = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.890674 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.890764 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.890891 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.890982 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.891128 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.891219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.891364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.891479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.891648 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.891732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.891821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.891911 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.892060 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.892157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.892300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.892391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.892535 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.892635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.892777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.892867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.893015 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.893112 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.893258 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.893389 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.893484 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.893571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.893713 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.893861 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.893949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.894051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.894145 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.894241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.894385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.894481 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.894630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.894733 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.894864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.894974 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.895106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.895203 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.895343 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.895439 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.895578 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.895688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.895817 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.895968 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.896076 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.896242 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.896343 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.896488 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.896599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.896723 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] auth.external = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.896920 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.897017 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] auth.mapped = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.897170 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.897268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.897409 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] auth.external = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.897508 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.897645 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] auth.mapped = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.897744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] auth.password = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.897899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] auth.token = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.897995 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.898140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.898237 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.898377 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] catalog.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.898456 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] auth.password = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.898715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] auth.token = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.898826 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.898931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.899027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.899141 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] catalog.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.899238 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.899395 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.899492 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.899632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.899722 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.899882 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] credential.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.899978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.900130 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.900217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] credential.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.900365 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.900462 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.900604 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] credential.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.900703 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.900840 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.900940 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] credential.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.901087 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.901177 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.901324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.901427 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.901563 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.901704 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.901802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.901892 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.902044 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.902136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.902304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.902400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.902561 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.902669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.902837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.902928 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.903097 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.903206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.903340 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.903436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.903598 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.903688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.903834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] federation.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.903923 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.904073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.904179 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.904322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] federation.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.904422 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.904569 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.904673 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] federation.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.904801 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.904897 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.905049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] federation.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.905144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.905283 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.905371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.905522 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.905610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.905760 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.905855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.905998 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.906094 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.906245 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.906341 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.906483 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.906577 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.906742 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.906840 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.906991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.907093 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.907237 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.907323 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.907475 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.907562 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.907710 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.907794 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.907959 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.908049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.908190 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.908291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.908428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.908525 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.908676 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.908774 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.908910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.909007 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.909149 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.909243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.909380 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.909469 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.909610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.909711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.909855 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.909952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.910517 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.910811 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.910906 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.910993 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.911076 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.911206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.911412 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.911507 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.911585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.911671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.911748 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.911831 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.911921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.911993 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.911993 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.912129 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.912199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.912324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.912422 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.912501 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.912590 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.912668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.912751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.912834 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.912924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.912996 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.913110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.913208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.913341 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.913512 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.913603 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.913682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.913822 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.913912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.914057 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.914161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.914844 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.914959 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.915100 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.915197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.915333 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.915438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.915571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.915669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.915800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.password = **** {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.915968 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.916072 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.916178 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.916327 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.916413 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.916484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.password = **** {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.916734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.916898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.916981 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.917060 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.917150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.917223 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.917299 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.917405 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.917499 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.917636 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.917733 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.917866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.917958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.918112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.918210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.918346 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.918443 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.918579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.918682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.918839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.918948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.919077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.919170 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.919306 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.919393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.919544 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.919642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.919781 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.919878 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.920017 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.920108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.920259 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.920365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.920504 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.920601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.920743 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.920840 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.920977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.921068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.921223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.921326 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.921429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.921602 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.921696 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.921778 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.921888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.921987 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.922118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.922222 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.922365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.922474 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.922669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.922765 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.922850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.922948 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.923091 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.923189 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.923335 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.923432 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.923564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.923668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.923808 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.923909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.924045 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.924137 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.924277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.924370 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.924495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.924582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.924730 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.924817 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.925010 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.925107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.925210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.925289 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.925442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.925534 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.925688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.925788 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] policy.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.925916 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.926013 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.926161 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.926260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.926397 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.926496 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] policy.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.926656 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.926751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] receipt.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.926896 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.926994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.927133 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.927552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.927655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] receipt.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.927734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.927847 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.927937 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.928083 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.928187 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.928324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] resource.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.928415 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.928557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.928647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.928817 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.928919 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] resource.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.929031 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.929121 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] resource.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.929282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.929374 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.929531 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] resource.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.929632 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.929763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] revoke.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.929862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.930593 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.930714 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.930795 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.930899 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.931039 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] role.cache_time = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.931141 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] revoke.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.931262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] role.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.931393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.931511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] role.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.931635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.931741 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] role.list_limit = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.931877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] role.cache_time = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.931990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.932115 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] role.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.932236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.932371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] role.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.932486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.932587 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] role.list_limit = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.932731 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.932829 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.932976 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.933077 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.933221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.933320 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.933466 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.933558 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.933715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.933813 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.933947 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.934038 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.934193 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.934285 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.934440 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.934533 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.934710 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.934804 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.934959 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.935051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.935222 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.935392 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.935484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.935630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.935721 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.935878 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.936121 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.936213 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.936361 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.936461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.936637 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.936743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.936831 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.936917 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.937087 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.937180 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.937342 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.937433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.937576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.937668 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.937804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.937902 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.938037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.938134 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.938268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.938367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.938517 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.938666 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.938767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.938862 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.938997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.939096 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.939251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.939349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.939486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.939586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.939720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] token.cache_time = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.939812 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.939955 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] token.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.940046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.940192 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.940291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.940424 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] token.cache_time = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.940522 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] token.provider = fernet {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.940663 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] token.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.940761 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.940903 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.941002 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.941151 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.941241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] token.provider = fernet {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.941387 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.941477 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.941631 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.941735 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.941877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.941976 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.942115 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.942212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] trust.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.942350 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.942453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.942588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.942763 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.942862 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.942936 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] trust.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.943078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.943252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.943347 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.943426 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.943542 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.943640 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.943782 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.943886 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.944032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.944117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.944266 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.944364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.connection = **** {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.944512 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.944614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.944792 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.944890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.945032 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.945137 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.connection = **** {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.945274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.945374 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.945525 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.945630 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.945785 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.945881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.946019 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.946111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.946255 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.946355 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.946493 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.946591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.946737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.946810 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.946982 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.947075 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.947216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.947307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.947453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.947543 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.947686 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.947785 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.947925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.948022 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.948153 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.948243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.948393 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.948485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.948628 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.948719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.948804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=220179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 20:23:16.948877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.949093 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.949332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:16.949505 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=220180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 20:23:16.981360 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:16.981618 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:16.981809 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:16.981917 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:16.982155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:16.982388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:16.990931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:16.991501 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.019319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.019565 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.019931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.020170 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.073208 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.073405 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.126107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.126340 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.126452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.126555 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.192283 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.192477 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.192591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.192682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.192777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.192884 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.192983 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.193111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.193203 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.193350 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.193481 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.193637 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.216816 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.217040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.217142 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.217250 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.217351 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.217477 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.217577 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.217699 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.217799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.217960 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.218058 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.218150 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.218235 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.218318 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.229486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.230023 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.244390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.244622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.244845 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.244942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.245069 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.245178 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.245273 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.245381 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.245476 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.245575 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.245692 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=220179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.245794 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.245917 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.246136 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=220180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:17.263384 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.263595 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:23:17.263872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.263985 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.264084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:23:17.264178 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:23:17.264382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.264475 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.264610 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:23:17.264711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.264888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.264982 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.265144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.265246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.265401 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.265660 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.276321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.276602 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.276873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.276965 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.277157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.277252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.277434 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.277722 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.285410 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.286030 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.288743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.289026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.289839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.289940 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.290200 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.290305 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.290485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.290629 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.290780 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.290903 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.291055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.291192 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.291330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.291457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.291604 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.291732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.291879 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.292012 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.292148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.292290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.292568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.292841 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.319714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.320773 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.321377 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.321660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.322440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.322754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.327042 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.327280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.327562 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.328184 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.328480 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.328765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.334945 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.335231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.336318 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.336607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.339924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.340220 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.340505 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.340787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.341064 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.341305 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.341408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.341596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.341688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.341866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.341960 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.342143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.342421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.342723 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.342997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.343270 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.361334 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.361616 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.362762 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.363046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.366269 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.368200 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.370568 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.370898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.371896 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.372196 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.376123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.377386 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.379800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.381127 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.383716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.384019 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.384306 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.384594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.384913 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.385069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.385194 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.385375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.385666 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.385954 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.386255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.386541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.404415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.404792 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.405062 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.405335 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.408621 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.409147 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.409525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.409886 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.413363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.415703 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.415980 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.418765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.419090 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.419380 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.419671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.419952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.420230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.420517 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.420798 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.423916 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.424213 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.424513 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.424801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.425084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.434629 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.434918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.435200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.435489 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.435773 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.436050 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.436325 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.439570 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.439858 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.440145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.440430 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.440715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.440994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.441272 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.454806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.458108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.459763 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.461510 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.463174 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.463293 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.464825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.465113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.465392 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.466526 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.468190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.469874 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.470166 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.470456 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.472936 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.474561 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.478400 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.478668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.478765 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.478980 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.479252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.480310 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.483610 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.483907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.484195 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.484477 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.488646 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.488945 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.489224 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.496399 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.496751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.497045 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.497765 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=220179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.498050 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.498343 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.498639 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.498922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.499204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.499475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.499742 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.500017 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.500286 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.500574 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.500838 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.501106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.501366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=220179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.505063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=220180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:17.505351 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.505643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.505933 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.506210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.506494 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.506797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.507076 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.507355 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.507627 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.507917 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.508210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.508486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.508749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=220180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:17.540988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d34c7c49c0 pid: 220179 (default app) May 19 20:23:17.544380 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea2a5c-f648-4779-aebd-d65192b158b0 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:17.544685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea2a5c-f648-4779-aebd-d65192b158b0 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:17.544965 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea2a5c-f648-4779-aebd-d65192b158b0 None None] PATH_INFO: `/v3` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:17.548576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d34c7c49c0 pid: 220180 (default app) May 19 20:23:17.549181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 1/1] 10.222.0.89 () {50 vars in 791 bytes} [Thu May 19 20:23:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:26.510546 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6bade-edf5-4bc9-916c-0652f838866c None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:26.511194 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6bade-edf5-4bc9-916c-0652f838866c None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:26.511194 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6bade-edf5-4bc9-916c-0652f838866c None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:26.515481 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 1/2] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:23:26.521023 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f664bf-3623-4689-8c92-dcf3429068e7 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:26.521511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f664bf-3623-4689-8c92-dcf3429068e7 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:26.521624 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f664bf-3623-4689-8c92-dcf3429068e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:26.591698 dv-cinder-841302-4-smb devstack@keystone.service[220179]: INFO dbcounter [None req-66f664bf-3623-4689-8c92-dcf3429068e7 None None] Registered counter for database keystone May 19 20:23:26.613471 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG oslo_db.sqlalchemy.engines [None req-66f664bf-3623-4689-8c92-dcf3429068e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=220179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 20:23:26.620023 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writer thread running {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 20:23:26.801157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG passlib.handlers.bcrypt [None req-66f664bf-3623-4689-8c92-dcf3429068e7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=220179) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 20:23:26.801589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG passlib.handlers.bcrypt [None req-66f664bf-3623-4689-8c92-dcf3429068e7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=220179) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 20:23:26.858322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-66f664bf-3623-4689-8c92-dcf3429068e7 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:26.860006 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-66f664bf-3623-4689-8c92-dcf3429068e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:26.988112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 2/3] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 20:23:27.010475 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6bade-edf5-4bc9-916c-0652f838866c None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:27.080522 dv-cinder-841302-4-smb devstack@keystone.service[220180]: INFO dbcounter [None req-71c6bade-edf5-4bc9-916c-0652f838866c None None] Registered counter for database keystone May 19 20:23:27.100455 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG oslo_db.sqlalchemy.engines [None req-71c6bade-edf5-4bc9-916c-0652f838866c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=220180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 20:23:27.106768 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writer thread running {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 20:23:27.227284 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6bade-edf5-4bc9-916c-0652f838866c None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:27.231609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff626a9-0505-4fe4-b486-060b4bb8e2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b2b197a0f67411c87c371c8b2a2dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:27.232338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff626a9-0505-4fe4-b486-060b4bb8e2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:27.232623 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff626a9-0505-4fe4-b486-060b4bb8e2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:27.232900 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff626a9-0505-4fe4-b486-060b4bb8e2f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:27.241763 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff626a9-0505-4fe4-b486-060b4bb8e2f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:27.293264 dv-cinder-841302-4-smb devstack@keystone.service[220180]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ff626a9-0505-4fe4-b486-060b4bb8e2f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 20:23:27.293601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff626a9-0505-4fe4-b486-060b4bb8e2f6 admin admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:27.303994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 2/4] 10.222.0.89 () {58 vars in 1324 bytes} [Thu May 19 20:23:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 20:23:27.310132 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f664bf-3623-4689-8c92-dcf3429068e7 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:27.325370 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f664bf-3623-4689-8c92-dcf3429068e7 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:27.329873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0413b5-51a7-4c1b-921a-5525b22af8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b2b197a0f67411c87c371c8b2a2dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:27.331080 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0413b5-51a7-4c1b-921a-5525b22af8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:27.331318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0413b5-51a7-4c1b-921a-5525b22af8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:27.331594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0413b5-51a7-4c1b-921a-5525b22af8e3 admin admin] PATH_INFO: `/v3/projects/4b2b197a0f67411c87c371c8b2a2dea8` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:27.333103 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0413b5-51a7-4c1b-921a-5525b22af8e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b2b197a0f67411c87c371c8b2a2dea8)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:27.494210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4b0413b5-51a7-4c1b-921a-5525b22af8e3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 20:23:27.494552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0413b5-51a7-4c1b-921a-5525b22af8e3 admin admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:27.499346 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 3/5] 10.222.0.89 () {56 vars in 1207 bytes} [Thu May 19 20:23:27 2022] GET /identity/v3/projects/4b2b197a0f67411c87c371c8b2a2dea8 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:29.720805 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3b1ed-15a7-4492-bf10-32a58563e091 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:29.721386 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3b1ed-15a7-4492-bf10-32a58563e091 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:29.721386 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3b1ed-15a7-4492-bf10-32a58563e091 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:29.725496 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 3/6] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:23:29.731288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd56a4a-24e0-48ee-b597-804e2a9d0732 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:29.731720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd56a4a-24e0-48ee-b597-804e2a9d0732 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:29.731855 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd56a4a-24e0-48ee-b597-804e2a9d0732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:29.751533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-efd56a4a-24e0-48ee-b597-804e2a9d0732 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:29.753046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-efd56a4a-24e0-48ee-b597-804e2a9d0732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:29.761673 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 4/7] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 20:23:29.784235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3b1ed-15a7-4492-bf10-32a58563e091 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:29.796910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3b1ed-15a7-4492-bf10-32a58563e091 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:29.801242 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6407e-24f2-4f5d-b4d5-aa777c803e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b2b197a0f67411c87c371c8b2a2dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:29.801894 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6407e-24f2-4f5d-b4d5-aa777c803e20 admin admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:29.802180 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6407e-24f2-4f5d-b4d5-aa777c803e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:29.802767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6407e-24f2-4f5d-b4d5-aa777c803e20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:29.811450 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6407e-24f2-4f5d-b4d5-aa777c803e20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:29.813244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6407e-24f2-4f5d-b4d5-aa777c803e20 admin admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:29.822824 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 4/8] 10.222.0.89 () {58 vars in 1324 bytes} [Thu May 19 20:23:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 20:23:29.828790 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd56a4a-24e0-48ee-b597-804e2a9d0732 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:29.837970 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd56a4a-24e0-48ee-b597-804e2a9d0732 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:29.842397 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a92bf-2796-466d-84ae-dfd54033db70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b2b197a0f67411c87c371c8b2a2dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:29.843294 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a92bf-2796-466d-84ae-dfd54033db70 admin admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:29.843587 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a92bf-2796-466d-84ae-dfd54033db70 admin admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:29.843862 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a92bf-2796-466d-84ae-dfd54033db70 admin admin] PATH_INFO: `/v3/users/f0b88d2c828540b1a63ceadb9cee8a00` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:29.845273 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a92bf-2796-466d-84ae-dfd54033db70 admin admin] RBAC: Authorizing `identity:get_user(user_id=f0b88d2c828540b1a63ceadb9cee8a00)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:29.847163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a92bf-2796-466d-84ae-dfd54033db70 admin admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:29.848737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 5/9] 10.222.0.89 () {56 vars in 1198 bytes} [Thu May 19 20:23:29 2022] GET /identity/v3/users/f0b88d2c828540b1a63ceadb9cee8a00 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:32.137224 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4418d-7f01-449a-8393-3757bf3e5d22 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:32.137781 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4418d-7f01-449a-8393-3757bf3e5d22 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:32.137781 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4418d-7f01-449a-8393-3757bf3e5d22 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:32.139182 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 5/10] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:32.144593 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670744-1455-498d-bfa9-72680cf60473 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:32.145081 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670744-1455-498d-bfa9-72680cf60473 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:32.145185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670744-1455-498d-bfa9-72680cf60473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:32.162032 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-1e670744-1455-498d-bfa9-72680cf60473 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:32.163267 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-1e670744-1455-498d-bfa9-72680cf60473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:32.203554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2c9d-e653-40e2-94d8-aa568b7789c1 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:32.203833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2c9d-e653-40e2-94d8-aa568b7789c1 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:32.204111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2c9d-e653-40e2-94d8-aa568b7789c1 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:32.205469 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 6/11] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:32.210927 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bf60f-d990-4ba7-8406-444190830e5a None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:32.211093 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bf60f-d990-4ba7-8406-444190830e5a None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:32.211373 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bf60f-d990-4ba7-8406-444190830e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:32.245584 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 6/12] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:23:32.251453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG passlib.handlers.bcrypt [None req-571bf60f-d990-4ba7-8406-444190830e5a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=220180) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 20:23:32.251877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG passlib.handlers.bcrypt [None req-571bf60f-d990-4ba7-8406-444190830e5a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=220180) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 20:23:32.269063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e670744-1455-498d-bfa9-72680cf60473 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:32.292598 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:32.299292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-571bf60f-d990-4ba7-8406-444190830e5a None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:32.300885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-571bf60f-d990-4ba7-8406-444190830e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:32.376228 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e670744-1455-498d-bfa9-72680cf60473 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:32.403856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 7/13] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:23:32.409880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1f79f-a0bb-4e65-bb19-58075b6af858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:32.410718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1f79f-a0bb-4e65-bb19-58075b6af858 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:32.411007 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1f79f-a0bb-4e65-bb19-58075b6af858 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:32.411288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1f79f-a0bb-4e65-bb19-58075b6af858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:32.425103 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1f79f-a0bb-4e65-bb19-58075b6af858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:32.426196 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bf60f-d990-4ba7-8406-444190830e5a None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-a6c1f79f-a0bb-4e65-bb19-58075b6af858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:32.437390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:32.438475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:23:32.439467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 7/14] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:23:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:23:32.444534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1f79f-a0bb-4e65-bb19-58075b6af858 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:32.535749 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:32.556765 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1f79f-a0bb-4e65-bb19-58075b6af858 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:32.593609 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dd136-de10-4d5e-8e69-ab32059069a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:32.594294 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd136-de10-4d5e-8e69-ab32059069a4 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:32.594581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd136-de10-4d5e-8e69-ab32059069a4 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:32.594899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dd136-de10-4d5e-8e69-ab32059069a4 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:32.595679 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dd136-de10-4d5e-8e69-ab32059069a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:32.595994 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dd136-de10-4d5e-8e69-ab32059069a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:32.597426 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dd136-de10-4d5e-8e69-ab32059069a4 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:32.610833 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 8/15] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:23:32.617362 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dd136-de10-4d5e-8e69-ab32059069a4 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:32.646143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bf60f-d990-4ba7-8406-444190830e5a None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:32.649550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:32.688023 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15b4fe-8e25-4b8d-9421-3343848da95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:32.689069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15b4fe-8e25-4b8d-9421-3343848da95e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:32.689359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15b4fe-8e25-4b8d-9421-3343848da95e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:32.689690 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15b4fe-8e25-4b8d-9421-3343848da95e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:32.727553 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dd136-de10-4d5e-8e69-ab32059069a4 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:32.762257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15b4fe-8e25-4b8d-9421-3343848da95e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:32.763849 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15b4fe-8e25-4b8d-9421-3343848da95e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:32.765653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471499c-ae8c-498d-a16d-71d9fea28974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:32.766618 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471499c-ae8c-498d-a16d-71d9fea28974 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:32.766981 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471499c-ae8c-498d-a16d-71d9fea28974 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:32.767264 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471499c-ae8c-498d-a16d-71d9fea28974 None admin] PATH_INFO: `/v3/users/f0b88d2c828540b1a63ceadb9cee8a00` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:32.768537 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471499c-ae8c-498d-a16d-71d9fea28974 None admin] RBAC: Authorizing `identity:get_user(user_id=f0b88d2c828540b1a63ceadb9cee8a00)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:32.770016 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471499c-ae8c-498d-a16d-71d9fea28974 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:32.772193 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 9/16] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:32 2022] GET /identity/v3/users/f0b88d2c828540b1a63ceadb9cee8a00 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:23:32.777914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471499c-ae8c-498d-a16d-71d9fea28974 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:32.794298 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:32.886665 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 8/17] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:23:32.892572 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15b4fe-8e25-4b8d-9421-3343848da95e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:32.893692 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471499c-ae8c-498d-a16d-71d9fea28974 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:32.897038 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:32.933985 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c2df7-09ac-498c-8b9d-86236da976e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:32.934827 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c2df7-09ac-498c-8b9d-86236da976e1 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:32.935116 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c2df7-09ac-498c-8b9d-86236da976e1 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:32.935765 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c2df7-09ac-498c-8b9d-86236da976e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:32.937143 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c2df7-09ac-498c-8b9d-86236da976e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:32.938167 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c2df7-09ac-498c-8b9d-86236da976e1 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:32.939772 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 10/18] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:23:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:23:32.945734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c2df7-09ac-498c-8b9d-86236da976e1 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:33.009647 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15b4fe-8e25-4b8d-9421-3343848da95e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:33.040964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:33.043503 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f176b-7dbd-4e46-b695-c001ff032361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:33.044311 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f176b-7dbd-4e46-b695-c001ff032361 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:33.044590 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f176b-7dbd-4e46-b695-c001ff032361 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:33.044861 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f176b-7dbd-4e46-b695-c001ff032361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:33.061630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c2df7-09ac-498c-8b9d-86236da976e1 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:33.065660 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f176b-7dbd-4e46-b695-c001ff032361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:33.067203 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f176b-7dbd-4e46-b695-c001ff032361 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-076f176b-7dbd-4e46-b695-c001ff032361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:23:33.089642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:33.091252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:33.092238 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:23:33.092238 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:23:33.092238 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:23:33.092238 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:23:33.092238 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 9/19] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:23:33.097001 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f176b-7dbd-4e46-b695-c001ff032361 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:33.099188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636b119-6a70-4f0e-8bd0-fd3d640d2f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:33.099871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b119-6a70-4f0e-8bd0-fd3d640d2f71 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:33.100153 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b119-6a70-4f0e-8bd0-fd3d640d2f71 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:33.100437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b119-6a70-4f0e-8bd0-fd3d640d2f71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:33.101347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636b119-6a70-4f0e-8bd0-fd3d640d2f71 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.domain.id=default, user.id=f0b88d2c828540b1a63ceadb9cee8a00) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:33.101660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636b119-6a70-4f0e-8bd0-fd3d640d2f71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:33.103164 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636b119-6a70-4f0e-8bd0-fd3d640d2f71 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:33.111742 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 11/20] 10.222.0.89 () {56 vars in 1322 bytes} [Thu May 19 20:23:32 2022] GET /identity/v3/role_assignments?user.id=f0b88d2c828540b1a63ceadb9cee8a00&scope.domain.id=default&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:33.183427 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:33.240459 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f176b-7dbd-4e46-b695-c001ff032361 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:33.281356 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8229ae7-ba59-46e2-8c8c-250b4eef2916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:33.282038 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8229ae7-ba59-46e2-8c8c-250b4eef2916 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:33.282324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8229ae7-ba59-46e2-8c8c-250b4eef2916 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:33.282633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8229ae7-ba59-46e2-8c8c-250b4eef2916 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:33.283378 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8229ae7-ba59-46e2-8c8c-250b4eef2916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:33.283688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8229ae7-ba59-46e2-8c8c-250b4eef2916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:33.285120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8229ae7-ba59-46e2-8c8c-250b4eef2916 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:33.304685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 10/21] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:23:35.584215 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8aff-d9f6-4656-9ecd-047bf8c94f79 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:35.584796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8aff-d9f6-4656-9ecd-047bf8c94f79 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:35.585090 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8aff-d9f6-4656-9ecd-047bf8c94f79 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:35.586634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 12/22] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:35.592283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffbeb3-2238-440c-8fe9-2de5bf10a866 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:35.592772 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffbeb3-2238-440c-8fe9-2de5bf10a866 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:35.593072 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffbeb3-2238-440c-8fe9-2de5bf10a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:35.615682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-7bffbeb3-2238-440c-8fe9-2de5bf10a866 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:35.617502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-7bffbeb3-2238-440c-8fe9-2de5bf10a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:35.703781 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 11/23] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:35.747949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f8aff-d9f6-4656-9ecd-047bf8c94f79 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:35.894359 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f8aff-d9f6-4656-9ecd-047bf8c94f79 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:35.952510 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed008dfe-3e2c-40f2-b159-097765b678bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:35.953848 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed008dfe-3e2c-40f2-b159-097765b678bd None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:35.954371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed008dfe-3e2c-40f2-b159-097765b678bd None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:35.954929 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed008dfe-3e2c-40f2-b159-097765b678bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:35.977803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed008dfe-3e2c-40f2-b159-097765b678bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-ed008dfe-3e2c-40f2-b159-097765b678bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:35.985924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:35.987046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:23:35.987934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 13/24] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:23:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:23:35.995039 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffbeb3-2238-440c-8fe9-2de5bf10a866 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:36.067814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:36.160613 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffbeb3-2238-440c-8fe9-2de5bf10a866 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:36.202537 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94340817-dc4c-4eea-8c7c-26da96a9691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:36.203268 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94340817-dc4c-4eea-8c7c-26da96a9691f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:36.203558 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94340817-dc4c-4eea-8c7c-26da96a9691f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:36.203840 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94340817-dc4c-4eea-8c7c-26da96a9691f None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:36.204623 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94340817-dc4c-4eea-8c7c-26da96a9691f None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:36.204938 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94340817-dc4c-4eea-8c7c-26da96a9691f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:36.206362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94340817-dc4c-4eea-8c7c-26da96a9691f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:36.224778 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 12/25] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:23:36.230938 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed008dfe-3e2c-40f2-b159-097765b678bd None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:36.247026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:36.357494 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11d4d-5d88-4e94-8f77-f254e368fbef None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:36.357893 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11d4d-5d88-4e94-8f77-f254e368fbef None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:36.358300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11d4d-5d88-4e94-8f77-f254e368fbef None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:36.360009 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 13/26] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:23:36.377971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0d609-a5b0-47e8-8a06-16dc6218ffa6 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:36.378542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0d609-a5b0-47e8-8a06-16dc6218ffa6 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:36.379002 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0d609-a5b0-47e8-8a06-16dc6218ffa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:36.406643 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed008dfe-3e2c-40f2-b159-097765b678bd None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:36.408231 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-92c0d609-a5b0-47e8-8a06-16dc6218ffa6 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:36.410131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-92c0d609-a5b0-47e8-8a06-16dc6218ffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:36.458726 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a846d61-35b8-4fd8-9267-b55e0c7aa2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:36.458726 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a846d61-35b8-4fd8-9267-b55e0c7aa2ef None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:36.458726 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a846d61-35b8-4fd8-9267-b55e0c7aa2ef None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:36.458726 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a846d61-35b8-4fd8-9267-b55e0c7aa2ef None admin] PATH_INFO: `/v3/users/f0b88d2c828540b1a63ceadb9cee8a00` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:36.460347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a846d61-35b8-4fd8-9267-b55e0c7aa2ef None admin] RBAC: Authorizing `identity:get_user(user_id=f0b88d2c828540b1a63ceadb9cee8a00)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:36.462252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a846d61-35b8-4fd8-9267-b55e0c7aa2ef None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:36.465286 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 14/27] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:36 2022] GET /identity/v3/users/f0b88d2c828540b1a63ceadb9cee8a00 => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:36.466808 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd7b70-1a65-46be-a315-e4b6cec2ebd8 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:36.467164 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd7b70-1a65-46be-a315-e4b6cec2ebd8 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:36.467584 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd7b70-1a65-46be-a315-e4b6cec2ebd8 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:36.469062 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 15/28] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:36.482649 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd7b70-1a65-46be-a315-e4b6cec2ebd8 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:36.566760 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 14/29] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 20:23:36.569744 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7345-0882-4302-af30-e3615c15b7f5 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:36.570623 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7345-0882-4302-af30-e3615c15b7f5 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:36.570910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7345-0882-4302-af30-e3615c15b7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:36.594984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:36.606834 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-e99a7345-0882-4302-af30-e3615c15b7f5 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:36.608442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-e99a7345-0882-4302-af30-e3615c15b7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:36.645904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:36.688925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 15/30] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:36.689321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd7b70-1a65-46be-a315-e4b6cec2ebd8 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:36.690427 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7345-0882-4302-af30-e3615c15b7f5 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:36.752703 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b0fdf-9b88-442d-a554-ea2110268f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:36.753466 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0fdf-9b88-442d-a554-ea2110268f2b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:36.753752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0fdf-9b88-442d-a554-ea2110268f2b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:36.754025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0fdf-9b88-442d-a554-ea2110268f2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:36.755371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b0fdf-9b88-442d-a554-ea2110268f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:36.756833 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b0fdf-9b88-442d-a554-ea2110268f2b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:36.760725 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 16/31] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:23:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:36.762264 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e27204-e687-453b-8dbe-1671a3dd75ed None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:36.762810 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e27204-e687-453b-8dbe-1671a3dd75ed None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:36.763317 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e27204-e687-453b-8dbe-1671a3dd75ed None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:36.765810 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 17/32] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:36.766764 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e27204-e687-453b-8dbe-1671a3dd75ed None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:36.837696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7345-0882-4302-af30-e3615c15b7f5 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:36.879453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc5bac-7686-40df-b52b-f160e6f5a3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:36.880188 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5bac-7686-40df-b52b-f160e6f5a3cb None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:36.880475 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5bac-7686-40df-b52b-f160e6f5a3cb None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:36.880804 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5bac-7686-40df-b52b-f160e6f5a3cb None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:36.881579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc5bac-7686-40df-b52b-f160e6f5a3cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:36.883585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc5bac-7686-40df-b52b-f160e6f5a3cb None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:36.904183 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e27204-e687-453b-8dbe-1671a3dd75ed None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:36.940618 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5063830-990f-4bdf-80b0-857336b3b120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:36.941419 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063830-990f-4bdf-80b0-857336b3b120 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:36.941702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063830-990f-4bdf-80b0-857336b3b120 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:36.941978 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063830-990f-4bdf-80b0-857336b3b120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:36.952273 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:36.954495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5063830-990f-4bdf-80b0-857336b3b120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:36.956012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5063830-990f-4bdf-80b0-857336b3b120 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-e5063830-990f-4bdf-80b0-857336b3b120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:23:36.975144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:36.976133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:36.977302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:23:36.977302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:23:36.977302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:23:36.977302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:23:36.977302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 18/33] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:23:36.977302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5063830-990f-4bdf-80b0-857336b3b120 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:37.103646 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5063830-990f-4bdf-80b0-857336b3b120 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:37.143464 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a3d1-de99-420a-bf88-506f3f31a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:37.144392 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a3d1-de99-420a-bf88-506f3f31a0ec None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:37.144680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a3d1-de99-420a-bf88-506f3f31a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:37.145033 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a3d1-de99-420a-bf88-506f3f31a0ec None admin] PATH_INFO: `/v3/domains/default/users/f0b88d2c828540b1a63ceadb9cee8a00/roles/59689ee7c4f5409692318371dac5cbc7` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:37.147235 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10a3d1-de99-420a-bf88-506f3f31a0ec None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f0b88d2c828540b1a63ceadb9cee8a00, role_id=59689ee7c4f5409692318371dac5cbc7)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:37.148782 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10a3d1-de99-420a-bf88-506f3f31a0ec None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:37.150097 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 16/34] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:23:36 2022] POST /identity/v3/roles => generated 219 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:23:37.152378 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b208501-00ad-406b-9a33-cc10ea19618a None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:37.152948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b208501-00ad-406b-9a33-cc10ea19618a None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:37.153482 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b208501-00ad-406b-9a33-cc10ea19618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:37.180071 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-9b208501-00ad-406b-9a33-cc10ea19618a None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:37.182366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-9b208501-00ad-406b-9a33-cc10ea19618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:37.213408 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:37.268951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 17/35] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:37.270472 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b208501-00ad-406b-9a33-cc10ea19618a None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:37.387509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b208501-00ad-406b-9a33-cc10ea19618a None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:37.412559 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 19/36] 10.222.0.89 () {58 vars in 1361 bytes} [Thu May 19 20:23:36 2022] PUT /identity/v3/domains/default/users/f0b88d2c828540b1a63ceadb9cee8a00/roles/59689ee7c4f5409692318371dac5cbc7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:23:37.416140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a3d1-de99-420a-bf88-506f3f31a0ec None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:37.426935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfaf4d-5517-4be7-9171-77384686c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:37.428411 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfaf4d-5517-4be7-9171-77384686c8aa None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:37.428905 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfaf4d-5517-4be7-9171-77384686c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:37.429924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfaf4d-5517-4be7-9171-77384686c8aa None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:37.431097 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfaf4d-5517-4be7-9171-77384686c8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:37.431686 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfaf4d-5517-4be7-9171-77384686c8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:37.433632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfaf4d-5517-4be7-9171-77384686c8aa None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:37.448360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 18/37] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:37.457975 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfaf4d-5517-4be7-9171-77384686c8aa None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:37.503078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:37.536291 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:37.639442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a3d1-de99-420a-bf88-506f3f31a0ec None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:37.679045 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfaf4d-5517-4be7-9171-77384686c8aa None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:37.695764 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd57044-e27b-4b6b-8423-211df8eddcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:37.696867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57044-e27b-4b6b-8423-211df8eddcd2 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:37.697380 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57044-e27b-4b6b-8423-211df8eddcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:37.697889 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57044-e27b-4b6b-8423-211df8eddcd2 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:37.699700 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd57044-e27b-4b6b-8423-211df8eddcd2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:37.701710 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd57044-e27b-4b6b-8423-211df8eddcd2 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:37.725999 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c690ed-513a-4b3e-941e-bb5f065eaea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:37.726755 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c690ed-513a-4b3e-941e-bb5f065eaea5 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:37.726998 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c690ed-513a-4b3e-941e-bb5f065eaea5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:37.727280 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c690ed-513a-4b3e-941e-bb5f065eaea5 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:37.728309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c690ed-513a-4b3e-941e-bb5f065eaea5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:37.730033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c690ed-513a-4b3e-941e-bb5f065eaea5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:37.805919 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 20/38] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:23:37 2022] POST /identity/v3/roles => generated 225 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:23:37.831137 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 19/39] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:23:37 2022] POST /identity/v3/projects => generated 301 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:23:37.868869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4f34f-ed01-44a0-9775-5971fb5cd39f None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:37.869218 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4f34f-ed01-44a0-9775-5971fb5cd39f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:37.869447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4f34f-ed01-44a0-9775-5971fb5cd39f None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:37.870999 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 21/40] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:37.884478 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c4bc-7d1b-4b4c-a533-8e72a3da8c29 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:37.887245 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c4bc-7d1b-4b4c-a533-8e72a3da8c29 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:37.887245 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c4bc-7d1b-4b4c-a533-8e72a3da8c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:37.909901 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-2a69c4bc-7d1b-4b4c-a533-8e72a3da8c29 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:37.911255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-2a69c4bc-7d1b-4b4c-a533-8e72a3da8c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:38.018333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:38.023850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 20/41] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:38.050498 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4f34f-ed01-44a0-9775-5971fb5cd39f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:38.099122 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bd3bf-c08d-4212-ad0b-44564afb65ef None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:38.099412 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bd3bf-c08d-4212-ad0b-44564afb65ef None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:38.099704 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bd3bf-c08d-4212-ad0b-44564afb65ef None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:38.101727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 21/42] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:23:38.109688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443e69-b6a4-49db-8dec-cff67b89ba8d None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:38.109994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443e69-b6a4-49db-8dec-cff67b89ba8d None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:38.110262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443e69-b6a4-49db-8dec-cff67b89ba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:38.132451 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-e5443e69-b6a4-49db-8dec-cff67b89ba8d None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:38.133681 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-e5443e69-b6a4-49db-8dec-cff67b89ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:38.192033 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4f34f-ed01-44a0-9775-5971fb5cd39f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:38.212262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:38.225314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 22/43] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:23:38.235415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ddf7a-9750-4679-a550-82f95a3bde70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:38.236131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ddf7a-9750-4679-a550-82f95a3bde70 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:38.236422 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ddf7a-9750-4679-a550-82f95a3bde70 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:38.236707 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ddf7a-9750-4679-a550-82f95a3bde70 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:38.237526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ddf7a-9750-4679-a550-82f95a3bde70 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:38.239080 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ddf7a-9750-4679-a550-82f95a3bde70 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:38.250313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443e69-b6a4-49db-8dec-cff67b89ba8d None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:38.300044 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 22/44] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:23:38 2022] POST /identity/v3/roles => generated 223 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:23:38.379856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443e69-b6a4-49db-8dec-cff67b89ba8d None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:38.413952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:38.421038 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01461e-d91a-468e-9f96-a9ff991c55d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:38.424733 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01461e-d91a-468e-9f96-a9ff991c55d8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:38.424733 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01461e-d91a-468e-9f96-a9ff991c55d8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:38.424733 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01461e-d91a-468e-9f96-a9ff991c55d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:38.424733 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01461e-d91a-468e-9f96-a9ff991c55d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:38.425197 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01461e-d91a-468e-9f96-a9ff991c55d8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:38.427378 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 23/45] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:23:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:23:38.432953 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ddf7a-9750-4679-a550-82f95a3bde70 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:38.547270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ddf7a-9750-4679-a550-82f95a3bde70 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:38.581589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db110e-8e7d-40d7-ac3d-5501d0058fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:38.582259 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db110e-8e7d-40d7-ac3d-5501d0058fe7 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:38.582547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db110e-8e7d-40d7-ac3d-5501d0058fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:38.582871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db110e-8e7d-40d7-ac3d-5501d0058fe7 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:38.583588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db110e-8e7d-40d7-ac3d-5501d0058fe7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:38.585080 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db110e-8e7d-40d7-ac3d-5501d0058fe7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:38.671868 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 23/46] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:23:38 2022] POST /identity/v3/projects => generated 312 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:23:39.943533 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef12c49-72b4-48e4-a4d4-7e9b229eef5e None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:39.944088 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef12c49-72b4-48e4-a4d4-7e9b229eef5e None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:39.944088 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef12c49-72b4-48e4-a4d4-7e9b229eef5e None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:39.946016 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 24/47] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:39.951555 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4655f-d867-4a53-b161-38e45278f73a None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:39.951980 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4655f-d867-4a53-b161-38e45278f73a None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:39.952121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4655f-d867-4a53-b161-38e45278f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:39.969643 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-e8a4655f-d867-4a53-b161-38e45278f73a None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:39.971240 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-e8a4655f-d867-4a53-b161-38e45278f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:39.992709 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:40.045336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 24/48] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:40.070079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef12c49-72b4-48e4-a4d4-7e9b229eef5e None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:40.171153 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef12c49-72b4-48e4-a4d4-7e9b229eef5e None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:40.206941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9bc5f-9c3b-4c29-8aba-375c616cf869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:40.207755 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9bc5f-9c3b-4c29-8aba-375c616cf869 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:40.208049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9bc5f-9c3b-4c29-8aba-375c616cf869 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:40.208335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9bc5f-9c3b-4c29-8aba-375c616cf869 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:40.220220 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9bc5f-9c3b-4c29-8aba-375c616cf869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-3fc9bc5f-9c3b-4c29-8aba-375c616cf869 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:40.229262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:40.230300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:23:40.231292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 25/49] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:23:40.236444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4655f-d867-4a53-b161-38e45278f73a None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:40.337171 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4655f-d867-4a53-b161-38e45278f73a None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:40.371177 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03f0cd-9ca2-491b-8952-0af0d031f2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:40.371861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03f0cd-9ca2-491b-8952-0af0d031f2b5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:40.372146 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03f0cd-9ca2-491b-8952-0af0d031f2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:40.372425 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03f0cd-9ca2-491b-8952-0af0d031f2b5 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:40.373188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03f0cd-9ca2-491b-8952-0af0d031f2b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:40.373503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03f0cd-9ca2-491b-8952-0af0d031f2b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:40.375073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03f0cd-9ca2-491b-8952-0af0d031f2b5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:40.383909 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 25/50] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:40.389359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9bc5f-9c3b-4c29-8aba-375c616cf869 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:40.449596 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:40.493518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9bc5f-9c3b-4c29-8aba-375c616cf869 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:40.527670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102503b-f1ad-4848-8671-644e2a51c0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:40.528564 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102503b-f1ad-4848-8671-644e2a51c0d6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:40.528860 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102503b-f1ad-4848-8671-644e2a51c0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:40.529156 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102503b-f1ad-4848-8671-644e2a51c0d6 None admin] PATH_INFO: `/v3/users/f0b88d2c828540b1a63ceadb9cee8a00` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:40.530627 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102503b-f1ad-4848-8671-644e2a51c0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=f0b88d2c828540b1a63ceadb9cee8a00)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:40.532115 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102503b-f1ad-4848-8671-644e2a51c0d6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:40.533967 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 26/51] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:40 2022] GET /identity/v3/users/f0b88d2c828540b1a63ceadb9cee8a00 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:23:40.539780 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03f0cd-9ca2-491b-8952-0af0d031f2b5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:40.558917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:40.653704 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03f0cd-9ca2-491b-8952-0af0d031f2b5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:40.687182 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8baea-6a1d-4f11-b42f-ff40088dbfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:40.687983 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8baea-6a1d-4f11-b42f-ff40088dbfa1 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:40.688273 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8baea-6a1d-4f11-b42f-ff40088dbfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:40.688554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8baea-6a1d-4f11-b42f-ff40088dbfa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:40.689783 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8baea-6a1d-4f11-b42f-ff40088dbfa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:40.691284 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8baea-6a1d-4f11-b42f-ff40088dbfa1 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:40.692942 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 26/52] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:23:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:40.699229 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102503b-f1ad-4848-8671-644e2a51c0d6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:40.811334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102503b-f1ad-4848-8671-644e2a51c0d6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:40.837980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:40.846587 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb83ce4-1f1f-417f-99fa-ef30b3b06884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:40.849120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83ce4-1f1f-417f-99fa-ef30b3b06884 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:40.849120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83ce4-1f1f-417f-99fa-ef30b3b06884 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:40.849120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83ce4-1f1f-417f-99fa-ef30b3b06884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:40.849120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb83ce4-1f1f-417f-99fa-ef30b3b06884 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.domain.id=default, user.id=f0b88d2c828540b1a63ceadb9cee8a00) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:40.849450 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb83ce4-1f1f-417f-99fa-ef30b3b06884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:40.850956 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb83ce4-1f1f-417f-99fa-ef30b3b06884 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:40.861006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 27/53] 10.222.0.89 () {56 vars in 1322 bytes} [Thu May 19 20:23:40 2022] GET /identity/v3/role_assignments?user.id=f0b88d2c828540b1a63ceadb9cee8a00&scope.domain.id=default&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:40.907638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c1505-f8d9-47d1-9790-352a7d6ab41c None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:40.907849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c1505-f8d9-47d1-9790-352a7d6ab41c None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:40.908120 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c1505-f8d9-47d1-9790-352a7d6ab41c None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:40.909529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 27/54] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:40.915434 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9757c57-1c15-4dfa-8cd1-0ab17675001f None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:40.915728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9757c57-1c15-4dfa-8cd1-0ab17675001f None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:40.916008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9757c57-1c15-4dfa-8cd1-0ab17675001f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:40.934701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-c9757c57-1c15-4dfa-8cd1-0ab17675001f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:40.935932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-c9757c57-1c15-4dfa-8cd1-0ab17675001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:41.025733 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 28/55] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:41.049089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c1505-f8d9-47d1-9790-352a7d6ab41c None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:41.140031 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:41.156058 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c1505-f8d9-47d1-9790-352a7d6ab41c None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:41.189417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f64d22-03f1-463c-9653-9df58a83f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:41.190178 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64d22-03f1-463c-9653-9df58a83f077 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:41.190458 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64d22-03f1-463c-9653-9df58a83f077 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:41.190766 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64d22-03f1-463c-9653-9df58a83f077 None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:41.191970 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f64d22-03f1-463c-9653-9df58a83f077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:41.193446 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f64d22-03f1-463c-9653-9df58a83f077 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:41.195744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 28/56] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:23:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:41.201526 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9757c57-1c15-4dfa-8cd1-0ab17675001f None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:41.316131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9757c57-1c15-4dfa-8cd1-0ab17675001f None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:41.336345 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:41.349862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d219c92-dc38-4137-aec3-9aeb3bdc7fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:41.350554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d219c92-dc38-4137-aec3-9aeb3bdc7fa0 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:41.351408 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d219c92-dc38-4137-aec3-9aeb3bdc7fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:41.351752 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d219c92-dc38-4137-aec3-9aeb3bdc7fa0 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:41.352501 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d219c92-dc38-4137-aec3-9aeb3bdc7fa0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:41.353990 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d219c92-dc38-4137-aec3-9aeb3bdc7fa0 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:41.435177 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 29/57] 10.222.0.89 () {60 vars in 1140 bytes} [Thu May 19 20:23:41 2022] POST /identity/v3/projects => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:23:43.653567 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885855b-edec-4b44-b23b-78f3176c9828 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:43.654109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885855b-edec-4b44-b23b-78f3176c9828 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:43.654109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885855b-edec-4b44-b23b-78f3176c9828 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:43.655664 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 29/58] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:43.661457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5bd0-fbb8-4070-915d-91194d611497 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:43.661904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5bd0-fbb8-4070-915d-91194d611497 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:43.662105 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5bd0-fbb8-4070-915d-91194d611497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:43.679440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-b11c5bd0-fbb8-4070-915d-91194d611497 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:43.680645 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-b11c5bd0-fbb8-4070-915d-91194d611497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:43.748875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 30/59] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:43.773985 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885855b-edec-4b44-b23b-78f3176c9828 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:43.875630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885855b-edec-4b44-b23b-78f3176c9828 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:43.908055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5014e5d-3b0b-49fa-8c49-eb150c883f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:43.908779 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014e5d-3b0b-49fa-8c49-eb150c883f1a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:43.909067 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014e5d-3b0b-49fa-8c49-eb150c883f1a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:43.909354 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014e5d-3b0b-49fa-8c49-eb150c883f1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:43.910542 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5014e5d-3b0b-49fa-8c49-eb150c883f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:43.912034 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5014e5d-3b0b-49fa-8c49-eb150c883f1a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:43.914185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 30/60] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:23:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:43.919709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5bd0-fbb8-4070-915d-91194d611497 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:44.017043 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5bd0-fbb8-4070-915d-91194d611497 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:44.018593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:44.051818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636a0c3-81e9-4ddf-9773-5aaca1ba9154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:44.052754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a0c3-81e9-4ddf-9773-5aaca1ba9154 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:44.053043 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a0c3-81e9-4ddf-9773-5aaca1ba9154 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:44.053328 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a0c3-81e9-4ddf-9773-5aaca1ba9154 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:44.054090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636a0c3-81e9-4ddf-9773-5aaca1ba9154 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:44.055617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636a0c3-81e9-4ddf-9773-5aaca1ba9154 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:44.150756 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 31/61] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:23:43 2022] POST /identity/v3/users => generated 275 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:23:47.473829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4066-44ae-437c-960f-7eaf4a8a46c1 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:47.474745 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4066-44ae-437c-960f-7eaf4a8a46c1 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:47.475179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4066-44ae-437c-960f-7eaf4a8a46c1 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:47.477275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 31/62] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:47.482740 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681373-e9d6-4e17-9bac-7f770ec6143e None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:47.483538 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681373-e9d6-4e17-9bac-7f770ec6143e None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:47.484036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681373-e9d6-4e17-9bac-7f770ec6143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:47.507711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-db681373-e9d6-4e17-9bac-7f770ec6143e None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:47.508954 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-db681373-e9d6-4e17-9bac-7f770ec6143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:47.601237 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 32/63] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:47.614571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eea5f-04fd-4031-911d-1dcb8ee37d4f None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:47.615185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eea5f-04fd-4031-911d-1dcb8ee37d4f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:47.615693 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eea5f-04fd-4031-911d-1dcb8ee37d4f None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:47.617874 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 32/64] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:47.635421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2dfa2-2feb-4c8b-a99f-fdda13b8968c None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:47.636060 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2dfa2-2feb-4c8b-a99f-fdda13b8968c None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:47.636568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2dfa2-2feb-4c8b-a99f-fdda13b8968c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:47.643655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eea5f-04fd-4031-911d-1dcb8ee37d4f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:47.671487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-a4a2dfa2-2feb-4c8b-a99f-fdda13b8968c None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:47.672717 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-a4a2dfa2-2feb-4c8b-a99f-fdda13b8968c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:47.679608 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:47.796913 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eea5f-04fd-4031-911d-1dcb8ee37d4f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:47.834298 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c71ee3-cbf8-4cba-a5b4-501baf3e6e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:47.835937 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c71ee3-cbf8-4cba-a5b4-501baf3e6e10 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:47.836400 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c71ee3-cbf8-4cba-a5b4-501baf3e6e10 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:47.836963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c71ee3-cbf8-4cba-a5b4-501baf3e6e10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:47.840658 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 33/65] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:47.848699 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c71ee3-cbf8-4cba-a5b4-501baf3e6e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-35c71ee3-cbf8-4cba-a5b4-501baf3e6e10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:47.857516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:47.858774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:23:47.859960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:23:47.862110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 33/66] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:23:47.868214 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2dfa2-2feb-4c8b-a99f-fdda13b8968c None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:47.872491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c71ee3-cbf8-4cba-a5b4-501baf3e6e10 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:47.909201 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:48.009747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:48.030681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c71ee3-cbf8-4cba-a5b4-501baf3e6e10 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:48.031424 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2dfa2-2feb-4c8b-a99f-fdda13b8968c None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:48.070533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d38c2-3536-4951-9041-ec432e1e2c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:48.071287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d38c2-3536-4951-9041-ec432e1e2c69 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.071577 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d38c2-3536-4951-9041-ec432e1e2c69 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.071857 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d38c2-3536-4951-9041-ec432e1e2c69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.077081 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc859cfd-f208-4efd-8af6-66c54c64cb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:48.078300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc859cfd-f208-4efd-8af6-66c54c64cb9c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.078870 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc859cfd-f208-4efd-8af6-66c54c64cb9c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.079688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc859cfd-f208-4efd-8af6-66c54c64cb9c None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.081516 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc859cfd-f208-4efd-8af6-66c54c64cb9c None admin] RBAC: Adding query filter params (name=member) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:48.082337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc859cfd-f208-4efd-8af6-66c54c64cb9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:48.082973 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d38c2-3536-4951-9041-ec432e1e2c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:48.084653 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc859cfd-f208-4efd-8af6-66c54c64cb9c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-4a6d38c2-3536-4951-9041-ec432e1e2c69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:48.091952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:48.093206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:23:48.094123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 34/67] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:23:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:23:48.094905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066e569-d8c3-4a9a-accd-7533fdb1beed None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.094905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066e569-d8c3-4a9a-accd-7533fdb1beed None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.095045 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066e569-d8c3-4a9a-accd-7533fdb1beed None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.096351 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 35/68] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:48.098316 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 34/69] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:23:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:48.103764 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ed4f1-2ae4-4c9a-a185-35b715e63137 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.104419 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ed4f1-2ae4-4c9a-a185-35b715e63137 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.104918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ed4f1-2ae4-4c9a-a185-35b715e63137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.107653 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc859cfd-f208-4efd-8af6-66c54c64cb9c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:48.123881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-a04ed4f1-2ae4-4c9a-a185-35b715e63137 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:48.125620 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-a04ed4f1-2ae4-4c9a-a185-35b715e63137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:48.198901 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 36/70] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:48.200069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:48.206331 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ed4f1-2ae4-4c9a-a185-35b715e63137 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:48.224693 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc859cfd-f208-4efd-8af6-66c54c64cb9c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:48.265208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a1063-2806-4be6-abe6-f0159e2dfa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:48.265891 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a1063-2806-4be6-abe6-f0159e2dfa7c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.266177 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a1063-2806-4be6-abe6-f0159e2dfa7c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.266454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a1063-2806-4be6-abe6-f0159e2dfa7c None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.267249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a1063-2806-4be6-abe6-f0159e2dfa7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:48.267558 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a1063-2806-4be6-abe6-f0159e2dfa7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:48.268933 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a1063-2806-4be6-abe6-f0159e2dfa7c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:48.282542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 35/71] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:48.282542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8e2e-c1ee-4741-b656-444b3fb64fa7 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.282542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8e2e-c1ee-4741-b656-444b3fb64fa7 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.282542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8e2e-c1ee-4741-b656-444b3fb64fa7 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.282542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 36/72] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:48.282542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d8e2e-c1ee-4741-b656-444b3fb64fa7 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:48.305696 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:48.339350 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ed4f1-2ae4-4c9a-a185-35b715e63137 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:48.377353 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c4c54-9c30-4db0-8c0a-01a746059d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:48.378247 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4c54-9c30-4db0-8c0a-01a746059d9a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.378528 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4c54-9c30-4db0-8c0a-01a746059d9a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.379055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4c54-9c30-4db0-8c0a-01a746059d9a None admin] PATH_INFO: `/v3/users/d05cd1394b114e79a86eca456272c6fb` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.394264 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c4c54-9c30-4db0-8c0a-01a746059d9a None admin] RBAC: Authorizing `identity:get_user(user_id=d05cd1394b114e79a86eca456272c6fb)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:48.395792 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c4c54-9c30-4db0-8c0a-01a746059d9a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:48.398234 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 37/73] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:48 2022] GET /identity/v3/users/d05cd1394b114e79a86eca456272c6fb => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:48.399040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c4c54-9c30-4db0-8c0a-01a746059d9a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:48.411831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d8e2e-c1ee-4741-b656-444b3fb64fa7 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:48.448827 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddc999-82ee-44f6-94d5-b08cb4ac645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:48.449658 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddc999-82ee-44f6-94d5-b08cb4ac645f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.449946 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddc999-82ee-44f6-94d5-b08cb4ac645f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.450225 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddc999-82ee-44f6-94d5-b08cb4ac645f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.461340 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddc999-82ee-44f6-94d5-b08cb4ac645f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-89ddc999-82ee-44f6-94d5-b08cb4ac645f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:48.469484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:48.470491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:23:48.471499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 37/74] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:23:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:23:48.472373 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e76ea6-5363-4a37-a26e-4e709302cf8f None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.472373 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e76ea6-5363-4a37-a26e-4e709302cf8f None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.472620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e76ea6-5363-4a37-a26e-4e709302cf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.478784 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:48.490076 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-54e76ea6-5363-4a37-a26e-4e709302cf8f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:48.492510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-54e76ea6-5363-4a37-a26e-4e709302cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:48.512727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c4c54-9c30-4db0-8c0a-01a746059d9a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:48.541327 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:48.549197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7d170-a6d6-43dd-aac3-f0fd8fe88fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:48.550083 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d170-a6d6-43dd-aac3-f0fd8fe88fcf None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.550370 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d170-a6d6-43dd-aac3-f0fd8fe88fcf None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.558553 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d170-a6d6-43dd-aac3-f0fd8fe88fcf None admin] PATH_INFO: `/v3/users/f0b88d2c828540b1a63ceadb9cee8a00` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.558553 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7d170-a6d6-43dd-aac3-f0fd8fe88fcf None admin] RBAC: Authorizing `identity:get_user(user_id=f0b88d2c828540b1a63ceadb9cee8a00)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:48.558553 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7d170-a6d6-43dd-aac3-f0fd8fe88fcf None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:48.558553 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 38/75] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:48 2022] GET /identity/v3/users/f0b88d2c828540b1a63ceadb9cee8a00 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:48.558553 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7d170-a6d6-43dd-aac3-f0fd8fe88fcf None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:48.562747 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 38/76] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:48.564111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48be0a-6b55-4fe2-b534-1783f904ae65 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.564407 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48be0a-6b55-4fe2-b534-1783f904ae65 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.564693 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48be0a-6b55-4fe2-b534-1783f904ae65 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.570179 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 39/77] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:48.570179 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48be0a-6b55-4fe2-b534-1783f904ae65 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:48.662220 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7d170-a6d6-43dd-aac3-f0fd8fe88fcf None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:48.678006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48be0a-6b55-4fe2-b534-1783f904ae65 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:48.697030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de4266-63d5-470f-8cc5-7e951b8ba455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:48.697689 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de4266-63d5-470f-8cc5-7e951b8ba455 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.697979 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de4266-63d5-470f-8cc5-7e951b8ba455 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.698257 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de4266-63d5-470f-8cc5-7e951b8ba455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.707896 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:48.713302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82aa01-cdd6-4336-b97a-d040b6a4f7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:48.714041 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82aa01-cdd6-4336-b97a-d040b6a4f7f1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.720991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82aa01-cdd6-4336-b97a-d040b6a4f7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.720991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82aa01-cdd6-4336-b97a-d040b6a4f7f1 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.720991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82aa01-cdd6-4336-b97a-d040b6a4f7f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:48.720991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82aa01-cdd6-4336-b97a-d040b6a4f7f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:48.720991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82aa01-cdd6-4336-b97a-d040b6a4f7f1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:48.726473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 40/78] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:23:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:48.727350 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82aa01-cdd6-4336-b97a-d040b6a4f7f1 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:48.767282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:48.776413 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de4266-63d5-470f-8cc5-7e951b8ba455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:48.790802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de4266-63d5-470f-8cc5-7e951b8ba455 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:48.840389 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82aa01-cdd6-4336-b97a-d040b6a4f7f1 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:48.874212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b0c23-7404-45c0-b707-6138b93284b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:48.874901 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b0c23-7404-45c0-b707-6138b93284b5 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.875191 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b0c23-7404-45c0-b707-6138b93284b5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.875474 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b0c23-7404-45c0-b707-6138b93284b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.880408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 39/79] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:23:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:23:48.882225 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573f61-c17d-40a0-b959-3f60ebad839f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:48.882514 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573f61-c17d-40a0-b959-3f60ebad839f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:48.882813 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573f61-c17d-40a0-b959-3f60ebad839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:48.899650 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-d4573f61-c17d-40a0-b959-3f60ebad839f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:48.900848 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-d4573f61-c17d-40a0-b959-3f60ebad839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:48.939940 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:48.948229 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b0c23-7404-45c0-b707-6138b93284b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:48.956632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b0c23-7404-45c0-b707-6138b93284b5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:48.966429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 40/80] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:48.968722 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4573f61-c17d-40a0-b959-3f60ebad839f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:48.996703 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:49.053192 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 41/81] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:23:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:23:49.054092 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b0c23-7404-45c0-b707-6138b93284b5 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:49.071055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4573f61-c17d-40a0-b959-3f60ebad839f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:49.104817 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f36dd1-de3e-44f3-979d-21fbf610b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:49.105628 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36dd1-de3e-44f3-979d-21fbf610b6c3 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:49.105913 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36dd1-de3e-44f3-979d-21fbf610b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:49.106192 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36dd1-de3e-44f3-979d-21fbf610b6c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:49.116514 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f36dd1-de3e-44f3-979d-21fbf610b6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-42f36dd1-de3e-44f3-979d-21fbf610b6c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:49.124252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:49.125481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:23:49.126448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 41/82] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:23:49.127272 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f36dd1-de3e-44f3-979d-21fbf610b6c3 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:49.149036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:49.155799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b0c23-7404-45c0-b707-6138b93284b5 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:49.190396 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22cd6b-b8f1-4353-bf09-193e0e179172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:49.191308 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22cd6b-b8f1-4353-bf09-193e0e179172 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:49.191601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22cd6b-b8f1-4353-bf09-193e0e179172 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:49.191885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22cd6b-b8f1-4353-bf09-193e0e179172 None admin] PATH_INFO: `/v3/users/d05cd1394b114e79a86eca456272c6fb` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:49.193124 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22cd6b-b8f1-4353-bf09-193e0e179172 None admin] RBAC: Authorizing `identity:get_user(user_id=d05cd1394b114e79a86eca456272c6fb)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:49.195256 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22cd6b-b8f1-4353-bf09-193e0e179172 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:49.196942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 42/83] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:49 2022] GET /identity/v3/users/d05cd1394b114e79a86eca456272c6fb => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:49.201692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22cd6b-b8f1-4353-bf09-193e0e179172 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:49.213096 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:49.228752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f36dd1-de3e-44f3-979d-21fbf610b6c3 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:49.263193 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f5a21-9081-4d44-ac5e-cc1da9cd234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:49.264165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5a21-9081-4d44-ac5e-cc1da9cd234f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:49.264465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5a21-9081-4d44-ac5e-cc1da9cd234f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:49.264744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5a21-9081-4d44-ac5e-cc1da9cd234f None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:49.265973 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f5a21-9081-4d44-ac5e-cc1da9cd234f None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:49.267505 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f5a21-9081-4d44-ac5e-cc1da9cd234f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:49.269237 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 42/84] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:23:49 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:49.270022 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f5a21-9081-4d44-ac5e-cc1da9cd234f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:49.302543 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22cd6b-b8f1-4353-bf09-193e0e179172 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:49.337544 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bb21e-1dfb-411c-9dfe-65b40b5408c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:49.338344 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bb21e-1dfb-411c-9dfe-65b40b5408c8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:49.338652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bb21e-1dfb-411c-9dfe-65b40b5408c8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:49.338934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bb21e-1dfb-411c-9dfe-65b40b5408c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:49.340122 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bb21e-1dfb-411c-9dfe-65b40b5408c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:49.341573 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bb21e-1dfb-411c-9dfe-65b40b5408c8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:49.343333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 43/85] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:23:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:49.344092 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bb21e-1dfb-411c-9dfe-65b40b5408c8 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:49.374991 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f5a21-9081-4d44-ac5e-cc1da9cd234f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:49.375312 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:49.409529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525df315-d37c-47f3-87e2-923cf9b6a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:49.410395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df315-d37c-47f3-87e2-923cf9b6a797 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:49.410725 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df315-d37c-47f3-87e2-923cf9b6a797 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:49.411011 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df315-d37c-47f3-87e2-923cf9b6a797 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:49.412219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525df315-d37c-47f3-87e2-923cf9b6a797 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:49.413729 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525df315-d37c-47f3-87e2-923cf9b6a797 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:49.415495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 43/86] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:23:49 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:49.416275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525df315-d37c-47f3-87e2-923cf9b6a797 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:49.443792 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:49.447623 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bb21e-1dfb-411c-9dfe-65b40b5408c8 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:49.482154 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14a0e1-b262-4ad7-a77a-04812cbb562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:49.482837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14a0e1-b262-4ad7-a77a-04812cbb562a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:49.483155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14a0e1-b262-4ad7-a77a-04812cbb562a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:49.483438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14a0e1-b262-4ad7-a77a-04812cbb562a None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:49.484194 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14a0e1-b262-4ad7-a77a-04812cbb562a None admin] RBAC: Adding query filter params (name=member) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:49.484551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14a0e1-b262-4ad7-a77a-04812cbb562a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:49.485947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14a0e1-b262-4ad7-a77a-04812cbb562a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:49.494529 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 44/87] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:23:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:49.495367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14a0e1-b262-4ad7-a77a-04812cbb562a None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:49.525660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525df315-d37c-47f3-87e2-923cf9b6a797 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:49.563801 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc7148-a706-4893-851e-531f9df085f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:49.564472 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7148-a706-4893-851e-531f9df085f2 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:49.564761 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7148-a706-4893-851e-531f9df085f2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:49.565737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7148-a706-4893-851e-531f9df085f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:49.586150 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:49.594685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14a0e1-b262-4ad7-a77a-04812cbb562a None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:49.629659 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dde42f-330e-4093-bf44-1d224ed0c757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:49.630317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dde42f-330e-4093-bf44-1d224ed0c757 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:49.630715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dde42f-330e-4093-bf44-1d224ed0c757 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:49.630996 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dde42f-330e-4093-bf44-1d224ed0c757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:49.631930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dde42f-330e-4093-bf44-1d224ed0c757 None admin] RBAC: Adding query filter params (role.id=a661e4208e2047e69b45e282caa0683b, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4, user.id=d05cd1394b114e79a86eca456272c6fb) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:49.632246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dde42f-330e-4093-bf44-1d224ed0c757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:49.633696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dde42f-330e-4093-bf44-1d224ed0c757 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:49.634873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc7148-a706-4893-851e-531f9df085f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:49.636370 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc7148-a706-4893-851e-531f9df085f2 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:49.639377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 45/88] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:23:49 2022] GET /identity/v3/role_assignments?user.id=d05cd1394b114e79a86eca456272c6fb&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=a661e4208e2047e69b45e282caa0683b => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:49.641261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dde42f-330e-4093-bf44-1d224ed0c757 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:49.662506 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:49.752573 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 44/89] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:23:49.757910 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc7148-a706-4893-851e-531f9df085f2 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:49.764981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dde42f-330e-4093-bf44-1d224ed0c757 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:49.808304 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133699a-5a5a-488a-bdca-ad24ee070240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:49.809106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133699a-5a5a-488a-bdca-ad24ee070240 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:49.809475 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133699a-5a5a-488a-bdca-ad24ee070240 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:49.809867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133699a-5a5a-488a-bdca-ad24ee070240 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:49.810746 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133699a-5a5a-488a-bdca-ad24ee070240 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:49.812328 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133699a-5a5a-488a-bdca-ad24ee070240 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:49.873185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc7148-a706-4893-851e-531f9df085f2 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:49.893600 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 46/90] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:23:49 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:23:49.894427 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133699a-5a5a-488a-bdca-ad24ee070240 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:49.907740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:49.921448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcf265-2b8d-4c00-85c3-295bc87be6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:49.922106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcf265-2b8d-4c00-85c3-295bc87be6d7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:49.922391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcf265-2b8d-4c00-85c3-295bc87be6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:49.922699 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcf265-2b8d-4c00-85c3-295bc87be6d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:49.923571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcf265-2b8d-4c00-85c3-295bc87be6d7 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4, user.id=f0b88d2c828540b1a63ceadb9cee8a00) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:49.923888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcf265-2b8d-4c00-85c3-295bc87be6d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:49.925385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcf265-2b8d-4c00-85c3-295bc87be6d7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:49.926333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:49.932849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 45/91] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:23:49 2022] GET /identity/v3/role_assignments?user.id=f0b88d2c828540b1a63ceadb9cee8a00&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:49.937979 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcf265-2b8d-4c00-85c3-295bc87be6d7 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:50.062579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133699a-5a5a-488a-bdca-ad24ee070240 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:50.127594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a6fe9-1812-4e62-a81e-c77e7afa99ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:50.127594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a6fe9-1812-4e62-a81e-c77e7afa99ad None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:50.127905 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a6fe9-1812-4e62-a81e-c77e7afa99ad None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:50.127991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a6fe9-1812-4e62-a81e-c77e7afa99ad None admin] PATH_INFO: `/v3/users/d05cd1394b114e79a86eca456272c6fb` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:50.132351 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a6fe9-1812-4e62-a81e-c77e7afa99ad None admin] RBAC: Authorizing `identity:get_user(user_id=d05cd1394b114e79a86eca456272c6fb)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:50.135288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a6fe9-1812-4e62-a81e-c77e7afa99ad None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:50.140336 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 47/92] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:49 2022] GET /identity/v3/users/d05cd1394b114e79a86eca456272c6fb => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:50.149760 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a6fe9-1812-4e62-a81e-c77e7afa99ad None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:50.190934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcf265-2b8d-4c00-85c3-295bc87be6d7 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:50.235618 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722198e9-e78d-43f5-ab1c-49a319205bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:50.236506 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722198e9-e78d-43f5-ab1c-49a319205bf0 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:50.236790 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722198e9-e78d-43f5-ab1c-49a319205bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:50.237068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722198e9-e78d-43f5-ab1c-49a319205bf0 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:50.239009 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722198e9-e78d-43f5-ab1c-49a319205bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:50.240499 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722198e9-e78d-43f5-ab1c-49a319205bf0 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:50.242852 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 46/93] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:23:49 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:50.249232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722198e9-e78d-43f5-ab1c-49a319205bf0 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:50.276661 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:50.307412 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a6fe9-1812-4e62-a81e-c77e7afa99ad None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:50.338276 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:50.364711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c27868-f55c-4eda-99f4-c3dac2df55ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:50.365397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c27868-f55c-4eda-99f4-c3dac2df55ac None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:50.365690 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c27868-f55c-4eda-99f4-c3dac2df55ac None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:50.366004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c27868-f55c-4eda-99f4-c3dac2df55ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:50.423511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722198e9-e78d-43f5-ab1c-49a319205bf0 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:50.486782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c27868-f55c-4eda-99f4-c3dac2df55ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:50.488311 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c27868-f55c-4eda-99f4-c3dac2df55ac None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:50.492029 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3011ba-212e-4448-ad42-594859a990b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:50.492713 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3011ba-212e-4448-ad42-594859a990b5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:50.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3011ba-212e-4448-ad42-594859a990b5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:50.493275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3011ba-212e-4448-ad42-594859a990b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:50.494133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3011ba-212e-4448-ad42-594859a990b5 None admin] RBAC: Adding query filter params (role.id=920e2cadf3044abda66c715e1c89f4e3, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4, user.id=d05cd1394b114e79a86eca456272c6fb) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:50.494452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3011ba-212e-4448-ad42-594859a990b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:50.495951 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3011ba-212e-4448-ad42-594859a990b5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:50.516584 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 47/94] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:23:50 2022] GET /identity/v3/role_assignments?user.id=d05cd1394b114e79a86eca456272c6fb&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=920e2cadf3044abda66c715e1c89f4e3 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:50.608801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:50.628242 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 48/95] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:23:50.633894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3011ba-212e-4448-ad42-594859a990b5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:50.781521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3011ba-212e-4448-ad42-594859a990b5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:50.807371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:50.827451 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bff83a-5b51-4250-90ed-cde60372086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:50.830956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bff83a-5b51-4250-90ed-cde60372086c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:50.830956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bff83a-5b51-4250-90ed-cde60372086c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:50.830956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bff83a-5b51-4250-90ed-cde60372086c None admin] PATH_INFO: `/v3/projects/b7bbb1c4a418473b8051c4bf9d4426e9` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:50.835945 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bff83a-5b51-4250-90ed-cde60372086c None admin] RBAC: Authorizing `identity:get_project(project_id=b7bbb1c4a418473b8051c4bf9d4426e9)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:50.837539 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bff83a-5b51-4250-90ed-cde60372086c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:50.839751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 48/96] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:23:50 2022] GET /identity/v3/projects/b7bbb1c4a418473b8051c4bf9d4426e9 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:50.845288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c27868-f55c-4eda-99f4-c3dac2df55ac None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:50.997708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c27868-f55c-4eda-99f4-c3dac2df55ac None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:51.042556 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0e008-e644-4cff-9fce-0a76d3cfbc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:51.043269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0e008-e644-4cff-9fce-0a76d3cfbc38 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:51.043561 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0e008-e644-4cff-9fce-0a76d3cfbc38 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:51.043848 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0e008-e644-4cff-9fce-0a76d3cfbc38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:51.044709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0e008-e644-4cff-9fce-0a76d3cfbc38 None admin] RBAC: Adding query filter params (role.id=a661e4208e2047e69b45e282caa0683b, scope.project.id=b7bbb1c4a418473b8051c4bf9d4426e9, user.id=d05cd1394b114e79a86eca456272c6fb) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:51.045032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0e008-e644-4cff-9fce-0a76d3cfbc38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:51.046490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0e008-e644-4cff-9fce-0a76d3cfbc38 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:51.053145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 49/97] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:23:50 2022] GET /identity/v3/role_assignments?user.id=d05cd1394b114e79a86eca456272c6fb&scope.project.id=b7bbb1c4a418473b8051c4bf9d4426e9&role.id=a661e4208e2047e69b45e282caa0683b => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:52.375012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8445b-c08e-4396-977a-cdddae2a2ed3 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:52.375552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8445b-c08e-4396-977a-cdddae2a2ed3 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:52.375552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8445b-c08e-4396-977a-cdddae2a2ed3 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:52.377071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 49/98] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:52.382896 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6aa554-e09b-4406-9127-bfef62a1029d None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:52.383371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6aa554-e09b-4406-9127-bfef62a1029d None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:52.383460 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6aa554-e09b-4406-9127-bfef62a1029d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:52.407657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-ec6aa554-e09b-4406-9127-bfef62a1029d None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:52.408890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-ec6aa554-e09b-4406-9127-bfef62a1029d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:52.463463 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:52.509233 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 50/99] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:52.545405 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8445b-c08e-4396-977a-cdddae2a2ed3 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:52.692135 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8445b-c08e-4396-977a-cdddae2a2ed3 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:52.737535 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ece93-9781-4eab-bd82-49c315d9893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:52.738348 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ece93-9781-4eab-bd82-49c315d9893d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:52.738721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ece93-9781-4eab-bd82-49c315d9893d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:52.739008 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ece93-9781-4eab-bd82-49c315d9893d None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:52.755483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ece93-9781-4eab-bd82-49c315d9893d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-c83ece93-9781-4eab-bd82-49c315d9893d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:52.763282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:52.764244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:23:52.765136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 50/100] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:23:52.775534 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6aa554-e09b-4406-9127-bfef62a1029d None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:52.926388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6aa554-e09b-4406-9127-bfef62a1029d None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:52.966544 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e7fcb-2e80-4660-b3ef-710e839beff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:52.967181 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e7fcb-2e80-4660-b3ef-710e839beff7 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:52.967474 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e7fcb-2e80-4660-b3ef-710e839beff7 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:52.967762 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e7fcb-2e80-4660-b3ef-710e839beff7 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:52.968534 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e7fcb-2e80-4660-b3ef-710e839beff7 None admin] RBAC: Adding query filter params (name=member) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:52.968853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e7fcb-2e80-4660-b3ef-710e839beff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:52.970258 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e7fcb-2e80-4660-b3ef-710e839beff7 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:52.979900 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 51/101] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:23:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:52.987709 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ece93-9781-4eab-bd82-49c315d9893d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:53.053388 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:53.132794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ece93-9781-4eab-bd82-49c315d9893d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:53.186427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cca17-3acd-46e3-a9e6-06b9df298f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:53.187367 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cca17-3acd-46e3-a9e6-06b9df298f20 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:53.187651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cca17-3acd-46e3-a9e6-06b9df298f20 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:53.187928 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cca17-3acd-46e3-a9e6-06b9df298f20 None admin] PATH_INFO: `/v3/users/d05cd1394b114e79a86eca456272c6fb` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:53.191969 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cca17-3acd-46e3-a9e6-06b9df298f20 None admin] RBAC: Authorizing `identity:get_user(user_id=d05cd1394b114e79a86eca456272c6fb)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:53.193502 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cca17-3acd-46e3-a9e6-06b9df298f20 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:53.195605 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 51/102] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:52 2022] GET /identity/v3/users/d05cd1394b114e79a86eca456272c6fb => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:53.200861 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e7fcb-2e80-4660-b3ef-710e839beff7 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:53.263156 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:53.355956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5338b2-8bc0-4143-8266-991acf70b981 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:53.356309 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5338b2-8bc0-4143-8266-991acf70b981 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:53.356530 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5338b2-8bc0-4143-8266-991acf70b981 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:53.357930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 52/103] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:53.364450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e347-389e-4f15-90ac-7ea905f8969c None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:53.364738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e347-389e-4f15-90ac-7ea905f8969c None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:53.365024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e347-389e-4f15-90ac-7ea905f8969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:53.391095 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e7fcb-2e80-4660-b3ef-710e839beff7 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:53.407726 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-0530e347-389e-4f15-90ac-7ea905f8969c None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:53.408967 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-0530e347-389e-4f15-90ac-7ea905f8969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:53.456303 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc71d5-d26a-4a7b-b56f-3adc278da5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:53.463764 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc71d5-d26a-4a7b-b56f-3adc278da5a7 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:53.464049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc71d5-d26a-4a7b-b56f-3adc278da5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:53.464327 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc71d5-d26a-4a7b-b56f-3adc278da5a7 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:53.474364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc71d5-d26a-4a7b-b56f-3adc278da5a7 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:53.477132 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc71d5-d26a-4a7b-b56f-3adc278da5a7 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:53.479760 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 52/104] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:23:53 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:53.487553 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc71d5-d26a-4a7b-b56f-3adc278da5a7 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:53.579853 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 53/105] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:53.580990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9660-cf95-4f4e-9aed-8f133d0923f8 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:53.581316 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9660-cf95-4f4e-9aed-8f133d0923f8 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:53.581671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9660-cf95-4f4e-9aed-8f133d0923f8 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:53.583237 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 54/106] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:53.592227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50dc7-ad0b-429a-8392-695d50551eda None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:53.592530 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50dc7-ad0b-429a-8392-695d50551eda None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:53.592808 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50dc7-ad0b-429a-8392-695d50551eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:53.623753 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-c0d50dc7-ad0b-429a-8392-695d50551eda None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:53.624982 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-c0d50dc7-ad0b-429a-8392-695d50551eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:53.660603 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc71d5-d26a-4a7b-b56f-3adc278da5a7 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:53.664143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:53.680245 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:53.732612 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 55/107] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:53.733509 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d50dc7-ad0b-429a-8392-695d50551eda None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:53.740316 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f471c1-8bbf-43bf-b562-38bbc8770cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:53.741800 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f471c1-8bbf-43bf-b562-38bbc8770cb7 None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:53.742093 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f471c1-8bbf-43bf-b562-38bbc8770cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:53.742375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f471c1-8bbf-43bf-b562-38bbc8770cb7 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/users/d05cd1394b114e79a86eca456272c6fb/roles/a661e4208e2047e69b45e282caa0683b` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:53.746201 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f471c1-8bbf-43bf-b562-38bbc8770cb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f2d70d8029a4523aa34a26c5d7548b4, user_id=d05cd1394b114e79a86eca456272c6fb, role_id=a661e4208e2047e69b45e282caa0683b)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:53.748657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f471c1-8bbf-43bf-b562-38bbc8770cb7 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:53.840373 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 53/108] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:23:53 2022] PUT /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/users/d05cd1394b114e79a86eca456272c6fb/roles/a661e4208e2047e69b45e282caa0683b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:23:53.841637 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7b659-b1e7-452a-b74f-3b93980ab887 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:53.841990 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7b659-b1e7-452a-b74f-3b93980ab887 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:53.842283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7b659-b1e7-452a-b74f-3b93980ab887 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:53.843902 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 54/109] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:53.844770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7b659-b1e7-452a-b74f-3b93980ab887 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:53.894889 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d50dc7-ad0b-429a-8392-695d50551eda None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:53.954184 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cb159-02b2-40e1-8614-d49872155a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:53.957057 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb159-02b2-40e1-8614-d49872155a0d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:53.957397 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb159-02b2-40e1-8614-d49872155a0d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:53.957681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb159-02b2-40e1-8614-d49872155a0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:53.961148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cb159-02b2-40e1-8614-d49872155a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:53.962949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cb159-02b2-40e1-8614-d49872155a0d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:53.966532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 56/110] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:23:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:53.976913 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcf7d5-ebb0-41d8-b3d3-fad7f64dcb7d None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:53.977269 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcf7d5-ebb0-41d8-b3d3-fad7f64dcb7d None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:53.978820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcf7d5-ebb0-41d8-b3d3-fad7f64dcb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.007897 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7b659-b1e7-452a-b74f-3b93980ab887 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:54.011581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-8edcf7d5-ebb0-41d8-b3d3-fad7f64dcb7d None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:54.012824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-8edcf7d5-ebb0-41d8-b3d3-fad7f64dcb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:54.054438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d33dbb-466d-4088-a64a-af915d68d3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:54.055806 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d33dbb-466d-4088-a64a-af915d68d3a8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.056405 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d33dbb-466d-4088-a64a-af915d68d3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.056920 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d33dbb-466d-4088-a64a-af915d68d3a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.066905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:54.071966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d33dbb-466d-4088-a64a-af915d68d3a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-d1d33dbb-466d-4088-a64a-af915d68d3a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:54.080353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:54.081421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:54.082314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:23:54.085586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 55/111] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:23:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:23:54.086675 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d33dbb-466d-4088-a64a-af915d68d3a8 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:54.107997 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 57/112] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:54.109538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a51cb-8748-4194-b182-d0c95f922b26 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.109898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a51cb-8748-4194-b182-d0c95f922b26 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.110187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a51cb-8748-4194-b182-d0c95f922b26 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.111698 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 58/113] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:54.112297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a51cb-8748-4194-b182-d0c95f922b26 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:54.122092 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:54.208650 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d33dbb-466d-4088-a64a-af915d68d3a8 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:54.258737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5822b-6fa8-49c1-9e8c-8ab86d0a7e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:54.259822 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5822b-6fa8-49c1-9e8c-8ab86d0a7e03 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.260310 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5822b-6fa8-49c1-9e8c-8ab86d0a7e03 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.260825 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5822b-6fa8-49c1-9e8c-8ab86d0a7e03 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.261837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5822b-6fa8-49c1-9e8c-8ab86d0a7e03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:54.263830 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5822b-6fa8-49c1-9e8c-8ab86d0a7e03 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:54.267491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a51cb-8748-4194-b182-d0c95f922b26 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:54.306123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c58aa-7060-4f55-b5f5-1ef4fcfe846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:54.306824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c58aa-7060-4f55-b5f5-1ef4fcfe846b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.307110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c58aa-7060-4f55-b5f5-1ef4fcfe846b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.307384 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c58aa-7060-4f55-b5f5-1ef4fcfe846b None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.308142 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c58aa-7060-4f55-b5f5-1ef4fcfe846b None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:54.308447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c58aa-7060-4f55-b5f5-1ef4fcfe846b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:54.310115 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c58aa-7060-4f55-b5f5-1ef4fcfe846b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:54.319916 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 59/114] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:54.321057 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de40bb-86d3-4396-aec8-02218cb776be None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.321343 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de40bb-86d3-4396-aec8-02218cb776be None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.321618 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de40bb-86d3-4396-aec8-02218cb776be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.339239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-01de40bb-86d3-4396-aec8-02218cb776be None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:54.340540 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-01de40bb-86d3-4396-aec8-02218cb776be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:54.351455 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 56/115] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:23:54 2022] POST /identity/v3/projects => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:23:54.353108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5822b-6fa8-49c1-9e8c-8ab86d0a7e03 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:54.390251 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:54.460709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:54.488533 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5822b-6fa8-49c1-9e8c-8ab86d0a7e03 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:54.488810 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 60/116] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:54.490167 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de40bb-86d3-4396-aec8-02218cb776be None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:54.554638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671be089-2257-4183-9f60-0996e4956a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:54.554638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671be089-2257-4183-9f60-0996e4956a66 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.554638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671be089-2257-4183-9f60-0996e4956a66 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.554638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671be089-2257-4183-9f60-0996e4956a66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.571287 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671be089-2257-4183-9f60-0996e4956a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-671be089-2257-4183-9f60-0996e4956a66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:54.579715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:54.581008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:23:54.582085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:23:54.586632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 57/117] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:23:54.586632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671be089-2257-4183-9f60-0996e4956a66 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:54.699287 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671be089-2257-4183-9f60-0996e4956a66 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:54.704845 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de40bb-86d3-4396-aec8-02218cb776be None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:54.737983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18665bb-35c8-4693-a8cf-42e3694100a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:54.738988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18665bb-35c8-4693-a8cf-42e3694100a9 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.739351 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18665bb-35c8-4693-a8cf-42e3694100a9 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.739706 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18665bb-35c8-4693-a8cf-42e3694100a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.743363 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:54.750132 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c18c-bb80-43d1-a38c-885608acf4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:54.751068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c18c-bb80-43d1-a38c-885608acf4c8 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.751352 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c18c-bb80-43d1-a38c-885608acf4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.751625 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c18c-bb80-43d1-a38c-885608acf4c8 None admin] PATH_INFO: `/v3/users/f0b88d2c828540b1a63ceadb9cee8a00` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.753745 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24c18c-bb80-43d1-a38c-885608acf4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=f0b88d2c828540b1a63ceadb9cee8a00)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:54.755218 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18665bb-35c8-4693-a8cf-42e3694100a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:54.763340 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24c18c-bb80-43d1-a38c-885608acf4c8 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:54.763340 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 61/118] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:54 2022] GET /identity/v3/users/f0b88d2c828540b1a63ceadb9cee8a00 => generated 247 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:54.763340 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c18c-bb80-43d1-a38c-885608acf4c8 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-f18665bb-35c8-4693-a8cf-42e3694100a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:54.765000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:54.766148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:23:54.767286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:23:54.769373 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 58/119] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:23:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:23:54.770845 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be750bae-ff0f-46f7-8c42-47dd57c15ac3 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.771346 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be750bae-ff0f-46f7-8c42-47dd57c15ac3 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.771667 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be750bae-ff0f-46f7-8c42-47dd57c15ac3 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.773131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 59/120] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:54.773681 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be750bae-ff0f-46f7-8c42-47dd57c15ac3 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:54.807406 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:54.885893 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c18c-bb80-43d1-a38c-885608acf4c8 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:54.929280 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be750bae-ff0f-46f7-8c42-47dd57c15ac3 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:54.931982 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bffd8-1a32-47b7-b98d-9f65056953ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:54.932663 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bffd8-1a32-47b7-b98d-9f65056953ea None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.932946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bffd8-1a32-47b7-b98d-9f65056953ea None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.933220 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bffd8-1a32-47b7-b98d-9f65056953ea None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.934093 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bffd8-1a32-47b7-b98d-9f65056953ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:54.934405 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bffd8-1a32-47b7-b98d-9f65056953ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:54.935833 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bffd8-1a32-47b7-b98d-9f65056953ea None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:54.956267 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 62/121] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:23:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:54.956267 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bffd8-1a32-47b7-b98d-9f65056953ea None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:54.986027 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637fd55-ab5d-4678-9363-566e0f391c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:54.987950 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637fd55-ab5d-4678-9363-566e0f391c1c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.988479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637fd55-ab5d-4678-9363-566e0f391c1c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.989232 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637fd55-ab5d-4678-9363-566e0f391c1c None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.991890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637fd55-ab5d-4678-9363-566e0f391c1c None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:54.993875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637fd55-ab5d-4678-9363-566e0f391c1c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:54.996795 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 60/122] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:23:54 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:54.997849 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54195240-6217-4261-bd6b-a74f03dd75b5 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.998138 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54195240-6217-4261-bd6b-a74f03dd75b5 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.998417 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54195240-6217-4261-bd6b-a74f03dd75b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:55.020068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-54195240-6217-4261-bd6b-a74f03dd75b5 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:55.021294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-54195240-6217-4261-bd6b-a74f03dd75b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:55.075106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:55.084164 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:55.085700 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bffd8-1a32-47b7-b98d-9f65056953ea None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:55.093322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 61/123] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:55.094460 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54195240-6217-4261-bd6b-a74f03dd75b5 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:55.134483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8976-c504-4968-b36e-3c22da15654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:55.135245 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8976-c504-4968-b36e-3c22da15654b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:55.135538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8976-c504-4968-b36e-3c22da15654b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:55.135823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8976-c504-4968-b36e-3c22da15654b None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:55.136602 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f8976-c504-4968-b36e-3c22da15654b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:55.136925 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f8976-c504-4968-b36e-3c22da15654b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:55.138917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f8976-c504-4968-b36e-3c22da15654b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:55.155081 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 63/124] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:23:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:55.155081 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8976-c504-4968-b36e-3c22da15654b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:55.219301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54195240-6217-4261-bd6b-a74f03dd75b5 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:55.258634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8c78d-f06c-4bec-9c75-fcd0c989e41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:55.259518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8c78d-f06c-4bec-9c75-fcd0c989e41e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:55.259805 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8c78d-f06c-4bec-9c75-fcd0c989e41e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:55.260086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8c78d-f06c-4bec-9c75-fcd0c989e41e None admin] PATH_INFO: `/v3/users/85fb59cdcd694736a6796ec1005a9592` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:55.274227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8976-c504-4968-b36e-3c22da15654b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:55.277956 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8c78d-f06c-4bec-9c75-fcd0c989e41e None admin] RBAC: Authorizing `identity:get_user(user_id=85fb59cdcd694736a6796ec1005a9592)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:55.279469 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8c78d-f06c-4bec-9c75-fcd0c989e41e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:55.285758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 62/125] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:55 2022] GET /identity/v3/users/85fb59cdcd694736a6796ec1005a9592 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:55.286784 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8c78d-f06c-4bec-9c75-fcd0c989e41e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:55.313162 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e5c36-cf0a-453e-b0e4-4a8925839f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:55.314515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5c36-cf0a-453e-b0e4-4a8925839f1f None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:55.315086 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5c36-cf0a-453e-b0e4-4a8925839f1f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:55.315618 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5c36-cf0a-453e-b0e4-4a8925839f1f None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/users/f0b88d2c828540b1a63ceadb9cee8a00/roles/59689ee7c4f5409692318371dac5cbc7` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:55.317923 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e5c36-cf0a-453e-b0e4-4a8925839f1f None admin] RBAC: Authorizing `identity:create_grant(project_id=9f2d70d8029a4523aa34a26c5d7548b4, user_id=f0b88d2c828540b1a63ceadb9cee8a00, role_id=59689ee7c4f5409692318371dac5cbc7)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:55.319818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e5c36-cf0a-453e-b0e4-4a8925839f1f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:55.346993 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:55.395558 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8c78d-f06c-4bec-9c75-fcd0c989e41e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:55.427429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 64/126] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:23:55 2022] PUT /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/users/f0b88d2c828540b1a63ceadb9cee8a00/roles/59689ee7c4f5409692318371dac5cbc7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:23:55.434430 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e5c36-cf0a-453e-b0e4-4a8925839f1f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:55.449767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a137e8a-7ec8-4778-b622-dd99311b7241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:55.450621 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a137e8a-7ec8-4778-b622-dd99311b7241 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:55.450918 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a137e8a-7ec8-4778-b622-dd99311b7241 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:55.451200 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a137e8a-7ec8-4778-b622-dd99311b7241 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:55.470209 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:55.480474 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a137e8a-7ec8-4778-b622-dd99311b7241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-3a137e8a-7ec8-4778-b622-dd99311b7241 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:55.494290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:55.495438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:23:55.496367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:23:55.497049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 63/127] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:23:55.497983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a137e8a-7ec8-4778-b622-dd99311b7241 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:55.663999 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e5c36-cf0a-453e-b0e4-4a8925839f1f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:55.699546 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a137e8a-7ec8-4778-b622-dd99311b7241 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:55.705860 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2e9a3-a566-484e-9736-7c8db5539926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:55.706782 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e9a3-a566-484e-9736-7c8db5539926 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:55.707075 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e9a3-a566-484e-9736-7c8db5539926 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:55.707356 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e9a3-a566-484e-9736-7c8db5539926 None admin] PATH_INFO: `/v3/users/d05cd1394b114e79a86eca456272c6fb` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:55.708600 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2e9a3-a566-484e-9736-7c8db5539926 None admin] RBAC: Authorizing `identity:get_user(user_id=d05cd1394b114e79a86eca456272c6fb)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:55.710674 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2e9a3-a566-484e-9736-7c8db5539926 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:55.712697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 65/128] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:55 2022] GET /identity/v3/users/d05cd1394b114e79a86eca456272c6fb => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:55.713767 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2e9a3-a566-484e-9736-7c8db5539926 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:55.722046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:55.747182 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88e8bd-8e5c-48d5-8e1a-2376a0fd1736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:55.748322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88e8bd-8e5c-48d5-8e1a-2376a0fd1736 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:55.748846 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88e8bd-8e5c-48d5-8e1a-2376a0fd1736 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:55.749350 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88e8bd-8e5c-48d5-8e1a-2376a0fd1736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:55.814781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:55.832181 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88e8bd-8e5c-48d5-8e1a-2376a0fd1736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:55.834109 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88e8bd-8e5c-48d5-8e1a-2376a0fd1736 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:55.840442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2e9a3-a566-484e-9736-7c8db5539926 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:55.895568 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965defa5-950e-49fd-94f5-5cd638fa3128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:55.896257 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965defa5-950e-49fd-94f5-5cd638fa3128 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:55.896548 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965defa5-950e-49fd-94f5-5cd638fa3128 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:55.896883 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965defa5-950e-49fd-94f5-5cd638fa3128 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:55.898173 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965defa5-950e-49fd-94f5-5cd638fa3128 None admin] RBAC: Adding query filter params (name=member) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:55.898481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965defa5-950e-49fd-94f5-5cd638fa3128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:55.908107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965defa5-950e-49fd-94f5-5cd638fa3128 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:55.924717 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 66/129] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:23:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:55.925745 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965defa5-950e-49fd-94f5-5cd638fa3128 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:55.954061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 64/130] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:23:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:23:55.955420 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88e8bd-8e5c-48d5-8e1a-2376a0fd1736 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:55.971485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:56.066877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88e8bd-8e5c-48d5-8e1a-2376a0fd1736 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:56.104939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70106f4-688b-4bc4-821f-068b7a70b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:56.106257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70106f4-688b-4bc4-821f-068b7a70b915 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:56.106798 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70106f4-688b-4bc4-821f-068b7a70b915 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:56.107307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70106f4-688b-4bc4-821f-068b7a70b915 None admin] PATH_INFO: `/v3/users/d05cd1394b114e79a86eca456272c6fb` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:56.108767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70106f4-688b-4bc4-821f-068b7a70b915 None admin] RBAC: Authorizing `identity:get_user(user_id=d05cd1394b114e79a86eca456272c6fb)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:56.110479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70106f4-688b-4bc4-821f-068b7a70b915 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:56.112606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 65/131] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:55 2022] GET /identity/v3/users/d05cd1394b114e79a86eca456272c6fb => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:56.113726 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70106f4-688b-4bc4-821f-068b7a70b915 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:56.194562 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965defa5-950e-49fd-94f5-5cd638fa3128 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:56.205445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:56.228691 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70106f4-688b-4bc4-821f-068b7a70b915 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:56.270938 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf36243-cd25-414b-8d6c-c15d1ae619a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:56.272788 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf36243-cd25-414b-8d6c-c15d1ae619a0 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:56.273381 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf36243-cd25-414b-8d6c-c15d1ae619a0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:56.273873 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf36243-cd25-414b-8d6c-c15d1ae619a0 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:56.275340 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf36243-cd25-414b-8d6c-c15d1ae619a0 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:56.277038 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf36243-cd25-414b-8d6c-c15d1ae619a0 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:56.279347 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 66/132] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:23:56 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:56.280519 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf36243-cd25-414b-8d6c-c15d1ae619a0 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:56.284375 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af9704-ed8a-461d-8932-6b49ede10522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:56.285586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af9704-ed8a-461d-8932-6b49ede10522 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:56.285586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af9704-ed8a-461d-8932-6b49ede10522 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:56.285892 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af9704-ed8a-461d-8932-6b49ede10522 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:56.291535 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af9704-ed8a-461d-8932-6b49ede10522 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:56.292875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af9704-ed8a-461d-8932-6b49ede10522 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:56.294823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 67/133] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:23:55 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:56.295469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af9704-ed8a-461d-8932-6b49ede10522 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:56.323220 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:56.395237 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf36243-cd25-414b-8d6c-c15d1ae619a0 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:56.446238 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ace14-b289-4585-9784-09955b8e2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:56.447547 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ace14-b289-4585-9784-09955b8e2a76 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:56.448210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ace14-b289-4585-9784-09955b8e2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:56.449403 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ace14-b289-4585-9784-09955b8e2a76 None admin] PATH_INFO: `/v3/projects/b7bbb1c4a418473b8051c4bf9d4426e9` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:56.452550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ace14-b289-4585-9784-09955b8e2a76 None admin] RBAC: Authorizing `identity:get_project(project_id=b7bbb1c4a418473b8051c4bf9d4426e9)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:56.454520 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ace14-b289-4585-9784-09955b8e2a76 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:56.456610 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 67/134] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:23:56 2022] GET /identity/v3/projects/b7bbb1c4a418473b8051c4bf9d4426e9 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:56.457583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ace14-b289-4585-9784-09955b8e2a76 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:56.478167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:56.517328 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af9704-ed8a-461d-8932-6b49ede10522 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:56.553458 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c6b15-fe75-44cf-9f81-acb8e89779e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:56.554419 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c6b15-fe75-44cf-9f81-acb8e89779e6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:56.554419 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c6b15-fe75-44cf-9f81-acb8e89779e6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:56.554766 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c6b15-fe75-44cf-9f81-acb8e89779e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:56.555576 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c6b15-fe75-44cf-9f81-acb8e89779e6 None admin] RBAC: Adding query filter params (role.id=8dff9e5a6c6340acb442a929d6affd4d, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4, user.id=85fb59cdcd694736a6796ec1005a9592) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:56.555925 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c6b15-fe75-44cf-9f81-acb8e89779e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:56.557390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c6b15-fe75-44cf-9f81-acb8e89779e6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:56.563404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 68/135] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:23:56 2022] GET /identity/v3/role_assignments?user.id=85fb59cdcd694736a6796ec1005a9592&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=8dff9e5a6c6340acb442a929d6affd4d => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:56.564277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c6b15-fe75-44cf-9f81-acb8e89779e6 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:56.578118 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ace14-b289-4585-9784-09955b8e2a76 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:56.621137 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fcbef-32bd-485c-8c88-d77c0f092117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:56.622069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fcbef-32bd-485c-8c88-d77c0f092117 None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:56.622358 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fcbef-32bd-485c-8c88-d77c0f092117 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:56.622682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fcbef-32bd-485c-8c88-d77c0f092117 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/users/d05cd1394b114e79a86eca456272c6fb/roles/920e2cadf3044abda66c715e1c89f4e3` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:56.625280 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fcbef-32bd-485c-8c88-d77c0f092117 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f2d70d8029a4523aa34a26c5d7548b4, user_id=d05cd1394b114e79a86eca456272c6fb, role_id=920e2cadf3044abda66c715e1c89f4e3)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:56.626844 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fcbef-32bd-485c-8c88-d77c0f092117 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:56.672440 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:56.698591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c6b15-fe75-44cf-9f81-acb8e89779e6 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:56.721504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 68/136] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:23:56 2022] PUT /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/users/d05cd1394b114e79a86eca456272c6fb/roles/920e2cadf3044abda66c715e1c89f4e3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:23:56.723231 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16d4a-585c-4870-8d9c-e2737a4314bf None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:56.723694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16d4a-585c-4870-8d9c-e2737a4314bf None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:56.724213 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16d4a-585c-4870-8d9c-e2737a4314bf None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:56.727013 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 69/137] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:56.732917 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c7e64-725e-4ff8-a387-6473f20e0878 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:56.733450 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c7e64-725e-4ff8-a387-6473f20e0878 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:56.733891 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c7e64-725e-4ff8-a387-6473f20e0878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:56.738049 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbfafb-8afc-4142-87cb-4294298e035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:56.739177 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbfafb-8afc-4142-87cb-4294298e035c None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:56.739620 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbfafb-8afc-4142-87cb-4294298e035c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:56.739984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbfafb-8afc-4142-87cb-4294298e035c None admin] PATH_INFO: `/v3/projects/b7bbb1c4a418473b8051c4bf9d4426e9/users/d05cd1394b114e79a86eca456272c6fb/roles/a661e4208e2047e69b45e282caa0683b` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:56.742878 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbfafb-8afc-4142-87cb-4294298e035c None admin] RBAC: Authorizing `identity:create_grant(project_id=b7bbb1c4a418473b8051c4bf9d4426e9, user_id=d05cd1394b114e79a86eca456272c6fb, role_id=a661e4208e2047e69b45e282caa0683b)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:56.745741 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbfafb-8afc-4142-87cb-4294298e035c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:56.775592 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-7b2c7e64-725e-4ff8-a387-6473f20e0878 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:56.777149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-7b2c7e64-725e-4ff8-a387-6473f20e0878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:56.849007 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 69/138] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:23:56 2022] PUT /identity/v3/projects/b7bbb1c4a418473b8051c4bf9d4426e9/users/d05cd1394b114e79a86eca456272c6fb/roles/a661e4208e2047e69b45e282caa0683b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:23:56.877980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 70/139] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:23:56.926237 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbfafb-8afc-4142-87cb-4294298e035c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:57.079053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbfafb-8afc-4142-87cb-4294298e035c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:57.119799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee04e0-8a75-4b35-9129-57d668f7ff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:57.120620 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee04e0-8a75-4b35-9129-57d668f7ff30 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:57.120910 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee04e0-8a75-4b35-9129-57d668f7ff30 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:57.121190 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee04e0-8a75-4b35-9129-57d668f7ff30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:57.133153 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:57.138122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee04e0-8a75-4b35-9129-57d668f7ff30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-33ee04e0-8a75-4b35-9129-57d668f7ff30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:57.145946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:57.147642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:23:57.148527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:23:57.150833 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 70/140] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:23:57.156712 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c7e64-725e-4ff8-a387-6473f20e0878 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:57.167010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:57.277369 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c7e64-725e-4ff8-a387-6473f20e0878 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:57.316049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd04a1b-be48-4eae-a6e5-3457ff6b0591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:57.316754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd04a1b-be48-4eae-a6e5-3457ff6b0591 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:57.317043 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd04a1b-be48-4eae-a6e5-3457ff6b0591 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:57.317323 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd04a1b-be48-4eae-a6e5-3457ff6b0591 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:57.318092 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd04a1b-be48-4eae-a6e5-3457ff6b0591 None admin] RBAC: Adding query filter params (name=member) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:57.318409 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd04a1b-be48-4eae-a6e5-3457ff6b0591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:57.320398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd04a1b-be48-4eae-a6e5-3457ff6b0591 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:57.329573 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 71/141] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:23:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:57.335746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee04e0-8a75-4b35-9129-57d668f7ff30 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:57.374674 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048033-1d92-4ce3-a8d8-61e5a9782014 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:57.374870 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048033-1d92-4ce3-a8d8-61e5a9782014 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:57.375163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048033-1d92-4ce3-a8d8-61e5a9782014 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:57.376714 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 72/142] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:23:57.383451 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a887-d483-422d-9aec-67fc700e2447 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:57.383735 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a887-d483-422d-9aec-67fc700e2447 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:57.384033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a887-d483-422d-9aec-67fc700e2447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:57.409569 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-4a50a887-d483-422d-9aec-67fc700e2447 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:57.411286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-4a50a887-d483-422d-9aec-67fc700e2447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:57.483588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee04e0-8a75-4b35-9129-57d668f7ff30 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:57.526963 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:57.539338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 73/143] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:57.545169 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d8ab-bdf0-4d97-a5c4-23046d58966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:57.545169 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d8ab-bdf0-4d97-a5c4-23046d58966d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:57.545169 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d8ab-bdf0-4d97-a5c4-23046d58966d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:57.545169 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d8ab-bdf0-4d97-a5c4-23046d58966d None admin] PATH_INFO: `/v3/users/d05cd1394b114e79a86eca456272c6fb` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:57.547438 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2d8ab-bdf0-4d97-a5c4-23046d58966d None admin] RBAC: Authorizing `identity:get_user(user_id=d05cd1394b114e79a86eca456272c6fb)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:57.548940 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2d8ab-bdf0-4d97-a5c4-23046d58966d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:57.550911 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 71/144] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:57 2022] GET /identity/v3/users/d05cd1394b114e79a86eca456272c6fb => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:57.556760 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50a887-d483-422d-9aec-67fc700e2447 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:57.589227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d8ab-bdf0-4d97-a5c4-23046d58966d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:57.729132 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:57.765504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50a887-d483-422d-9aec-67fc700e2447 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:57.819983 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d8ab-bdf0-4d97-a5c4-23046d58966d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:57.845539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f36a36-caf4-46a1-9fa8-e376a2072f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:57.846212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f36a36-caf4-46a1-9fa8-e376a2072f88 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:57.846501 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f36a36-caf4-46a1-9fa8-e376a2072f88 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:57.851825 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f36a36-caf4-46a1-9fa8-e376a2072f88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:57.919137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac382c-19e8-4826-99ce-88069a0e8ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:57.919966 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac382c-19e8-4826-99ce-88069a0e8ae6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:57.920261 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac382c-19e8-4826-99ce-88069a0e8ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:57.920543 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac382c-19e8-4826-99ce-88069a0e8ae6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:57.922459 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac382c-19e8-4826-99ce-88069a0e8ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:57.923969 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac382c-19e8-4826-99ce-88069a0e8ae6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:57.926937 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 72/145] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:23:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:23:57.936429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac382c-19e8-4826-99ce-88069a0e8ae6 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:58.023056 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:58.031779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f36a36-caf4-46a1-9fa8-e376a2072f88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:58.038082 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f36a36-caf4-46a1-9fa8-e376a2072f88 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:58.200918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac382c-19e8-4826-99ce-88069a0e8ae6 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:58.271537 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 74/146] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:23:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:23:58.278162 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f36a36-caf4-46a1-9fa8-e376a2072f88 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:58.312952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0e5e6-38ca-4654-9a01-0c6cbaeb7504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:58.313638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e5e6-38ca-4654-9a01-0c6cbaeb7504 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:58.313920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e5e6-38ca-4654-9a01-0c6cbaeb7504 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:58.314191 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e5e6-38ca-4654-9a01-0c6cbaeb7504 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:58.314947 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0e5e6-38ca-4654-9a01-0c6cbaeb7504 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:58.316411 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0e5e6-38ca-4654-9a01-0c6cbaeb7504 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:58.344565 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:58.413232 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:58.417618 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f36a36-caf4-46a1-9fa8-e376a2072f88 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:58.471035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be93a1-c830-4dfb-9056-5b348d940191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:58.474359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be93a1-c830-4dfb-9056-5b348d940191 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:58.478944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 73/147] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:23:57 2022] POST /identity/v3/users => generated 283 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:23:58.481719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be93a1-c830-4dfb-9056-5b348d940191 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:58.481719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be93a1-c830-4dfb-9056-5b348d940191 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:58.487288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be93a1-c830-4dfb-9056-5b348d940191 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:58.488913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be93a1-c830-4dfb-9056-5b348d940191 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:58.491555 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 75/148] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:23:58 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:23:58.497877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0e5e6-38ca-4654-9a01-0c6cbaeb7504 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:58.648217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0e5e6-38ca-4654-9a01-0c6cbaeb7504 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:58.691162 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8e58d-5d9d-42e4-beea-b76cca7b337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:58.691894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8e58d-5d9d-42e4-beea-b76cca7b337b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:58.692181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8e58d-5d9d-42e4-beea-b76cca7b337b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:58.692461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8e58d-5d9d-42e4-beea-b76cca7b337b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:58.693321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8e58d-5d9d-42e4-beea-b76cca7b337b None admin] RBAC: Adding query filter params (role.id=a661e4208e2047e69b45e282caa0683b, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4, user.id=d05cd1394b114e79a86eca456272c6fb) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:58.693755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8e58d-5d9d-42e4-beea-b76cca7b337b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:58.695285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8e58d-5d9d-42e4-beea-b76cca7b337b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:58.704659 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 74/149] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:23:58 2022] GET /identity/v3/role_assignments?user.id=d05cd1394b114e79a86eca456272c6fb&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=a661e4208e2047e69b45e282caa0683b => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:58.802740 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357479-d754-4b9b-94ba-8cbdec01c2fc None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:58.804185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357479-d754-4b9b-94ba-8cbdec01c2fc None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:58.804695 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357479-d754-4b9b-94ba-8cbdec01c2fc None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:58.806388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 76/150] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:58.812508 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142dd3c-24a9-4c23-836a-ac8f6a5fb456 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:58.813009 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142dd3c-24a9-4c23-836a-ac8f6a5fb456 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:58.813091 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142dd3c-24a9-4c23-836a-ac8f6a5fb456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:58.840492 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-b142dd3c-24a9-4c23-836a-ac8f6a5fb456 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:58.841762 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-b142dd3c-24a9-4c23-836a-ac8f6a5fb456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:58.933866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:58.961754 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 75/151] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:58.987743 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c357479-d754-4b9b-94ba-8cbdec01c2fc None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:59.118234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c357479-d754-4b9b-94ba-8cbdec01c2fc None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:59.159550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bada031-eb3f-4af0-a925-5bd572dc35bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:59.160371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bada031-eb3f-4af0-a925-5bd572dc35bc None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:59.160700 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bada031-eb3f-4af0-a925-5bd572dc35bc None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:59.160949 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bada031-eb3f-4af0-a925-5bd572dc35bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:59.172586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bada031-eb3f-4af0-a925-5bd572dc35bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-5bada031-eb3f-4af0-a925-5bd572dc35bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:23:59.181473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:23:59.182495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:23:59.183436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 77/152] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:23:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:23:59.195921 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142dd3c-24a9-4c23-836a-ac8f6a5fb456 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:59.323442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142dd3c-24a9-4c23-836a-ac8f6a5fb456 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:59.367658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988d907-b251-4f1c-9999-ed0fb5311d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:59.368764 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988d907-b251-4f1c-9999-ed0fb5311d50 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:59.369274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988d907-b251-4f1c-9999-ed0fb5311d50 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:59.369764 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988d907-b251-4f1c-9999-ed0fb5311d50 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:59.370840 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988d907-b251-4f1c-9999-ed0fb5311d50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:23:59.371380 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988d907-b251-4f1c-9999-ed0fb5311d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:59.373013 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988d907-b251-4f1c-9999-ed0fb5311d50 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:59.383317 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 76/153] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:23:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:59.389258 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bada031-eb3f-4af0-a925-5bd572dc35bc None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:59.432321 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:59.521931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bada031-eb3f-4af0-a925-5bd572dc35bc None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:59.567567 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f8c09-30cd-4d4f-bf55-7f5f168726c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:59.568474 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8c09-30cd-4d4f-bf55-7f5f168726c7 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:59.568794 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8c09-30cd-4d4f-bf55-7f5f168726c7 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:59.569075 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8c09-30cd-4d4f-bf55-7f5f168726c7 None admin] PATH_INFO: `/v3/users/f0b88d2c828540b1a63ceadb9cee8a00` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:59.570309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f8c09-30cd-4d4f-bf55-7f5f168726c7 None admin] RBAC: Authorizing `identity:get_user(user_id=f0b88d2c828540b1a63ceadb9cee8a00)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:59.571810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f8c09-30cd-4d4f-bf55-7f5f168726c7 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:59.573882 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 78/154] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:23:59 2022] GET /identity/v3/users/f0b88d2c828540b1a63ceadb9cee8a00 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:23:59.579602 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988d907-b251-4f1c-9999-ed0fb5311d50 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:59.637726 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:59.704677 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988d907-b251-4f1c-9999-ed0fb5311d50 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:23:59.745819 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4b8fb-a9bd-4cbb-a478-76674b5909ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:23:59.746486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4b8fb-a9bd-4cbb-a478-76674b5909ff None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:59.746904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4b8fb-a9bd-4cbb-a478-76674b5909ff None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:59.747217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4b8fb-a9bd-4cbb-a478-76674b5909ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:59.784583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee5f67-4f61-4322-93c5-fe1c3c1f15d8 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:59.784777 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee5f67-4f61-4322-93c5-fe1c3c1f15d8 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:59.785088 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee5f67-4f61-4322-93c5-fe1c3c1f15d8 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:59.786915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 79/155] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:23:59.802534 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd8e8-d631-4fa2-bef7-418592305f2d None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:59.803144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd8e8-d631-4fa2-bef7-418592305f2d None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:59.804008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd8e8-d631-4fa2-bef7-418592305f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:59.822749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-ee1dd8e8-d631-4fa2-bef7-418592305f2d None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:59.824328 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-ee1dd8e8-d631-4fa2-bef7-418592305f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:23:59.844167 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4b8fb-a9bd-4cbb-a478-76674b5909ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:23:59.845790 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4b8fb-a9bd-4cbb-a478-76674b5909ff None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:23:59.906063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:23:59.916975 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 80/156] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:23:59.935535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031abe0-4bc1-4f5c-91b0-c63516bafb5c None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:59.936709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031abe0-4bc1-4f5c-91b0-c63516bafb5c None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:59.936709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031abe0-4bc1-4f5c-91b0-c63516bafb5c None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:59.940614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 81/157] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:23:59.960147 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31839-19ba-4238-8668-e7d552df1a0c None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:59.960850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31839-19ba-4238-8668-e7d552df1a0c None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:59.961435 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31839-19ba-4238-8668-e7d552df1a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:59.979156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 77/158] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:23:59.982225 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4b8fb-a9bd-4cbb-a478-76674b5909ff None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:23:59.991579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-83a31839-19ba-4238-8668-e7d552df1a0c None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:23:59.993253 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-83a31839-19ba-4238-8668-e7d552df1a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:00.014904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:00.092765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 82/159] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:00.093572 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a31839-19ba-4238-8668-e7d552df1a0c None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:00.100579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4b8fb-a9bd-4cbb-a478-76674b5909ff None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:00.162831 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3371de-281e-4ac6-a7cf-b07df864a277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:00.164069 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3371de-281e-4ac6-a7cf-b07df864a277 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:00.164578 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3371de-281e-4ac6-a7cf-b07df864a277 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:00.165085 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3371de-281e-4ac6-a7cf-b07df864a277 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:00.199300 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3371de-281e-4ac6-a7cf-b07df864a277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-9f3371de-281e-4ac6-a7cf-b07df864a277 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:00.208355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:00.209468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:00.210379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:00.212961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 78/160] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:23:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:00.219740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3371de-281e-4ac6-a7cf-b07df864a277 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:00.236139 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:00.269111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a31839-19ba-4238-8668-e7d552df1a0c None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:00.339705 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80996be6-d01d-4f9a-b3bc-a159fda3d1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:00.340673 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80996be6-d01d-4f9a-b3bc-a159fda3d1ba None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:00.340956 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80996be6-d01d-4f9a-b3bc-a159fda3d1ba None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:00.341236 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80996be6-d01d-4f9a-b3bc-a159fda3d1ba None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:00.342551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80996be6-d01d-4f9a-b3bc-a159fda3d1ba None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:00.344100 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80996be6-d01d-4f9a-b3bc-a159fda3d1ba None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:00.345819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 83/161] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:00 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:00.346637 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80996be6-d01d-4f9a-b3bc-a159fda3d1ba None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:00.394797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:00.455832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3371de-281e-4ac6-a7cf-b07df864a277 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:00.524682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d7fba-c45e-464f-90e5-1d3000fa6aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:00.525611 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7fba-c45e-464f-90e5-1d3000fa6aff None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:00.525908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7fba-c45e-464f-90e5-1d3000fa6aff None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:00.526187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7fba-c45e-464f-90e5-1d3000fa6aff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:00.543591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d7fba-c45e-464f-90e5-1d3000fa6aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:00.546797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80996be6-d01d-4f9a-b3bc-a159fda3d1ba None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-922d7fba-c45e-464f-90e5-1d3000fa6aff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:00.551899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:00.553746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:00.556437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:00.558813 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 79/162] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:00.559901 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d7fba-c45e-464f-90e5-1d3000fa6aff None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:00.618821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f9709-2961-46a1-8b35-d24384c9e1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:00.619845 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f9709-2961-46a1-8b35-d24384c9e1c1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:00.620422 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f9709-2961-46a1-8b35-d24384c9e1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:00.621509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f9709-2961-46a1-8b35-d24384c9e1c1 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:00.622727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f9709-2961-46a1-8b35-d24384c9e1c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:00.624404 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f9709-2961-46a1-8b35-d24384c9e1c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:00.632943 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f9709-2961-46a1-8b35-d24384c9e1c1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:00.642190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 84/163] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:00.643777 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ec537-0fb5-4f7e-a388-0333e4f142e6 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:00.644131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ec537-0fb5-4f7e-a388-0333e4f142e6 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:00.644477 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ec537-0fb5-4f7e-a388-0333e4f142e6 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:00.645865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 85/164] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:00.646739 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ec537-0fb5-4f7e-a388-0333e4f142e6 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:00.669240 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:00.715368 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d7fba-c45e-464f-90e5-1d3000fa6aff None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:00.758025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a08e5-6443-409e-93d8-e466f09f5c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:00.759099 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a08e5-6443-409e-93d8-e466f09f5c03 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:00.759444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a08e5-6443-409e-93d8-e466f09f5c03 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:00.759943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a08e5-6443-409e-93d8-e466f09f5c03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:00.760885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a08e5-6443-409e-93d8-e466f09f5c03 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4, user.id=f0b88d2c828540b1a63ceadb9cee8a00) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:00.761294 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a08e5-6443-409e-93d8-e466f09f5c03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:00.762904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a08e5-6443-409e-93d8-e466f09f5c03 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:00.771020 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 80/165] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:00 2022] GET /identity/v3/role_assignments?user.id=f0b88d2c828540b1a63ceadb9cee8a00&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:00.772003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a08e5-6443-409e-93d8-e466f09f5c03 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:00.883116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:00.895730 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a08e5-6443-409e-93d8-e466f09f5c03 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:00.929656 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ec537-0fb5-4f7e-a388-0333e4f142e6 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:00.935029 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:00.945679 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a8c94-e5c3-45fa-9759-dc3707ddc779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:00.946587 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8c94-e5c3-45fa-9759-dc3707ddc779 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:00.946912 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8c94-e5c3-45fa-9759-dc3707ddc779 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:00.947191 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8c94-e5c3-45fa-9759-dc3707ddc779 None admin] PATH_INFO: `/v3/users/d05cd1394b114e79a86eca456272c6fb` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:00.951737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a8c94-e5c3-45fa-9759-dc3707ddc779 None admin] RBAC: Authorizing `identity:get_user(user_id=d05cd1394b114e79a86eca456272c6fb)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:00.953394 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a8c94-e5c3-45fa-9759-dc3707ddc779 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:00.957112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 81/166] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:00 2022] GET /identity/v3/users/d05cd1394b114e79a86eca456272c6fb => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:00.959050 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ced23c-8e5b-480d-97a6-084c628cb71f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:00.959050 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ced23c-8e5b-480d-97a6-084c628cb71f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:00.959050 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ced23c-8e5b-480d-97a6-084c628cb71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:00.993653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-f6ced23c-8e5b-480d-97a6-084c628cb71f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:00.994915 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-f6ced23c-8e5b-480d-97a6-084c628cb71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:01.012417 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e6d42-6c70-4a1c-9dd4-fc8af008f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:01.013130 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e6d42-6c70-4a1c-9dd4-fc8af008f755 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:01.013413 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e6d42-6c70-4a1c-9dd4-fc8af008f755 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:01.013690 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e6d42-6c70-4a1c-9dd4-fc8af008f755 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:01.014481 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e6d42-6c70-4a1c-9dd4-fc8af008f755 None admin] RBAC: Adding query filter params (name=reader) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:01.014818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e6d42-6c70-4a1c-9dd4-fc8af008f755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:01.016263 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e6d42-6c70-4a1c-9dd4-fc8af008f755 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:01.036063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 86/167] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:01.036965 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e6d42-6c70-4a1c-9dd4-fc8af008f755 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:01.148897 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 82/168] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:01.150188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ced23c-8e5b-480d-97a6-084c628cb71f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:01.215549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e6d42-6c70-4a1c-9dd4-fc8af008f755 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:01.262693 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46b25c-67cd-4a41-bdff-60fc47d064d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:01.263373 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b25c-67cd-4a41-bdff-60fc47d064d3 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:01.263659 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b25c-67cd-4a41-bdff-60fc47d064d3 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:01.263938 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b25c-67cd-4a41-bdff-60fc47d064d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:01.292998 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:01.360813 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ced23c-8e5b-480d-97a6-084c628cb71f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:01.362195 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46b25c-67cd-4a41-bdff-60fc47d064d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:01.368453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46b25c-67cd-4a41-bdff-60fc47d064d3 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:01.391364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:01.408002 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05243a51-0f37-46ff-9c5f-8419a85fd1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:01.408824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05243a51-0f37-46ff-9c5f-8419a85fd1ae None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:01.409112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05243a51-0f37-46ff-9c5f-8419a85fd1ae None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:01.409383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05243a51-0f37-46ff-9c5f-8419a85fd1ae None admin] PATH_INFO: `/v3/users/85fb59cdcd694736a6796ec1005a9592` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:01.411016 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05243a51-0f37-46ff-9c5f-8419a85fd1ae None admin] RBAC: Authorizing `identity:get_user(user_id=85fb59cdcd694736a6796ec1005a9592)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:01.413148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05243a51-0f37-46ff-9c5f-8419a85fd1ae None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:01.417898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 83/169] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:01 2022] GET /identity/v3/users/85fb59cdcd694736a6796ec1005a9592 => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:01.419692 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05243a51-0f37-46ff-9c5f-8419a85fd1ae None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:01.565029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 87/170] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:01.566170 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46b25c-67cd-4a41-bdff-60fc47d064d3 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:01.647561 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:01.693155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05243a51-0f37-46ff-9c5f-8419a85fd1ae None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:01.714234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46b25c-67cd-4a41-bdff-60fc47d064d3 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:01.758176 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e826d-fd99-4689-8fe6-a224696c5922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:01.759027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e826d-fd99-4689-8fe6-a224696c5922 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:01.759305 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e826d-fd99-4689-8fe6-a224696c5922 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:01.759574 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e826d-fd99-4689-8fe6-a224696c5922 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:01.779457 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e826d-fd99-4689-8fe6-a224696c5922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-6c1e826d-fd99-4689-8fe6-a224696c5922 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:01.790720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:01.791815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:01.792721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:01.793419 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa3a30-3b94-4bbb-8046-53fe4857ed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:01.793419 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa3a30-3b94-4bbb-8046-53fe4857ed56 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:01.793588 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa3a30-3b94-4bbb-8046-53fe4857ed56 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:01.794190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa3a30-3b94-4bbb-8046-53fe4857ed56 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:01.795700 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 84/171] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:01.796551 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e826d-fd99-4689-8fe6-a224696c5922 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:01.797642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa3a30-3b94-4bbb-8046-53fe4857ed56 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:01.799153 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa3a30-3b94-4bbb-8046-53fe4857ed56 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:01.801321 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 88/172] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:01 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:01.806923 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa3a30-3b94-4bbb-8046-53fe4857ed56 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:01.910220 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:01.991511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e826d-fd99-4689-8fe6-a224696c5922 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:02.016435 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa3a30-3b94-4bbb-8046-53fe4857ed56 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:02.050990 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:02.075200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876ba70-a515-4ca9-af69-e829e8de941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:02.076179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876ba70-a515-4ca9-af69-e829e8de941b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:02.076463 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876ba70-a515-4ca9-af69-e829e8de941b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:02.076739 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876ba70-a515-4ca9-af69-e829e8de941b None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:02.082298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5736ca-9021-4e87-8f75-8d0f0134b58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:02.083160 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5736ca-9021-4e87-8f75-8d0f0134b58a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:02.083448 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5736ca-9021-4e87-8f75-8d0f0134b58a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:02.083666 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876ba70-a515-4ca9-af69-e829e8de941b None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:02.083791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5736ca-9021-4e87-8f75-8d0f0134b58a None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:02.084544 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5736ca-9021-4e87-8f75-8d0f0134b58a None admin] RBAC: Adding query filter params (name=member) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:02.084854 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5736ca-9021-4e87-8f75-8d0f0134b58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:02.085260 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876ba70-a515-4ca9-af69-e829e8de941b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:02.086273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5736ca-9021-4e87-8f75-8d0f0134b58a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:02.087888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 85/173] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:01 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:02.089024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876ba70-a515-4ca9-af69-e829e8de941b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:02.106963 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 89/174] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:02.108372 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5736ca-9021-4e87-8f75-8d0f0134b58a None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:02.321346 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876ba70-a515-4ca9-af69-e829e8de941b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:02.350505 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:02.367282 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5736ca-9021-4e87-8f75-8d0f0134b58a None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:02.368821 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999865cc-7218-4e66-8e68-c760d924b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:02.369975 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999865cc-7218-4e66-8e68-c760d924b54f None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:02.371007 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999865cc-7218-4e66-8e68-c760d924b54f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:02.371483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999865cc-7218-4e66-8e68-c760d924b54f None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/users/85fb59cdcd694736a6796ec1005a9592/roles/8dff9e5a6c6340acb442a929d6affd4d` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:02.377508 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999865cc-7218-4e66-8e68-c760d924b54f None admin] RBAC: Authorizing `identity:create_grant(project_id=9f2d70d8029a4523aa34a26c5d7548b4, user_id=85fb59cdcd694736a6796ec1005a9592, role_id=8dff9e5a6c6340acb442a929d6affd4d)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:02.384661 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999865cc-7218-4e66-8e68-c760d924b54f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:02.419811 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093007da-aaf3-4ffd-90a7-8bdee25a7b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:02.420837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093007da-aaf3-4ffd-90a7-8bdee25a7b3e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:02.421318 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093007da-aaf3-4ffd-90a7-8bdee25a7b3e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:02.421788 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093007da-aaf3-4ffd-90a7-8bdee25a7b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:02.422892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093007da-aaf3-4ffd-90a7-8bdee25a7b3e None admin] RBAC: Adding query filter params (role.id=920e2cadf3044abda66c715e1c89f4e3, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4, user.id=d05cd1394b114e79a86eca456272c6fb) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:02.423422 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093007da-aaf3-4ffd-90a7-8bdee25a7b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:02.425106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093007da-aaf3-4ffd-90a7-8bdee25a7b3e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:02.435286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 90/175] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:02 2022] GET /identity/v3/role_assignments?user.id=d05cd1394b114e79a86eca456272c6fb&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=920e2cadf3044abda66c715e1c89f4e3 => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:02.436433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093007da-aaf3-4ffd-90a7-8bdee25a7b3e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:02.488063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 86/176] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:24:02 2022] PUT /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/users/85fb59cdcd694736a6796ec1005a9592/roles/8dff9e5a6c6340acb442a929d6affd4d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:02.489869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d65d-8982-4a71-9abc-5b6d30a57e6f None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:02.490946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d65d-8982-4a71-9abc-5b6d30a57e6f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:02.491504 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d65d-8982-4a71-9abc-5b6d30a57e6f None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:02.493173 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 87/177] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:02.508272 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56265a-0010-4631-8dc9-e95ea22fa790 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:02.510474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56265a-0010-4631-8dc9-e95ea22fa790 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:02.510474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56265a-0010-4631-8dc9-e95ea22fa790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:02.518363 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:02.555610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-fc56265a-0010-4631-8dc9-e95ea22fa790 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:02.556882 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-fc56265a-0010-4631-8dc9-e95ea22fa790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:02.636545 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093007da-aaf3-4ffd-90a7-8bdee25a7b3e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:02.677169 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64ba95-ce1f-4687-a931-6d98b2830416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:02.678662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64ba95-ce1f-4687-a931-6d98b2830416 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:02.678956 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64ba95-ce1f-4687-a931-6d98b2830416 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:02.679240 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64ba95-ce1f-4687-a931-6d98b2830416 None admin] PATH_INFO: `/v3/users/d05cd1394b114e79a86eca456272c6fb` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:02.682212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64ba95-ce1f-4687-a931-6d98b2830416 None admin] RBAC: Authorizing `identity:get_user(user_id=d05cd1394b114e79a86eca456272c6fb)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:02.682212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64ba95-ce1f-4687-a931-6d98b2830416 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:02.685550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 91/178] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:02 2022] GET /identity/v3/users/d05cd1394b114e79a86eca456272c6fb => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:02.690023 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64ba95-ce1f-4687-a931-6d98b2830416 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:02.709853 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 88/179] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:02.755580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56265a-0010-4631-8dc9-e95ea22fa790 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:02.818699 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64ba95-ce1f-4687-a931-6d98b2830416 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:02.825736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:02.855447 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041cd71-e70c-4167-a2bf-2ee299f3cb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:02.856130 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041cd71-e70c-4167-a2bf-2ee299f3cb2b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:02.856420 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041cd71-e70c-4167-a2bf-2ee299f3cb2b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:02.856702 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041cd71-e70c-4167-a2bf-2ee299f3cb2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:02.950834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56265a-0010-4631-8dc9-e95ea22fa790 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:02.960900 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041cd71-e70c-4167-a2bf-2ee299f3cb2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:02.962955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041cd71-e70c-4167-a2bf-2ee299f3cb2b None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:02.975812 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:03.003085 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45adda-0636-4572-bc7a-25a619c3676e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:03.004037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45adda-0636-4572-bc7a-25a619c3676e None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.004395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45adda-0636-4572-bc7a-25a619c3676e None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.004750 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45adda-0636-4572-bc7a-25a619c3676e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.018814 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45adda-0636-4572-bc7a-25a619c3676e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-be45adda-0636-4572-bc7a-25a619c3676e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:03.028763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:03.029963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:03.030930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:03.039304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 89/180] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:24:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:03.039304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aea83-3ff1-41a1-8443-bd2817cbbbfa None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.039304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aea83-3ff1-41a1-8443-bd2817cbbbfa None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.039304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aea83-3ff1-41a1-8443-bd2817cbbbfa None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.039304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 90/181] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:03.041503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8bf67-3fbe-46b6-a6ad-473b37b55d77 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.041503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8bf67-3fbe-46b6-a6ad-473b37b55d77 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.041503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8bf67-3fbe-46b6-a6ad-473b37b55d77 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.044662 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 91/182] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:03.044662 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8bf67-3fbe-46b6-a6ad-473b37b55d77 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:03.093645 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 92/183] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:03.095674 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f332da-d2f8-4087-a198-8cec81ec95fa None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.096206 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f332da-d2f8-4087-a198-8cec81ec95fa None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.096688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f332da-d2f8-4087-a198-8cec81ec95fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.114883 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-72f332da-d2f8-4087-a198-8cec81ec95fa None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:03.116172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-72f332da-d2f8-4087-a198-8cec81ec95fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:03.118371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:03.176007 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8bf67-3fbe-46b6-a6ad-473b37b55d77 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:03.195436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 93/184] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:03.202242 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512d0f-3413-4b87-8102-84614220b5bd None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.202242 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512d0f-3413-4b87-8102-84614220b5bd None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.202242 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512d0f-3413-4b87-8102-84614220b5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.218020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-22512d0f-3413-4b87-8102-84614220b5bd None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:03.219273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-22512d0f-3413-4b87-8102-84614220b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:03.232894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f6dab-1914-4992-b713-719864cf1302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:03.233582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f6dab-1914-4992-b713-719864cf1302 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.233871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f6dab-1914-4992-b713-719864cf1302 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.234153 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f6dab-1914-4992-b713-719864cf1302 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.234975 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f6dab-1914-4992-b713-719864cf1302 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:03.235283 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f6dab-1914-4992-b713-719864cf1302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:03.236707 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f6dab-1914-4992-b713-719864cf1302 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:03.246687 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 92/185] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:03.251918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f6dab-1914-4992-b713-719864cf1302 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:03.287640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:03.305998 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 94/186] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:03.311468 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22512d0f-3413-4b87-8102-84614220b5bd None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:03.366345 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f6dab-1914-4992-b713-719864cf1302 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:03.390479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:03.414330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a065fa-7313-4a26-887b-c9e25b0f5058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:03.415514 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a065fa-7313-4a26-887b-c9e25b0f5058 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.415946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a065fa-7313-4a26-887b-c9e25b0f5058 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.416401 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a065fa-7313-4a26-887b-c9e25b0f5058 None admin] PATH_INFO: `/v3/projects/b7bbb1c4a418473b8051c4bf9d4426e9` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.417849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a065fa-7313-4a26-887b-c9e25b0f5058 None admin] RBAC: Authorizing `identity:get_project(project_id=b7bbb1c4a418473b8051c4bf9d4426e9)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:03.419304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a065fa-7313-4a26-887b-c9e25b0f5058 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:03.421063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 93/187] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:03 2022] GET /identity/v3/projects/b7bbb1c4a418473b8051c4bf9d4426e9 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:03.421936 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a065fa-7313-4a26-887b-c9e25b0f5058 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:03.437745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22512d0f-3413-4b87-8102-84614220b5bd None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:03.484870 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a75e2f-2f47-4181-af4c-df760c0aa3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:03.486456 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75e2f-2f47-4181-af4c-df760c0aa3d8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.486812 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75e2f-2f47-4181-af4c-df760c0aa3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.487106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75e2f-2f47-4181-af4c-df760c0aa3d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.499349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a75e2f-2f47-4181-af4c-df760c0aa3d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-68a75e2f-2f47-4181-af4c-df760c0aa3d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:03.508539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:03.509758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:03.510955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:03.514712 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 95/188] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:24:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:03.515724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a75e2f-2f47-4181-af4c-df760c0aa3d8 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:03.538243 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a065fa-7313-4a26-887b-c9e25b0f5058 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:03.541284 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:03.581968 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d586ca7-a219-4bc7-b05c-f223c339992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:03.582899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d586ca7-a219-4bc7-b05c-f223c339992f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.583190 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d586ca7-a219-4bc7-b05c-f223c339992f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.583481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d586ca7-a219-4bc7-b05c-f223c339992f None admin] PATH_INFO: `/v3/users/45ecc56cd7c64491ae944ab468e09186` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.598057 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d586ca7-a219-4bc7-b05c-f223c339992f None admin] RBAC: Authorizing `identity:get_user(user_id=45ecc56cd7c64491ae944ab468e09186)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:03.599628 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d586ca7-a219-4bc7-b05c-f223c339992f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:03.601416 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 94/189] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:03 2022] GET /identity/v3/users/45ecc56cd7c64491ae944ab468e09186 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:03.602212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d586ca7-a219-4bc7-b05c-f223c339992f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:03.641290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a75e2f-2f47-4181-af4c-df760c0aa3d8 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:03.674093 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:03.685258 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4927b31-d774-431a-8a36-dbcd5bc4d414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:03.690814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4927b31-d774-431a-8a36-dbcd5bc4d414 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.690814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4927b31-d774-431a-8a36-dbcd5bc4d414 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.690814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4927b31-d774-431a-8a36-dbcd5bc4d414 None admin] PATH_INFO: `/v3/domains/default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.690814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4927b31-d774-431a-8a36-dbcd5bc4d414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:03.690814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4927b31-d774-431a-8a36-dbcd5bc4d414 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:03.697500 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 96/190] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:03.697500 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4927b31-d774-431a-8a36-dbcd5bc4d414 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:03.727043 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d586ca7-a219-4bc7-b05c-f223c339992f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:03.765272 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810168-1973-4105-b6a7-455063e943fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:03.766225 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810168-1973-4105-b6a7-455063e943fa None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.766706 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810168-1973-4105-b6a7-455063e943fa None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.767152 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810168-1973-4105-b6a7-455063e943fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.768033 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16810168-1973-4105-b6a7-455063e943fa None admin] RBAC: Adding query filter params (role.id=a661e4208e2047e69b45e282caa0683b, scope.project.id=b7bbb1c4a418473b8051c4bf9d4426e9, user.id=d05cd1394b114e79a86eca456272c6fb) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:03.768327 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16810168-1973-4105-b6a7-455063e943fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:03.769816 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16810168-1973-4105-b6a7-455063e943fa None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:03.776355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 95/191] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:03 2022] GET /identity/v3/role_assignments?user.id=d05cd1394b114e79a86eca456272c6fb&scope.project.id=b7bbb1c4a418473b8051c4bf9d4426e9&role.id=a661e4208e2047e69b45e282caa0683b => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:03.777100 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810168-1973-4105-b6a7-455063e943fa None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:03.831425 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:03.842883 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4927b31-d774-431a-8a36-dbcd5bc4d414 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:03.893451 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0ac71-01b7-4549-b522-196b21f4b9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:03.894158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0ac71-01b7-4549-b522-196b21f4b9c6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.894440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0ac71-01b7-4549-b522-196b21f4b9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.894750 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0ac71-01b7-4549-b522-196b21f4b9c6 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.895932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0ac71-01b7-4549-b522-196b21f4b9c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:03.897387 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0ac71-01b7-4549-b522-196b21f4b9c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:03.898860 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0ac71-01b7-4549-b522-196b21f4b9c6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:03.912799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 97/192] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:03.914014 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0ac71-01b7-4549-b522-196b21f4b9c6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:03.941511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810168-1973-4105-b6a7-455063e943fa None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:03.997714 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:04.001119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa815-8198-4ff3-b6a5-5ca2df033c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:04.001797 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa815-8198-4ff3-b6a5-5ca2df033c4d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:04.002081 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa815-8198-4ff3-b6a5-5ca2df033c4d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:04.002355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa815-8198-4ff3-b6a5-5ca2df033c4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:04.053406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0ac71-01b7-4549-b522-196b21f4b9c6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:04.104730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1d6b7-be66-4cda-8cd2-20fbecd98b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:04.105745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d6b7-be66-4cda-8cd2-20fbecd98b7f None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:04.106159 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d6b7-be66-4cda-8cd2-20fbecd98b7f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:04.106567 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d6b7-be66-4cda-8cd2-20fbecd98b7f None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:04.108385 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1d6b7-be66-4cda-8cd2-20fbecd98b7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:04.110178 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1d6b7-be66-4cda-8cd2-20fbecd98b7f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:04.113944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa815-8198-4ff3-b6a5-5ca2df033c4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:04.116379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa815-8198-4ff3-b6a5-5ca2df033c4d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:04.153440 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:04.197585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 98/193] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:24:03 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:04.198508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1d6b7-be66-4cda-8cd2-20fbecd98b7f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:04.258696 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 96/194] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:04.262443 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa815-8198-4ff3-b6a5-5ca2df033c4d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:04.372248 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1d6b7-be66-4cda-8cd2-20fbecd98b7f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:04.392316 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:04.417724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811c857-0d8f-4442-be7d-b4326585cb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:04.418701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811c857-0d8f-4442-be7d-b4326585cb1d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:04.419296 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811c857-0d8f-4442-be7d-b4326585cb1d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:04.419296 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811c857-0d8f-4442-be7d-b4326585cb1d None admin] PATH_INFO: `/v3/users/45ecc56cd7c64491ae944ab468e09186` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:04.420810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811c857-0d8f-4442-be7d-b4326585cb1d None admin] RBAC: Authorizing `identity:get_user(user_id=45ecc56cd7c64491ae944ab468e09186)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:04.423759 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811c857-0d8f-4442-be7d-b4326585cb1d None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:04.427961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa815-8198-4ff3-b6a5-5ca2df033c4d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:04.428450 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 99/195] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:04 2022] GET /identity/v3/users/45ecc56cd7c64491ae944ab468e09186 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:04.432755 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811c857-0d8f-4442-be7d-b4326585cb1d None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:04.465832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:04.484201 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bf233-6b23-4eb1-b9bf-a187fff06797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:04.486658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bf233-6b23-4eb1-b9bf-a187fff06797 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:04.486658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bf233-6b23-4eb1-b9bf-a187fff06797 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:04.486658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bf233-6b23-4eb1-b9bf-a187fff06797 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:04.488551 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bf233-6b23-4eb1-b9bf-a187fff06797 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:04.492785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bf233-6b23-4eb1-b9bf-a187fff06797 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:04.497265 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 97/196] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:04 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:04.506428 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bf233-6b23-4eb1-b9bf-a187fff06797 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:04.589837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811c857-0d8f-4442-be7d-b4326585cb1d None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:04.638163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd543f8e-e8cc-48f0-8abf-1ee0adacdee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:04.638163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd543f8e-e8cc-48f0-8abf-1ee0adacdee4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:04.638163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd543f8e-e8cc-48f0-8abf-1ee0adacdee4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:04.638533 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd543f8e-e8cc-48f0-8abf-1ee0adacdee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:04.639985 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bf233-6b23-4eb1-b9bf-a187fff06797 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:04.692613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48d3c-c39e-4c13-86e3-9c31d409460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:04.693908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48d3c-c39e-4c13-86e3-9c31d409460c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:04.694199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48d3c-c39e-4c13-86e3-9c31d409460c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:04.694479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48d3c-c39e-4c13-86e3-9c31d409460c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:04.695377 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c48d3c-c39e-4c13-86e3-9c31d409460c None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a, user.id=45ecc56cd7c64491ae944ab468e09186) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:04.695693 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c48d3c-c39e-4c13-86e3-9c31d409460c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:04.697338 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c48d3c-c39e-4c13-86e3-9c31d409460c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:04.706588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 98/197] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:04 2022] GET /identity/v3/role_assignments?user.id=45ecc56cd7c64491ae944ab468e09186&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:04.728405 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:04.753843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd543f8e-e8cc-48f0-8abf-1ee0adacdee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:04.755431 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd543f8e-e8cc-48f0-8abf-1ee0adacdee4 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:04.885129 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 100/198] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:24:04.891907 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48d3c-c39e-4c13-86e3-9c31d409460c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:04.978764 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:05.039077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48d3c-c39e-4c13-86e3-9c31d409460c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:05.093312 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d0935-4916-4946-a620-3d025569ed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:05.094197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d0935-4916-4946-a620-3d025569ed9a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:05.094478 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d0935-4916-4946-a620-3d025569ed9a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:05.094781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d0935-4916-4946-a620-3d025569ed9a None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:05.096053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d0935-4916-4946-a620-3d025569ed9a None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:05.097569 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d0935-4916-4946-a620-3d025569ed9a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:05.100346 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 99/199] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:04 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:05.106100 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd543f8e-e8cc-48f0-8abf-1ee0adacdee4 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:05.179027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe1e4-f45d-4b11-9858-6b79c16bf251 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:05.179317 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe1e4-f45d-4b11-9858-6b79c16bf251 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:05.179617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe1e4-f45d-4b11-9858-6b79c16bf251 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:05.182265 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 100/200] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:05.186622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b94910-c058-413a-94ec-ff30548be29b None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:05.186915 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b94910-c058-413a-94ec-ff30548be29b None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:05.187195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b94910-c058-413a-94ec-ff30548be29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:05.200825 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:05.221009 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd543f8e-e8cc-48f0-8abf-1ee0adacdee4 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:05.227709 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-b6b94910-c058-413a-94ec-ff30548be29b None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:05.228930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-b6b94910-c058-413a-94ec-ff30548be29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:05.260608 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd001c-b2d7-4795-82ac-878aa733d280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:05.261476 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd001c-b2d7-4795-82ac-878aa733d280 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:05.261750 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd001c-b2d7-4795-82ac-878aa733d280 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:05.262034 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd001c-b2d7-4795-82ac-878aa733d280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:05.263307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd001c-b2d7-4795-82ac-878aa733d280 None admin] RBAC: Adding query filter params (role.id=920e2cadf3044abda66c715e1c89f4e3, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a, user.id=45ecc56cd7c64491ae944ab468e09186) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:05.263982 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd001c-b2d7-4795-82ac-878aa733d280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:05.265488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd001c-b2d7-4795-82ac-878aa733d280 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:05.273752 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 101/201] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:05 2022] GET /identity/v3/role_assignments?user.id=45ecc56cd7c64491ae944ab468e09186&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=920e2cadf3044abda66c715e1c89f4e3 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:05.348121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 101/202] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:05.384968 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd001c-b2d7-4795-82ac-878aa733d280 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:05.505338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd001c-b2d7-4795-82ac-878aa733d280 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:05.543649 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c82d6f-8e97-491d-bda0-4eab8380d3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:05.544466 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82d6f-8e97-491d-bda0-4eab8380d3c0 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:05.544753 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82d6f-8e97-491d-bda0-4eab8380d3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:05.545036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82d6f-8e97-491d-bda0-4eab8380d3c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:05.556970 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c82d6f-8e97-491d-bda0-4eab8380d3c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-77c82d6f-8e97-491d-bda0-4eab8380d3c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:05.564911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:05.565904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:05.566837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 102/203] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:05.572205 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b94910-c058-413a-94ec-ff30548be29b None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:05.641902 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:05.679798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b94910-c058-413a-94ec-ff30548be29b None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:05.716758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6b2c0-58f0-4fe3-9dfd-9d12badc0efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:05.717438 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b2c0-58f0-4fe3-9dfd-9d12badc0efd None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:05.717724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b2c0-58f0-4fe3-9dfd-9d12badc0efd None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:05.718005 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b2c0-58f0-4fe3-9dfd-9d12badc0efd None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:05.718799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6b2c0-58f0-4fe3-9dfd-9d12badc0efd None admin] RBAC: Adding query filter params (name=reader) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:05.719113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6b2c0-58f0-4fe3-9dfd-9d12badc0efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:05.720513 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6b2c0-58f0-4fe3-9dfd-9d12badc0efd None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:05.730300 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 102/204] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:05.735909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c82d6f-8e97-491d-bda0-4eab8380d3c0 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:05.759613 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:05.847479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c82d6f-8e97-491d-bda0-4eab8380d3c0 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:05.885260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae516fe-6e63-4528-a954-2ec3924c748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:05.886153 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae516fe-6e63-4528-a954-2ec3924c748e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:05.886438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae516fe-6e63-4528-a954-2ec3924c748e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:05.886758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae516fe-6e63-4528-a954-2ec3924c748e None admin] PATH_INFO: `/v3/users/85fb59cdcd694736a6796ec1005a9592` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:05.888016 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae516fe-6e63-4528-a954-2ec3924c748e None admin] RBAC: Authorizing `identity:get_user(user_id=85fb59cdcd694736a6796ec1005a9592)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:05.889472 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae516fe-6e63-4528-a954-2ec3924c748e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:05.891170 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 103/205] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:05 2022] GET /identity/v3/users/85fb59cdcd694736a6796ec1005a9592 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:05.897562 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6b2c0-58f0-4fe3-9dfd-9d12badc0efd None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:06.004354 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6b2c0-58f0-4fe3-9dfd-9d12badc0efd None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:06.027379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:06.041234 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69fc96-81ff-42a2-876d-f6c35dc06bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:06.041922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69fc96-81ff-42a2-876d-f6c35dc06bb5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:06.042179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69fc96-81ff-42a2-876d-f6c35dc06bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:06.042461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69fc96-81ff-42a2-876d-f6c35dc06bb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:06.116490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69fc96-81ff-42a2-876d-f6c35dc06bb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:06.118015 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69fc96-81ff-42a2-876d-f6c35dc06bb5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:06.224766 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 103/206] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:06.230374 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae516fe-6e63-4528-a954-2ec3924c748e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:06.313085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:06.340488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae516fe-6e63-4528-a954-2ec3924c748e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:06.381762 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a15c3a-abe6-4bd6-bd79-4319d0f8acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:06.382670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15c3a-abe6-4bd6-bd79-4319d0f8acb8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:06.382964 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15c3a-abe6-4bd6-bd79-4319d0f8acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:06.383250 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15c3a-abe6-4bd6-bd79-4319d0f8acb8 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:06.387376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a15c3a-abe6-4bd6-bd79-4319d0f8acb8 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:06.388908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a15c3a-abe6-4bd6-bd79-4319d0f8acb8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:06.390772 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 104/207] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:06 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:06.397367 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69fc96-81ff-42a2-876d-f6c35dc06bb5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:06.450986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:06.531537 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69fc96-81ff-42a2-876d-f6c35dc06bb5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:06.568422 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338e415-03d2-46ad-855f-4a01dbdc161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:06.569018 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338e415-03d2-46ad-855f-4a01dbdc161c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:06.569304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338e415-03d2-46ad-855f-4a01dbdc161c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:06.569581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338e415-03d2-46ad-855f-4a01dbdc161c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:06.570445 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338e415-03d2-46ad-855f-4a01dbdc161c None admin] RBAC: Adding query filter params (role.id=8dff9e5a6c6340acb442a929d6affd4d, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4, user.id=85fb59cdcd694736a6796ec1005a9592) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:06.570796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338e415-03d2-46ad-855f-4a01dbdc161c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:06.572302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338e415-03d2-46ad-855f-4a01dbdc161c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:06.579414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 104/208] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:06 2022] GET /identity/v3/role_assignments?user.id=85fb59cdcd694736a6796ec1005a9592&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=8dff9e5a6c6340acb442a929d6affd4d => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:07.224034 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f1327-f7f4-4368-b416-07f59f02ea49 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:07.224855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f1327-f7f4-4368-b416-07f59f02ea49 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:07.225366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f1327-f7f4-4368-b416-07f59f02ea49 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:07.227299 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 105/209] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:07.233304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6491-a7a3-4421-856a-bae745a04440 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:07.234205 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6491-a7a3-4421-856a-bae745a04440 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:07.234744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6491-a7a3-4421-856a-bae745a04440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:07.252720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-9c8e6491-a7a3-4421-856a-bae745a04440 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:07.254560 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-9c8e6491-a7a3-4421-856a-bae745a04440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:07.334899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 105/210] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:07.352059 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f1327-f7f4-4368-b416-07f59f02ea49 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:07.468925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f1327-f7f4-4368-b416-07f59f02ea49 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:07.507342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b352b8-9d37-447e-b08a-6d888521c1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:07.508082 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b352b8-9d37-447e-b08a-6d888521c1be None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:07.508365 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b352b8-9d37-447e-b08a-6d888521c1be None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:07.508638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b352b8-9d37-447e-b08a-6d888521c1be None admin] PATH_INFO: `/v3/roles/member` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:07.519954 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b352b8-9d37-447e-b08a-6d888521c1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-78b352b8-9d37-447e-b08a-6d888521c1be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:07.528582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:07.529583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:07.530782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 106/211] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:07.539067 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ce395-58ce-4afb-8afe-60696b60620f None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:07.539360 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ce395-58ce-4afb-8afe-60696b60620f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:07.539643 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ce395-58ce-4afb-8afe-60696b60620f None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:07.540376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b352b8-9d37-447e-b08a-6d888521c1be None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:07.541312 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 106/212] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:07.545768 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:07.546669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41010ccc-69bd-4277-83c4-ffbe0b5cde1a None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:07.546669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41010ccc-69bd-4277-83c4-ffbe0b5cde1a None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:07.546884 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41010ccc-69bd-4277-83c4-ffbe0b5cde1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:07.564378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-41010ccc-69bd-4277-83c4-ffbe0b5cde1a None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:07.565731 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-41010ccc-69bd-4277-83c4-ffbe0b5cde1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:07.575917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:07.649935 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 107/213] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:07.651552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be65c6-e2b1-44c8-8e64-75fb0e1d6387 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:07.651916 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be65c6-e2b1-44c8-8e64-75fb0e1d6387 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:07.652271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be65c6-e2b1-44c8-8e64-75fb0e1d6387 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:07.653805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 108/214] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:07.660538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bd176-7dd2-47d7-8f3b-bd7d1404b14e None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:07.660940 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bd176-7dd2-47d7-8f3b-bd7d1404b14e None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:07.661637 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bd176-7dd2-47d7-8f3b-bd7d1404b14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:07.663879 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b352b8-9d37-447e-b08a-6d888521c1be None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:07.681489 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-e17bd176-7dd2-47d7-8f3b-bd7d1404b14e None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:07.682809 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-e17bd176-7dd2-47d7-8f3b-bd7d1404b14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:07.702448 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7f614-7998-40d3-abed-b6009480f2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:07.703163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f614-7998-40d3-abed-b6009480f2ba None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:07.703452 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f614-7998-40d3-abed-b6009480f2ba None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:07.703734 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f614-7998-40d3-abed-b6009480f2ba None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:07.704496 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7f614-7998-40d3-abed-b6009480f2ba None admin] RBAC: Adding query filter params (name=member) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:07.704811 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7f614-7998-40d3-abed-b6009480f2ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:07.706190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7f614-7998-40d3-abed-b6009480f2ba None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:07.715368 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 107/215] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:07.716200 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7f614-7998-40d3-abed-b6009480f2ba None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:07.760774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 109/216] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:07.772080 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bd176-7dd2-47d7-8f3b-bd7d1404b14e None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:07.784114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:07.838936 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7f614-7998-40d3-abed-b6009480f2ba None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:07.853817 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:07.878668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5bb80-de40-40c8-b300-46696b0dec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:07.879482 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5bb80-de40-40c8-b300-46696b0dec2b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:07.879775 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5bb80-de40-40c8-b300-46696b0dec2b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:07.880059 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5bb80-de40-40c8-b300-46696b0dec2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:07.881862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5bb80-de40-40c8-b300-46696b0dec2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:07.883376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5bb80-de40-40c8-b300-46696b0dec2b None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:07.885064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 108/217] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:07.885846 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5bb80-de40-40c8-b300-46696b0dec2b None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:07.892348 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bd176-7dd2-47d7-8f3b-bd7d1404b14e None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:07.935620 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f94fdf-294a-4502-9a2c-8593f01406c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:07.936821 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94fdf-294a-4502-9a2c-8593f01406c0 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:07.937108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94fdf-294a-4502-9a2c-8593f01406c0 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:07.937650 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94fdf-294a-4502-9a2c-8593f01406c0 None admin] PATH_INFO: `/v3/users/6db2b9b8f72b49ec96c2a0dbcbfc93de` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:07.955545 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f94fdf-294a-4502-9a2c-8593f01406c0 None admin] RBAC: Authorizing `identity:get_user(user_id=6db2b9b8f72b49ec96c2a0dbcbfc93de)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:07.957318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f94fdf-294a-4502-9a2c-8593f01406c0 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:07.964554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 110/218] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:07 2022] GET /identity/v3/users/6db2b9b8f72b49ec96c2a0dbcbfc93de => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:07.964554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f94fdf-294a-4502-9a2c-8593f01406c0 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:07.997046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5bb80-de40-40c8-b300-46696b0dec2b None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.028697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.034188 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d322e65-71af-4d19-bbeb-3a4a1c50e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.042789 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d322e65-71af-4d19-bbeb-3a4a1c50e76c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.042789 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d322e65-71af-4d19-bbeb-3a4a1c50e76c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.042789 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d322e65-71af-4d19-bbeb-3a4a1c50e76c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.048162 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d322e65-71af-4d19-bbeb-3a4a1c50e76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-0d322e65-71af-4d19-bbeb-3a4a1c50e76c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:08.056869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:08.057913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:08.058907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 109/219] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:24:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:08.060291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d322e65-71af-4d19-bbeb-3a4a1c50e76c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.085069 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f94fdf-294a-4502-9a2c-8593f01406c0 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.114032 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.120413 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d8ac0-e7dc-4774-b000-7c07dc561a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.121720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8ac0-e7dc-4774-b000-7c07dc561a32 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.121720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8ac0-e7dc-4774-b000-7c07dc561a32 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.121720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8ac0-e7dc-4774-b000-7c07dc561a32 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.128776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d8ac0-e7dc-4774-b000-7c07dc561a32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:08.128776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d8ac0-e7dc-4774-b000-7c07dc561a32 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:08.170018 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d322e65-71af-4d19-bbeb-3a4a1c50e76c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.205313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2ad4b-1167-4287-8184-6c11e4afa1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.205967 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ad4b-1167-4287-8184-6c11e4afa1b1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.206252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ad4b-1167-4287-8184-6c11e4afa1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.206530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ad4b-1167-4287-8184-6c11e4afa1b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.226935 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 111/220] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:24:07 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:08.228133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d8ac0-e7dc-4774-b000-7c07dc561a32 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.272116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.282222 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2ad4b-1167-4287-8184-6c11e4afa1b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:08.283690 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2ad4b-1167-4287-8184-6c11e4afa1b1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:08.374300 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d8ac0-e7dc-4774-b000-7c07dc561a32 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.412623 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f0c9e-59a5-4ab3-8251-805bd9adc073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.413320 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f0c9e-59a5-4ab3-8251-805bd9adc073 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.413613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f0c9e-59a5-4ab3-8251-805bd9adc073 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.413890 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f0c9e-59a5-4ab3-8251-805bd9adc073 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.414692 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f0c9e-59a5-4ab3-8251-805bd9adc073 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:08.415005 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f0c9e-59a5-4ab3-8251-805bd9adc073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:08.416427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f0c9e-59a5-4ab3-8251-805bd9adc073 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:08.417530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 110/221] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:08.419634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714793-9762-4b8a-97b2-cae5b6a3b6a2 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.420189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714793-9762-4b8a-97b2-cae5b6a3b6a2 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.420684 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714793-9762-4b8a-97b2-cae5b6a3b6a2 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.422595 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 111/222] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:08.423617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2714793-9762-4b8a-97b2-cae5b6a3b6a2 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.433061 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 112/223] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:08.434369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535134e2-7dc3-462c-b0e8-dc4620c7fc11 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.434712 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535134e2-7dc3-462c-b0e8-dc4620c7fc11 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.434994 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535134e2-7dc3-462c-b0e8-dc4620c7fc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.453780 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-535134e2-7dc3-462c-b0e8-dc4620c7fc11 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:08.455053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-535134e2-7dc3-462c-b0e8-dc4620c7fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:08.522287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.540561 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.553594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 113/224] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:08.553793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2714793-9762-4b8a-97b2-cae5b6a3b6a2 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.555223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535134e2-7dc3-462c-b0e8-dc4620c7fc11 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.620458 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5c741-13d4-4be4-b08f-402bd8b9c172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.620897 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c741-13d4-4be4-b08f-402bd8b9c172 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.621182 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c741-13d4-4be4-b08f-402bd8b9c172 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.621456 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c741-13d4-4be4-b08f-402bd8b9c172 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.623397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5c741-13d4-4be4-b08f-402bd8b9c172 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:08.625831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5c741-13d4-4be4-b08f-402bd8b9c172 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:08.630745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 112/225] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:08.630745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5c741-13d4-4be4-b08f-402bd8b9c172 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.684763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535134e2-7dc3-462c-b0e8-dc4620c7fc11 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.731613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c54bf-c7e9-49ea-8912-fd52cf529ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.732974 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c54bf-c7e9-49ea-8912-fd52cf529ad9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.733564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c54bf-c7e9-49ea-8912-fd52cf529ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.734096 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c54bf-c7e9-49ea-8912-fd52cf529ad9 None admin] PATH_INFO: `/v3/users/45ecc56cd7c64491ae944ab468e09186` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.737587 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c54bf-c7e9-49ea-8912-fd52cf529ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=45ecc56cd7c64491ae944ab468e09186)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:08.739091 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c54bf-c7e9-49ea-8912-fd52cf529ad9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:08.740805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 114/226] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/users/45ecc56cd7c64491ae944ab468e09186 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:08.741578 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c54bf-c7e9-49ea-8912-fd52cf529ad9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.770762 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5c741-13d4-4be4-b08f-402bd8b9c172 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.793407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.822418 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8e19d-0b84-4028-9c47-09fd88d749eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.823582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8e19d-0b84-4028-9c47-09fd88d749eb None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.824043 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8e19d-0b84-4028-9c47-09fd88d749eb None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.824478 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8e19d-0b84-4028-9c47-09fd88d749eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.841597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8e19d-0b84-4028-9c47-09fd88d749eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-59c8e19d-0b84-4028-9c47-09fd88d749eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:08.851440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:08.852701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:08.853821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:08.855885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 113/227] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:08.856858 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8e19d-0b84-4028-9c47-09fd88d749eb None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.865020 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c54bf-c7e9-49ea-8912-fd52cf529ad9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.881176 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.916141 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bad36-0dbe-41e2-92b1-61cc63e38730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.917621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bad36-0dbe-41e2-92b1-61cc63e38730 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.918362 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bad36-0dbe-41e2-92b1-61cc63e38730 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.918832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bad36-0dbe-41e2-92b1-61cc63e38730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.920121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bad36-0dbe-41e2-92b1-61cc63e38730 None admin] RBAC: Adding query filter params (role.id=a661e4208e2047e69b45e282caa0683b, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a, user.id=6db2b9b8f72b49ec96c2a0dbcbfc93de) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:08.920737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bad36-0dbe-41e2-92b1-61cc63e38730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:08.923133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bad36-0dbe-41e2-92b1-61cc63e38730 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:08.934561 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 115/228] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/role_assignments?user.id=6db2b9b8f72b49ec96c2a0dbcbfc93de&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=a661e4208e2047e69b45e282caa0683b => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:08.935702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bad36-0dbe-41e2-92b1-61cc63e38730 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:09.023840 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8e19d-0b84-4028-9c47-09fd88d749eb None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:09.096334 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bad36-0dbe-41e2-92b1-61cc63e38730 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:09.111097 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:09.134821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff56e0-cbda-40ab-9151-e36fb404a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:09.136774 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff56e0-cbda-40ab-9151-e36fb404a091 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:09.138890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff56e0-cbda-40ab-9151-e36fb404a091 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:09.139467 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff56e0-cbda-40ab-9151-e36fb404a091 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:09.143248 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff56e0-cbda-40ab-9151-e36fb404a091 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:09.147334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff56e0-cbda-40ab-9151-e36fb404a091 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:09.151632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 114/229] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:09.157627 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff56e0-cbda-40ab-9151-e36fb404a091 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:09.166973 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed544d1-fa6b-4460-a8fd-f460253ee900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:09.167671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed544d1-fa6b-4460-a8fd-f460253ee900 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:09.167951 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed544d1-fa6b-4460-a8fd-f460253ee900 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:09.168222 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed544d1-fa6b-4460-a8fd-f460253ee900 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:09.168995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed544d1-fa6b-4460-a8fd-f460253ee900 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:09.169299 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed544d1-fa6b-4460-a8fd-f460253ee900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:09.170764 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed544d1-fa6b-4460-a8fd-f460253ee900 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:09.189956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 116/230] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:09.196539 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed544d1-fa6b-4460-a8fd-f460253ee900 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:09.271158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:09.283321 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff56e0-cbda-40ab-9151-e36fb404a091 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:09.325955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2830969-9fb4-4e88-b84c-3ad229fb3100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:09.327610 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2830969-9fb4-4e88-b84c-3ad229fb3100 None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:09.328288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2830969-9fb4-4e88-b84c-3ad229fb3100 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:09.328785 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2830969-9fb4-4e88-b84c-3ad229fb3100 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/users/45ecc56cd7c64491ae944ab468e09186/roles/59689ee7c4f5409692318371dac5cbc7` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:09.331763 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2830969-9fb4-4e88-b84c-3ad229fb3100 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fc86a6aca544e2b9b180fb63e16f39a, user_id=45ecc56cd7c64491ae944ab468e09186, role_id=59689ee7c4f5409692318371dac5cbc7)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:09.333884 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2830969-9fb4-4e88-b84c-3ad229fb3100 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:09.377961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed544d1-fa6b-4460-a8fd-f460253ee900 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:09.395552 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 115/231] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:24:09 2022] PUT /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/users/45ecc56cd7c64491ae944ab468e09186/roles/59689ee7c4f5409692318371dac5cbc7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:09.426377 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5443e-79f6-4aad-970e-9cebd68dde55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:09.428634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5443e-79f6-4aad-970e-9cebd68dde55 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:09.429149 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5443e-79f6-4aad-970e-9cebd68dde55 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:09.429644 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5443e-79f6-4aad-970e-9cebd68dde55 None admin] PATH_INFO: `/v3/users/45ecc56cd7c64491ae944ab468e09186` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:09.431418 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5443e-79f6-4aad-970e-9cebd68dde55 None admin] RBAC: Authorizing `identity:get_user(user_id=45ecc56cd7c64491ae944ab468e09186)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:09.433165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5443e-79f6-4aad-970e-9cebd68dde55 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:09.435709 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 117/232] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:09 2022] GET /identity/v3/users/45ecc56cd7c64491ae944ab468e09186 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:09.442513 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2830969-9fb4-4e88-b84c-3ad229fb3100 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:09.619747 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2830969-9fb4-4e88-b84c-3ad229fb3100 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:09.660174 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61712d9-2246-4c48-afba-65734de9694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:09.660987 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61712d9-2246-4c48-afba-65734de9694a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:09.661272 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61712d9-2246-4c48-afba-65734de9694a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:09.661549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61712d9-2246-4c48-afba-65734de9694a None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:09.663694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61712d9-2246-4c48-afba-65734de9694a None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:09.665349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61712d9-2246-4c48-afba-65734de9694a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:09.667681 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 116/233] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:09 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:09.673250 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5443e-79f6-4aad-970e-9cebd68dde55 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:09.731825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:09.818871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5443e-79f6-4aad-970e-9cebd68dde55 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:09.854748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5594d-423f-490d-a249-016472f9c907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:09.855658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5594d-423f-490d-a249-016472f9c907 None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:09.855944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5594d-423f-490d-a249-016472f9c907 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:09.856222 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5594d-423f-490d-a249-016472f9c907 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/users/45ecc56cd7c64491ae944ab468e09186/roles/920e2cadf3044abda66c715e1c89f4e3` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:09.858526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5594d-423f-490d-a249-016472f9c907 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fc86a6aca544e2b9b180fb63e16f39a, user_id=45ecc56cd7c64491ae944ab468e09186, role_id=920e2cadf3044abda66c715e1c89f4e3)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:09.860096 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5594d-423f-490d-a249-016472f9c907 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:09.951172 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 118/234] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:24:09 2022] PUT /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/users/45ecc56cd7c64491ae944ab468e09186/roles/920e2cadf3044abda66c715e1c89f4e3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:10.923004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9f34-77ba-49f0-a710-e086098817ea None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:10.924032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9f34-77ba-49f0-a710-e086098817ea None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:10.924563 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9f34-77ba-49f0-a710-e086098817ea None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:10.926176 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 117/235] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:10.932818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff47aa6-760f-4d18-92c5-790246ff73ed None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:10.933717 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff47aa6-760f-4d18-92c5-790246ff73ed None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:10.934206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff47aa6-760f-4d18-92c5-790246ff73ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:10.960109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-1ff47aa6-760f-4d18-92c5-790246ff73ed None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:10.961658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-1ff47aa6-760f-4d18-92c5-790246ff73ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:11.056067 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 119/236] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:11.070466 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb04c1-850f-4e63-9f5b-e844d04c9d96 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.070795 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb04c1-850f-4e63-9f5b-e844d04c9d96 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.071072 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb04c1-850f-4e63-9f5b-e844d04c9d96 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.072738 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 118/237] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:11.078150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291a63-3ae0-42f8-b1f7-dcc91d2e9b21 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.078546 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291a63-3ae0-42f8-b1f7-dcc91d2e9b21 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.078860 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291a63-3ae0-42f8-b1f7-dcc91d2e9b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.103902 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-cb291a63-3ae0-42f8-b1f7-dcc91d2e9b21 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:11.105109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-cb291a63-3ae0-42f8-b1f7-dcc91d2e9b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:11.109719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb04c1-850f-4e63-9f5b-e844d04c9d96 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:11.141218 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:11.158298 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:11.246719 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 120/238] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:11.283227 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb04c1-850f-4e63-9f5b-e844d04c9d96 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:11.291687 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb291a63-3ae0-42f8-b1f7-dcc91d2e9b21 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:11.328269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cca35-870a-4a2a-9f14-e0a7b9a603e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:11.328996 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cca35-870a-4a2a-9f14-e0a7b9a603e9 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.329275 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cca35-870a-4a2a-9f14-e0a7b9a603e9 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.329544 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cca35-870a-4a2a-9f14-e0a7b9a603e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.331939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cca35-870a-4a2a-9f14-e0a7b9a603e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:11.335942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cca35-870a-4a2a-9f14-e0a7b9a603e9 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:11.337592 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 119/239] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:11.343860 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cca35-870a-4a2a-9f14-e0a7b9a603e9 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:11.501923 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb291a63-3ae0-42f8-b1f7-dcc91d2e9b21 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:11.515745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:11.545098 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cca35-870a-4a2a-9f14-e0a7b9a603e9 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:11.592924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3d163-815e-438d-9e90-89dedde18669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:11.593682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3d163-815e-438d-9e90-89dedde18669 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.593968 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3d163-815e-438d-9e90-89dedde18669 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.594405 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3d163-815e-438d-9e90-89dedde18669 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.613807 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3d163-815e-438d-9e90-89dedde18669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:11.629253 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a95e14-0831-4847-b0fb-f4ed8c1597e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:11.629937 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a95e14-0831-4847-b0fb-f4ed8c1597e9 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.630218 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a95e14-0831-4847-b0fb-f4ed8c1597e9 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.631029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a95e14-0831-4847-b0fb-f4ed8c1597e9 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.631769 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a95e14-0831-4847-b0fb-f4ed8c1597e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-63f3d163-815e-438d-9e90-89dedde18669 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:11.632734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:11.633711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:11.634743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:11.635430 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a95e14-0831-4847-b0fb-f4ed8c1597e9 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:11.635970 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 121/240] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:11.645596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3d163-815e-438d-9e90-89dedde18669 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:11.692141 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:11.754937 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 120/241] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:24:11 2022] POST /identity/v3/users => generated 293 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:11.757516 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3b5a-a72b-4cb5-b839-419c2f8046c8 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.758023 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3b5a-a72b-4cb5-b839-419c2f8046c8 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.758588 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3b5a-a72b-4cb5-b839-419c2f8046c8 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.763849 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 121/242] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:11.770053 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f102c-330b-4cdd-8b0d-a5f15b6cc6e7 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.770356 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f102c-330b-4cdd-8b0d-a5f15b6cc6e7 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.770835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f102c-330b-4cdd-8b0d-a5f15b6cc6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.815800 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-758f102c-330b-4cdd-8b0d-a5f15b6cc6e7 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:11.817044 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-758f102c-330b-4cdd-8b0d-a5f15b6cc6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:11.854538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3d163-815e-438d-9e90-89dedde18669 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:11.925054 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af6a96-7458-424f-864d-fb454e73698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:11.926463 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af6a96-7458-424f-864d-fb454e73698f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.927983 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af6a96-7458-424f-864d-fb454e73698f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.928463 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af6a96-7458-424f-864d-fb454e73698f None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.930276 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af6a96-7458-424f-864d-fb454e73698f None admin] RBAC: Adding query filter params (name=reader) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:11.931015 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af6a96-7458-424f-864d-fb454e73698f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:11.934094 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af6a96-7458-424f-864d-fb454e73698f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:11.947677 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 122/243] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:11.952589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 122/244] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:11.961463 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f102c-330b-4cdd-8b0d-a5f15b6cc6e7 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:11.973971 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af6a96-7458-424f-864d-fb454e73698f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.078310 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.079005 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.099159 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af6a96-7458-424f-864d-fb454e73698f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.121910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f102c-330b-4cdd-8b0d-a5f15b6cc6e7 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.145446 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2f07d-ab0a-460a-aafc-e1ed082a4073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.146787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2f07d-ab0a-460a-aafc-e1ed082a4073 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.147315 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2f07d-ab0a-460a-aafc-e1ed082a4073 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.147832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2f07d-ab0a-460a-aafc-e1ed082a4073 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.160997 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2f07d-ab0a-460a-aafc-e1ed082a4073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:12.165638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ae770-3395-452f-8eea-037686455c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.166627 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ae770-3395-452f-8eea-037686455c29 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.166994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ae770-3395-452f-8eea-037686455c29 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.167346 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ae770-3395-452f-8eea-037686455c29 None admin] PATH_INFO: `/v3/users/4357f6576ac047f5a047a133168f914b` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-bcc2f07d-ab0a-460a-aafc-e1ed082a4073 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:12.172800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:12.173835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:12.174769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:12.178559 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 123/245] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:12.189086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ae770-3395-452f-8eea-037686455c29 None admin] RBAC: Authorizing `identity:get_user(user_id=4357f6576ac047f5a047a133168f914b)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:12.189086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ae770-3395-452f-8eea-037686455c29 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:12.190566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2f07d-ab0a-460a-aafc-e1ed082a4073 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.191444 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 123/246] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:11 2022] GET /identity/v3/users/4357f6576ac047f5a047a133168f914b => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:12.197277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ae770-3395-452f-8eea-037686455c29 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.307073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2f07d-ab0a-460a-aafc-e1ed082a4073 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.328769 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ae770-3395-452f-8eea-037686455c29 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.345289 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767ea61-04be-414f-9dbe-d351ed455883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.345969 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767ea61-04be-414f-9dbe-d351ed455883 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.346256 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767ea61-04be-414f-9dbe-d351ed455883 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.346532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767ea61-04be-414f-9dbe-d351ed455883 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.347349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767ea61-04be-414f-9dbe-d351ed455883 None admin] RBAC: Adding query filter params (name=member) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:12.347662 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767ea61-04be-414f-9dbe-d351ed455883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:12.349875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767ea61-04be-414f-9dbe-d351ed455883 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:12.359199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 124/247] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:12.360683 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05fd79-264e-4fbc-8f88-e18e9215b184 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.361300 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05fd79-264e-4fbc-8f88-e18e9215b184 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.361300 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05fd79-264e-4fbc-8f88-e18e9215b184 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.362651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 125/248] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:12.365671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05fd79-264e-4fbc-8f88-e18e9215b184 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.369426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.370853 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.381053 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67dd54-f152-4dcd-a276-b49db8ab8937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.381881 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67dd54-f152-4dcd-a276-b49db8ab8937 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.382384 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67dd54-f152-4dcd-a276-b49db8ab8937 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.382899 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67dd54-f152-4dcd-a276-b49db8ab8937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.483322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67dd54-f152-4dcd-a276-b49db8ab8937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:12.484866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67dd54-f152-4dcd-a276-b49db8ab8937 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:12.497682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05fd79-264e-4fbc-8f88-e18e9215b184 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.537727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f3b07-6ab5-41e9-83cf-06b8975bd4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.539293 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3b07-6ab5-41e9-83cf-06b8975bd4ea None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.539809 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3b07-6ab5-41e9-83cf-06b8975bd4ea None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.540312 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3b07-6ab5-41e9-83cf-06b8975bd4ea None admin] PATH_INFO: `/v3/users/6db2b9b8f72b49ec96c2a0dbcbfc93de` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.542857 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f3b07-6ab5-41e9-83cf-06b8975bd4ea None admin] RBAC: Authorizing `identity:get_user(user_id=6db2b9b8f72b49ec96c2a0dbcbfc93de)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:12.544613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f3b07-6ab5-41e9-83cf-06b8975bd4ea None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:12.547605 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 126/249] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:12 2022] GET /identity/v3/users/6db2b9b8f72b49ec96c2a0dbcbfc93de => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:12.549561 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ad625-b486-4123-bc5b-b3931348ed9b None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.550544 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ad625-b486-4123-bc5b-b3931348ed9b None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.551197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ad625-b486-4123-bc5b-b3931348ed9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.574097 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-da7ad625-b486-4123-bc5b-b3931348ed9b None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:12.576189 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-da7ad625-b486-4123-bc5b-b3931348ed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:12.605949 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 124/250] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:12.606918 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67dd54-f152-4dcd-a276-b49db8ab8937 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.640215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.678344 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 127/251] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:12.681852 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ad625-b486-4123-bc5b-b3931348ed9b None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.686352 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.723171 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67dd54-f152-4dcd-a276-b49db8ab8937 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.767398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815bc6-9da0-434f-a306-66a2cd3e2958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.768299 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815bc6-9da0-434f-a306-66a2cd3e2958 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.768639 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815bc6-9da0-434f-a306-66a2cd3e2958 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.769016 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815bc6-9da0-434f-a306-66a2cd3e2958 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.770369 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03815bc6-9da0-434f-a306-66a2cd3e2958 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:12.772351 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03815bc6-9da0-434f-a306-66a2cd3e2958 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:12.778750 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 125/252] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:12 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:12.779480 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815bc6-9da0-434f-a306-66a2cd3e2958 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.814073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ad625-b486-4123-bc5b-b3931348ed9b None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.861364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90396a-865b-4cc1-b7eb-796fbbad57d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.862759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90396a-865b-4cc1-b7eb-796fbbad57d7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.863253 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90396a-865b-4cc1-b7eb-796fbbad57d7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.863807 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90396a-865b-4cc1-b7eb-796fbbad57d7 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.871552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90396a-865b-4cc1-b7eb-796fbbad57d7 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:12.873435 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90396a-865b-4cc1-b7eb-796fbbad57d7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:12.875570 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 128/253] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:12 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:12.876573 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90396a-865b-4cc1-b7eb-796fbbad57d7 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.883213 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.894705 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815bc6-9da0-434f-a306-66a2cd3e2958 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.926512 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac8bac-ab4a-408d-9783-d1cc78a99910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.927652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac8bac-ab4a-408d-9783-d1cc78a99910 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.927933 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac8bac-ab4a-408d-9783-d1cc78a99910 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.928234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac8bac-ab4a-408d-9783-d1cc78a99910 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.954961 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac8bac-ab4a-408d-9783-d1cc78a99910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-8fac8bac-ab4a-408d-9783-d1cc78a99910 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:12.964473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:12.965606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 126/254] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:12.971471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac8bac-ab4a-408d-9783-d1cc78a99910 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.003056 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:13.053215 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90396a-865b-4cc1-b7eb-796fbbad57d7 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.081796 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac8bac-ab4a-408d-9783-d1cc78a99910 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.094700 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fbbe0-5c5e-4eba-acbd-7993b399051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.096126 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fbbe0-5c5e-4eba-acbd-7993b399051c None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.096631 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fbbe0-5c5e-4eba-acbd-7993b399051c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.097531 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fbbe0-5c5e-4eba-acbd-7993b399051c None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/users/6db2b9b8f72b49ec96c2a0dbcbfc93de/roles/a661e4208e2047e69b45e282caa0683b` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.100747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fbbe0-5c5e-4eba-acbd-7993b399051c None admin] RBAC: Authorizing `identity:create_grant(project_id=9fc86a6aca544e2b9b180fb63e16f39a, user_id=6db2b9b8f72b49ec96c2a0dbcbfc93de, role_id=a661e4208e2047e69b45e282caa0683b)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.102429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fbbe0-5c5e-4eba-acbd-7993b399051c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:13.118407 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f232983-ff23-49f9-bbc2-14477a4656b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.119174 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f232983-ff23-49f9-bbc2-14477a4656b1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.119589 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f232983-ff23-49f9-bbc2-14477a4656b1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.120035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f232983-ff23-49f9-bbc2-14477a4656b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.120940 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f232983-ff23-49f9-bbc2-14477a4656b1 None admin] RBAC: Adding query filter params (role.id=8dff9e5a6c6340acb442a929d6affd4d, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a, user.id=4357f6576ac047f5a047a133168f914b) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:13.121259 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f232983-ff23-49f9-bbc2-14477a4656b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.122797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f232983-ff23-49f9-bbc2-14477a4656b1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:13.133980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 127/255] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:12 2022] GET /identity/v3/role_assignments?user.id=4357f6576ac047f5a047a133168f914b&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=8dff9e5a6c6340acb442a929d6affd4d => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:13.133980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df89c42-e562-4f2c-8a43-b52388b07407 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.133980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df89c42-e562-4f2c-8a43-b52388b07407 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.133980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df89c42-e562-4f2c-8a43-b52388b07407 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.133980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 128/256] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:13.133980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df89c42-e562-4f2c-8a43-b52388b07407 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.161599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:13.186013 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 129/257] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:24:12 2022] PUT /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/users/6db2b9b8f72b49ec96c2a0dbcbfc93de/roles/a661e4208e2047e69b45e282caa0683b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:13.190402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d166b-1b16-4aa1-9ece-925204b06a7d None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.190769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d166b-1b16-4aa1-9ece-925204b06a7d None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.191067 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d166b-1b16-4aa1-9ece-925204b06a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.233600 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-781d166b-1b16-4aa1-9ece-925204b06a7d None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:13.234949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-781d166b-1b16-4aa1-9ece-925204b06a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:13.348632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df89c42-e562-4f2c-8a43-b52388b07407 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.393863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 130/258] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:13.402273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03013d2d-72d9-498c-86d6-e8d9082da12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.403047 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03013d2d-72d9-498c-86d6-e8d9082da12b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.403384 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03013d2d-72d9-498c-86d6-e8d9082da12b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.403668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03013d2d-72d9-498c-86d6-e8d9082da12b None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.404447 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03013d2d-72d9-498c-86d6-e8d9082da12b None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:13.404755 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03013d2d-72d9-498c-86d6-e8d9082da12b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.406231 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03013d2d-72d9-498c-86d6-e8d9082da12b None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:13.416766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 129/259] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:13.421115 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d166b-1b16-4aa1-9ece-925204b06a7d None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.423689 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03013d2d-72d9-498c-86d6-e8d9082da12b None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.536027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:13.549188 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:13.587142 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d166b-1b16-4aa1-9ece-925204b06a7d None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.594834 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03013d2d-72d9-498c-86d6-e8d9082da12b None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.623521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46b168-8cac-48d5-ba3a-ed772f7d6c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.624346 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46b168-8cac-48d5-ba3a-ed772f7d6c8c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.624625 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46b168-8cac-48d5-ba3a-ed772f7d6c8c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.624897 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46b168-8cac-48d5-ba3a-ed772f7d6c8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.647324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46b168-8cac-48d5-ba3a-ed772f7d6c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-7d46b168-8cac-48d5-ba3a-ed772f7d6c8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:13.655607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:13.656626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:13.657532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:13.659254 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 131/260] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:24:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:13.668577 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46b168-8cac-48d5-ba3a-ed772f7d6c8c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.675946 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdbc3a-1a08-44f2-842f-ef01c2f02621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.677911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdbc3a-1a08-44f2-842f-ef01c2f02621 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.678354 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdbc3a-1a08-44f2-842f-ef01c2f02621 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.678831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdbc3a-1a08-44f2-842f-ef01c2f02621 None admin] PATH_INFO: `/v3/users/45ecc56cd7c64491ae944ab468e09186` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.683366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdbc3a-1a08-44f2-842f-ef01c2f02621 None admin] RBAC: Authorizing `identity:get_user(user_id=45ecc56cd7c64491ae944ab468e09186)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.685105 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdbc3a-1a08-44f2-842f-ef01c2f02621 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:13.687136 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 130/261] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:13 2022] GET /identity/v3/users/45ecc56cd7c64491ae944ab468e09186 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:13.692233 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdbc3a-1a08-44f2-842f-ef01c2f02621 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.822338 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46b168-8cac-48d5-ba3a-ed772f7d6c8c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.867118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:13.889102 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e2f3a-9871-4a81-b567-e1d1e445beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.889836 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e2f3a-9871-4a81-b567-e1d1e445beb6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.890126 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e2f3a-9871-4a81-b567-e1d1e445beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.890410 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e2f3a-9871-4a81-b567-e1d1e445beb6 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.891212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e2f3a-9871-4a81-b567-e1d1e445beb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:13.892013 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e2f3a-9871-4a81-b567-e1d1e445beb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.893599 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e2f3a-9871-4a81-b567-e1d1e445beb6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:13.905511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 132/262] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:13.914923 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e2f3a-9871-4a81-b567-e1d1e445beb6 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.915800 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdbc3a-1a08-44f2-842f-ef01c2f02621 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.995339 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10ae6f-cdba-4782-b093-6c766125ecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.995958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10ae6f-cdba-4782-b093-6c766125ecc4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.996217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10ae6f-cdba-4782-b093-6c766125ecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.996466 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10ae6f-cdba-4782-b093-6c766125ecc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:14.042647 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:14.082541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e2f3a-9871-4a81-b567-e1d1e445beb6 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:14.138318 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10ae6f-cdba-4782-b093-6c766125ecc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:14.143764 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10ae6f-cdba-4782-b093-6c766125ecc4 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:14.149728 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9d3e1-20e8-431c-844f-82f0313b8652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:14.150853 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9d3e1-20e8-431c-844f-82f0313b8652 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:14.151150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9d3e1-20e8-431c-844f-82f0313b8652 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:14.151437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9d3e1-20e8-431c-844f-82f0313b8652 None admin] PATH_INFO: `/v3/users/45ecc56cd7c64491ae944ab468e09186` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:14.152820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9d3e1-20e8-431c-844f-82f0313b8652 None admin] RBAC: Authorizing `identity:get_user(user_id=45ecc56cd7c64491ae944ab468e09186)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:14.159599 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9d3e1-20e8-431c-844f-82f0313b8652 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:14.161699 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 133/263] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:13 2022] GET /identity/v3/users/45ecc56cd7c64491ae944ab468e09186 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:14.167369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9d3e1-20e8-431c-844f-82f0313b8652 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:14.271934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:14.346887 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 131/264] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:24:14.353241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10ae6f-cdba-4782-b093-6c766125ecc4 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:14.377115 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9d3e1-20e8-431c-844f-82f0313b8652 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:14.432811 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:14.465008 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e73a5-d42a-482f-8d98-cc129b067f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:14.465748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e73a5-d42a-482f-8d98-cc129b067f23 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:14.466036 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e73a5-d42a-482f-8d98-cc129b067f23 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:14.466313 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e73a5-d42a-482f-8d98-cc129b067f23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:14.497696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10ae6f-cdba-4782-b093-6c766125ecc4 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:14.559972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c1530-3a64-4954-9c7c-e36cce5a7750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:14.561219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c1530-3a64-4954-9c7c-e36cce5a7750 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:14.561733 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c1530-3a64-4954-9c7c-e36cce5a7750 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:14.562242 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c1530-3a64-4954-9c7c-e36cce5a7750 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:14.563733 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c1530-3a64-4954-9c7c-e36cce5a7750 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:14.565444 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c1530-3a64-4954-9c7c-e36cce5a7750 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:14.567433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 132/265] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:14 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:14.573326 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c1530-3a64-4954-9c7c-e36cce5a7750 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:14.646366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e73a5-d42a-482f-8d98-cc129b067f23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:14.647965 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e73a5-d42a-482f-8d98-cc129b067f23 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:14.754968 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:14.801508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c1530-3a64-4954-9c7c-e36cce5a7750 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:14.839123 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:14.861848 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 134/266] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:14.866506 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e73a5-d42a-482f-8d98-cc129b067f23 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:14.870518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f48ab9-963e-45b7-893d-7218a11fc5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:14.871233 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f48ab9-963e-45b7-893d-7218a11fc5b4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:14.871517 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f48ab9-963e-45b7-893d-7218a11fc5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:14.871784 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f48ab9-963e-45b7-893d-7218a11fc5b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:14.872647 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f48ab9-963e-45b7-893d-7218a11fc5b4 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a, user.id=45ecc56cd7c64491ae944ab468e09186) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:14.872965 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f48ab9-963e-45b7-893d-7218a11fc5b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:14.874431 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f48ab9-963e-45b7-893d-7218a11fc5b4 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:14.891373 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 133/267] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:14 2022] GET /identity/v3/role_assignments?user.id=45ecc56cd7c64491ae944ab468e09186&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:15.007329 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e73a5-d42a-482f-8d98-cc129b067f23 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:15.069535 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cb60b-f741-45f8-9a9e-f697d16f3cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:15.070425 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cb60b-f741-45f8-9a9e-f697d16f3cd9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.070739 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cb60b-f741-45f8-9a9e-f697d16f3cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.071016 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cb60b-f741-45f8-9a9e-f697d16f3cd9 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.072264 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cb60b-f741-45f8-9a9e-f697d16f3cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:15.073773 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cb60b-f741-45f8-9a9e-f697d16f3cd9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:15.075927 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 135/268] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:14 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:15.081847 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f48ab9-963e-45b7-893d-7218a11fc5b4 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:15.118871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb045c5-efa8-4fda-9a91-0aed22deaf1b None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.119435 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb045c5-efa8-4fda-9a91-0aed22deaf1b None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.119435 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb045c5-efa8-4fda-9a91-0aed22deaf1b None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.122221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 136/269] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:15.134041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a24a-1095-4d80-8981-9761b38344a3 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.134322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a24a-1095-4d80-8981-9761b38344a3 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.134620 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a24a-1095-4d80-8981-9761b38344a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.162992 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-7629a24a-1095-4d80-8981-9761b38344a3 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:15.164221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-7629a24a-1095-4d80-8981-9761b38344a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:15.187481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:15.310738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 137/270] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:15.311914 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f48ab9-963e-45b7-893d-7218a11fc5b4 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:15.332640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629a24a-1095-4d80-8981-9761b38344a3 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:15.421915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7745c-89ae-4277-b524-788185abe34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:15.422517 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7745c-89ae-4277-b524-788185abe34e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.422824 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7745c-89ae-4277-b524-788185abe34e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.423100 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7745c-89ae-4277-b524-788185abe34e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.423947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7745c-89ae-4277-b524-788185abe34e None admin] RBAC: Adding query filter params (role.id=920e2cadf3044abda66c715e1c89f4e3, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a, user.id=45ecc56cd7c64491ae944ab468e09186) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:15.424258 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7745c-89ae-4277-b524-788185abe34e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:15.425721 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7745c-89ae-4277-b524-788185abe34e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:15.442897 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 134/271] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:15 2022] GET /identity/v3/role_assignments?user.id=45ecc56cd7c64491ae944ab468e09186&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=920e2cadf3044abda66c715e1c89f4e3 => generated 608 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:15.463462 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629a24a-1095-4d80-8981-9761b38344a3 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:15.500946 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760b01-d94b-47b6-93b8-d2b24162fe4d None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.501267 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760b01-d94b-47b6-93b8-d2b24162fe4d None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.501520 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760b01-d94b-47b6-93b8-d2b24162fe4d None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.504633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 135/272] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:15.513509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854913d4-b654-465c-9d9e-271ba3cdc765 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.513823 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854913d4-b654-465c-9d9e-271ba3cdc765 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.514051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854913d4-b654-465c-9d9e-271ba3cdc765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.529365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d2e85-56a8-42e3-9d56-9dca71bf09fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:15.530188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d2e85-56a8-42e3-9d56-9dca71bf09fc None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.530470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d2e85-56a8-42e3-9d56-9dca71bf09fc None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.530785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d2e85-56a8-42e3-9d56-9dca71bf09fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.544675 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d2e85-56a8-42e3-9d56-9dca71bf09fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:15.551708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-854913d4-b654-465c-9d9e-271ba3cdc765 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-8d8d2e85-56a8-42e3-9d56-9dca71bf09fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:15.553003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:15.554109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:15.555547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 138/273] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:15.558838 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-854913d4-b654-465c-9d9e-271ba3cdc765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:15.560907 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d2e85-56a8-42e3-9d56-9dca71bf09fc None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:15.580413 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:15.638970 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:15.685704 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 136/274] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:15.691127 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d2e85-56a8-42e3-9d56-9dca71bf09fc None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:15.728029 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cca9fd-d270-434a-9f1a-8398cd7dab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:15.728723 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cca9fd-d270-434a-9f1a-8398cd7dab20 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.729008 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cca9fd-d270-434a-9f1a-8398cd7dab20 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.729289 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cca9fd-d270-434a-9f1a-8398cd7dab20 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.730064 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cca9fd-d270-434a-9f1a-8398cd7dab20 None admin] RBAC: Adding query filter params (name=member) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:15.730376 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cca9fd-d270-434a-9f1a-8398cd7dab20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:15.731867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cca9fd-d270-434a-9f1a-8398cd7dab20 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:15.733864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854913d4-b654-465c-9d9e-271ba3cdc765 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:15.757595 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 139/275] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:15.761589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cca9fd-d270-434a-9f1a-8398cd7dab20 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:15.864723 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:15.897847 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854913d4-b654-465c-9d9e-271ba3cdc765 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:15.907908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cca9fd-d270-434a-9f1a-8398cd7dab20 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:15.950515 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cd425-c50c-4a98-80d3-1cd1c2d92448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:15.954126 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cd425-c50c-4a98-80d3-1cd1c2d92448 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.954739 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cd425-c50c-4a98-80d3-1cd1c2d92448 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.955031 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cd425-c50c-4a98-80d3-1cd1c2d92448 None admin] PATH_INFO: `/v3/domains/default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.956509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cd425-c50c-4a98-80d3-1cd1c2d92448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:15.959192 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cd425-c50c-4a98-80d3-1cd1c2d92448 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:15.961214 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 137/276] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:15.962109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fb951-be7f-429f-8542-7c31f8bc00a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:15.963782 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fb951-be7f-429f-8542-7c31f8bc00a8 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.963782 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fb951-be7f-429f-8542-7c31f8bc00a8 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.963782 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fb951-be7f-429f-8542-7c31f8bc00a8 None admin] PATH_INFO: `/v3/users/e34182811e9b4b14a67934e07428a79d` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.966786 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cd425-c50c-4a98-80d3-1cd1c2d92448 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:15.981515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fb951-be7f-429f-8542-7c31f8bc00a8 None admin] RBAC: Authorizing `identity:get_user(user_id=e34182811e9b4b14a67934e07428a79d)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:15.983496 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fb951-be7f-429f-8542-7c31f8bc00a8 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:15.985905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 140/277] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:15 2022] GET /identity/v3/users/e34182811e9b4b14a67934e07428a79d => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:15.993200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fb951-be7f-429f-8542-7c31f8bc00a8 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:16.029674 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:16.091183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cd425-c50c-4a98-80d3-1cd1c2d92448 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.105730 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fb951-be7f-429f-8542-7c31f8bc00a8 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.128110 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab28f0d-b9b5-4385-9fb6-877175e80637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:16.128852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28f0d-b9b5-4385-9fb6-877175e80637 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.129240 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28f0d-b9b5-4385-9fb6-877175e80637 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.129617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28f0d-b9b5-4385-9fb6-877175e80637 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.131089 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab28f0d-b9b5-4385-9fb6-877175e80637 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:16.132723 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab28f0d-b9b5-4385-9fb6-877175e80637 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:16.136617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:16.147390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55544c53-c1b4-494f-9ae2-f04bf4be6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:16.148111 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55544c53-c1b4-494f-9ae2-f04bf4be6547 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.157030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55544c53-c1b4-494f-9ae2-f04bf4be6547 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.157030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55544c53-c1b4-494f-9ae2-f04bf4be6547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.157030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55544c53-c1b4-494f-9ae2-f04bf4be6547 None admin] RBAC: Adding query filter params (role.id=a661e4208e2047e69b45e282caa0683b, user.id=e34182811e9b4b14a67934e07428a79d, scope.system=all) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:16.157030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55544c53-c1b4-494f-9ae2-f04bf4be6547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:16.157030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55544c53-c1b4-494f-9ae2-f04bf4be6547 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:16.157030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 141/278] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:24:15 2022] GET /identity/v3/role_assignments?user.id=e34182811e9b4b14a67934e07428a79d&scope.system=all&role.id=a661e4208e2047e69b45e282caa0683b => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:16.264320 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 138/279] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:24:15 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:24:16.447364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e3a7-6837-469b-89ef-515e7014b85f None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.447648 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e3a7-6837-469b-89ef-515e7014b85f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.447928 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e3a7-6837-469b-89ef-515e7014b85f None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.449776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 142/280] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:16.455627 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a129ae6-987a-40ba-87c4-a5a2dbda2194 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.455930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a129ae6-987a-40ba-87c4-a5a2dbda2194 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.456199 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a129ae6-987a-40ba-87c4-a5a2dbda2194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.475512 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-7a129ae6-987a-40ba-87c4-a5a2dbda2194 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:16.476727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-7a129ae6-987a-40ba-87c4-a5a2dbda2194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:16.507841 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440661a-7c4b-4e80-8861-b74f0622df26 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.508499 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440661a-7c4b-4e80-8861-b74f0622df26 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.508995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440661a-7c4b-4e80-8861-b74f0622df26 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.510897 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 143/281] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:16.516650 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0614250-37db-4fae-bd11-9f56963dc6eb None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.517215 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0614250-37db-4fae-bd11-9f56963dc6eb None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.517721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0614250-37db-4fae-bd11-9f56963dc6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.538206 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-b0614250-37db-4fae-bd11-9f56963dc6eb None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:16.539736 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-b0614250-37db-4fae-bd11-9f56963dc6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:16.554734 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 139/282] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:16.578217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a129ae6-987a-40ba-87c4-a5a2dbda2194 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:16.619893 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 144/283] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:16.622185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:16.643707 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0614250-37db-4fae-bd11-9f56963dc6eb None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:16.710464 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a129ae6-987a-40ba-87c4-a5a2dbda2194 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.749225 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e89d41-beb7-4ffa-8e9b-2ce797006871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:16.750429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e89d41-beb7-4ffa-8e9b-2ce797006871 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.750994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e89d41-beb7-4ffa-8e9b-2ce797006871 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.751472 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e89d41-beb7-4ffa-8e9b-2ce797006871 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.765154 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e89d41-beb7-4ffa-8e9b-2ce797006871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-65e89d41-beb7-4ffa-8e9b-2ce797006871 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:16.774066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:16.775322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:16.776204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:16.777257 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0614250-37db-4fae-bd11-9f56963dc6eb None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.779354 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 140/284] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:16.785396 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e89d41-beb7-4ffa-8e9b-2ce797006871 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:16.806852 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:16.819774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34b5fa-fc7e-4dcb-a7da-19ed2fa04b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:16.821197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34b5fa-fc7e-4dcb-a7da-19ed2fa04b14 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.821197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34b5fa-fc7e-4dcb-a7da-19ed2fa04b14 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.821197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34b5fa-fc7e-4dcb-a7da-19ed2fa04b14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.840100 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34b5fa-fc7e-4dcb-a7da-19ed2fa04b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-6b34b5fa-fc7e-4dcb-a7da-19ed2fa04b14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:16.848671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:16.849744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:16.850702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:16.851395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 145/285] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:16.855847 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34b5fa-fc7e-4dcb-a7da-19ed2fa04b14 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:16.977549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:16.994894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34b5fa-fc7e-4dcb-a7da-19ed2fa04b14 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.999460 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e89d41-beb7-4ffa-8e9b-2ce797006871 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:17.036531 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4048-47ac-4af0-9ca1-02317eeb6661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:17.037515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4048-47ac-4af0-9ca1-02317eeb6661 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:17.037993 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4048-47ac-4af0-9ca1-02317eeb6661 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:17.038462 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4048-47ac-4af0-9ca1-02317eeb6661 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:17.039451 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d4048-47ac-4af0-9ca1-02317eeb6661 None admin] RBAC: Adding query filter params (name=member) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:17.039953 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d4048-47ac-4af0-9ca1-02317eeb6661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:17.042158 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d4048-47ac-4af0-9ca1-02317eeb6661 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:17.053683 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 146/286] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:17.059273 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4048-47ac-4af0-9ca1-02317eeb6661 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:17.099382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da4c39-19e0-43d5-ad27-f1b84ac42cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:17.100088 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da4c39-19e0-43d5-ad27-f1b84ac42cb2 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:17.100379 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da4c39-19e0-43d5-ad27-f1b84ac42cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:17.100660 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da4c39-19e0-43d5-ad27-f1b84ac42cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:17.101505 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da4c39-19e0-43d5-ad27-f1b84ac42cb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:17.101742 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da4c39-19e0-43d5-ad27-f1b84ac42cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:17.103169 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da4c39-19e0-43d5-ad27-f1b84ac42cb2 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:17.118948 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:17.120680 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 141/287] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:17.127635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da4c39-19e0-43d5-ad27-f1b84ac42cb2 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:17.247747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4048-47ac-4af0-9ca1-02317eeb6661 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:17.248633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da4c39-19e0-43d5-ad27-f1b84ac42cb2 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:17.287093 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae8592-80d4-41e3-a106-98b96ed9d14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:17.288228 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8592-80d4-41e3-a106-98b96ed9d14b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:17.288672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8592-80d4-41e3-a106-98b96ed9d14b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:17.289129 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8592-80d4-41e3-a106-98b96ed9d14b None admin] PATH_INFO: `/v3/users/4357f6576ac047f5a047a133168f914b` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:17.290518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8592-80d4-41e3-a106-98b96ed9d14b None admin] RBAC: Authorizing `identity:get_user(user_id=4357f6576ac047f5a047a133168f914b)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:17.292181 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8592-80d4-41e3-a106-98b96ed9d14b None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:17.294361 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 142/288] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:17 2022] GET /identity/v3/users/4357f6576ac047f5a047a133168f914b => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:17.299288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae8592-80d4-41e3-a106-98b96ed9d14b None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:17.321820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6aeb80-2f11-4f0d-955d-c401389b9812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:17.324574 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aeb80-2f11-4f0d-955d-c401389b9812 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:17.325201 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aeb80-2f11-4f0d-955d-c401389b9812 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:17.326924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aeb80-2f11-4f0d-955d-c401389b9812 None admin] PATH_INFO: `/v3/users/6db2b9b8f72b49ec96c2a0dbcbfc93de` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:17.330223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6aeb80-2f11-4f0d-955d-c401389b9812 None admin] RBAC: Authorizing `identity:get_user(user_id=6db2b9b8f72b49ec96c2a0dbcbfc93de)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:17.334906 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6aeb80-2f11-4f0d-955d-c401389b9812 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:17.339219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 147/289] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:17 2022] GET /identity/v3/users/6db2b9b8f72b49ec96c2a0dbcbfc93de => generated 297 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:17.345994 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6aeb80-2f11-4f0d-955d-c401389b9812 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:17.352604 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:17.502034 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae8592-80d4-41e3-a106-98b96ed9d14b None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:17.512987 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6aeb80-2f11-4f0d-955d-c401389b9812 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:17.539209 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:17.549493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba7621-cc2d-4754-b0f6-ce6d33f5693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:17.550245 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba7621-cc2d-4754-b0f6-ce6d33f5693e None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:17.550593 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba7621-cc2d-4754-b0f6-ce6d33f5693e None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:17.550957 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba7621-cc2d-4754-b0f6-ce6d33f5693e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:17.592431 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a4fb6-73eb-4917-a668-36f01809e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:17.593321 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a4fb6-73eb-4917-a668-36f01809e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:17.593606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a4fb6-73eb-4917-a668-36f01809e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:17.593884 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a4fb6-73eb-4917-a668-36f01809e4e2 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:17.599865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a4fb6-73eb-4917-a668-36f01809e4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:17.601365 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a4fb6-73eb-4917-a668-36f01809e4e2 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:17.603582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 143/290] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:17 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:17.611471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a4fb6-73eb-4917-a668-36f01809e4e2 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:17.623419 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba7621-cc2d-4754-b0f6-ce6d33f5693e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:17.625029 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba7621-cc2d-4754-b0f6-ce6d33f5693e None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:17.731024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 148/291] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:17.736696 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba7621-cc2d-4754-b0f6-ce6d33f5693e None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:17.763086 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:17.814728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:17.835613 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a4fb6-73eb-4917-a668-36f01809e4e2 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:17.850414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba7621-cc2d-4754-b0f6-ce6d33f5693e None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:17.890395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046b8e1-2c90-48b2-8256-0d4f4c2a0cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:17.891772 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b8e1-2c90-48b2-8256-0d4f4c2a0cb7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:17.892232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b8e1-2c90-48b2-8256-0d4f4c2a0cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:17.892661 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b8e1-2c90-48b2-8256-0d4f4c2a0cb7 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:17.894242 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046b8e1-2c90-48b2-8256-0d4f4c2a0cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:17.896503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046b8e1-2c90-48b2-8256-0d4f4c2a0cb7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:17.898739 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 149/292] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:17 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:17.904478 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046b8e1-2c90-48b2-8256-0d4f4c2a0cb7 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:17.911316 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaa44c-7104-4e49-9a85-086f400766ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:17.912804 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa44c-7104-4e49-9a85-086f400766ae None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:17.913087 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa44c-7104-4e49-9a85-086f400766ae None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:17.913364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa44c-7104-4e49-9a85-086f400766ae None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/users/4357f6576ac047f5a047a133168f914b/roles/8dff9e5a6c6340acb442a929d6affd4d` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:17.915467 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaa44c-7104-4e49-9a85-086f400766ae None admin] RBAC: Authorizing `identity:create_grant(project_id=9fc86a6aca544e2b9b180fb63e16f39a, user_id=4357f6576ac047f5a047a133168f914b, role_id=8dff9e5a6c6340acb442a929d6affd4d)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:17.916901 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaa44c-7104-4e49-9a85-086f400766ae None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:17.995011 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:18.013221 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 144/293] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:24:17 2022] PUT /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/users/4357f6576ac047f5a047a133168f914b/roles/8dff9e5a6c6340acb442a929d6affd4d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:18.013490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046b8e1-2c90-48b2-8256-0d4f4c2a0cb7 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:18.053480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd992434-cefd-42da-934b-bb485b041343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:18.054414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd992434-cefd-42da-934b-bb485b041343 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:18.054979 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd992434-cefd-42da-934b-bb485b041343 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:18.055420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd992434-cefd-42da-934b-bb485b041343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:18.056465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd992434-cefd-42da-934b-bb485b041343 None admin] RBAC: Adding query filter params (role.id=a661e4208e2047e69b45e282caa0683b, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a, user.id=6db2b9b8f72b49ec96c2a0dbcbfc93de) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:18.056952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd992434-cefd-42da-934b-bb485b041343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:18.058702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd992434-cefd-42da-934b-bb485b041343 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:18.066329 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 150/294] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:17 2022] GET /identity/v3/role_assignments?user.id=6db2b9b8f72b49ec96c2a0dbcbfc93de&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=a661e4208e2047e69b45e282caa0683b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:18.902584 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d040c-b9fd-4b2f-aa7f-c6c334668d5e None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:18.903147 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d040c-b9fd-4b2f-aa7f-c6c334668d5e None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:18.903230 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d040c-b9fd-4b2f-aa7f-c6c334668d5e None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:18.905057 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 145/295] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:18.911151 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156d90-399f-43e1-a39c-e5e5a3efa39b None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:18.911731 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156d90-399f-43e1-a39c-e5e5a3efa39b None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:18.911731 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156d90-399f-43e1-a39c-e5e5a3efa39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:18.934218 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-65156d90-399f-43e1-a39c-e5e5a3efa39b None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:18.935836 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-65156d90-399f-43e1-a39c-e5e5a3efa39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:19.007864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 151/296] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:19.030471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d040c-b9fd-4b2f-aa7f-c6c334668d5e None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.088762 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc52a7f-5334-42fc-a25e-d52679cd4062 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.089061 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc52a7f-5334-42fc-a25e-d52679cd4062 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.089271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc52a7f-5334-42fc-a25e-d52679cd4062 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.090880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 152/297] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:19.091932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828aeba-5c89-4c00-93a8-9884cb091274 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.092324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828aeba-5c89-4c00-93a8-9884cb091274 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.092599 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828aeba-5c89-4c00-93a8-9884cb091274 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.093961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 153/298] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:19.099084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0faac-6477-48af-a8cd-782b1eb35ef7 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.099375 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0faac-6477-48af-a8cd-782b1eb35ef7 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.099748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0faac-6477-48af-a8cd-782b1eb35ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.116419 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-5da0faac-6477-48af-a8cd-782b1eb35ef7 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:19.117780 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-5da0faac-6477-48af-a8cd-782b1eb35ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:19.144405 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d040c-b9fd-4b2f-aa7f-c6c334668d5e None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:19.182346 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f8660-22ed-4528-9bda-7f68ed405657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:19.183197 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8660-22ed-4528-9bda-7f68ed405657 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.183484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8660-22ed-4528-9bda-7f68ed405657 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.183802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8660-22ed-4528-9bda-7f68ed405657 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.186789 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 154/299] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:19.187975 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493f0ea-2c63-4567-abbb-e3f6d25ba07c None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.188262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493f0ea-2c63-4567-abbb-e3f6d25ba07c None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.188538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493f0ea-2c63-4567-abbb-e3f6d25ba07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.194895 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:19.205736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f8660-22ed-4528-9bda-7f68ed405657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:19.209116 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-8493f0ea-2c63-4567-abbb-e3f6d25ba07c None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:19.210369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-8493f0ea-2c63-4567-abbb-e3f6d25ba07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-db6f8660-22ed-4528-9bda-7f68ed405657 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:19.214003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:19.215049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:19.215947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 146/300] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:19.216698 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f8660-22ed-4528-9bda-7f68ed405657 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.229000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:19.289402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 155/301] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:19.290258 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493f0ea-2c63-4567-abbb-e3f6d25ba07c None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.330420 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f8660-22ed-4528-9bda-7f68ed405657 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:19.375811 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47357959-923b-42b5-bb68-66770580751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:19.376825 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357959-923b-42b5-bb68-66770580751d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.376964 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357959-923b-42b5-bb68-66770580751d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.377180 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357959-923b-42b5-bb68-66770580751d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.389272 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47357959-923b-42b5-bb68-66770580751d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-47357959-923b-42b5-bb68-66770580751d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:19.397086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:19.398155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 147/302] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:19.399607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47357959-923b-42b5-bb68-66770580751d None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.415168 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493f0ea-2c63-4567-abbb-e3f6d25ba07c None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:19.455608 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16e7dc-2a72-4200-8678-fa00c5bef675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:19.456295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16e7dc-2a72-4200-8678-fa00c5bef675 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.456642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16e7dc-2a72-4200-8678-fa00c5bef675 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.456922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16e7dc-2a72-4200-8678-fa00c5bef675 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.457708 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16e7dc-2a72-4200-8678-fa00c5bef675 None admin] RBAC: Adding query filter params (name=member) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:19.458025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16e7dc-2a72-4200-8678-fa00c5bef675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:19.459514 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16e7dc-2a72-4200-8678-fa00c5bef675 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:19.460996 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:19.472170 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 156/303] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:19.472170 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16e7dc-2a72-4200-8678-fa00c5bef675 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.517167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:19.521485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47357959-923b-42b5-bb68-66770580751d None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:19.556754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadf0c0-9d52-43f8-96b6-a9d8619c112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:19.557563 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf0c0-9d52-43f8-96b6-a9d8619c112e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.557853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf0c0-9d52-43f8-96b6-a9d8619c112e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.558131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf0c0-9d52-43f8-96b6-a9d8619c112e None admin] PATH_INFO: `/v3/domains/default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.559416 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadf0c0-9d52-43f8-96b6-a9d8619c112e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:19.560888 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadf0c0-9d52-43f8-96b6-a9d8619c112e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:19.566710 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 148/304] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:19.566710 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadf0c0-9d52-43f8-96b6-a9d8619c112e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.586051 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16e7dc-2a72-4200-8678-fa00c5bef675 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:19.625651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b13e9-8e75-4242-b0d3-30bc9f543672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:19.626382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b13e9-8e75-4242-b0d3-30bc9f543672 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.626631 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b13e9-8e75-4242-b0d3-30bc9f543672 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.626919 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b13e9-8e75-4242-b0d3-30bc9f543672 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.627700 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b13e9-8e75-4242-b0d3-30bc9f543672 None admin] RBAC: Adding query filter params (name=reader) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:19.628011 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b13e9-8e75-4242-b0d3-30bc9f543672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:19.629395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b13e9-8e75-4242-b0d3-30bc9f543672 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:19.637732 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 157/305] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:19.640413 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b13e9-8e75-4242-b0d3-30bc9f543672 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.671070 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadf0c0-9d52-43f8-96b6-a9d8619c112e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:19.708005 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0153c-0784-441b-a2dc-f70c8f4414aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:19.709434 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0153c-0784-441b-a2dc-f70c8f4414aa None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.709712 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0153c-0784-441b-a2dc-f70c8f4414aa None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.709983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0153c-0784-441b-a2dc-f70c8f4414aa None admin] PATH_INFO: `/v3/users/e34182811e9b4b14a67934e07428a79d` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.711219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0153c-0784-441b-a2dc-f70c8f4414aa None admin] RBAC: Authorizing `identity:get_user(user_id=e34182811e9b4b14a67934e07428a79d)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:19.712653 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0153c-0784-441b-a2dc-f70c8f4414aa None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:19.719137 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 149/306] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:19 2022] GET /identity/v3/users/e34182811e9b4b14a67934e07428a79d => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:19.719137 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0153c-0784-441b-a2dc-f70c8f4414aa None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.720685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:19.720910 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:19.762501 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b13e9-8e75-4242-b0d3-30bc9f543672 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:19.815640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267dd2d-e841-4e4a-a84c-533ec561f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:19.816457 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267dd2d-e841-4e4a-a84c-533ec561f8d0 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.816872 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267dd2d-e841-4e4a-a84c-533ec561f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.817283 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267dd2d-e841-4e4a-a84c-533ec561f8d0 None admin] PATH_INFO: `/v3/groups` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.818133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267dd2d-e841-4e4a-a84c-533ec561f8d0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:19.820237 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267dd2d-e841-4e4a-a84c-533ec561f8d0 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:19.832417 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0153c-0784-441b-a2dc-f70c8f4414aa None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:19.866824 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff38125-ad1f-41ea-8f33-6842d650a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:19.867761 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff38125-ad1f-41ea-8f33-6842d650a85a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.868046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff38125-ad1f-41ea-8f33-6842d650a85a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.868323 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff38125-ad1f-41ea-8f33-6842d650a85a None admin] PATH_INFO: `/v3/users/a6338b3319ae4d57bbbc8bb7024b500c` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.884835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff38125-ad1f-41ea-8f33-6842d650a85a None admin] RBAC: Authorizing `identity:get_user(user_id=a6338b3319ae4d57bbbc8bb7024b500c)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:19.884835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff38125-ad1f-41ea-8f33-6842d650a85a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:19.885428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 150/307] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:19 2022] GET /identity/v3/users/a6338b3319ae4d57bbbc8bb7024b500c => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:19.886181 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff38125-ad1f-41ea-8f33-6842d650a85a None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.909184 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 158/308] 10.222.0.89 () {60 vars in 1134 bytes} [Thu May 19 20:24:19 2022] POST /identity/v3/groups => generated 229 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:19.913892 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267dd2d-e841-4e4a-a84c-533ec561f8d0 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.980503 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:20.036417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267dd2d-e841-4e4a-a84c-533ec561f8d0 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:20.040779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff38125-ad1f-41ea-8f33-6842d650a85a None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:20.058502 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:20.079039 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd4c3a-a0dd-4ef2-a73b-b1a3d886d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:20.079615 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd4c3a-a0dd-4ef2-a73b-b1a3d886d0ac None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:20.079998 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd4c3a-a0dd-4ef2-a73b-b1a3d886d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:20.080465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd4c3a-a0dd-4ef2-a73b-b1a3d886d0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:20.081328 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd4c3a-a0dd-4ef2-a73b-b1a3d886d0ac None admin] RBAC: Adding query filter params (role.id=8dff9e5a6c6340acb442a929d6affd4d, user.id=a6338b3319ae4d57bbbc8bb7024b500c, scope.system=all) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:20.081748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd4c3a-a0dd-4ef2-a73b-b1a3d886d0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:20.083699 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd4c3a-a0dd-4ef2-a73b-b1a3d886d0ac None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:20.093286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a055bd-eb98-4f00-9821-9cc3feadba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:20.094485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a055bd-eb98-4f00-9821-9cc3feadba8c None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:20.094839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 159/309] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:24:19 2022] GET /identity/v3/role_assignments?user.id=a6338b3319ae4d57bbbc8bb7024b500c&scope.system=all&role.id=8dff9e5a6c6340acb442a929d6affd4d => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:20.095130 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a055bd-eb98-4f00-9821-9cc3feadba8c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:20.095561 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a055bd-eb98-4f00-9821-9cc3feadba8c None admin] PATH_INFO: `/v3/system/users/e34182811e9b4b14a67934e07428a79d/roles/a661e4208e2047e69b45e282caa0683b` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:20.097461 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a055bd-eb98-4f00-9821-9cc3feadba8c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e34182811e9b4b14a67934e07428a79d, role_id=a661e4208e2047e69b45e282caa0683b)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:20.099686 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a055bd-eb98-4f00-9821-9cc3feadba8c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:20.196567 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 151/310] 10.222.0.89 () {58 vars in 1334 bytes} [Thu May 19 20:24:19 2022] PUT /identity/v3/system/users/e34182811e9b4b14a67934e07428a79d/roles/a661e4208e2047e69b45e282caa0683b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:20.557762 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e43135-3e98-4a50-a131-26b4924eefb0 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:20.557958 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e43135-3e98-4a50-a131-26b4924eefb0 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:20.558230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e43135-3e98-4a50-a131-26b4924eefb0 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:20.559849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 160/311] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:20.565089 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1684-0943-4b84-8648-0fe89b151110 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:20.565385 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1684-0943-4b84-8648-0fe89b151110 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:20.565678 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1684-0943-4b84-8648-0fe89b151110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:20.583953 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-9c9b1684-0943-4b84-8648-0fe89b151110 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:20.585164 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-9c9b1684-0943-4b84-8648-0fe89b151110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:20.656938 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 152/312] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:20.681558 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e43135-3e98-4a50-a131-26b4924eefb0 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:20.793223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e43135-3e98-4a50-a131-26b4924eefb0 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:20.829972 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae643a6-cbc4-4ad2-95a9-0c3dfa3fdc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:20.830721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae643a6-cbc4-4ad2-95a9-0c3dfa3fdc92 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:20.830999 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae643a6-cbc4-4ad2-95a9-0c3dfa3fdc92 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:20.831270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae643a6-cbc4-4ad2-95a9-0c3dfa3fdc92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:20.842788 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae643a6-cbc4-4ad2-95a9-0c3dfa3fdc92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-2ae643a6-cbc4-4ad2-95a9-0c3dfa3fdc92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:20.850837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:20.851888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:20.852863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 161/313] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:20.857803 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b1684-0943-4b84-8648-0fe89b151110 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:20.930991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:20.964520 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b1684-0943-4b84-8648-0fe89b151110 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:21.000730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3576783-895a-4a3f-ac80-4882092fbc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:21.001405 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3576783-895a-4a3f-ac80-4882092fbc81 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:21.001683 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3576783-895a-4a3f-ac80-4882092fbc81 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:21.001963 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3576783-895a-4a3f-ac80-4882092fbc81 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:21.002767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3576783-895a-4a3f-ac80-4882092fbc81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:21.003564 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3576783-895a-4a3f-ac80-4882092fbc81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:21.004956 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3576783-895a-4a3f-ac80-4882092fbc81 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:21.014802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 153/314] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:21.023711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae643a6-cbc4-4ad2-95a9-0c3dfa3fdc92 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:21.072004 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:21.134069 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae643a6-cbc4-4ad2-95a9-0c3dfa3fdc92 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:21.172886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9ac40-98db-47fa-bdf5-f8ff8eb833f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:21.173780 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9ac40-98db-47fa-bdf5-f8ff8eb833f1 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:21.174064 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9ac40-98db-47fa-bdf5-f8ff8eb833f1 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:21.174342 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9ac40-98db-47fa-bdf5-f8ff8eb833f1 None admin] PATH_INFO: `/v3/users/4357f6576ac047f5a047a133168f914b` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:21.175588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9ac40-98db-47fa-bdf5-f8ff8eb833f1 None admin] RBAC: Authorizing `identity:get_user(user_id=4357f6576ac047f5a047a133168f914b)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:21.178004 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9ac40-98db-47fa-bdf5-f8ff8eb833f1 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:21.180139 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 162/315] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:21 2022] GET /identity/v3/users/4357f6576ac047f5a047a133168f914b => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:21.185308 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3576783-895a-4a3f-ac80-4882092fbc81 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:21.298358 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3576783-895a-4a3f-ac80-4882092fbc81 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:21.323017 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:21.341335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3709d8-c407-4691-9734-4d0ae3b8cf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:21.342010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3709d8-c407-4691-9734-4d0ae3b8cf0c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:21.342298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3709d8-c407-4691-9734-4d0ae3b8cf0c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:21.342580 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3709d8-c407-4691-9734-4d0ae3b8cf0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:21.418510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3709d8-c407-4691-9734-4d0ae3b8cf0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:21.419954 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3709d8-c407-4691-9734-4d0ae3b8cf0c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:21.526047 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 154/316] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:21.531929 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9ac40-98db-47fa-bdf5-f8ff8eb833f1 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:21.634171 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9ac40-98db-47fa-bdf5-f8ff8eb833f1 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:21.644698 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:21.669375 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb01b3-2ef3-4332-b921-d052a80ec379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:21.670174 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb01b3-2ef3-4332-b921-d052a80ec379 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:21.670463 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb01b3-2ef3-4332-b921-d052a80ec379 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:21.670774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb01b3-2ef3-4332-b921-d052a80ec379 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:21.671998 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb01b3-2ef3-4332-b921-d052a80ec379 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:21.673471 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb01b3-2ef3-4332-b921-d052a80ec379 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:21.680388 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 163/317] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:21 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:21.681568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3709d8-c407-4691-9734-4d0ae3b8cf0c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:21.703124 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:21.787205 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3709d8-c407-4691-9734-4d0ae3b8cf0c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:21.824329 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53652a-65b1-4457-bd94-650cc3a4f260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:21.825196 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53652a-65b1-4457-bd94-650cc3a4f260 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:21.825485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53652a-65b1-4457-bd94-650cc3a4f260 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:21.825760 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53652a-65b1-4457-bd94-650cc3a4f260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:21.826634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53652a-65b1-4457-bd94-650cc3a4f260 None admin] RBAC: Adding query filter params (role.id=8dff9e5a6c6340acb442a929d6affd4d, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a, user.id=4357f6576ac047f5a047a133168f914b) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:21.826947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53652a-65b1-4457-bd94-650cc3a4f260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:21.828410 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53652a-65b1-4457-bd94-650cc3a4f260 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:21.835590 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 155/318] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:21 2022] GET /identity/v3/role_assignments?user.id=4357f6576ac047f5a047a133168f914b&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=8dff9e5a6c6340acb442a929d6affd4d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:22.334280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc927a-c164-4ed8-a4ed-3a3b70d045e5 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.334876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc927a-c164-4ed8-a4ed-3a3b70d045e5 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.334876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc927a-c164-4ed8-a4ed-3a3b70d045e5 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.336314 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 164/319] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:22.341855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c81be-5023-43d2-ad5e-8986f2a7f370 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.342371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c81be-5023-43d2-ad5e-8986f2a7f370 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.342471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c81be-5023-43d2-ad5e-8986f2a7f370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.360892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-233c81be-5023-43d2-ad5e-8986f2a7f370 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:22.362143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-233c81be-5023-43d2-ad5e-8986f2a7f370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:22.480394 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 156/320] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:22.503323 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc927a-c164-4ed8-a4ed-3a3b70d045e5 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:22.535883 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42733e8-6ee5-4315-b029-a66ed76e2a6b None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.536746 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42733e8-6ee5-4315-b029-a66ed76e2a6b None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.537004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42733e8-6ee5-4315-b029-a66ed76e2a6b None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.538409 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 157/321] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:22.543615 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa45f5-1e29-49a8-990a-9039d468d229 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.543883 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa45f5-1e29-49a8-990a-9039d468d229 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.544169 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa45f5-1e29-49a8-990a-9039d468d229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.568386 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-f8fa45f5-1e29-49a8-990a-9039d468d229 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:22.569585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-f8fa45f5-1e29-49a8-990a-9039d468d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:22.577171 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:22.620750 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc927a-c164-4ed8-a4ed-3a3b70d045e5 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:22.637562 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 158/322] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:22.638744 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3da1-f6ec-44ce-a5f8-427df99e9427 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.639031 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3da1-f6ec-44ce-a5f8-427df99e9427 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.639304 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3da1-f6ec-44ce-a5f8-427df99e9427 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.640703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 159/323] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:22.645931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3af81-e80d-4405-a9f1-16897e74d5a8 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.646217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3af81-e80d-4405-a9f1-16897e74d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.646496 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3af81-e80d-4405-a9f1-16897e74d5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.655465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572401a-c1eb-4041-a8d9-a8c803c96b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:22.656272 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572401a-c1eb-4041-a8d9-a8c803c96b64 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.656560 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572401a-c1eb-4041-a8d9-a8c803c96b64 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.656841 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572401a-c1eb-4041-a8d9-a8c803c96b64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.658456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572401a-c1eb-4041-a8d9-a8c803c96b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:22.659969 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572401a-c1eb-4041-a8d9-a8c803c96b64 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:22.662163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 165/324] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:22.662959 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572401a-c1eb-4041-a8d9-a8c803c96b64 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:22.664032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-d7f3af81-e80d-4405-a9f1-16897e74d5a8 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:22.665229 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-d7f3af81-e80d-4405-a9f1-16897e74d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:22.710356 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:22.734822 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 160/325] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:22.735660 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3af81-e80d-4405-a9f1-16897e74d5a8 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:22.770909 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572401a-c1eb-4041-a8d9-a8c803c96b64 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:22.808474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de477c55-065e-4b8b-846c-30771c429ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:22.809277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de477c55-065e-4b8b-846c-30771c429ab2 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.809554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de477c55-065e-4b8b-846c-30771c429ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.809827 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de477c55-065e-4b8b-846c-30771c429ab2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.812623 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:22.820523 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de477c55-065e-4b8b-846c-30771c429ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-de477c55-065e-4b8b-846c-30771c429ab2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:22.832806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:22.833839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 166/326] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:22.834775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de477c55-065e-4b8b-846c-30771c429ab2 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:22.844897 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3af81-e80d-4405-a9f1-16897e74d5a8 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:22.881867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe64c19-d768-4681-8c9e-3051e670b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:22.882466 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe64c19-d768-4681-8c9e-3051e670b398 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.882785 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe64c19-d768-4681-8c9e-3051e670b398 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.883065 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe64c19-d768-4681-8c9e-3051e670b398 None admin] PATH_INFO: `/v3/groups` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.883759 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe64c19-d768-4681-8c9e-3051e670b398 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:22.885221 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe64c19-d768-4681-8c9e-3051e670b398 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:22.932065 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de477c55-065e-4b8b-846c-30771c429ab2 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:22.939287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:22.965302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8e559-317b-4061-830d-5601f7488eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:22.966086 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8e559-317b-4061-830d-5601f7488eb1 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.966366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8e559-317b-4061-830d-5601f7488eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.966666 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8e559-317b-4061-830d-5601f7488eb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.977738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8e559-317b-4061-830d-5601f7488eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:22.983261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 161/327] 10.222.0.89 () {60 vars in 1134 bytes} [Thu May 19 20:24:22 2022] POST /identity/v3/groups => generated 226 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:22.987707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe64c19-d768-4681-8c9e-3051e670b398 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-c3d8e559-317b-4061-830d-5601f7488eb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:22.987856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:22.988832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:22.989785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 167/328] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:22.992515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8e559-317b-4061-830d-5601f7488eb1 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.108329 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8e559-317b-4061-830d-5601f7488eb1 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.112702 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe64c19-d768-4681-8c9e-3051e670b398 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.147903 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.151449 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032b742-3f67-466a-bcf8-8a1205f138c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.152181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032b742-3f67-466a-bcf8-8a1205f138c6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.152486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032b742-3f67-466a-bcf8-8a1205f138c6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.152766 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032b742-3f67-466a-bcf8-8a1205f138c6 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.153360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b97e33-c5aa-47f4-863a-d7309fbe35bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.153559 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032b742-3f67-466a-bcf8-8a1205f138c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:23.153853 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032b742-3f67-466a-bcf8-8a1205f138c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:23.154050 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b97e33-c5aa-47f4-863a-d7309fbe35bf None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.154333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b97e33-c5aa-47f4-863a-d7309fbe35bf None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.154628 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b97e33-c5aa-47f4-863a-d7309fbe35bf None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.155304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032b742-3f67-466a-bcf8-8a1205f138c6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:23.155417 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b97e33-c5aa-47f4-863a-d7309fbe35bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:23.155694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b97e33-c5aa-47f4-863a-d7309fbe35bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:23.157086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b97e33-c5aa-47f4-863a-d7309fbe35bf None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:23.165217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 168/329] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:23.170805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032b742-3f67-466a-bcf8-8a1205f138c6 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.175642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 162/330] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:23.178852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b97e33-c5aa-47f4-863a-d7309fbe35bf None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.210363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.305280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032b742-3f67-466a-bcf8-8a1205f138c6 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.309819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b97e33-c5aa-47f4-863a-d7309fbe35bf None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.343855 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f8ef5-e0d6-494d-a6ee-ef78d36aa257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.344740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f8ef5-e0d6-494d-a6ee-ef78d36aa257 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.345777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f8ef5-e0d6-494d-a6ee-ef78d36aa257 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.345777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f8ef5-e0d6-494d-a6ee-ef78d36aa257 None admin] PATH_INFO: `/v3/users/e34182811e9b4b14a67934e07428a79d` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.347505 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f8ef5-e0d6-494d-a6ee-ef78d36aa257 None admin] RBAC: Authorizing `identity:get_user(user_id=e34182811e9b4b14a67934e07428a79d)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:23.349649 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f8ef5-e0d6-494d-a6ee-ef78d36aa257 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:23.351408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 169/331] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:23 2022] GET /identity/v3/users/e34182811e9b4b14a67934e07428a79d => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:23.357793 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f8ef5-e0d6-494d-a6ee-ef78d36aa257 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.358370 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464277d8-5afb-4aa4-ac44-8a9e9b186d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.359846 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464277d8-5afb-4aa4-ac44-8a9e9b186d90 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.360337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464277d8-5afb-4aa4-ac44-8a9e9b186d90 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.360843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464277d8-5afb-4aa4-ac44-8a9e9b186d90 None admin] PATH_INFO: `/v3/users/a6338b3319ae4d57bbbc8bb7024b500c` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.362304 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464277d8-5afb-4aa4-ac44-8a9e9b186d90 None admin] RBAC: Authorizing `identity:get_user(user_id=a6338b3319ae4d57bbbc8bb7024b500c)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:23.363814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464277d8-5afb-4aa4-ac44-8a9e9b186d90 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:23.366403 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 163/332] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:23 2022] GET /identity/v3/users/a6338b3319ae4d57bbbc8bb7024b500c => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:23.372118 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464277d8-5afb-4aa4-ac44-8a9e9b186d90 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.453128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.487922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.499373 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f8ef5-e0d6-494d-a6ee-ef78d36aa257 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.510025 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464277d8-5afb-4aa4-ac44-8a9e9b186d90 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.544653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadb3e9-0bf5-4bf1-83ef-ed83334d4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.545434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadb3e9-0bf5-4bf1-83ef-ed83334d4804 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.545793 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadb3e9-0bf5-4bf1-83ef-ed83334d4804 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.546146 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadb3e9-0bf5-4bf1-83ef-ed83334d4804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.547127 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadb3e9-0bf5-4bf1-83ef-ed83334d4804 None admin] RBAC: Adding query filter params (role.id=a661e4208e2047e69b45e282caa0683b, user.id=e34182811e9b4b14a67934e07428a79d, scope.system=all) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:23.547453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadb3e9-0bf5-4bf1-83ef-ed83334d4804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:23.549089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadb3e9-0bf5-4bf1-83ef-ed83334d4804 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:23.559296 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294a0ea-1a7e-4ac8-8382-abcbe6fe8059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.560173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a0ea-1a7e-4ac8-8382-abcbe6fe8059 None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.560453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a0ea-1a7e-4ac8-8382-abcbe6fe8059 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.560730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a0ea-1a7e-4ac8-8382-abcbe6fe8059 None admin] PATH_INFO: `/v3/system/users/a6338b3319ae4d57bbbc8bb7024b500c/roles/8dff9e5a6c6340acb442a929d6affd4d` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.562255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294a0ea-1a7e-4ac8-8382-abcbe6fe8059 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6338b3319ae4d57bbbc8bb7024b500c, role_id=8dff9e5a6c6340acb442a929d6affd4d)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:23.563691 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294a0ea-1a7e-4ac8-8382-abcbe6fe8059 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:23.566201 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 170/333] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:24:23 2022] GET /identity/v3/role_assignments?user.id=e34182811e9b4b14a67934e07428a79d&scope.system=all&role.id=a661e4208e2047e69b45e282caa0683b => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:23.647351 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 164/334] 10.222.0.89 () {58 vars in 1334 bytes} [Thu May 19 20:24:23 2022] PUT /identity/v3/system/users/a6338b3319ae4d57bbbc8bb7024b500c/roles/8dff9e5a6c6340acb442a929d6affd4d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:24:25.568179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a48e66-f99f-4025-90e7-d440671bb18d None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:25.568722 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a48e66-f99f-4025-90e7-d440671bb18d None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:25.568722 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a48e66-f99f-4025-90e7-d440671bb18d None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:25.570397 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 171/335] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:25.575938 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e900a8-0f3f-4931-9367-4db0fe35d842 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:25.576399 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e900a8-0f3f-4931-9367-4db0fe35d842 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:25.576482 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e900a8-0f3f-4931-9367-4db0fe35d842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:25.594878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-c0e900a8-0f3f-4931-9367-4db0fe35d842 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:25.596059 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-c0e900a8-0f3f-4931-9367-4db0fe35d842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:25.692983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 165/336] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:25.732358 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a48e66-f99f-4025-90e7-d440671bb18d None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:25.873528 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a48e66-f99f-4025-90e7-d440671bb18d None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:25.921583 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4618a62-1cce-4e46-b4c4-96ad50c5c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:25.922382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618a62-1cce-4e46-b4c4-96ad50c5c472 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:25.922680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618a62-1cce-4e46-b4c4-96ad50c5c472 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:25.922952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618a62-1cce-4e46-b4c4-96ad50c5c472 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:25.937794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4618a62-1cce-4e46-b4c4-96ad50c5c472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-c4618a62-1cce-4e46-b4c4-96ad50c5c472 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:25.947582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:25.948622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:25.949554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:25.950245 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 172/337] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:25.956741 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e900a8-0f3f-4931-9367-4db0fe35d842 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:26.054778 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:26.106646 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e900a8-0f3f-4931-9367-4db0fe35d842 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:26.152324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7cbb8-356a-4b3c-ba76-8738e9f74b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:26.152932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7cbb8-356a-4b3c-ba76-8738e9f74b27 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:26.153212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7cbb8-356a-4b3c-ba76-8738e9f74b27 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:26.153487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7cbb8-356a-4b3c-ba76-8738e9f74b27 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:26.154249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7cbb8-356a-4b3c-ba76-8738e9f74b27 None admin] RBAC: Adding query filter params (name=member) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:26.154556 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7cbb8-356a-4b3c-ba76-8738e9f74b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:26.155975 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7cbb8-356a-4b3c-ba76-8738e9f74b27 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:26.170724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 166/338] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:26.176421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4618a62-1cce-4e46-b4c4-96ad50c5c472 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:26.200388 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:26.298670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083391-63bd-44bf-91fc-2b1e6b0e2946 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:26.299038 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083391-63bd-44bf-91fc-2b1e6b0e2946 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:26.299235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083391-63bd-44bf-91fc-2b1e6b0e2946 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:26.300622 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 167/339] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:26.304412 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4618a62-1cce-4e46-b4c4-96ad50c5c472 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:26.323225 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee21e8-a4e8-4f92-aa43-029c7cf6e277 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:26.323876 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee21e8-a4e8-4f92-aa43-029c7cf6e277 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:26.324398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee21e8-a4e8-4f92-aa43-029c7cf6e277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:26.347530 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456c3ca-ae2a-4cc9-b7ad-08a490c65d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:26.348197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c3ca-ae2a-4cc9-b7ad-08a490c65d0f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:26.348478 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c3ca-ae2a-4cc9-b7ad-08a490c65d0f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:26.349286 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c3ca-ae2a-4cc9-b7ad-08a490c65d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:26.354677 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-2eee21e8-a4e8-4f92-aa43-029c7cf6e277 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:26.360560 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-2eee21e8-a4e8-4f92-aa43-029c7cf6e277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:26.463314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 168/340] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:26.477933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456c3ca-ae2a-4cc9-b7ad-08a490c65d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:26.479455 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456c3ca-ae2a-4cc9-b7ad-08a490c65d0f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:26.505517 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:26.513314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee21e8-a4e8-4f92-aa43-029c7cf6e277 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:26.591775 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:26.636920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 173/341] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:26.656540 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456c3ca-ae2a-4cc9-b7ad-08a490c65d0f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:26.659685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee21e8-a4e8-4f92-aa43-029c7cf6e277 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:26.700603 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf74b1-d0b9-41be-aa1c-5ed63bc8affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:26.701883 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf74b1-d0b9-41be-aa1c-5ed63bc8affc None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:26.702383 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf74b1-d0b9-41be-aa1c-5ed63bc8affc None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:26.703021 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf74b1-d0b9-41be-aa1c-5ed63bc8affc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:26.720407 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf74b1-d0b9-41be-aa1c-5ed63bc8affc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-d8cf74b1-d0b9-41be-aa1c-5ed63bc8affc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:26.737707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:26.738808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:26.739835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:26.742585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 169/342] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:24:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:26.748947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf74b1-d0b9-41be-aa1c-5ed63bc8affc None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:26.855968 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456c3ca-ae2a-4cc9-b7ad-08a490c65d0f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:26.911051 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:26.929829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c398-bdb8-420f-98be-70ac199c5c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:26.934946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c398-bdb8-420f-98be-70ac199c5c17 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:26.934946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c398-bdb8-420f-98be-70ac199c5c17 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:26.934946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c398-bdb8-420f-98be-70ac199c5c17 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:26.934946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206c398-bdb8-420f-98be-70ac199c5c17 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:26.934946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206c398-bdb8-420f-98be-70ac199c5c17 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:26.936612 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 174/343] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:26 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:26.942672 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c398-bdb8-420f-98be-70ac199c5c17 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:27.028814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf74b1-d0b9-41be-aa1c-5ed63bc8affc None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:27.051116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:27.095934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63015618-3e30-4abb-a956-efa3558f0aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:27.096635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63015618-3e30-4abb-a956-efa3558f0aaf None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.096927 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63015618-3e30-4abb-a956-efa3558f0aaf None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.097208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63015618-3e30-4abb-a956-efa3558f0aaf None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.098176 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63015618-3e30-4abb-a956-efa3558f0aaf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:27.098449 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c398-bdb8-420f-98be-70ac199c5c17 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:27.098884 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63015618-3e30-4abb-a956-efa3558f0aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:27.100463 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63015618-3e30-4abb-a956-efa3558f0aaf None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:27.120360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 170/344] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:27.125289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63015618-3e30-4abb-a956-efa3558f0aaf None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:27.146911 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01411e-614c-4689-a04b-33810225aa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:27.148032 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01411e-614c-4689-a04b-33810225aa9d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.148491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01411e-614c-4689-a04b-33810225aa9d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.148929 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01411e-614c-4689-a04b-33810225aa9d None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.155757 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01411e-614c-4689-a04b-33810225aa9d None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:27.157427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01411e-614c-4689-a04b-33810225aa9d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:27.163801 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 175/345] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:26 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:27.169866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01411e-614c-4689-a04b-33810225aa9d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:27.262350 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:27.283156 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63015618-3e30-4abb-a956-efa3558f0aaf None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:27.329861 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11a9e7-6014-4e65-9719-3c24e598306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:27.330594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11a9e7-6014-4e65-9719-3c24e598306a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.330919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11a9e7-6014-4e65-9719-3c24e598306a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.331198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11a9e7-6014-4e65-9719-3c24e598306a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.387692 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01411e-614c-4689-a04b-33810225aa9d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:27.403129 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:27.436720 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11a9e7-6014-4e65-9719-3c24e598306a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:27.438214 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11a9e7-6014-4e65-9719-3c24e598306a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:27.461853 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825e655-c91f-4af3-836a-18685eba4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:27.462541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825e655-c91f-4af3-836a-18685eba4759 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.462861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825e655-c91f-4af3-836a-18685eba4759 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.463146 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825e655-c91f-4af3-836a-18685eba4759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.464008 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825e655-c91f-4af3-836a-18685eba4759 None admin] RBAC: Adding query filter params (group.id=cd4b1c76a16047b491a21aa921bd00f6, role.id=a661e4208e2047e69b45e282caa0683b, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:27.464326 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825e655-c91f-4af3-836a-18685eba4759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:27.465794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825e655-c91f-4af3-836a-18685eba4759 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:27.479573 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 176/346] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:24:27 2022] GET /identity/v3/role_assignments?group.id=cd4b1c76a16047b491a21aa921bd00f6&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=a661e4208e2047e69b45e282caa0683b => generated 260 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:27.480931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc483b-0b63-42c1-89b0-8727fff0b646 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.481224 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc483b-0b63-42c1-89b0-8727fff0b646 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.481503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc483b-0b63-42c1-89b0-8727fff0b646 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.485647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 177/347] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:27.492306 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d653640-d7e8-41b3-9845-a8798211964e None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.492961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d653640-d7e8-41b3-9845-a8798211964e None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.493428 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d653640-d7e8-41b3-9845-a8798211964e None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.495163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 178/348] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:27.496718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0681a90-9ce6-48bd-aa09-9717a125067a None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.497183 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0681a90-9ce6-48bd-aa09-9717a125067a None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.497635 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0681a90-9ce6-48bd-aa09-9717a125067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.529666 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-e0681a90-9ce6-48bd-aa09-9717a125067a None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:27.533607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-e0681a90-9ce6-48bd-aa09-9717a125067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:27.633691 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 171/349] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:24:27.638637 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4553e74-b2c4-4383-9864-53a614d4604d None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.638637 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4553e74-b2c4-4383-9864-53a614d4604d None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.638637 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4553e74-b2c4-4383-9864-53a614d4604d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.663646 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-a4553e74-b2c4-4383-9864-53a614d4604d None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:27.665447 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-a4553e74-b2c4-4383-9864-53a614d4604d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:27.697040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 179/350] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:27.698652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0681a90-9ce6-48bd-aa09-9717a125067a None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:27.756435 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:27.763534 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 172/351] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:27.765458 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6319b3-00d6-4710-90a5-25845424a812 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.765751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6319b3-00d6-4710-90a5-25845424a812 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.766034 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6319b3-00d6-4710-90a5-25845424a812 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.768920 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 173/352] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:27.774749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6319b3-00d6-4710-90a5-25845424a812 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:27.781378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:27.881570 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0681a90-9ce6-48bd-aa09-9717a125067a None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:27.927605 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa232e4-7960-42f3-be73-eae215c2e833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:27.928862 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa232e4-7960-42f3-be73-eae215c2e833 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.929339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa232e4-7960-42f3-be73-eae215c2e833 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.929816 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa232e4-7960-42f3-be73-eae215c2e833 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.930672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6319b3-00d6-4710-90a5-25845424a812 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:27.931522 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa232e4-7960-42f3-be73-eae215c2e833 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:27.933198 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa232e4-7960-42f3-be73-eae215c2e833 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:27.936874 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 180/353] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:27 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:27.938765 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600c4ed-511e-4b89-9005-0296a0c3be5f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.939280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600c4ed-511e-4b89-9005-0296a0c3be5f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.939754 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600c4ed-511e-4b89-9005-0296a0c3be5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.960978 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-d600c4ed-511e-4b89-9005-0296a0c3be5f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:27.962568 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-d600c4ed-511e-4b89-9005-0296a0c3be5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:27.982552 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001f080-9e0a-410f-aafc-642c3acf86d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:27.983800 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001f080-9e0a-410f-aafc-642c3acf86d3 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.984095 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001f080-9e0a-410f-aafc-642c3acf86d3 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.984371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001f080-9e0a-410f-aafc-642c3acf86d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.001538 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001f080-9e0a-410f-aafc-642c3acf86d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-1001f080-9e0a-410f-aafc-642c3acf86d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:28.012585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:28.013662 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:28.014591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:28.023019 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 174/354] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:28.024342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001f080-9e0a-410f-aafc-642c3acf86d3 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.058033 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 181/355] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:28.059036 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600c4ed-511e-4b89-9005-0296a0c3be5f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.110988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:28.116038 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:28.162080 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001f080-9e0a-410f-aafc-642c3acf86d3 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.190251 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600c4ed-511e-4b89-9005-0296a0c3be5f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.210657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccb6a4-0339-4456-8f4f-d8b13940820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.211479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb6a4-0339-4456-8f4f-d8b13940820e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.211764 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb6a4-0339-4456-8f4f-d8b13940820e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.212043 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb6a4-0339-4456-8f4f-d8b13940820e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.228525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccb6a4-0339-4456-8f4f-d8b13940820e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:28.235153 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580d32a-36f6-49c7-b0e4-40a7995c3850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.236018 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580d32a-36f6-49c7-b0e4-40a7995c3850 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.236297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580d32a-36f6-49c7-b0e4-40a7995c3850 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.236569 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580d32a-36f6-49c7-b0e4-40a7995c3850 None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-4dccb6a4-0339-4456-8f4f-d8b13940820e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:28.236875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:28.237856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 175/356] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:28.239766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccb6a4-0339-4456-8f4f-d8b13940820e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.241891 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580d32a-36f6-49c7-b0e4-40a7995c3850 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:28.243442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580d32a-36f6-49c7-b0e4-40a7995c3850 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:28.245293 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 182/357] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:28.250055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580d32a-36f6-49c7-b0e4-40a7995c3850 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.367965 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccb6a4-0339-4456-8f4f-d8b13940820e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.394017 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:28.396634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580d32a-36f6-49c7-b0e4-40a7995c3850 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.407630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:28.409996 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3384c15-a272-4696-b272-00a0b1b52e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.411279 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384c15-a272-4696-b272-00a0b1b52e39 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.411279 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384c15-a272-4696-b272-00a0b1b52e39 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.411474 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384c15-a272-4696-b272-00a0b1b52e39 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.412237 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3384c15-a272-4696-b272-00a0b1b52e39 None admin] RBAC: Adding query filter params (name=member) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:28.412544 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3384c15-a272-4696-b272-00a0b1b52e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:28.414863 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3384c15-a272-4696-b272-00a0b1b52e39 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:28.423681 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 176/358] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:28.425088 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae945a49-d0ad-469b-a924-33d3e9be0a09 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.425424 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae945a49-d0ad-469b-a924-33d3e9be0a09 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.425713 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae945a49-d0ad-469b-a924-33d3e9be0a09 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.427824 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 177/359] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:28.428546 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae945a49-d0ad-469b-a924-33d3e9be0a09 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.452127 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bde83-3397-4a89-acf9-9ba61f1786ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.453765 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bde83-3397-4a89-acf9-9ba61f1786ba None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.454458 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bde83-3397-4a89-acf9-9ba61f1786ba None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.456417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bde83-3397-4a89-acf9-9ba61f1786ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.470657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bde83-3397-4a89-acf9-9ba61f1786ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-1a1bde83-3397-4a89-acf9-9ba61f1786ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:28.479026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:28.480047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:28.480943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 183/360] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:28.481697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bde83-3397-4a89-acf9-9ba61f1786ba None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.579955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae945a49-d0ad-469b-a924-33d3e9be0a09 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.622011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bfca8-2deb-4ab4-ba21-5052bc53e48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.622541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfca8-2deb-4ab4-ba21-5052bc53e48f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.622853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfca8-2deb-4ab4-ba21-5052bc53e48f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.623178 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfca8-2deb-4ab4-ba21-5052bc53e48f None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.623942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bfca8-2deb-4ab4-ba21-5052bc53e48f None admin] RBAC: Adding query filter params (name=reader) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:28.624248 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bfca8-2deb-4ab4-ba21-5052bc53e48f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:28.625465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bde83-3397-4a89-acf9-9ba61f1786ba None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.625635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bfca8-2deb-4ab4-ba21-5052bc53e48f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:28.636033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 178/361] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:28.636892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bfca8-2deb-4ab4-ba21-5052bc53e48f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.671031 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df4343-ce26-4265-bc02-68bc1e62e9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.672237 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4343-ce26-4265-bc02-68bc1e62e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.672859 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4343-ce26-4265-bc02-68bc1e62e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.673171 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4343-ce26-4265-bc02-68bc1e62e9a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.674039 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df4343-ce26-4265-bc02-68bc1e62e9a9 None admin] RBAC: Adding query filter params (group.id=cd4b1c76a16047b491a21aa921bd00f6, role.id=920e2cadf3044abda66c715e1c89f4e3, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:28.674808 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df4343-ce26-4265-bc02-68bc1e62e9a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:28.676596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df4343-ce26-4265-bc02-68bc1e62e9a9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:28.685382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 184/362] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/role_assignments?group.id=cd4b1c76a16047b491a21aa921bd00f6&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=920e2cadf3044abda66c715e1c89f4e3 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:28.687234 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263c63-a9cd-430e-bfdd-754d0c627527 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.687669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263c63-a9cd-430e-bfdd-754d0c627527 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.688089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263c63-a9cd-430e-bfdd-754d0c627527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.708935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:28.713487 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-e7263c63-a9cd-430e-bfdd-754d0c627527 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:28.715369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-e7263c63-a9cd-430e-bfdd-754d0c627527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:28.753202 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:28.797988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bfca8-2deb-4ab4-ba21-5052bc53e48f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.844536 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 185/363] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:28.845798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7263c63-a9cd-430e-bfdd-754d0c627527 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.897179 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fda14b-e7ec-4e53-a4fc-e7cda35c89b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.898158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fda14b-e7ec-4e53-a4fc-e7cda35c89b6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.899208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fda14b-e7ec-4e53-a4fc-e7cda35c89b6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.899642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fda14b-e7ec-4e53-a4fc-e7cda35c89b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.041047 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fda14b-e7ec-4e53-a4fc-e7cda35c89b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.042885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fda14b-e7ec-4e53-a4fc-e7cda35c89b6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.061731 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7263c63-a9cd-430e-bfdd-754d0c627527 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.111624 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9997-d2f7-4fab-98cb-251e7861ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.112381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9997-d2f7-4fab-98cb-251e7861ed72 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.112670 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9997-d2f7-4fab-98cb-251e7861ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.112992 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9997-d2f7-4fab-98cb-251e7861ed72 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.113834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9997-d2f7-4fab-98cb-251e7861ed72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:29.114812 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9997-d2f7-4fab-98cb-251e7861ed72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.117149 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9997-d2f7-4fab-98cb-251e7861ed72 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.122364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.131850 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 186/364] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:29.132654 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9997-d2f7-4fab-98cb-251e7861ed72 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.175344 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.271033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 179/365] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:29.273498 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fda14b-e7ec-4e53-a4fc-e7cda35c89b6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.332521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9997-d2f7-4fab-98cb-251e7861ed72 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.411967 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8371312-f0da-40d2-a891-c6ee00451001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.412871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8371312-f0da-40d2-a891-c6ee00451001 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.413155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8371312-f0da-40d2-a891-c6ee00451001 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.413431 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8371312-f0da-40d2-a891-c6ee00451001 None admin] PATH_INFO: `/v3/users/a6338b3319ae4d57bbbc8bb7024b500c` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.415809 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8371312-f0da-40d2-a891-c6ee00451001 None admin] RBAC: Authorizing `identity:get_user(user_id=a6338b3319ae4d57bbbc8bb7024b500c)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.417576 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8371312-f0da-40d2-a891-c6ee00451001 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.421004 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 187/366] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/users/a6338b3319ae4d57bbbc8bb7024b500c => generated 293 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:29.421262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8371312-f0da-40d2-a891-c6ee00451001 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.444975 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fda14b-e7ec-4e53-a4fc-e7cda35c89b6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.507427 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b01fb5-9d23-4b52-aeab-d5af220a1614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.508308 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b01fb5-9d23-4b52-aeab-d5af220a1614 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.508599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b01fb5-9d23-4b52-aeab-d5af220a1614 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.508873 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b01fb5-9d23-4b52-aeab-d5af220a1614 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.524394 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b01fb5-9d23-4b52-aeab-d5af220a1614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-93b01fb5-9d23-4b52-aeab-d5af220a1614 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:29.536652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:29.537737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:29.539163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 180/367] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:29.540111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b01fb5-9d23-4b52-aeab-d5af220a1614 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.545664 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.594000 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.614922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8371312-f0da-40d2-a891-c6ee00451001 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.658391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9bc14-5e50-4f1d-9aaf-3196d94aef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.658849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9bc14-5e50-4f1d-9aaf-3196d94aef6f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.659139 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9bc14-5e50-4f1d-9aaf-3196d94aef6f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.659418 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9bc14-5e50-4f1d-9aaf-3196d94aef6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.689795 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b01fb5-9d23-4b52-aeab-d5af220a1614 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.745688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd48ee1-4cd6-4c31-8fee-977cead6c462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.747162 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd48ee1-4cd6-4c31-8fee-977cead6c462 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.747610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9bc14-5e50-4f1d-9aaf-3196d94aef6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.748057 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd48ee1-4cd6-4c31-8fee-977cead6c462 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.748507 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd48ee1-4cd6-4c31-8fee-977cead6c462 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.750385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9bc14-5e50-4f1d-9aaf-3196d94aef6f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.751290 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd48ee1-4cd6-4c31-8fee-977cead6c462 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.754190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd48ee1-4cd6-4c31-8fee-977cead6c462 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.756599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 181/368] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:29.757562 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd48ee1-4cd6-4c31-8fee-977cead6c462 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.853630 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.876795 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.888735 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 188/369] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:29.889415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9bc14-5e50-4f1d-9aaf-3196d94aef6f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.896022 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd48ee1-4cd6-4c31-8fee-977cead6c462 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.946588 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc3171-57ac-45e4-aace-347ff9648b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.947585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc3171-57ac-45e4-aace-347ff9648b60 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.947874 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc3171-57ac-45e4-aace-347ff9648b60 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.948150 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc3171-57ac-45e4-aace-347ff9648b60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.949010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc3171-57ac-45e4-aace-347ff9648b60 None admin] RBAC: Adding query filter params (role.id=8dff9e5a6c6340acb442a929d6affd4d, user.id=a6338b3319ae4d57bbbc8bb7024b500c, scope.system=all) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:29.949323 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc3171-57ac-45e4-aace-347ff9648b60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.950833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc3171-57ac-45e4-aace-347ff9648b60 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.966397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 182/370] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/role_assignments?user.id=a6338b3319ae4d57bbbc8bb7024b500c&scope.system=all&role.id=8dff9e5a6c6340acb442a929d6affd4d => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:29.967249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc3171-57ac-45e4-aace-347ff9648b60 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.046620 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9bc14-5e50-4f1d-9aaf-3196d94aef6f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.122366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f179377-7c28-4841-898a-c2da59a7b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.123460 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f179377-7c28-4841-898a-c2da59a7b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.123947 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f179377-7c28-4841-898a-c2da59a7b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.124615 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f179377-7c28-4841-898a-c2da59a7b6d7 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.125593 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f179377-7c28-4841-898a-c2da59a7b6d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:30.126112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f179377-7c28-4841-898a-c2da59a7b6d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.128924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f179377-7c28-4841-898a-c2da59a7b6d7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.143768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 189/371] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.145063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f179377-7c28-4841-898a-c2da59a7b6d7 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.189032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc3171-57ac-45e4-aace-347ff9648b60 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.245460 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.251227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.251833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f99b-a298-4df2-b417-fd356ab85125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.252721 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f99b-a298-4df2-b417-fd356ab85125 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.253007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f99b-a298-4df2-b417-fd356ab85125 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.253287 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f99b-a298-4df2-b417-fd356ab85125 None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.254577 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585f99b-a298-4df2-b417-fd356ab85125 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.256560 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585f99b-a298-4df2-b417-fd356ab85125 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.258560 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 183/372] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.259524 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f99b-a298-4df2-b417-fd356ab85125 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.325373 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f179377-7c28-4841-898a-c2da59a7b6d7 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.381084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8db800-3d0f-4d66-8129-6456f84b0953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.381964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8db800-3d0f-4d66-8129-6456f84b0953 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.382250 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8db800-3d0f-4d66-8129-6456f84b0953 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.382531 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8db800-3d0f-4d66-8129-6456f84b0953 None admin] PATH_INFO: `/v3/projects/4b2b197a0f67411c87c371c8b2a2dea8` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.383793 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8db800-3d0f-4d66-8129-6456f84b0953 None admin] RBAC: Authorizing `identity:get_project(project_id=4b2b197a0f67411c87c371c8b2a2dea8)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.385248 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8db800-3d0f-4d66-8129-6456f84b0953 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.394661 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 190/373] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/projects/4b2b197a0f67411c87c371c8b2a2dea8 => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.394661 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae4678-e88c-4403-9d0c-3daf97322fb8 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.394661 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae4678-e88c-4403-9d0c-3daf97322fb8 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.394661 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae4678-e88c-4403-9d0c-3daf97322fb8 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.394661 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 191/374] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:30.394661 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae4678-e88c-4403-9d0c-3daf97322fb8 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.407431 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f99b-a298-4df2-b417-fd356ab85125 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.461321 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4d6b3-489a-4fa3-afb8-361afe890e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.463112 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d6b3-489a-4fa3-afb8-361afe890e1e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.463644 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d6b3-489a-4fa3-afb8-361afe890e1e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.464392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d6b3-489a-4fa3-afb8-361afe890e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.568243 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae4678-e88c-4403-9d0c-3daf97322fb8 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.572784 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.577189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4d6b3-489a-4fa3-afb8-361afe890e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.579794 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4d6b3-489a-4fa3-afb8-361afe890e1e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.601774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.623661 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f0ec-2311-42e9-a39b-2826fbde7aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.624597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f0ec-2311-42e9-a39b-2826fbde7aa6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.624879 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f0ec-2311-42e9-a39b-2826fbde7aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.625159 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f0ec-2311-42e9-a39b-2826fbde7aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.626010 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005f0ec-2311-42e9-a39b-2826fbde7aa6 None admin] RBAC: Adding query filter params (group.id=cd4b1c76a16047b491a21aa921bd00f6, role.id=a661e4208e2047e69b45e282caa0683b, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:30.626319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005f0ec-2311-42e9-a39b-2826fbde7aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.627818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005f0ec-2311-42e9-a39b-2826fbde7aa6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.635828 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 192/375] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/role_assignments?group.id=cd4b1c76a16047b491a21aa921bd00f6&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=a661e4208e2047e69b45e282caa0683b => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.638949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f0ec-2311-42e9-a39b-2826fbde7aa6 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.747305 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 184/376] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:30.748632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1fa6b-99f6-4885-8649-15add88b7a87 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.748921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1fa6b-99f6-4885-8649-15add88b7a87 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.749201 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1fa6b-99f6-4885-8649-15add88b7a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.773818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-3da1fa6b-99f6-4885-8649-15add88b7a87 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:30.775105 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-3da1fa6b-99f6-4885-8649-15add88b7a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:30.785407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f0ec-2311-42e9-a39b-2826fbde7aa6 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.825700 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8a3e-f66d-4750-9bbc-26b143738f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.826598 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8a3e-f66d-4750-9bbc-26b143738f27 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.826977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8a3e-f66d-4750-9bbc-26b143738f27 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.827321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8a3e-f66d-4750-9bbc-26b143738f27 None admin] PATH_INFO: `/v3/groups/47efab687e804171ad4c2794a05613f7` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.836582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8a3e-f66d-4750-9bbc-26b143738f27 None admin] RBAC: Authorizing `identity:get_group(group_id=47efab687e804171ad4c2794a05613f7)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.838105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8a3e-f66d-4750-9bbc-26b143738f27 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.839986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 193/377] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/groups/47efab687e804171ad4c2794a05613f7 => generated 229 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.840890 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8a3e-f66d-4750-9bbc-26b143738f27 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.858047 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 185/378] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:30.858973 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1fa6b-99f6-4885-8649-15add88b7a87 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.897334 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.914561 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.953639 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8a3e-f66d-4750-9bbc-26b143738f27 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.991884 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037e9e-31b5-4fe4-9bf5-7a6f553bb81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.992814 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037e9e-31b5-4fe4-9bf5-7a6f553bb81d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.993110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037e9e-31b5-4fe4-9bf5-7a6f553bb81d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.993386 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037e9e-31b5-4fe4-9bf5-7a6f553bb81d None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.994668 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a037e9e-31b5-4fe4-9bf5-7a6f553bb81d None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.996120 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a037e9e-31b5-4fe4-9bf5-7a6f553bb81d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.998186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 194/379] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.998849 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1fa6b-99f6-4885-8649-15add88b7a87 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.003179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037e9e-31b5-4fe4-9bf5-7a6f553bb81d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.038529 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db61ba-a6c3-4090-b9b8-394a89d516e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.039239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db61ba-a6c3-4090-b9b8-394a89d516e5 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.039525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db61ba-a6c3-4090-b9b8-394a89d516e5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.039805 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db61ba-a6c3-4090-b9b8-394a89d516e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.040655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db61ba-a6c3-4090-b9b8-394a89d516e5 None admin] RBAC: Adding query filter params (group.id=47efab687e804171ad4c2794a05613f7, role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=4b2b197a0f67411c87c371c8b2a2dea8) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:31.040967 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db61ba-a6c3-4090-b9b8-394a89d516e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.042721 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db61ba-a6c3-4090-b9b8-394a89d516e5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.049195 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 186/380] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/role_assignments?group.id=47efab687e804171ad4c2794a05613f7&scope.project.id=4b2b197a0f67411c87c371c8b2a2dea8&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:31.051217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db61ba-a6c3-4090-b9b8-394a89d516e5 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.117693 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037e9e-31b5-4fe4-9bf5-7a6f553bb81d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.136666 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:31.156475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bebc4c-25b1-4cb2-a5f3-38b7bc61a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.157727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bebc4c-25b1-4cb2-a5f3-38b7bc61a428 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.157727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bebc4c-25b1-4cb2-a5f3-38b7bc61a428 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.158063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bebc4c-25b1-4cb2-a5f3-38b7bc61a428 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.165237 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:31.171364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bebc4c-25b1-4cb2-a5f3-38b7bc61a428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:31.175597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db61ba-a6c3-4090-b9b8-394a89d516e5 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-83bebc4c-25b1-4cb2-a5f3-38b7bc61a428 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:31.181647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:31.188571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 195/381] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:31.190758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bebc4c-25b1-4cb2-a5f3-38b7bc61a428 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.219592 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d08395-6227-4eca-be9f-fb402a02ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.220617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08395-6227-4eca-be9f-fb402a02ad01 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.220939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08395-6227-4eca-be9f-fb402a02ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.221219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08395-6227-4eca-be9f-fb402a02ad01 None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.222638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d08395-6227-4eca-be9f-fb402a02ad01 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.224355 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d08395-6227-4eca-be9f-fb402a02ad01 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.226330 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 187/382] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:31 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:31.233468 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d08395-6227-4eca-be9f-fb402a02ad01 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.312671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bebc4c-25b1-4cb2-a5f3-38b7bc61a428 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.352331 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f387d5e-062c-4300-b049-a7274b2626b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.353021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f387d5e-062c-4300-b049-a7274b2626b6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.353306 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f387d5e-062c-4300-b049-a7274b2626b6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.353585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f387d5e-062c-4300-b049-a7274b2626b6 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.354356 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f387d5e-062c-4300-b049-a7274b2626b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:31.354694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f387d5e-062c-4300-b049-a7274b2626b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.356148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f387d5e-062c-4300-b049-a7274b2626b6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.358742 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d08395-6227-4eca-be9f-fb402a02ad01 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.367668 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 196/383] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:31.373553 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f387d5e-062c-4300-b049-a7274b2626b6 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.401112 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c8814-905f-4105-8885-216e7b7d926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.401783 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c8814-905f-4105-8885-216e7b7d926d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.402116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c8814-905f-4105-8885-216e7b7d926d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.402495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c8814-905f-4105-8885-216e7b7d926d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.403511 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c8814-905f-4105-8885-216e7b7d926d None admin] RBAC: Adding query filter params (group.id=cd4b1c76a16047b491a21aa921bd00f6, role.id=920e2cadf3044abda66c715e1c89f4e3, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:31.403885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c8814-905f-4105-8885-216e7b7d926d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.405357 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c8814-905f-4105-8885-216e7b7d926d None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.413473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 188/384] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:24:31 2022] GET /identity/v3/role_assignments?group.id=cd4b1c76a16047b491a21aa921bd00f6&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=920e2cadf3044abda66c715e1c89f4e3 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:31.421049 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:31.495270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f387d5e-062c-4300-b049-a7274b2626b6 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.534511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3fa63-aaf0-46fa-95da-7f629acdc7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.535437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3fa63-aaf0-46fa-95da-7f629acdc7b1 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.535721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3fa63-aaf0-46fa-95da-7f629acdc7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.536541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3fa63-aaf0-46fa-95da-7f629acdc7b1 None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.537921 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3fa63-aaf0-46fa-95da-7f629acdc7b1 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.539444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3fa63-aaf0-46fa-95da-7f629acdc7b1 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.541488 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 197/385] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:31 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:31.547126 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c8814-905f-4105-8885-216e7b7d926d None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.577297 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:31.635408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca815d1-b952-4d95-879d-429b59557e5f None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.635746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca815d1-b952-4d95-879d-429b59557e5f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.635927 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca815d1-b952-4d95-879d-429b59557e5f None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.637633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 198/386] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:31.643811 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e866-f1bd-4f30-b2da-8d73dfbd79bd None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.644120 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e866-f1bd-4f30-b2da-8d73dfbd79bd None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.644363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e866-f1bd-4f30-b2da-8d73dfbd79bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.673014 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c8814-905f-4105-8885-216e7b7d926d None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.683752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-1b97e866-f1bd-4f30-b2da-8d73dfbd79bd None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:31.685029 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-1b97e866-f1bd-4f30-b2da-8d73dfbd79bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:31.713232 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5223cb-b558-4391-acaa-f91d3d1dfd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.714415 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5223cb-b558-4391-acaa-f91d3d1dfd60 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.714739 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5223cb-b558-4391-acaa-f91d3d1dfd60 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.715020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5223cb-b558-4391-acaa-f91d3d1dfd60 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.716406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5223cb-b558-4391-acaa-f91d3d1dfd60 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.717910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5223cb-b558-4391-acaa-f91d3d1dfd60 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.719743 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 189/387] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:31 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:31.727107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5223cb-b558-4391-acaa-f91d3d1dfd60 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.839043 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:31.847756 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5223cb-b558-4391-acaa-f91d3d1dfd60 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.887989 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca09bb7-b09c-4b42-a40e-ee5ee8050d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.889166 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca09bb7-b09c-4b42-a40e-ee5ee8050d33 None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.889454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca09bb7-b09c-4b42-a40e-ee5ee8050d33 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.889732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca09bb7-b09c-4b42-a40e-ee5ee8050d33 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/groups/cd4b1c76a16047b491a21aa921bd00f6/roles/a661e4208e2047e69b45e282caa0683b` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.892753 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca09bb7-b09c-4b42-a40e-ee5ee8050d33 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f2d70d8029a4523aa34a26c5d7548b4, group_id=cd4b1c76a16047b491a21aa921bd00f6, role_id=a661e4208e2047e69b45e282caa0683b)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.897018 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca09bb7-b09c-4b42-a40e-ee5ee8050d33 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.911660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 199/388] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:31.937631 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97e866-f1bd-4f30-b2da-8d73dfbd79bd None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.978826 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 190/389] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:24:31 2022] PUT /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/groups/cd4b1c76a16047b491a21aa921bd00f6/roles/a661e4208e2047e69b45e282caa0683b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:24:31.989170 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:32.066855 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97e866-f1bd-4f30-b2da-8d73dfbd79bd None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:32.118178 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b66da-6831-4abe-87d3-39b5aad540c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:32.119202 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b66da-6831-4abe-87d3-39b5aad540c2 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:32.119494 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b66da-6831-4abe-87d3-39b5aad540c2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:32.119772 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b66da-6831-4abe-87d3-39b5aad540c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:32.138309 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b66da-6831-4abe-87d3-39b5aad540c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-114b66da-6831-4abe-87d3-39b5aad540c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:32.147106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:32.149434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:32.151582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 200/390] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:24:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:32.160927 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca09bb7-b09c-4b42-a40e-ee5ee8050d33 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:32.275723 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca09bb7-b09c-4b42-a40e-ee5ee8050d33 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:32.326327 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3553ec-54fe-4137-bb3b-e786adf15a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:32.327051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3553ec-54fe-4137-bb3b-e786adf15a6d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:32.327338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3553ec-54fe-4137-bb3b-e786adf15a6d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:32.327616 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3553ec-54fe-4137-bb3b-e786adf15a6d None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:32.328384 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3553ec-54fe-4137-bb3b-e786adf15a6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:32.328697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3553ec-54fe-4137-bb3b-e786adf15a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:32.330181 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3553ec-54fe-4137-bb3b-e786adf15a6d None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:32.343600 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 191/391] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:32.349822 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b66da-6831-4abe-87d3-39b5aad540c2 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:32.477859 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:32.487357 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b66da-6831-4abe-87d3-39b5aad540c2 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:32.531071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34fec9-5d45-4db9-bb26-917c633ac376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:32.532403 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34fec9-5d45-4db9-bb26-917c633ac376 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:32.532934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34fec9-5d45-4db9-bb26-917c633ac376 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:32.533475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34fec9-5d45-4db9-bb26-917c633ac376 None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:32.534961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34fec9-5d45-4db9-bb26-917c633ac376 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:32.536759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34fec9-5d45-4db9-bb26-917c633ac376 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:32.542740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 201/392] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:32 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:32.544931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3553ec-54fe-4137-bb3b-e786adf15a6d None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:32.567579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:32.688994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3553ec-54fe-4137-bb3b-e786adf15a6d None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:32.743715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e64d6e-d491-4a20-8193-c03fa6d9b8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:32.744547 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64d6e-d491-4a20-8193-c03fa6d9b8da None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:32.744832 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64d6e-d491-4a20-8193-c03fa6d9b8da None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:32.745112 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64d6e-d491-4a20-8193-c03fa6d9b8da None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:32.751563 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e64d6e-d491-4a20-8193-c03fa6d9b8da None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:32.753063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e64d6e-d491-4a20-8193-c03fa6d9b8da None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:32.755862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 192/393] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:32 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:32.761397 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34fec9-5d45-4db9-bb26-917c633ac376 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:32.894815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34fec9-5d45-4db9-bb26-917c633ac376 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:32.931809 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34153f0a-e885-4806-a2d6-89672fafa89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:32.932717 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34153f0a-e885-4806-a2d6-89672fafa89e None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:32.933001 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34153f0a-e885-4806-a2d6-89672fafa89e None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:32.933278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34153f0a-e885-4806-a2d6-89672fafa89e None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/groups/cd4b1c76a16047b491a21aa921bd00f6/roles/920e2cadf3044abda66c715e1c89f4e3` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:32.935564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34153f0a-e885-4806-a2d6-89672fafa89e None admin] RBAC: Authorizing `identity:create_grant(project_id=9f2d70d8029a4523aa34a26c5d7548b4, group_id=cd4b1c76a16047b491a21aa921bd00f6, role_id=920e2cadf3044abda66c715e1c89f4e3)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:32.937062 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34153f0a-e885-4806-a2d6-89672fafa89e None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:33.032813 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 202/394] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:24:32 2022] PUT /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4/groups/cd4b1c76a16047b491a21aa921bd00f6/roles/920e2cadf3044abda66c715e1c89f4e3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:33.328447 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96082a0d-44e7-47a4-8463-09a01ae0dfb9 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:33.328948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96082a0d-44e7-47a4-8463-09a01ae0dfb9 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:33.328948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96082a0d-44e7-47a4-8463-09a01ae0dfb9 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:33.330291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 193/395] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:33.344578 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfbd64-ba8a-49bb-ad1a-f1cd9430164e None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:33.344945 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfbd64-ba8a-49bb-ad1a-f1cd9430164e None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:33.345142 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfbd64-ba8a-49bb-ad1a-f1cd9430164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:33.369975 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-62dfbd64-ba8a-49bb-ad1a-f1cd9430164e None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:33.371223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-62dfbd64-ba8a-49bb-ad1a-f1cd9430164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:33.390768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:33.448957 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 203/396] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:33.471933 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96082a0d-44e7-47a4-8463-09a01ae0dfb9 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:33.589415 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:33.619560 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96082a0d-44e7-47a4-8463-09a01ae0dfb9 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:33.666217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923d7ae-57b8-4323-b6b1-35c0dabcb788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:33.667078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923d7ae-57b8-4323-b6b1-35c0dabcb788 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:33.667362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923d7ae-57b8-4323-b6b1-35c0dabcb788 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:33.667635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923d7ae-57b8-4323-b6b1-35c0dabcb788 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:33.684214 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923d7ae-57b8-4323-b6b1-35c0dabcb788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-4923d7ae-57b8-4323-b6b1-35c0dabcb788 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:33.692246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:33.694104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:33.695925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 194/397] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:33.700018 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfbd64-ba8a-49bb-ad1a-f1cd9430164e None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:33.878380 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfbd64-ba8a-49bb-ad1a-f1cd9430164e None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:33.930360 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55267456-e6a1-431e-9e4e-5582e20b3e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:33.931175 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55267456-e6a1-431e-9e4e-5582e20b3e22 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:33.931462 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55267456-e6a1-431e-9e4e-5582e20b3e22 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:33.931740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55267456-e6a1-431e-9e4e-5582e20b3e22 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:33.932553 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55267456-e6a1-431e-9e4e-5582e20b3e22 None admin] RBAC: Adding query filter params (name=member) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:33.933095 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55267456-e6a1-431e-9e4e-5582e20b3e22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:33.934246 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55267456-e6a1-431e-9e4e-5582e20b3e22 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:33.950007 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 204/398] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:33.950946 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923d7ae-57b8-4323-b6b1-35c0dabcb788 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.119906 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923d7ae-57b8-4323-b6b1-35c0dabcb788 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:34.169295 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfe66b-db94-4124-8389-abd4f24a36fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:34.170552 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfe66b-db94-4124-8389-abd4f24a36fe None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.171060 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfe66b-db94-4124-8389-abd4f24a36fe None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.171570 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfe66b-db94-4124-8389-abd4f24a36fe None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.173002 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfe66b-db94-4124-8389-abd4f24a36fe None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:34.178683 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfe66b-db94-4124-8389-abd4f24a36fe None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:34.180777 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 195/399] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:33 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:34.189827 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55267456-e6a1-431e-9e4e-5582e20b3e22 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.210334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ef7d-1cb0-4cc1-a47e-e1e36b0516f5 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.211023 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ef7d-1cb0-4cc1-a47e-e1e36b0516f5 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.211559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ef7d-1cb0-4cc1-a47e-e1e36b0516f5 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.213438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 196/400] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:34.219283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef83f1-9927-44b4-9b0a-a7c848f9f0b3 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.219939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef83f1-9927-44b4-9b0a-a7c848f9f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.221265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef83f1-9927-44b4-9b0a-a7c848f9f0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.230716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:34.241568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-95ef83f1-9927-44b4-9b0a-a7c848f9f0b3 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:34.243198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-95ef83f1-9927-44b4-9b0a-a7c848f9f0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:34.252037 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:34.373457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 197/401] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:34.378880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55267456-e6a1-431e-9e4e-5582e20b3e22 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:34.381760 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089a12e-4181-4af4-b381-92e52f85e4c7 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.381760 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089a12e-4181-4af4-b381-92e52f85e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.381973 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089a12e-4181-4af4-b381-92e52f85e4c7 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.387857 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 198/402] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:34.395242 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50423484-12af-424b-80d6-fbf3fd11bc9b None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.395747 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50423484-12af-424b-80d6-fbf3fd11bc9b None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.396221 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50423484-12af-424b-80d6-fbf3fd11bc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.416461 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-50423484-12af-424b-80d6-fbf3fd11bc9b None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:34.417651 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-50423484-12af-424b-80d6-fbf3fd11bc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:34.432095 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d0ab0-f093-43c7-95d6-639dcbd5ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:34.433730 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d0ab0-f093-43c7-95d6-639dcbd5ff1c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.434223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d0ab0-f093-43c7-95d6-639dcbd5ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.435071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d0ab0-f093-43c7-95d6-639dcbd5ff1c None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.436616 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d0ab0-f093-43c7-95d6-639dcbd5ff1c None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:34.438696 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d0ab0-f093-43c7-95d6-639dcbd5ff1c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:34.441496 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 205/403] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:34 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:34.443241 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d0ab0-f093-43c7-95d6-639dcbd5ff1c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.493909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 199/404] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:34.500302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50423484-12af-424b-80d6-fbf3fd11bc9b None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.559939 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:34.585276 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d0ab0-f093-43c7-95d6-639dcbd5ff1c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:34.590157 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:34.626316 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50423484-12af-424b-80d6-fbf3fd11bc9b None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:34.634800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60971770-ce72-4388-8efb-fbb97a88c087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:34.635876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60971770-ce72-4388-8efb-fbb97a88c087 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.636346 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60971770-ce72-4388-8efb-fbb97a88c087 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.637270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60971770-ce72-4388-8efb-fbb97a88c087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.649229 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60971770-ce72-4388-8efb-fbb97a88c087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-60971770-ce72-4388-8efb-fbb97a88c087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:34.657297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:34.658339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:34.659292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 206/405] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:24:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:34.660028 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60971770-ce72-4388-8efb-fbb97a88c087 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.671284 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259aade-316e-401b-9be5-7962b509061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:34.673073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259aade-316e-401b-9be5-7962b509061e None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.673539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259aade-316e-401b-9be5-7962b509061e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.673971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259aade-316e-401b-9be5-7962b509061e None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/groups/cd4b1c76a16047b491a21aa921bd00f6/roles/a661e4208e2047e69b45e282caa0683b` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.677535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259aade-316e-401b-9be5-7962b509061e None admin] RBAC: Authorizing `identity:create_grant(project_id=9fc86a6aca544e2b9b180fb63e16f39a, group_id=cd4b1c76a16047b491a21aa921bd00f6, role_id=a661e4208e2047e69b45e282caa0683b)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:34.680168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259aade-316e-401b-9be5-7962b509061e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:34.780527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60971770-ce72-4388-8efb-fbb97a88c087 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:34.788043 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 200/406] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:24:34 2022] PUT /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/groups/cd4b1c76a16047b491a21aa921bd00f6/roles/a661e4208e2047e69b45e282caa0683b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:34.789196 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259aade-316e-401b-9be5-7962b509061e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.878370 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064976-87bc-40ff-9e19-eb88c9dddc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:34.879221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064976-87bc-40ff-9e19-eb88c9dddc6a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.879544 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064976-87bc-40ff-9e19-eb88c9dddc6a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.879822 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064976-87bc-40ff-9e19-eb88c9dddc6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.903411 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3064976-87bc-40ff-9e19-eb88c9dddc6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-d3064976-87bc-40ff-9e19-eb88c9dddc6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:34.921755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:34.922908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:34.923824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:34.927261 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 207/407] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:24:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:34.943487 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064976-87bc-40ff-9e19-eb88c9dddc6a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.949897 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:34.960794 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259aade-316e-401b-9be5-7962b509061e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:34.996606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.002269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f228ba-3b94-44b2-90d8-b0a8dd37578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.003198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f228ba-3b94-44b2-90d8-b0a8dd37578d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.003549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f228ba-3b94-44b2-90d8-b0a8dd37578d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.004190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f228ba-3b94-44b2-90d8-b0a8dd37578d None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.005451 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f228ba-3b94-44b2-90d8-b0a8dd37578d None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:35.005765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f228ba-3b94-44b2-90d8-b0a8dd37578d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.008037 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f228ba-3b94-44b2-90d8-b0a8dd37578d None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.019255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 201/408] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:35.026138 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f228ba-3b94-44b2-90d8-b0a8dd37578d None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.104007 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064976-87bc-40ff-9e19-eb88c9dddc6a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.166381 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f228ba-3b94-44b2-90d8-b0a8dd37578d None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.199347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45d910-e72d-406a-a7bd-d7bfe0d2237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.200041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45d910-e72d-406a-a7bd-d7bfe0d2237f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.200327 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45d910-e72d-406a-a7bd-d7bfe0d2237f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.200600 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45d910-e72d-406a-a7bd-d7bfe0d2237f None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.201368 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45d910-e72d-406a-a7bd-d7bfe0d2237f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:35.201679 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45d910-e72d-406a-a7bd-d7bfe0d2237f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.203347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45d910-e72d-406a-a7bd-d7bfe0d2237f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.204922 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdc26d-20ca-415f-92ef-7c974ec33086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.205809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc26d-20ca-415f-92ef-7c974ec33086 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.206092 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc26d-20ca-415f-92ef-7c974ec33086 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.206374 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc26d-20ca-415f-92ef-7c974ec33086 None admin] PATH_INFO: `/v3/groups/47efab687e804171ad4c2794a05613f7` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.208203 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdc26d-20ca-415f-92ef-7c974ec33086 None admin] RBAC: Authorizing `identity:get_group(group_id=47efab687e804171ad4c2794a05613f7)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.209650 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdc26d-20ca-415f-92ef-7c974ec33086 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.212398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 202/409] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/groups/47efab687e804171ad4c2794a05613f7 => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:35.220727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdc26d-20ca-415f-92ef-7c974ec33086 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.222714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 208/410] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:35.228847 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45d910-e72d-406a-a7bd-d7bfe0d2237f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.333623 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.350694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.385295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45d910-e72d-406a-a7bd-d7bfe0d2237f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.402724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdc26d-20ca-415f-92ef-7c974ec33086 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.430369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64be7f-7720-408b-9b7f-43574f197caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.431550 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64be7f-7720-408b-9b7f-43574f197caa None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.432022 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64be7f-7720-408b-9b7f-43574f197caa None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.432476 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64be7f-7720-408b-9b7f-43574f197caa None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.434142 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64be7f-7720-408b-9b7f-43574f197caa None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.436594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64be7f-7720-408b-9b7f-43574f197caa None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.438449 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 209/411] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:35.439944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4d28-c116-4f88-a72a-8424cd1daaab None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.440413 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4d28-c116-4f88-a72a-8424cd1daaab None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.440854 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4d28-c116-4f88-a72a-8424cd1daaab None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.441215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21fd2d-3856-4c11-9ba0-52025d5574aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.442664 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21fd2d-3856-4c11-9ba0-52025d5574aa None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.442958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21fd2d-3856-4c11-9ba0-52025d5574aa None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.443246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21fd2d-3856-4c11-9ba0-52025d5574aa None admin] PATH_INFO: `/v3/projects/4b2b197a0f67411c87c371c8b2a2dea8` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.447816 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21fd2d-3856-4c11-9ba0-52025d5574aa None admin] RBAC: Authorizing `identity:get_project(project_id=4b2b197a0f67411c87c371c8b2a2dea8)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.447816 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21fd2d-3856-4c11-9ba0-52025d5574aa None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.448112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 210/412] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:35.448718 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 203/413] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/projects/4b2b197a0f67411c87c371c8b2a2dea8 => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:35.449354 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb4d28-c116-4f88-a72a-8424cd1daaab None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.450104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0731f75-9a03-4d59-81a8-2a321d9b0021 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.450427 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0731f75-9a03-4d59-81a8-2a321d9b0021 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.450719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0731f75-9a03-4d59-81a8-2a321d9b0021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.468507 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-c0731f75-9a03-4d59-81a8-2a321d9b0021 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:35.469883 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-c0731f75-9a03-4d59-81a8-2a321d9b0021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:35.556358 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 204/414] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:35.557487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0731f75-9a03-4d59-81a8-2a321d9b0021 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.573365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb4d28-c116-4f88-a72a-8424cd1daaab None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.610526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df713d-906c-4b74-a844-3c87e5c6b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.611461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df713d-906c-4b74-a844-3c87e5c6b248 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.611745 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df713d-906c-4b74-a844-3c87e5c6b248 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.612021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df713d-906c-4b74-a844-3c87e5c6b248 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.613346 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df713d-906c-4b74-a844-3c87e5c6b248 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.614913 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df713d-906c-4b74-a844-3c87e5c6b248 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.617122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 211/415] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:35.618065 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df713d-906c-4b74-a844-3c87e5c6b248 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.621424 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.655368 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.697325 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0731f75-9a03-4d59-81a8-2a321d9b0021 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.727240 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df713d-906c-4b74-a844-3c87e5c6b248 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.735545 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5530c16-976a-43d2-a797-7678d4a0272b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.736687 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5530c16-976a-43d2-a797-7678d4a0272b None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.737152 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5530c16-976a-43d2-a797-7678d4a0272b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.737591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5530c16-976a-43d2-a797-7678d4a0272b None admin] PATH_INFO: `/v3/projects/4b2b197a0f67411c87c371c8b2a2dea8/groups/47efab687e804171ad4c2794a05613f7/roles/59689ee7c4f5409692318371dac5cbc7` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.740488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5530c16-976a-43d2-a797-7678d4a0272b None admin] RBAC: Authorizing `identity:create_grant(project_id=4b2b197a0f67411c87c371c8b2a2dea8, group_id=47efab687e804171ad4c2794a05613f7, role_id=59689ee7c4f5409692318371dac5cbc7)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.742091 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5530c16-976a-43d2-a797-7678d4a0272b None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.764818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e53e0b-7e5f-4ba3-aee2-093581ccf483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.765631 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e53e0b-7e5f-4ba3-aee2-093581ccf483 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.765919 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e53e0b-7e5f-4ba3-aee2-093581ccf483 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.766201 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e53e0b-7e5f-4ba3-aee2-093581ccf483 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.777317 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e53e0b-7e5f-4ba3-aee2-093581ccf483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-74e53e0b-7e5f-4ba3-aee2-093581ccf483 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:35.785212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:35.786365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:35.787371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 212/416] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:35.788123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e53e0b-7e5f-4ba3-aee2-093581ccf483 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.826245 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 205/417] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:24:35 2022] PUT /identity/v3/projects/4b2b197a0f67411c87c371c8b2a2dea8/groups/47efab687e804171ad4c2794a05613f7/roles/59689ee7c4f5409692318371dac5cbc7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:35.827793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5530c16-976a-43d2-a797-7678d4a0272b None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.857015 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.902188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e53e0b-7e5f-4ba3-aee2-093581ccf483 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.965966 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bcfeb-0ecf-4fea-9b4c-36abc5b6a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.965966 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bcfeb-0ecf-4fea-9b4c-36abc5b6a06b None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.965966 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bcfeb-0ecf-4fea-9b4c-36abc5b6a06b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.965966 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bcfeb-0ecf-4fea-9b4c-36abc5b6a06b None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/groups/cd4b1c76a16047b491a21aa921bd00f6/roles/920e2cadf3044abda66c715e1c89f4e3` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.967485 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bcfeb-0ecf-4fea-9b4c-36abc5b6a06b None admin] RBAC: Authorizing `identity:create_grant(project_id=9fc86a6aca544e2b9b180fb63e16f39a, group_id=cd4b1c76a16047b491a21aa921bd00f6, role_id=920e2cadf3044abda66c715e1c89f4e3)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.969511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bcfeb-0ecf-4fea-9b4c-36abc5b6a06b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.981972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5530c16-976a-43d2-a797-7678d4a0272b None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.004326 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:36.024389 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10a490-6067-492e-9d1b-b7ba97b9f935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.025479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10a490-6067-492e-9d1b-b7ba97b9f935 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.025982 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10a490-6067-492e-9d1b-b7ba97b9f935 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.026779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10a490-6067-492e-9d1b-b7ba97b9f935 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.027803 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10a490-6067-492e-9d1b-b7ba97b9f935 None admin] RBAC: Adding query filter params (name=member) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:36.028334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10a490-6067-492e-9d1b-b7ba97b9f935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:36.030115 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10a490-6067-492e-9d1b-b7ba97b9f935 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:36.041537 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 206/418] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:36.047655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10a490-6067-492e-9d1b-b7ba97b9f935 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.061580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 213/419] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:24:35 2022] PUT /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a/groups/cd4b1c76a16047b491a21aa921bd00f6/roles/920e2cadf3044abda66c715e1c89f4e3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:36.103450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0db6b-98f0-4c14-9cf7-8e638903b6fc None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.103801 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0db6b-98f0-4c14-9cf7-8e638903b6fc None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.104090 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0db6b-98f0-4c14-9cf7-8e638903b6fc None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.105711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 214/420] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:36.112479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eb58e-e1fd-4206-a85a-539190dd3fd5 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.112832 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eb58e-e1fd-4206-a85a-539190dd3fd5 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.113042 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eb58e-e1fd-4206-a85a-539190dd3fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.147739 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-834eb58e-e1fd-4206-a85a-539190dd3fd5 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:36.150123 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-834eb58e-e1fd-4206-a85a-539190dd3fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:36.171751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10a490-6067-492e-9d1b-b7ba97b9f935 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.217923 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264867-ad87-42be-a984-061daa923104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.217923 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264867-ad87-42be-a984-061daa923104 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.217923 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264867-ad87-42be-a984-061daa923104 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.218268 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264867-ad87-42be-a984-061daa923104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.258855 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 215/421] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:36.282263 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834eb58e-e1fd-4206-a85a-539190dd3fd5 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.298993 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:36.353197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:36.356689 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2264867-ad87-42be-a984-061daa923104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:36.358837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2264867-ad87-42be-a984-061daa923104 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:36.427467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834eb58e-e1fd-4206-a85a-539190dd3fd5 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.469437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401ba9c-14c8-48e4-9dd6-7940d33506af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.470732 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401ba9c-14c8-48e4-9dd6-7940d33506af None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.471025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401ba9c-14c8-48e4-9dd6-7940d33506af None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.471308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401ba9c-14c8-48e4-9dd6-7940d33506af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.484236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401ba9c-14c8-48e4-9dd6-7940d33506af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-2401ba9c-14c8-48e4-9dd6-7940d33506af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:36.492995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:36.494040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:36.494988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 216/422] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:36.501506 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401ba9c-14c8-48e4-9dd6-7940d33506af None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.508467 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 207/423] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:36.513397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264867-ad87-42be-a984-061daa923104 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.643996 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:36.684871 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264867-ad87-42be-a984-061daa923104 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.709564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401ba9c-14c8-48e4-9dd6-7940d33506af None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.739120 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:36.748770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c8b99-e09e-41db-9676-d00819bf5b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.754241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c8b99-e09e-41db-9676-d00819bf5b08 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.754241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c8b99-e09e-41db-9676-d00819bf5b08 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.754241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c8b99-e09e-41db-9676-d00819bf5b08 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.759453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c8b99-e09e-41db-9676-d00819bf5b08 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:36.760937 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c8b99-e09e-41db-9676-d00819bf5b08 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:36.763152 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 208/424] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:36.763748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc730b15-2ab7-491e-bc04-b3fbf6e2c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.768917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc730b15-2ab7-491e-bc04-b3fbf6e2c707 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.769677 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc730b15-2ab7-491e-bc04-b3fbf6e2c707 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.770767 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc730b15-2ab7-491e-bc04-b3fbf6e2c707 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.770881 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c8b99-e09e-41db-9676-d00819bf5b08 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.772012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc730b15-2ab7-491e-bc04-b3fbf6e2c707 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:36.772541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc730b15-2ab7-491e-bc04-b3fbf6e2c707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:36.774178 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc730b15-2ab7-491e-bc04-b3fbf6e2c707 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:36.786665 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 217/425] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:36.792619 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc730b15-2ab7-491e-bc04-b3fbf6e2c707 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.941170 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc730b15-2ab7-491e-bc04-b3fbf6e2c707 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.988847 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c8b99-e09e-41db-9676-d00819bf5b08 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:37.027671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca49ba-553c-4660-bb7a-0708344bc60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:37.028510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca49ba-553c-4660-bb7a-0708344bc60e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.028802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca49ba-553c-4660-bb7a-0708344bc60e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.029082 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca49ba-553c-4660-bb7a-0708344bc60e None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.030368 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca49ba-553c-4660-bb7a-0708344bc60e None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:37.031850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca49ba-553c-4660-bb7a-0708344bc60e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:37.033865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 209/426] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:37.039346 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca49ba-553c-4660-bb7a-0708344bc60e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:37.039853 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c2001-c11e-4beb-9d4d-98f9f3e3d4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:37.040521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c2001-c11e-4beb-9d4d-98f9f3e3d4e0 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.040806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c2001-c11e-4beb-9d4d-98f9f3e3d4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.041085 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c2001-c11e-4beb-9d4d-98f9f3e3d4e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.067718 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:37.153445 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:37.170241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca49ba-553c-4660-bb7a-0708344bc60e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:37.208842 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c2001-c11e-4beb-9d4d-98f9f3e3d4e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:37.210350 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c2001-c11e-4beb-9d4d-98f9f3e3d4e0 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:37.250288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf7bf0-4d4d-4413-88ad-a83b32be2b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:37.251537 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7bf0-4d4d-4413-88ad-a83b32be2b1c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.252122 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7bf0-4d4d-4413-88ad-a83b32be2b1c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.252610 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7bf0-4d4d-4413-88ad-a83b32be2b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.253914 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf7bf0-4d4d-4413-88ad-a83b32be2b1c None admin] RBAC: Adding query filter params (group.id=cd4b1c76a16047b491a21aa921bd00f6, role.id=a661e4208e2047e69b45e282caa0683b, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:37.254501 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf7bf0-4d4d-4413-88ad-a83b32be2b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:37.256882 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf7bf0-4d4d-4413-88ad-a83b32be2b1c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:37.264296 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 210/427] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:24:37 2022] GET /identity/v3/role_assignments?group.id=cd4b1c76a16047b491a21aa921bd00f6&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=a661e4208e2047e69b45e282caa0683b => generated 611 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:37.343076 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 218/428] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:37.348812 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf7bf0-4d4d-4413-88ad-a83b32be2b1c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:37.484445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:37.505085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf7bf0-4d4d-4413-88ad-a83b32be2b1c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:37.515563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f459-64ac-4a1d-b200-423fdb71b509 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.515875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f459-64ac-4a1d-b200-423fdb71b509 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.516132 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f459-64ac-4a1d-b200-423fdb71b509 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.517804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 219/429] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:37.523875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7278f52-380e-4554-830c-c72af734cdab None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.524164 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7278f52-380e-4554-830c-c72af734cdab None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.524436 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7278f52-380e-4554-830c-c72af734cdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.545372 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1601bc-2137-4a46-a6d8-fbe20d808fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:37.546256 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1601bc-2137-4a46-a6d8-fbe20d808fb8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.546540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1601bc-2137-4a46-a6d8-fbe20d808fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.546860 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1601bc-2137-4a46-a6d8-fbe20d808fb8 None admin] PATH_INFO: `/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.547509 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-c7278f52-380e-4554-830c-c72af734cdab None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:37.548082 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1601bc-2137-4a46-a6d8-fbe20d808fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=9f2d70d8029a4523aa34a26c5d7548b4)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:37.549204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-c7278f52-380e-4554-830c-c72af734cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:37.549521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1601bc-2137-4a46-a6d8-fbe20d808fb8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:37.552818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 211/430] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:37 2022] GET /identity/v3/projects/9f2d70d8029a4523aa34a26c5d7548b4 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:37.557777 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1601bc-2137-4a46-a6d8-fbe20d808fb8 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:37.639730 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 220/431] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:37.663914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7278f52-380e-4554-830c-c72af734cdab None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:37.668819 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:37.683943 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1601bc-2137-4a46-a6d8-fbe20d808fb8 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:37.733866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f4485-7a8a-4548-848a-b073dda45103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:37.736184 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f4485-7a8a-4548-848a-b073dda45103 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.736723 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f4485-7a8a-4548-848a-b073dda45103 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.737472 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f4485-7a8a-4548-848a-b073dda45103 None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.739902 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f4485-7a8a-4548-848a-b073dda45103 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:37.742168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f4485-7a8a-4548-848a-b073dda45103 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:37.744988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 212/432] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:37 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:37.752034 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f4485-7a8a-4548-848a-b073dda45103 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:37.777777 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:37.802041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7278f52-380e-4554-830c-c72af734cdab None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:37.847423 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8644e89-d506-45de-8814-c05fe40285d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:37.849334 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644e89-d506-45de-8814-c05fe40285d4 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.849812 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644e89-d506-45de-8814-c05fe40285d4 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.850334 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644e89-d506-45de-8814-c05fe40285d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.863259 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8644e89-d506-45de-8814-c05fe40285d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-e8644e89-d506-45de-8814-c05fe40285d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:37.872886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:37.873920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:37.874876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:37.876939 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 221/433] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:37.883793 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8644e89-d506-45de-8814-c05fe40285d4 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:37.911555 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f4485-7a8a-4548-848a-b073dda45103 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:37.961157 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb4f7e-a8d4-4ef1-ac1a-18c717d9d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:37.961832 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb4f7e-a8d4-4ef1-ac1a-18c717d9d85f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.962118 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb4f7e-a8d4-4ef1-ac1a-18c717d9d85f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.962395 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb4f7e-a8d4-4ef1-ac1a-18c717d9d85f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.963303 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb4f7e-a8d4-4ef1-ac1a-18c717d9d85f None admin] RBAC: Adding query filter params (group.id=cd4b1c76a16047b491a21aa921bd00f6, role.id=920e2cadf3044abda66c715e1c89f4e3, scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:37.963545 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:37.963657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb4f7e-a8d4-4ef1-ac1a-18c717d9d85f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:37.965104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb4f7e-a8d4-4ef1-ac1a-18c717d9d85f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:37.972111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 213/434] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:24:37 2022] GET /identity/v3/role_assignments?group.id=cd4b1c76a16047b491a21aa921bd00f6&scope.project.id=9f2d70d8029a4523aa34a26c5d7548b4&role.id=920e2cadf3044abda66c715e1c89f4e3 => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:38.011013 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8644e89-d506-45de-8814-c05fe40285d4 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.053943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25f99c-9d47-4e3b-af5f-c29a3f64748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.055447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f99c-9d47-4e3b-af5f-c29a3f64748c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.055928 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f99c-9d47-4e3b-af5f-c29a3f64748c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.056412 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f99c-9d47-4e3b-af5f-c29a3f64748c None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.057400 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25f99c-9d47-4e3b-af5f-c29a3f64748c None admin] RBAC: Adding query filter params (name=member) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:38.057971 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25f99c-9d47-4e3b-af5f-c29a3f64748c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.059669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25f99c-9d47-4e3b-af5f-c29a3f64748c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.070290 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 222/435] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:24:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:38.075861 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb4f7e-a8d4-4ef1-ac1a-18c717d9d85f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.184514 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:38.205760 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb4f7e-a8d4-4ef1-ac1a-18c717d9d85f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.244417 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e83b9-9dff-4623-88a2-8e6a1835be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.245136 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e83b9-9dff-4623-88a2-8e6a1835be57 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.245425 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e83b9-9dff-4623-88a2-8e6a1835be57 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.245704 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e83b9-9dff-4623-88a2-8e6a1835be57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.323254 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e83b9-9dff-4623-88a2-8e6a1835be57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.324862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e83b9-9dff-4623-88a2-8e6a1835be57 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.412292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:38.433850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 214/436] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:38.439282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25f99c-9d47-4e3b-af5f-c29a3f64748c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.501042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb41317-c28f-4816-b869-6bcafcfea14d None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.501337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb41317-c28f-4816-b869-6bcafcfea14d None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.501616 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb41317-c28f-4816-b869-6bcafcfea14d None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.503176 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 215/437] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:38.509029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a079-97a7-4a75-843b-232a356b15b3 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.509504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a079-97a7-4a75-843b-232a356b15b3 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.509784 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a079-97a7-4a75-843b-232a356b15b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.527632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-2ad9a079-97a7-4a75-843b-232a356b15b3 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:38.528822 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-2ad9a079-97a7-4a75-843b-232a356b15b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:38.555742 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25f99c-9d47-4e3b-af5f-c29a3f64748c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.587349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:38.598006 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c35a1c-dd8f-4d1a-abfe-a4bb57b55e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.598937 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c35a1c-dd8f-4d1a-abfe-a4bb57b55e7b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.599217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c35a1c-dd8f-4d1a-abfe-a4bb57b55e7b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.599513 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c35a1c-dd8f-4d1a-abfe-a4bb57b55e7b None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.600674 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c35a1c-dd8f-4d1a-abfe-a4bb57b55e7b None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.602108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c35a1c-dd8f-4d1a-abfe-a4bb57b55e7b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.608453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 216/438] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:38.609028 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 223/439] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:38.609450 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9a079-97a7-4a75-843b-232a356b15b3 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.627513 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c35a1c-dd8f-4d1a-abfe-a4bb57b55e7b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.716729 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9a079-97a7-4a75-843b-232a356b15b3 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.728653 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:38.734964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c35a1c-dd8f-4d1a-abfe-a4bb57b55e7b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.758362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6472e-00e4-4039-ba2f-1a5d41687177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.759509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6472e-00e4-4039-ba2f-1a5d41687177 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.759797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6472e-00e4-4039-ba2f-1a5d41687177 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.760081 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6472e-00e4-4039-ba2f-1a5d41687177 None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.761615 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6472e-00e4-4039-ba2f-1a5d41687177 None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.763112 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6472e-00e4-4039-ba2f-1a5d41687177 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.773043 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 217/440] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:38.773915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6472e-00e4-4039-ba2f-1a5d41687177 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.782957 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554658a0-7e19-43dc-a34e-f390829e5202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.783763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554658a0-7e19-43dc-a34e-f390829e5202 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.784050 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554658a0-7e19-43dc-a34e-f390829e5202 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.784327 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554658a0-7e19-43dc-a34e-f390829e5202 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.804359 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554658a0-7e19-43dc-a34e-f390829e5202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-554658a0-7e19-43dc-a34e-f390829e5202 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:38.812089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:38.813107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:38.814012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 224/441] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:38.819616 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554658a0-7e19-43dc-a34e-f390829e5202 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.879843 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:38.893590 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6472e-00e4-4039-ba2f-1a5d41687177 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.927075 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554658a0-7e19-43dc-a34e-f390829e5202 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.929951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e623c0-95fd-4c09-a1bd-a895f090d39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.930716 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e623c0-95fd-4c09-a1bd-a895f090d39c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.931004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e623c0-95fd-4c09-a1bd-a895f090d39c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.931281 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e623c0-95fd-4c09-a1bd-a895f090d39c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.932130 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e623c0-95fd-4c09-a1bd-a895f090d39c None admin] RBAC: Adding query filter params (group.id=cd4b1c76a16047b491a21aa921bd00f6, role.id=a661e4208e2047e69b45e282caa0683b, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:38.932444 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e623c0-95fd-4c09-a1bd-a895f090d39c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.933871 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e623c0-95fd-4c09-a1bd-a895f090d39c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.939969 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 218/442] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/role_assignments?group.id=cd4b1c76a16047b491a21aa921bd00f6&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=a661e4208e2047e69b45e282caa0683b => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:38.941202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b6db-0194-4ed5-ab65-fc558b085014 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.941486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b6db-0194-4ed5-ab65-fc558b085014 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.941817 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b6db-0194-4ed5-ab65-fc558b085014 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.943761 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 219/443] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:38.949157 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc1138-44b7-4808-b575-05c2edd64ebf None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.949442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc1138-44b7-4808-b575-05c2edd64ebf None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.949718 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc1138-44b7-4808-b575-05c2edd64ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.967562 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-00bc1138-44b7-4808-b575-05c2edd64ebf None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:38.968702 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-00bc1138-44b7-4808-b575-05c2edd64ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:38.978932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cc573-4b3b-43dd-bf6e-944e0140f106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.979627 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cc573-4b3b-43dd-bf6e-944e0140f106 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.979917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cc573-4b3b-43dd-bf6e-944e0140f106 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.980194 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cc573-4b3b-43dd-bf6e-944e0140f106 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.980977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cc573-4b3b-43dd-bf6e-944e0140f106 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:38.981293 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cc573-4b3b-43dd-bf6e-944e0140f106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.982798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cc573-4b3b-43dd-bf6e-944e0140f106 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.993894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 225/444] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:38.999336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cc573-4b3b-43dd-bf6e-944e0140f106 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.010939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.048316 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 220/445] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:39.072768 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc1138-44b7-4808-b575-05c2edd64ebf None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.122662 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cc573-4b3b-43dd-bf6e-944e0140f106 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.144580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.167257 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b0926-68c0-4373-8b12-7ed869e2b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.167923 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b0926-68c0-4373-8b12-7ed869e2b3af None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.168213 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b0926-68c0-4373-8b12-7ed869e2b3af None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.168495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b0926-68c0-4373-8b12-7ed869e2b3af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.187051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc1138-44b7-4808-b575-05c2edd64ebf None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.226925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f514c70-c18a-4470-ae31-72d3984020bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.227831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f514c70-c18a-4470-ae31-72d3984020bd None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.228180 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f514c70-c18a-4470-ae31-72d3984020bd None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.228528 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f514c70-c18a-4470-ae31-72d3984020bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.240281 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f514c70-c18a-4470-ae31-72d3984020bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-3f514c70-c18a-4470-ae31-72d3984020bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:39.248934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:39.250235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:39.251317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:39.252013 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 221/446] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:39.254331 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b0926-68c0-4373-8b12-7ed869e2b3af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.256018 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b0926-68c0-4373-8b12-7ed869e2b3af None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.257442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f514c70-c18a-4470-ae31-72d3984020bd None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.300260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.379841 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f514c70-c18a-4470-ae31-72d3984020bd None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.381953 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 226/447] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:24:39.387463 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b0926-68c0-4373-8b12-7ed869e2b3af None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.404386 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.418942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dd743-cdd7-418a-b99c-23bf84cecfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.419619 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dd743-cdd7-418a-b99c-23bf84cecfcd None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.420551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dd743-cdd7-418a-b99c-23bf84cecfcd None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.420551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dd743-cdd7-418a-b99c-23bf84cecfcd None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.420911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30dd743-cdd7-418a-b99c-23bf84cecfcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:39.421220 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30dd743-cdd7-418a-b99c-23bf84cecfcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.422633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30dd743-cdd7-418a-b99c-23bf84cecfcd None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.431667 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 222/448] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:39.437153 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dd743-cdd7-418a-b99c-23bf84cecfcd None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.489323 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b0926-68c0-4373-8b12-7ed869e2b3af None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.523272 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc87aa-3f00-444c-ae7b-e52105df54d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.524138 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc87aa-3f00-444c-ae7b-e52105df54d4 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.524425 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc87aa-3f00-444c-ae7b-e52105df54d4 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.524706 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc87aa-3f00-444c-ae7b-e52105df54d4 None admin] PATH_INFO: `/v3/projects/4b2b197a0f67411c87c371c8b2a2dea8` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.525912 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc87aa-3f00-444c-ae7b-e52105df54d4 None admin] RBAC: Authorizing `identity:get_project(project_id=4b2b197a0f67411c87c371c8b2a2dea8)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.527413 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc87aa-3f00-444c-ae7b-e52105df54d4 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.529129 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 227/449] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/projects/4b2b197a0f67411c87c371c8b2a2dea8 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:39.534413 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc87aa-3f00-444c-ae7b-e52105df54d4 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.536195 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.542942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dd743-cdd7-418a-b99c-23bf84cecfcd None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.576959 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8cc16-75eb-448a-8e95-c297b10fb236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.577618 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8cc16-75eb-448a-8e95-c297b10fb236 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.577906 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8cc16-75eb-448a-8e95-c297b10fb236 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.578190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8cc16-75eb-448a-8e95-c297b10fb236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.619542 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.636512 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc87aa-3f00-444c-ae7b-e52105df54d4 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.657571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8cc16-75eb-448a-8e95-c297b10fb236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.659082 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8cc16-75eb-448a-8e95-c297b10fb236 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.673418 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a8fb6-2ef8-43eb-9435-1a19f39120c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.674286 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a8fb6-2ef8-43eb-9435-1a19f39120c4 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.674567 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a8fb6-2ef8-43eb-9435-1a19f39120c4 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.674881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a8fb6-2ef8-43eb-9435-1a19f39120c4 None admin] PATH_INFO: `/v3/groups/47efab687e804171ad4c2794a05613f7` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.676080 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a8fb6-2ef8-43eb-9435-1a19f39120c4 None admin] RBAC: Authorizing `identity:get_group(group_id=47efab687e804171ad4c2794a05613f7)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.677772 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a8fb6-2ef8-43eb-9435-1a19f39120c4 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.679432 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 228/450] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/groups/47efab687e804171ad4c2794a05613f7 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:39.685120 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a8fb6-2ef8-43eb-9435-1a19f39120c4 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.752403 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.759605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 223/451] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:24:39.765151 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8cc16-75eb-448a-8e95-c297b10fb236 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.785330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a8fb6-2ef8-43eb-9435-1a19f39120c4 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.820791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cec29b-8ede-4423-b912-9749d26780c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.821449 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cec29b-8ede-4423-b912-9749d26780c0 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.821731 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cec29b-8ede-4423-b912-9749d26780c0 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.822017 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cec29b-8ede-4423-b912-9749d26780c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.822886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cec29b-8ede-4423-b912-9749d26780c0 None admin] RBAC: Adding query filter params (group.id=47efab687e804171ad4c2794a05613f7, role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=4b2b197a0f67411c87c371c8b2a2dea8) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:39.823203 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cec29b-8ede-4423-b912-9749d26780c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.824641 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cec29b-8ede-4423-b912-9749d26780c0 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.830476 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 229/452] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/role_assignments?group.id=47efab687e804171ad4c2794a05613f7&scope.project.id=4b2b197a0f67411c87c371c8b2a2dea8&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:39.871529 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8cc16-75eb-448a-8e95-c297b10fb236 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.909548 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d141e6e-c25a-4c06-9c37-5edfd1ca4db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.910592 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d141e6e-c25a-4c06-9c37-5edfd1ca4db5 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.910904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d141e6e-c25a-4c06-9c37-5edfd1ca4db5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.911184 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d141e6e-c25a-4c06-9c37-5edfd1ca4db5 None admin] PATH_INFO: `/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.912521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d141e6e-c25a-4c06-9c37-5edfd1ca4db5 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc86a6aca544e2b9b180fb63e16f39a)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.914090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d141e6e-c25a-4c06-9c37-5edfd1ca4db5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.925125 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 224/453] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/projects/9fc86a6aca544e2b9b180fb63e16f39a => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:39.931198 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cec29b-8ede-4423-b912-9749d26780c0 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.951657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:40.041904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cec29b-8ede-4423-b912-9749d26780c0 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:40.077368 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc043747-9dce-491e-92a9-34941d5f973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:40.078232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043747-9dce-491e-92a9-34941d5f973a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:40.078517 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043747-9dce-491e-92a9-34941d5f973a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:40.078869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043747-9dce-491e-92a9-34941d5f973a None admin] PATH_INFO: `/v3/groups/cd4b1c76a16047b491a21aa921bd00f6` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:40.080055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc043747-9dce-491e-92a9-34941d5f973a None admin] RBAC: Authorizing `identity:get_group(group_id=cd4b1c76a16047b491a21aa921bd00f6)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:40.081548 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc043747-9dce-491e-92a9-34941d5f973a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:40.083775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 230/454] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/groups/cd4b1c76a16047b491a21aa921bd00f6 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:40.089585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d141e6e-c25a-4c06-9c37-5edfd1ca4db5 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:40.149407 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:40.186395 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d141e6e-c25a-4c06-9c37-5edfd1ca4db5 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:40.219941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5a92b-74a6-4f6a-a06a-28ef62e955d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:40.220599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5a92b-74a6-4f6a-a06a-28ef62e955d1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:40.220888 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5a92b-74a6-4f6a-a06a-28ef62e955d1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:40.221170 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5a92b-74a6-4f6a-a06a-28ef62e955d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:40.222075 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5a92b-74a6-4f6a-a06a-28ef62e955d1 None admin] RBAC: Adding query filter params (group.id=cd4b1c76a16047b491a21aa921bd00f6, role.id=920e2cadf3044abda66c715e1c89f4e3, scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:40.222390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5a92b-74a6-4f6a-a06a-28ef62e955d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:40.223864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5a92b-74a6-4f6a-a06a-28ef62e955d1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:40.229687 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 225/455] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:24:40 2022] GET /identity/v3/role_assignments?group.id=cd4b1c76a16047b491a21aa921bd00f6&scope.project.id=9fc86a6aca544e2b9b180fb63e16f39a&role.id=920e2cadf3044abda66c715e1c89f4e3 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:42.980347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14cf13-6faf-4930-9472-5b8d26cc3a3e None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.981386 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14cf13-6faf-4930-9472-5b8d26cc3a3e None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.981885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14cf13-6faf-4930-9472-5b8d26cc3a3e None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.983865 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 231/456] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:42.989579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892758e-728e-4681-975d-6d8d01e3cdab None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.990450 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892758e-728e-4681-975d-6d8d01e3cdab None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.990954 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892758e-728e-4681-975d-6d8d01e3cdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.015598 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-1892758e-728e-4681-975d-6d8d01e3cdab None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:43.017131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-1892758e-728e-4681-975d-6d8d01e3cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:43.125536 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 226/457] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:43.163216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14cf13-6faf-4930-9472-5b8d26cc3a3e None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:43.274653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:43.286629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3440-3de4-4679-a93a-b9be94971c49 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.287232 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3440-3de4-4679-a93a-b9be94971c49 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.287677 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3440-3de4-4679-a93a-b9be94971c49 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.289420 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 227/458] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:43.296826 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14cf13-6faf-4930-9472-5b8d26cc3a3e None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:43.298338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432a29f-5d07-45d1-a5a3-94468b974f46 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.298881 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432a29f-5d07-45d1-a5a3-94468b974f46 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.299394 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432a29f-5d07-45d1-a5a3-94468b974f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.330486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-0432a29f-5d07-45d1-a5a3-94468b974f46 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:43.331801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-0432a29f-5d07-45d1-a5a3-94468b974f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:43.336120 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3256-4bce-4dc1-9d15-134942a6c843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:43.337146 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3256-4bce-4dc1-9d15-134942a6c843 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.337608 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3256-4bce-4dc1-9d15-134942a6c843 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.338073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3256-4bce-4dc1-9d15-134942a6c843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.354892 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf3256-4bce-4dc1-9d15-134942a6c843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:43.356687 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf3256-4bce-4dc1-9d15-134942a6c843 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-ecdf3256-4bce-4dc1-9d15-134942a6c843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:43.394114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:43.395867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:43.396834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:43.396834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:43.396834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:43.396834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:43.400970 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 232/459] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:43.402642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3256-4bce-4dc1-9d15-134942a6c843 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:43.434718 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:43.442468 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 228/460] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:43.488470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432a29f-5d07-45d1-a5a3-94468b974f46 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:43.593530 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3256-4bce-4dc1-9d15-134942a6c843 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:43.634083 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432a29f-5d07-45d1-a5a3-94468b974f46 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:43.666092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c8e7-d76c-4d1c-8fa8-6bb1742e5809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:43.666709 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c8e7-d76c-4d1c-8fa8-6bb1742e5809 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.666994 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c8e7-d76c-4d1c-8fa8-6bb1742e5809 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.667267 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c8e7-d76c-4d1c-8fa8-6bb1742e5809 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.667999 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887c8e7-d76c-4d1c-8fa8-6bb1742e5809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:43.668302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887c8e7-d76c-4d1c-8fa8-6bb1742e5809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:43.669700 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887c8e7-d76c-4d1c-8fa8-6bb1742e5809 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:43.673433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0799fd-4716-46a8-ad70-aae8c16b2bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:43.673974 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:43.675276 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0799fd-4716-46a8-ad70-aae8c16b2bd6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.675634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0799fd-4716-46a8-ad70-aae8c16b2bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.676011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0799fd-4716-46a8-ad70-aae8c16b2bd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.687658 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0799fd-4716-46a8-ad70-aae8c16b2bd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:43.689311 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0799fd-4716-46a8-ad70-aae8c16b2bd6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:43.690986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 233/461] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:43.693920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299ffc-e786-48a5-90b9-a576003b8337 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.694421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299ffc-e786-48a5-90b9-a576003b8337 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.694942 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299ffc-e786-48a5-90b9-a576003b8337 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.696916 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 234/462] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:43.702977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05299ffc-e786-48a5-90b9-a576003b8337 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-fe0799fd-4716-46a8-ad70-aae8c16b2bd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:43.710554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:43.711540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:43.712622 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:43.712622 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:43.712622 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:43.712622 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:43.712622 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 229/463] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:43.713936 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b587c-2289-4269-8bd0-f8345e755d8a None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.714302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b587c-2289-4269-8bd0-f8345e755d8a None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.714698 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b587c-2289-4269-8bd0-f8345e755d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.734153 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-451b587c-2289-4269-8bd0-f8345e755d8a None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:43.735505 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-451b587c-2289-4269-8bd0-f8345e755d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:43.768613 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:43.815133 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 230/464] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:43.817060 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b587c-2289-4269-8bd0-f8345e755d8a None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:43.842780 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05299ffc-e786-48a5-90b9-a576003b8337 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:43.890666 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91379e9-38c1-4548-aac1-d252048da011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:43.892255 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91379e9-38c1-4548-aac1-d252048da011 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.892704 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91379e9-38c1-4548-aac1-d252048da011 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.893402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91379e9-38c1-4548-aac1-d252048da011 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.894313 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91379e9-38c1-4548-aac1-d252048da011 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:43.897781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91379e9-38c1-4548-aac1-d252048da011 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:43.931052 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b587c-2289-4269-8bd0-f8345e755d8a None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:43.967236 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffb38-6fd4-4550-a63c-6093196473ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:43.967909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffb38-6fd4-4550-a63c-6093196473ff None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.968190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffb38-6fd4-4550-a63c-6093196473ff None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.968462 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffb38-6fd4-4550-a63c-6093196473ff None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.969206 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ffb38-6fd4-4550-a63c-6093196473ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:43.969511 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ffb38-6fd4-4550-a63c-6093196473ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:43.970908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ffb38-6fd4-4550-a63c-6093196473ff None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:43.982660 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 231/465] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:43.983535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffb38-6fd4-4550-a63c-6093196473ff None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:44.002794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 235/466] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:24:43 2022] POST /identity/v3/users => generated 246 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:44.006424 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91379e9-38c1-4548-aac1-d252048da011 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:44.023501 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:44.126030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:44.158165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffb38-6fd4-4550-a63c-6093196473ff None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:44.229066 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91379e9-38c1-4548-aac1-d252048da011 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:44.229450 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffe333-3969-4d7a-8e13-036c57abb68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:44.230329 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe333-3969-4d7a-8e13-036c57abb68d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.230638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe333-3969-4d7a-8e13-036c57abb68d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.230920 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe333-3969-4d7a-8e13-036c57abb68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.246958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffe333-3969-4d7a-8e13-036c57abb68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:44.248448 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffe333-3969-4d7a-8e13-036c57abb68d None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-9fffe333-3969-4d7a-8e13-036c57abb68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:44.270487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:44.271549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:44.272502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:44.272502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:44.272502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:44.272502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:44.272502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 232/467] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:44.273340 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547ba4b-225c-4226-a9e3-91812898d32a None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.278500 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547ba4b-225c-4226-a9e3-91812898d32a None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.278500 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547ba4b-225c-4226-a9e3-91812898d32a None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.278500 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 233/468] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:44.281008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547ba4b-225c-4226-a9e3-91812898d32a None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:44.282951 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db216528-e6fb-4fb6-a359-68e056eb89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:44.283647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db216528-e6fb-4fb6-a359-68e056eb89e5 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.283929 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db216528-e6fb-4fb6-a359-68e056eb89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.284209 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db216528-e6fb-4fb6-a359-68e056eb89e5 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.285147 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db216528-e6fb-4fb6-a359-68e056eb89e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:44.287204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db216528-e6fb-4fb6-a359-68e056eb89e5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:44.377122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 236/469] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:24:44 2022] POST /identity/v3/users => generated 248 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:44.378420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd01f5-c0fb-4916-95dc-d208514d77d9 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.378732 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd01f5-c0fb-4916-95dc-d208514d77d9 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.379059 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd01f5-c0fb-4916-95dc-d208514d77d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.393626 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:44.407511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-d7dd01f5-c0fb-4916-95dc-d208514d77d9 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:44.408840 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-d7dd01f5-c0fb-4916-95dc-d208514d77d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:44.423219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547ba4b-225c-4226-a9e3-91812898d32a None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:44.470664 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e01dc-8896-408b-bd06-e28fbf68a01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:44.471961 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e01dc-8896-408b-bd06-e28fbf68a01a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.472725 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e01dc-8896-408b-bd06-e28fbf68a01a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.473159 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e01dc-8896-408b-bd06-e28fbf68a01a None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.473981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e01dc-8896-408b-bd06-e28fbf68a01a None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:44.474294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e01dc-8896-408b-bd06-e28fbf68a01a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:44.476244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e01dc-8896-408b-bd06-e28fbf68a01a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:44.494187 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 234/470] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:44.495890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b3261-30cb-490c-8a19-09f268a70bd8 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.496285 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b3261-30cb-490c-8a19-09f268a70bd8 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.496661 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b3261-30cb-490c-8a19-09f268a70bd8 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.503204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 235/471] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:44.504853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b3261-30cb-490c-8a19-09f268a70bd8 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:44.513044 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 237/472] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:44.514563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018fd3-4ba9-420f-820f-471aefdea8a4 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.514942 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018fd3-4ba9-420f-820f-471aefdea8a4 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.515228 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018fd3-4ba9-420f-820f-471aefdea8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.542240 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-66018fd3-4ba9-420f-820f-471aefdea8a4 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:44.543678 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-66018fd3-4ba9-420f-820f-471aefdea8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:44.587223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:44.639297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 238/473] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:44.640353 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66018fd3-4ba9-420f-820f-471aefdea8a4 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:44.646097 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b3261-30cb-490c-8a19-09f268a70bd8 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:44.687234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705a067-ddf7-4dbe-8a2d-475cfa08762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:44.687931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a067-ddf7-4dbe-8a2d-475cfa08762b None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.688212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a067-ddf7-4dbe-8a2d-475cfa08762b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.688486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a067-ddf7-4dbe-8a2d-475cfa08762b None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.689201 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705a067-ddf7-4dbe-8a2d-475cfa08762b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:44.690671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705a067-ddf7-4dbe-8a2d-475cfa08762b None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:44.701941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:44.762195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66018fd3-4ba9-420f-820f-471aefdea8a4 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:44.815559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 236/474] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:24:44 2022] POST /identity/v3/users => generated 248 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:44.815559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705a067-ddf7-4dbe-8a2d-475cfa08762b None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:44.825489 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57488ab-c606-486c-a7a8-8e13d8d9b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:44.827157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57488ab-c606-486c-a7a8-8e13d8d9b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.827703 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57488ab-c606-486c-a7a8-8e13d8d9b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.828530 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57488ab-c606-486c-a7a8-8e13d8d9b7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.862241 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57488ab-c606-486c-a7a8-8e13d8d9b7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:44.870870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57488ab-c606-486c-a7a8-8e13d8d9b7a9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-a57488ab-c606-486c-a7a8-8e13d8d9b7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:44.937407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:44.939450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:44.940820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:44.940820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:44.940820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:44.940820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:44.948071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 239/475] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:44.958128 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57488ab-c606-486c-a7a8-8e13d8d9b7a9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:45.000482 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:45.048526 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705a067-ddf7-4dbe-8a2d-475cfa08762b None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:45.098341 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397a6aa-f950-4d15-898d-3a017ad9bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:45.099196 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a6aa-f950-4d15-898d-3a017ad9bd52 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.099539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a6aa-f950-4d15-898d-3a017ad9bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.099825 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a6aa-f950-4d15-898d-3a017ad9bd52 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.100590 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397a6aa-f950-4d15-898d-3a017ad9bd52 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:45.102003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397a6aa-f950-4d15-898d-3a017ad9bd52 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:45.132987 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57488ab-c606-486c-a7a8-8e13d8d9b7a9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:45.138066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.sql.core [None req-7397a6aa-f950-4d15-898d-3a017ad9bd52 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:24:45.138066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 20:24:45.138066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [parameters: {'id': '1b6650930908488c876692747dca5556', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 20:24:45.138066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=220180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-7397a6aa-f950-4d15-898d-3a017ad9bd52 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application conn.query(q) May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application result.read() May 19 20:24:45.161843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return ref.to_dict() May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:24:45.162971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application next(self.gen) May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application yield resource May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application next(self.gen) May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise self.value May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application session.commit() May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:24:45.164067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self.session.flush() May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application compat.raise_( May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:24:45.165779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:24:45.167036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application conn.query(q) May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application result.read() May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:24:45.168508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [parameters: {'id': '1b6650930908488c876692747dca5556', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:45.170682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 20:24:45.172850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:45.179177 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 237/476] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:24:44 2022] POST /identity/v3/roles => generated 144 bytes in 355 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:45.179177 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397a6aa-f950-4d15-898d-3a017ad9bd52 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:45.197547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8a255-57e7-405b-b8ab-a92f4e2ad9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:45.199336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8a255-57e7-405b-b8ab-a92f4e2ad9df None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.199868 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8a255-57e7-405b-b8ab-a92f4e2ad9df None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.200950 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8a255-57e7-405b-b8ab-a92f4e2ad9df None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.202286 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8a255-57e7-405b-b8ab-a92f4e2ad9df None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:45.202811 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8a255-57e7-405b-b8ab-a92f4e2ad9df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:45.205288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8a255-57e7-405b-b8ab-a92f4e2ad9df None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:45.226903 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 240/477] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:45.230274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8a255-57e7-405b-b8ab-a92f4e2ad9df None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:45.247932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:45.360939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397a6aa-f950-4d15-898d-3a017ad9bd52 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:45.393540 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:45.413262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa4837-33bd-4901-998e-f9cdfc2f54aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:45.414105 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa4837-33bd-4901-998e-f9cdfc2f54aa None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.414420 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa4837-33bd-4901-998e-f9cdfc2f54aa None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.414720 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa4837-33bd-4901-998e-f9cdfc2f54aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.422470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8a255-57e7-405b-b8ab-a92f4e2ad9df None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:45.445641 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa4837-33bd-4901-998e-f9cdfc2f54aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-cbaa4837-33bd-4901-998e-f9cdfc2f54aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:45.454294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:45.455440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:45.456359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:45.465371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 238/478] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:24:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:45.469452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeddf55-b929-4672-802f-1785bae4926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:45.470380 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeddf55-b929-4672-802f-1785bae4926f None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.472470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa4837-33bd-4901-998e-f9cdfc2f54aa None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:45.474571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeddf55-b929-4672-802f-1785bae4926f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.476684 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeddf55-b929-4672-802f-1785bae4926f None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.477606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeddf55-b929-4672-802f-1785bae4926f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:45.480265 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeddf55-b929-4672-802f-1785bae4926f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:45.581939 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 241/479] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:24:45 2022] POST /identity/v3/users => generated 249 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:24:45.596892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa4837-33bd-4901-998e-f9cdfc2f54aa None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:45.621772 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:45.639133 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fe4cf-d758-482b-aed5-ccc334ef605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:45.640215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fe4cf-d758-482b-aed5-ccc334ef605b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.640738 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fe4cf-d758-482b-aed5-ccc334ef605b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.641202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fe4cf-d758-482b-aed5-ccc334ef605b None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.642196 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fe4cf-d758-482b-aed5-ccc334ef605b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:45.642749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fe4cf-d758-482b-aed5-ccc334ef605b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:45.644397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fe4cf-d758-482b-aed5-ccc334ef605b None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:45.655747 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 239/480] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:46.799861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53a546-68a1-4870-b827-a4cf88d881c8 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:46.799861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53a546-68a1-4870-b827-a4cf88d881c8 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:46.799861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53a546-68a1-4870-b827-a4cf88d881c8 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:46.802116 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 242/481] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:46.807767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85123a7-8a7b-4121-9ed0-c24d899c4e86 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:46.808654 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85123a7-8a7b-4121-9ed0-c24d899c4e86 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:46.809144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85123a7-8a7b-4121-9ed0-c24d899c4e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:46.834820 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-c85123a7-8a7b-4121-9ed0-c24d899c4e86 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:46.836010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-c85123a7-8a7b-4121-9ed0-c24d899c4e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:46.941562 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 240/482] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:46.981454 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53a546-68a1-4870-b827-a4cf88d881c8 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.132536 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53a546-68a1-4870-b827-a4cf88d881c8 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:47.183314 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f6fd2-37b3-4efa-9a99-c89f42b346db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.184532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f6fd2-37b3-4efa-9a99-c89f42b346db None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.185029 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f6fd2-37b3-4efa-9a99-c89f42b346db None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.185515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f6fd2-37b3-4efa-9a99-c89f42b346db None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.196525 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:47.199718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f6fd2-37b3-4efa-9a99-c89f42b346db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-ac2f6fd2-37b3-4efa-9a99-c89f42b346db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:47.208493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:47.209776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:47.210894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:47.212963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 243/483] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:47.219132 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85123a7-8a7b-4121-9ed0-c24d899c4e86 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.345107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42864a36-337a-43ca-bdad-b513fce0a88a None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.345915 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42864a36-337a-43ca-bdad-b513fce0a88a None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.346335 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42864a36-337a-43ca-bdad-b513fce0a88a None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.350259 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 244/484] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:47.357247 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2959aba-f9ad-40ec-b61d-21366f29371c None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.357670 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2959aba-f9ad-40ec-b61d-21366f29371c None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.358084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2959aba-f9ad-40ec-b61d-21366f29371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.365828 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85123a7-8a7b-4121-9ed0-c24d899c4e86 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:47.393941 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-f2959aba-f9ad-40ec-b61d-21366f29371c None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:47.396031 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-f2959aba-f9ad-40ec-b61d-21366f29371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:47.411011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:47.439107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b811eef-b3d4-4757-8212-fbc0ab6d49f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.439861 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b811eef-b3d4-4757-8212-fbc0ab6d49f2 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.440151 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b811eef-b3d4-4757-8212-fbc0ab6d49f2 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.440432 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b811eef-b3d4-4757-8212-fbc0ab6d49f2 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.441888 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b811eef-b3d4-4757-8212-fbc0ab6d49f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:47.442208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b811eef-b3d4-4757-8212-fbc0ab6d49f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:47.443658 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b811eef-b3d4-4757-8212-fbc0ab6d49f2 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:47.453427 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 241/485] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:47.454768 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d2926-ffef-4bf6-8808-45ed570b51f3 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.455086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d2926-ffef-4bf6-8808-45ed570b51f3 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.455346 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d2926-ffef-4bf6-8808-45ed570b51f3 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.456905 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 242/486] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:47.462773 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d2926-ffef-4bf6-8808-45ed570b51f3 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.495686 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 245/487] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:47.497454 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ace4a-d47d-4429-a385-8ec2ab01124c None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.497848 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ace4a-d47d-4429-a385-8ec2ab01124c None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.498225 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ace4a-d47d-4429-a385-8ec2ab01124c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.516359 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-6e7ace4a-d47d-4429-a385-8ec2ab01124c None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:47.517718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-6e7ace4a-d47d-4429-a385-8ec2ab01124c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:47.579641 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d2926-ffef-4bf6-8808-45ed570b51f3 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:47.593572 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 246/488] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:47.594712 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ace4a-d47d-4429-a385-8ec2ab01124c None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.638176 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec70725-9595-4778-9a99-4aeab575cae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.639126 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec70725-9595-4778-9a99-4aeab575cae6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.639420 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec70725-9595-4778-9a99-4aeab575cae6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.639698 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec70725-9595-4778-9a99-4aeab575cae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.655260 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:47.656122 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec70725-9595-4778-9a99-4aeab575cae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:47.657588 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec70725-9595-4778-9a99-4aeab575cae6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-7ec70725-9595-4778-9a99-4aeab575cae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:47.676850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:47.678011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:47.679179 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:47.679179 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:47.679179 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:47.679179 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:47.679179 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 243/489] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:47.679554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec70725-9595-4778-9a99-4aeab575cae6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.706121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ace4a-d47d-4429-a385-8ec2ab01124c None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:47.710984 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:47.743916 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cfdca-2bbc-4c22-98db-9435553b0d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.745928 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfdca-2bbc-4c22-98db-9435553b0d3a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.746589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfdca-2bbc-4c22-98db-9435553b0d3a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.747111 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfdca-2bbc-4c22-98db-9435553b0d3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.759970 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cfdca-2bbc-4c22-98db-9435553b0d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-362cfdca-2bbc-4c22-98db-9435553b0d3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:47.768634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:47.769714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:47.770671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:47.773626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 247/490] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:47.774929 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cfdca-2bbc-4c22-98db-9435553b0d3a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.791235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec70725-9595-4778-9a99-4aeab575cae6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:47.830295 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a977d4b-4997-4c77-abf4-1094af57bf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.831147 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a977d4b-4997-4c77-abf4-1094af57bf63 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.831436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a977d4b-4997-4c77-abf4-1094af57bf63 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.831717 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a977d4b-4997-4c77-abf4-1094af57bf63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.846273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a977d4b-4997-4c77-abf4-1094af57bf63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-6a977d4b-4997-4c77-abf4-1094af57bf63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:47.857362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:47.858437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:47.859945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:47.862681 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 244/491] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:47.864526 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a977d4b-4997-4c77-abf4-1094af57bf63 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.900559 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cfdca-2bbc-4c22-98db-9435553b0d3a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:47.918638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:47.940156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716f338-5b3b-4a02-b4ad-1a950b9eca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.941182 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716f338-5b3b-4a02-b4ad-1a950b9eca6b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.942038 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716f338-5b3b-4a02-b4ad-1a950b9eca6b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.942465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716f338-5b3b-4a02-b4ad-1a950b9eca6b None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.943404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716f338-5b3b-4a02-b4ad-1a950b9eca6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:47.943715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716f338-5b3b-4a02-b4ad-1a950b9eca6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:47.945471 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716f338-5b3b-4a02-b4ad-1a950b9eca6b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:47.962035 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 248/492] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:47.963569 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716f338-5b3b-4a02-b4ad-1a950b9eca6b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.997221 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.013022 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a977d4b-4997-4c77-abf4-1094af57bf63 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.052049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31c97-09ad-4c25-93c4-a2f3597b5ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.053044 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31c97-09ad-4c25-93c4-a2f3597b5ea2 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.053334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31c97-09ad-4c25-93c4-a2f3597b5ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.053614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31c97-09ad-4c25-93c4-a2f3597b5ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.054375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f31c97-09ad-4c25-93c4-a2f3597b5ea2 None admin] RBAC: Adding query filter params (name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:48.054708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f31c97-09ad-4c25-93c4-a2f3597b5ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.057091 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f31c97-09ad-4c25-93c4-a2f3597b5ea2 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.067376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 245/493] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:48.068323 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31c97-09ad-4c25-93c4-a2f3597b5ea2 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.089889 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716f338-5b3b-4a02-b4ad-1a950b9eca6b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.130054 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b25f4b-69dc-4348-a03e-d3bc5ee763ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.131140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b25f4b-69dc-4348-a03e-d3bc5ee763ff None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.131674 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b25f4b-69dc-4348-a03e-d3bc5ee763ff None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.132176 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b25f4b-69dc-4348-a03e-d3bc5ee763ff None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.133284 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b25f4b-69dc-4348-a03e-d3bc5ee763ff None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:48.133907 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b25f4b-69dc-4348-a03e-d3bc5ee763ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.135648 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b25f4b-69dc-4348-a03e-d3bc5ee763ff None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.150048 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 249/494] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:48.151480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b25f4b-69dc-4348-a03e-d3bc5ee763ff None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.196032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31c97-09ad-4c25-93c4-a2f3597b5ea2 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.197252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.234426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2846-278a-4b5e-be4d-846661d8c603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.235683 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2846-278a-4b5e-be4d-846661d8c603 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.236216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2846-278a-4b5e-be4d-846661d8c603 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.236704 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2846-278a-4b5e-be4d-846661d8c603 None admin] PATH_INFO: `/v3/users/nova` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.253427 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a2846-278a-4b5e-be4d-846661d8c603 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.255605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a2846-278a-4b5e-be4d-846661d8c603 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.275504 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b25f4b-69dc-4348-a03e-d3bc5ee763ff None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-138a2846-278a-4b5e-be4d-846661d8c603 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:24:48.276479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:48.277669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:48.278754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:48.278754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:48.278754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:24:48.278754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:24:48.278754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:24:48.278754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:24:48.278754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:24:48.278754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:24:48.278754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:24:48.278754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:48.278754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 246/495] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:48.280555 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2846-278a-4b5e-be4d-846661d8c603 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.295595 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.320981 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5aefe-b3a9-495a-ad1b-a764430b222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.323542 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5aefe-b3a9-495a-ad1b-a764430b222f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.324108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5aefe-b3a9-495a-ad1b-a764430b222f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.324614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5aefe-b3a9-495a-ad1b-a764430b222f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.342189 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5aefe-b3a9-495a-ad1b-a764430b222f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.343844 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5aefe-b3a9-495a-ad1b-a764430b222f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-c4e5aefe-b3a9-495a-ad1b-a764430b222f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:48.373534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:48.374552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:48.376351 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:48.376351 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:48.376351 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:48.376351 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:48.376351 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 250/496] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:48.376351 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5aefe-b3a9-495a-ad1b-a764430b222f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.414257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2846-278a-4b5e-be4d-846661d8c603 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.457520 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4ce3e-55b5-45d4-8add-4b5f22ebb518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.458313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4ce3e-55b5-45d4-8add-4b5f22ebb518 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.458727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4ce3e-55b5-45d4-8add-4b5f22ebb518 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.459158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4ce3e-55b5-45d4-8add-4b5f22ebb518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.473946 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4ce3e-55b5-45d4-8add-4b5f22ebb518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.475772 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4ce3e-55b5-45d4-8add-4b5f22ebb518 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.488783 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-c5a4ce3e-55b5-45d4-8add-4b5f22ebb518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:48.496749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:48.511594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:48.512719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:48.512719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:48.512719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:48.512719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:48.513043 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5aefe-b3a9-495a-ad1b-a764430b222f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.513130 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 247/497] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:48.513130 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4ce3e-55b5-45d4-8add-4b5f22ebb518 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.537426 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddd65f-ecef-46bd-91d4-4bc5444a2e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.538107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddd65f-ecef-46bd-91d4-4bc5444a2e29 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.538390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddd65f-ecef-46bd-91d4-4bc5444a2e29 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.538689 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddd65f-ecef-46bd-91d4-4bc5444a2e29 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.539543 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddd65f-ecef-46bd-91d4-4bc5444a2e29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:48.539860 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddd65f-ecef-46bd-91d4-4bc5444a2e29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.541419 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddd65f-ecef-46bd-91d4-4bc5444a2e29 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.578501 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.582811 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 251/498] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:48.582811 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddd65f-ecef-46bd-91d4-4bc5444a2e29 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.629493 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4ce3e-55b5-45d4-8add-4b5f22ebb518 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.668217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b64803-1673-4709-8ccd-e84d0271c1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.669287 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b64803-1673-4709-8ccd-e84d0271c1ae None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.669584 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b64803-1673-4709-8ccd-e84d0271c1ae None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.669866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b64803-1673-4709-8ccd-e84d0271c1ae None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.671004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b64803-1673-4709-8ccd-e84d0271c1ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:48.671491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b64803-1673-4709-8ccd-e84d0271c1ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.672919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b64803-1673-4709-8ccd-e84d0271c1ae None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.686579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 248/499] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:48.688063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835163d-3e05-480e-ab32-34f451cb68d4 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.688355 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835163d-3e05-480e-ab32-34f451cb68d4 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.688632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835163d-3e05-480e-ab32-34f451cb68d4 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.690189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 249/500] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:48.691231 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835163d-3e05-480e-ab32-34f451cb68d4 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.694697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddd65f-ecef-46bd-91d4-4bc5444a2e29 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.731501 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ffa8c-6f86-4853-8e27-754df1248779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.732087 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ffa8c-6f86-4853-8e27-754df1248779 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.732378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ffa8c-6f86-4853-8e27-754df1248779 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.732654 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ffa8c-6f86-4853-8e27-754df1248779 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.733382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ffa8c-6f86-4853-8e27-754df1248779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:48.733693 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ffa8c-6f86-4853-8e27-754df1248779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.735213 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ffa8c-6f86-4853-8e27-754df1248779 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.751260 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 252/501] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:48.751260 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31169696-802c-48b3-851e-fddfdf7357ae None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.751260 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31169696-802c-48b3-851e-fddfdf7357ae None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.751260 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31169696-802c-48b3-851e-fddfdf7357ae None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.751260 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 253/502] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:48.751260 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31169696-802c-48b3-851e-fddfdf7357ae None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.761527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.800751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835163d-3e05-480e-ab32-34f451cb68d4 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.822127 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.837260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b746429-4e06-4d99-9e20-23b3faee2cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.837925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b746429-4e06-4d99-9e20-23b3faee2cd9 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.838212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b746429-4e06-4d99-9e20-23b3faee2cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.838494 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b746429-4e06-4d99-9e20-23b3faee2cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.859092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31169696-802c-48b3-851e-fddfdf7357ae None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.894110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54c915-7a78-4415-a044-782359f6fdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.895805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c915-7a78-4415-a044-782359f6fdb2 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.896154 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c915-7a78-4415-a044-782359f6fdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.896570 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c915-7a78-4415-a044-782359f6fdb2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.906247 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54c915-7a78-4415-a044-782359f6fdb2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.907918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54c915-7a78-4415-a044-782359f6fdb2 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.910712 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b746429-4e06-4d99-9e20-23b3faee2cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.912190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b746429-4e06-4d99-9e20-23b3faee2cd9 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-4a54c915-7a78-4415-a044-782359f6fdb2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:24:48.924480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:48.925660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:48.927378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:48.927378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:48.927378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:24:48.927378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:24:48.927378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:24:48.927378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:24:48.927378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:24:48.927378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:24:48.927378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:24:48.927378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:48.927378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 254/503] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:48.928211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862fe98-a92b-4bb2-a399-6d1b13ccfe69 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.928211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862fe98-a92b-4bb2-a399-6d1b13ccfe69 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.928211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862fe98-a92b-4bb2-a399-6d1b13ccfe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.945342 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-0862fe98-a92b-4bb2-a399-6d1b13ccfe69 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:48.946451 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-0862fe98-a92b-4bb2-a399-6d1b13ccfe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:49.009379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.014506 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 255/504] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:49.015349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862fe98-a92b-4bb2-a399-6d1b13ccfe69 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.033214 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 250/505] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:49.035175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7552a-9ca7-454f-9025-8ca086b492f5 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.035767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7552a-9ca7-454f-9025-8ca086b492f5 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.036226 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7552a-9ca7-454f-9025-8ca086b492f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.054474 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-fbc7552a-9ca7-454f-9025-8ca086b492f5 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:49.055729 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-fbc7552a-9ca7-454f-9025-8ca086b492f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:49.070393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.116885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862fe98-a92b-4bb2-a399-6d1b13ccfe69 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.123942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 251/506] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:49.124789 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7552a-9ca7-454f-9025-8ca086b492f5 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.153382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470e91e-fe59-4154-af31-91a7bf686847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.154200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470e91e-fe59-4154-af31-91a7bf686847 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.154463 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470e91e-fe59-4154-af31-91a7bf686847 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.154769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470e91e-fe59-4154-af31-91a7bf686847 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.162270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470e91e-fe59-4154-af31-91a7bf686847 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.163802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470e91e-fe59-4154-af31-91a7bf686847 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-2470e91e-fe59-4154-af31-91a7bf686847 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:24:49.180444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:49.181669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 256/507] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:49.182727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470e91e-fe59-4154-af31-91a7bf686847 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.242261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7552a-9ca7-454f-9025-8ca086b492f5 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.248586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.278126 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabc857-da5c-4e4f-82b9-39258c9a0f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.278749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabc857-da5c-4e4f-82b9-39258c9a0f2c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.279036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabc857-da5c-4e4f-82b9-39258c9a0f2c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.279321 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabc857-da5c-4e4f-82b9-39258c9a0f2c None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.280167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabc857-da5c-4e4f-82b9-39258c9a0f2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:49.280478 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabc857-da5c-4e4f-82b9-39258c9a0f2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.281912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabc857-da5c-4e4f-82b9-39258c9a0f2c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.291645 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470e91e-fe59-4154-af31-91a7bf686847 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.321940 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 252/508] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:49.322845 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabc857-da5c-4e4f-82b9-39258c9a0f2c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.332153 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7817d0-7dd4-41a8-b8d7-43189023ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.332967 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7817d0-7dd4-41a8-b8d7-43189023ee18 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.333236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7817d0-7dd4-41a8-b8d7-43189023ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.333391 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.333548 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7817d0-7dd4-41a8-b8d7-43189023ee18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.343810 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7817d0-7dd4-41a8-b8d7-43189023ee18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.345277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7817d0-7dd4-41a8-b8d7-43189023ee18 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-8c7817d0-7dd4-41a8-b8d7-43189023ee18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:49.362917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:49.364594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:49.365600 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:49.365600 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:49.365600 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:49.365600 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:49.365600 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 257/509] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:49.365909 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7817d0-7dd4-41a8-b8d7-43189023ee18 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.426941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabc857-da5c-4e4f-82b9-39258c9a0f2c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.461486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10305767-3d0e-4068-86d4-72ee5c3e3961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.462577 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305767-3d0e-4068-86d4-72ee5c3e3961 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.462889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305767-3d0e-4068-86d4-72ee5c3e3961 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.463166 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305767-3d0e-4068-86d4-72ee5c3e3961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.469948 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7817d0-7dd4-41a8-b8d7-43189023ee18 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.473887 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10305767-3d0e-4068-86d4-72ee5c3e3961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.475406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10305767-3d0e-4068-86d4-72ee5c3e3961 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.481414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-10305767-3d0e-4068-86d4-72ee5c3e3961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:49.492972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:49.494029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:49.495068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:49.495068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:49.495068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:49.495068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:49.495068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 253/510] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:49.495619 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10305767-3d0e-4068-86d4-72ee5c3e3961 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.506723 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe318f7-6e58-42e1-8e0c-88d0f299b99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.507901 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe318f7-6e58-42e1-8e0c-88d0f299b99a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.508182 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe318f7-6e58-42e1-8e0c-88d0f299b99a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.508789 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe318f7-6e58-42e1-8e0c-88d0f299b99a None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.519125 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe318f7-6e58-42e1-8e0c-88d0f299b99a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-efe318f7-6e58-42e1-8e0c-88d0f299b99a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:49.528262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:49.529404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:49.530322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 258/511] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:49.531128 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe318f7-6e58-42e1-8e0c-88d0f299b99a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.559689 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.602417 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10305767-3d0e-4068-86d4-72ee5c3e3961 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.630934 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe318f7-6e58-42e1-8e0c-88d0f299b99a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.635339 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666b89d-4829-44e8-81af-c221f47f4544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.636102 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666b89d-4829-44e8-81af-c221f47f4544 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.636382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666b89d-4829-44e8-81af-c221f47f4544 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.636653 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666b89d-4829-44e8-81af-c221f47f4544 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.637490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666b89d-4829-44e8-81af-c221f47f4544 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:49.637801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666b89d-4829-44e8-81af-c221f47f4544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.639279 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666b89d-4829-44e8-81af-c221f47f4544 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.656821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 254/512] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:49.657701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666b89d-4829-44e8-81af-c221f47f4544 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.669188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a4636-75c5-4367-b249-f98d4623e55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.669835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a4636-75c5-4367-b249-f98d4623e55c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.670114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a4636-75c5-4367-b249-f98d4623e55c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.670384 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a4636-75c5-4367-b249-f98d4623e55c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.711340 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.739637 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a4636-75c5-4367-b249-f98d4623e55c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.741114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a4636-75c5-4367-b249-f98d4623e55c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.763166 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666b89d-4829-44e8-81af-c221f47f4544 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.780866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.798240 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210accc-e32f-4041-81a3-dea8b9ea77bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.798949 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210accc-e32f-4041-81a3-dea8b9ea77bc None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.799239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210accc-e32f-4041-81a3-dea8b9ea77bc None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.799514 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210accc-e32f-4041-81a3-dea8b9ea77bc None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.800242 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210accc-e32f-4041-81a3-dea8b9ea77bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:49.800547 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210accc-e32f-4041-81a3-dea8b9ea77bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.802858 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210accc-e32f-4041-81a3-dea8b9ea77bc None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.814565 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 255/513] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:49.815422 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210accc-e32f-4041-81a3-dea8b9ea77bc None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.844436 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 259/514] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:49.845291 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a4636-75c5-4367-b249-f98d4623e55c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.915602 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.916479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210accc-e32f-4041-81a3-dea8b9ea77bc None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.946769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a4636-75c5-4367-b249-f98d4623e55c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.949948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176c130-ddb4-4f82-a6c4-acc9708d8ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.950655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176c130-ddb4-4f82-a6c4-acc9708d8ba3 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.950947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176c130-ddb4-4f82-a6c4-acc9708d8ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.951225 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176c130-ddb4-4f82-a6c4-acc9708d8ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.951951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176c130-ddb4-4f82-a6c4-acc9708d8ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:49.952260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176c130-ddb4-4f82-a6c4-acc9708d8ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.953637 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176c130-ddb4-4f82-a6c4-acc9708d8ba3 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.966089 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 256/515] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:49.966928 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176c130-ddb4-4f82-a6c4-acc9708d8ba3 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.985187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969dfa4-7afa-4bda-957f-1193ad3b5454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.985865 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969dfa4-7afa-4bda-957f-1193ad3b5454 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.986148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969dfa4-7afa-4bda-957f-1193ad3b5454 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.986423 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969dfa4-7afa-4bda-957f-1193ad3b5454 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.987222 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969dfa4-7afa-4bda-957f-1193ad3b5454 None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:49.987531 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969dfa4-7afa-4bda-957f-1193ad3b5454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.988968 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969dfa4-7afa-4bda-957f-1193ad3b5454 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.999947 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 260/516] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:49.999947 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969dfa4-7afa-4bda-957f-1193ad3b5454 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.013171 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.077030 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176c130-ddb4-4f82-a6c4-acc9708d8ba3 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.102198 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969dfa4-7afa-4bda-957f-1193ad3b5454 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.112114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44ac85-6d1f-4a57-a151-0fa53da65978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.112774 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ac85-6d1f-4a57-a151-0fa53da65978 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.113077 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ac85-6d1f-4a57-a151-0fa53da65978 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.113356 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ac85-6d1f-4a57-a151-0fa53da65978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.131598 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.136785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac400b-919f-4adc-a514-205fc2ae779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.137579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac400b-919f-4adc-a514-205fc2ae779c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.137867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac400b-919f-4adc-a514-205fc2ae779c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.138145 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac400b-919f-4adc-a514-205fc2ae779c None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.145631 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac400b-919f-4adc-a514-205fc2ae779c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.147130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac400b-919f-4adc-a514-205fc2ae779c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-c1ac400b-919f-4adc-a514-205fc2ae779c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:24:50.162800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:50.163805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:50.164877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:24:50.164877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:24:50.164877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:24:50.164877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:24:50.164877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:24:50.164877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:24:50.164877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:50.164877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:50.164877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 261/517] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:50.164877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac400b-919f-4adc-a514-205fc2ae779c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.186410 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44ac85-6d1f-4a57-a151-0fa53da65978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.188000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44ac85-6d1f-4a57-a151-0fa53da65978 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.229546 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.276302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac400b-919f-4adc-a514-205fc2ae779c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.291968 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 257/518] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:50.292792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44ac85-6d1f-4a57-a151-0fa53da65978 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.312606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a29e6-2fbf-4be8-95d3-03b7d0f5fd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.313409 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a29e6-2fbf-4be8-95d3-03b7d0f5fd4f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.313689 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a29e6-2fbf-4be8-95d3-03b7d0f5fd4f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.313975 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a29e6-2fbf-4be8-95d3-03b7d0f5fd4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.325031 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a29e6-2fbf-4be8-95d3-03b7d0f5fd4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.326593 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a29e6-2fbf-4be8-95d3-03b7d0f5fd4f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-ab7a29e6-2fbf-4be8-95d3-03b7d0f5fd4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:50.350733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:50.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:50.357851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:50.357851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:50.357851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:50.357851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:50.357851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 262/519] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:50.357851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a29e6-2fbf-4be8-95d3-03b7d0f5fd4f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.399964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.413675 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44ac85-6d1f-4a57-a151-0fa53da65978 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.449010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6466d9-4b1a-4e7a-9c9d-a254bd08ef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.449682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6466d9-4b1a-4e7a-9c9d-a254bd08ef64 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.449960 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6466d9-4b1a-4e7a-9c9d-a254bd08ef64 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.450240 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6466d9-4b1a-4e7a-9c9d-a254bd08ef64 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.450966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6466d9-4b1a-4e7a-9c9d-a254bd08ef64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.452451 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6466d9-4b1a-4e7a-9c9d-a254bd08ef64 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.456990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a29e6-2fbf-4be8-95d3-03b7d0f5fd4f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.461587 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.491306 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7985b-794d-4f47-b62b-c74f5301dade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.492101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7985b-794d-4f47-b62b-c74f5301dade None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.492384 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7985b-794d-4f47-b62b-c74f5301dade None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.492661 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7985b-794d-4f47-b62b-c74f5301dade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.502690 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7985b-794d-4f47-b62b-c74f5301dade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.504739 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7985b-794d-4f47-b62b-c74f5301dade None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-65b7985b-794d-4f47-b62b-c74f5301dade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:50.522881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:50.523990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:50.525197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:50.525197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:50.525197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:50.525197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:50.525197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 263/520] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:50.525197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7985b-794d-4f47-b62b-c74f5301dade None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.580065 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 258/521] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:24:50 2022] POST /identity/v3/users => generated 247 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:50.581080 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6466d9-4b1a-4e7a-9c9d-a254bd08ef64 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.633316 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.640678 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7985b-794d-4f47-b62b-c74f5301dade None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.686666 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7fb5e-2cb1-46b9-8b66-c5155d0d5fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.687616 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7fb5e-2cb1-46b9-8b66-c5155d0d5fab None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.687976 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7fb5e-2cb1-46b9-8b66-c5155d0d5fab None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.688320 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7fb5e-2cb1-46b9-8b66-c5155d0d5fab None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.689218 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7fb5e-2cb1-46b9-8b66-c5155d0d5fab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:50.689633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7fb5e-2cb1-46b9-8b66-c5155d0d5fab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.691216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7fb5e-2cb1-46b9-8b66-c5155d0d5fab None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.696924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6466d9-4b1a-4e7a-9c9d-a254bd08ef64 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.718118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 264/522] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:50.718118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7fb5e-2cb1-46b9-8b66-c5155d0d5fab None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.748743 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eddbd-6728-452b-ab23-e968ab6f12d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.749911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eddbd-6728-452b-ab23-e968ab6f12d6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.750194 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eddbd-6728-452b-ab23-e968ab6f12d6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.750478 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eddbd-6728-452b-ab23-e968ab6f12d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.762969 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4eddbd-6728-452b-ab23-e968ab6f12d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.764459 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4eddbd-6728-452b-ab23-e968ab6f12d6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-3d4eddbd-6728-452b-ab23-e968ab6f12d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:50.785257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:50.786260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:50.788168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:50.788168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:50.788168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:50.788168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:50.788168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 259/523] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:50.788770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eddbd-6728-452b-ab23-e968ab6f12d6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.842136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7fb5e-2cb1-46b9-8b66-c5155d0d5fab None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.851933 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.884207 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05050b-a45b-402c-87cb-0bf75c74abe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.884805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05050b-a45b-402c-87cb-0bf75c74abe6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.885091 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05050b-a45b-402c-87cb-0bf75c74abe6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.885366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05050b-a45b-402c-87cb-0bf75c74abe6 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05050b-a45b-402c-87cb-0bf75c74abe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:50.886478 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05050b-a45b-402c-87cb-0bf75c74abe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.887847 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05050b-a45b-402c-87cb-0bf75c74abe6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.904888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 265/524] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:50.904888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05050b-a45b-402c-87cb-0bf75c74abe6 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.919985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eddbd-6728-452b-ab23-e968ab6f12d6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.926826 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.960550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e334c-b0ca-4f2a-a1b7-0da666deb4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.961226 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e334c-b0ca-4f2a-a1b7-0da666deb4bb None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.961518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e334c-b0ca-4f2a-a1b7-0da666deb4bb None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.961802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e334c-b0ca-4f2a-a1b7-0da666deb4bb None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.962530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e334c-b0ca-4f2a-a1b7-0da666deb4bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:50.962891 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e334c-b0ca-4f2a-a1b7-0da666deb4bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.964302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e334c-b0ca-4f2a-a1b7-0da666deb4bb None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.979253 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 260/525] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:50.980442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e334c-b0ca-4f2a-a1b7-0da666deb4bb None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.022371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05050b-a45b-402c-87cb-0bf75c74abe6 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.060735 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc646cb-543c-4e18-960c-deb09346c5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.061777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc646cb-543c-4e18-960c-deb09346c5a6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.062316 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc646cb-543c-4e18-960c-deb09346c5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.062819 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc646cb-543c-4e18-960c-deb09346c5a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.063985 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc646cb-543c-4e18-960c-deb09346c5a6 None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=382eda270f1545718847c9687bd62846) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:51.064502 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc646cb-543c-4e18-960c-deb09346c5a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.066862 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc646cb-543c-4e18-960c-deb09346c5a6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.073810 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 266/526] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/role_assignments?user.id=382eda270f1545718847c9687bd62846&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:51.074894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc646cb-543c-4e18-960c-deb09346c5a6 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.100191 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e334c-b0ca-4f2a-a1b7-0da666deb4bb None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.110400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:51.155347 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe386c4-6ac1-4c0f-8738-bd888c1efad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.156372 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe386c4-6ac1-4c0f-8738-bd888c1efad2 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.156949 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe386c4-6ac1-4c0f-8738-bd888c1efad2 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.157469 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe386c4-6ac1-4c0f-8738-bd888c1efad2 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.158467 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe386c4-6ac1-4c0f-8738-bd888c1efad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:51.159047 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe386c4-6ac1-4c0f-8738-bd888c1efad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.161233 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe386c4-6ac1-4c0f-8738-bd888c1efad2 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.176252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 261/527] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:51.177916 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe386c4-6ac1-4c0f-8738-bd888c1efad2 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.194922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:51.217309 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc646cb-543c-4e18-960c-deb09346c5a6 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.259833 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1791d7-7297-4829-9551-746d7b6972c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.260723 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1791d7-7297-4829-9551-746d7b6972c9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.260896 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1791d7-7297-4829-9551-746d7b6972c9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.261179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1791d7-7297-4829-9551-746d7b6972c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.269299 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1791d7-7297-4829-9551-746d7b6972c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.271162 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1791d7-7297-4829-9551-746d7b6972c9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-cb1791d7-7297-4829-9551-746d7b6972c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:24:51.291516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:51.292864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:51.293870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:24:51.293870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:24:51.293870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:24:51.293870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:24:51.293870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:24:51.293870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:24:51.293870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:51.293870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:51.293870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 267/528] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:51.293870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1791d7-7297-4829-9551-746d7b6972c9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.310658 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe386c4-6ac1-4c0f-8738-bd888c1efad2 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.354677 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1244c-4b97-4257-bf6e-7460564b7af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.355903 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1244c-4b97-4257-bf6e-7460564b7af6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.356417 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1244c-4b97-4257-bf6e-7460564b7af6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.357375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1244c-4b97-4257-bf6e-7460564b7af6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.369933 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1244c-4b97-4257-bf6e-7460564b7af6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.371851 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1244c-4b97-4257-bf6e-7460564b7af6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-9da1244c-4b97-4257-bf6e-7460564b7af6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:24:51.392504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:51.393593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:51.394728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:51.394728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:51.394728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:24:51.394728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:24:51.394728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:24:51.394728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:24:51.394728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:24:51.394728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:24:51.394728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:24:51.394728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:51.402757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 262/529] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:51.402757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1244c-4b97-4257-bf6e-7460564b7af6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.434327 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:51.436327 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1791d7-7297-4829-9551-746d7b6972c9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.475284 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726be518-0ed5-4e38-b6ad-6d4392ec72c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.476499 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726be518-0ed5-4e38-b6ad-6d4392ec72c8 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.477000 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726be518-0ed5-4e38-b6ad-6d4392ec72c8 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.477521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726be518-0ed5-4e38-b6ad-6d4392ec72c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.487281 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726be518-0ed5-4e38-b6ad-6d4392ec72c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.489759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726be518-0ed5-4e38-b6ad-6d4392ec72c8 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.494048 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:51.510724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1244c-4b97-4257-bf6e-7460564b7af6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-726be518-0ed5-4e38-b6ad-6d4392ec72c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:24:51.511364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:51.512288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:51.513232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:24:51.513232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:24:51.513232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:24:51.513232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:24:51.513232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:24:51.513232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:24:51.513232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:51.513232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:51.516590 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 268/530] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:51.517741 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726be518-0ed5-4e38-b6ad-6d4392ec72c8 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.550114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323fbea-93c5-4b77-a89f-d1865435e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.550927 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323fbea-93c5-4b77-a89f-d1865435e71a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.551315 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323fbea-93c5-4b77-a89f-d1865435e71a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.551970 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323fbea-93c5-4b77-a89f-d1865435e71a None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.552870 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323fbea-93c5-4b77-a89f-d1865435e71a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:51.553282 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323fbea-93c5-4b77-a89f-d1865435e71a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.554850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323fbea-93c5-4b77-a89f-d1865435e71a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.573702 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 263/531] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:51.579657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323fbea-93c5-4b77-a89f-d1865435e71a None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.641910 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726be518-0ed5-4e38-b6ad-6d4392ec72c8 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.686064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:51.688244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7dee2-7f50-4cbb-8eb2-019a38a36769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.689195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7dee2-7f50-4cbb-8eb2-019a38a36769 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.689646 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7dee2-7f50-4cbb-8eb2-019a38a36769 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.690147 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7dee2-7f50-4cbb-8eb2-019a38a36769 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.691317 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7dee2-7f50-4cbb-8eb2-019a38a36769 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:51.691804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7dee2-7f50-4cbb-8eb2-019a38a36769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.693445 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7dee2-7f50-4cbb-8eb2-019a38a36769 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.701706 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323fbea-93c5-4b77-a89f-d1865435e71a None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.719172 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 269/532] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:51.720375 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7dee2-7f50-4cbb-8eb2-019a38a36769 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.739241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599560-b2ab-4059-b8c6-1afe411f90e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.739922 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599560-b2ab-4059-b8c6-1afe411f90e7 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.740271 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599560-b2ab-4059-b8c6-1afe411f90e7 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.740482 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599560-b2ab-4059-b8c6-1afe411f90e7 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.741282 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81599560-b2ab-4059-b8c6-1afe411f90e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:51.741598 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81599560-b2ab-4059-b8c6-1afe411f90e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.743066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81599560-b2ab-4059-b8c6-1afe411f90e7 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.755699 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 264/533] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:51.756585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599560-b2ab-4059-b8c6-1afe411f90e7 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.792431 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:51.844521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7dee2-7f50-4cbb-8eb2-019a38a36769 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.868219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599560-b2ab-4059-b8c6-1afe411f90e7 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.884493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c71b1-8096-4e8c-b71e-cf89b7957c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.885457 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c71b1-8096-4e8c-b71e-cf89b7957c23 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.885969 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c71b1-8096-4e8c-b71e-cf89b7957c23 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.886478 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c71b1-8096-4e8c-b71e-cf89b7957c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.887665 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c71b1-8096-4e8c-b71e-cf89b7957c23 None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=dfeabf7571794b87b88276b9902d1c0b) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:51.888152 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c71b1-8096-4e8c-b71e-cf89b7957c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.889797 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c71b1-8096-4e8c-b71e-cf89b7957c23 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.897688 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 270/534] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/role_assignments?user.id=dfeabf7571794b87b88276b9902d1c0b&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:51.898863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c71b1-8096-4e8c-b71e-cf89b7957c23 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.905460 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d14b5-824c-4dd8-a772-4f84c646fdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.906150 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d14b5-824c-4dd8-a772-4f84c646fdd1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.906434 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d14b5-824c-4dd8-a772-4f84c646fdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.906764 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d14b5-824c-4dd8-a772-4f84c646fdd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.924597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:52.023395 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d14b5-824c-4dd8-a772-4f84c646fdd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:52.023611 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c71b1-8096-4e8c-b71e-cf89b7957c23 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:52.024813 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d14b5-824c-4dd8-a772-4f84c646fdd1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:52.050838 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:52.072677 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33122-e517-4e86-a22c-8fc4a8a161e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:52.073652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33122-e517-4e86-a22c-8fc4a8a161e0 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.074107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33122-e517-4e86-a22c-8fc4a8a161e0 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.074633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33122-e517-4e86-a22c-8fc4a8a161e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.075928 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33122-e517-4e86-a22c-8fc4a8a161e0 None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=c8570414248b45d9917bee9b00cac027) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:52.077230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33122-e517-4e86-a22c-8fc4a8a161e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:52.079158 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33122-e517-4e86-a22c-8fc4a8a161e0 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:52.093355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 271/535] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/role_assignments?user.id=c8570414248b45d9917bee9b00cac027&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:52.214309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 265/536] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:52.221456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33122-e517-4e86-a22c-8fc4a8a161e0 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:52.366072 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33122-e517-4e86-a22c-8fc4a8a161e0 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:52.402475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c36575-c57d-4bd8-92c4-4c41a24a1442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:52.403575 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c36575-c57d-4bd8-92c4-4c41a24a1442 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.404016 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c36575-c57d-4bd8-92c4-4c41a24a1442 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.404459 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c36575-c57d-4bd8-92c4-4c41a24a1442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.416151 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c36575-c57d-4bd8-92c4-4c41a24a1442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:52.417974 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c36575-c57d-4bd8-92c4-4c41a24a1442 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-b2c36575-c57d-4bd8-92c4-4c41a24a1442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:52.437622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:52.438873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:52.440019 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:52.440019 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:52.440019 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:52.440019 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:52.442702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 272/537] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:52.450638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d14b5-824c-4dd8-a772-4f84c646fdd1 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:52.531161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:52.601316 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d14b5-824c-4dd8-a772-4f84c646fdd1 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:52.646071 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab0c90-1706-4076-b7f9-35b3e0c4d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:52.646701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab0c90-1706-4076-b7f9-35b3e0c4d19a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.650992 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab0c90-1706-4076-b7f9-35b3e0c4d19a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.651286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab0c90-1706-4076-b7f9-35b3e0c4d19a None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.652050 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab0c90-1706-4076-b7f9-35b3e0c4d19a None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:52.652367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab0c90-1706-4076-b7f9-35b3e0c4d19a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:52.653770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab0c90-1706-4076-b7f9-35b3e0c4d19a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:52.670999 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 266/538] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:52.672395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c36575-c57d-4bd8-92c4-4c41a24a1442 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:52.741711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:52.827064 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c36575-c57d-4bd8-92c4-4c41a24a1442 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:52.878129 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e684be-3d39-4788-9d87-3a9a13d3c999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:52.879399 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e684be-3d39-4788-9d87-3a9a13d3c999 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.879920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e684be-3d39-4788-9d87-3a9a13d3c999 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.880406 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e684be-3d39-4788-9d87-3a9a13d3c999 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.893881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e684be-3d39-4788-9d87-3a9a13d3c999 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:52.895814 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e684be-3d39-4788-9d87-3a9a13d3c999 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-71e684be-3d39-4788-9d87-3a9a13d3c999 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:24:52.918715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:52.919718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:52.920658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:24:52.920658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:24:52.920658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:24:52.920658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:24:52.920658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:24:52.920658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:24:52.920658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:52.920658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:52.923454 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 273/539] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:52.929746 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab0c90-1706-4076-b7f9-35b3e0c4d19a None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.078811 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab0c90-1706-4076-b7f9-35b3e0c4d19a None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.086560 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:53.124026 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c7f3e-7be6-4b91-ab7a-c25f7e0ad256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.124718 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c7f3e-7be6-4b91-ab7a-c25f7e0ad256 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.125007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c7f3e-7be6-4b91-ab7a-c25f7e0ad256 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.125289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c7f3e-7be6-4b91-ab7a-c25f7e0ad256 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.126101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c7f3e-7be6-4b91-ab7a-c25f7e0ad256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:53.126418 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c7f3e-7be6-4b91-ab7a-c25f7e0ad256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:53.127957 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c7f3e-7be6-4b91-ab7a-c25f7e0ad256 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:53.145884 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 267/540] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:24:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:53.151805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e684be-3d39-4788-9d87-3a9a13d3c999 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.236802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbcfa8-b9f8-4b06-9781-0a18477ee0b5 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.237026 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbcfa8-b9f8-4b06-9781-0a18477ee0b5 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.237314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbcfa8-b9f8-4b06-9781-0a18477ee0b5 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.243332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 268/541] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:53.249228 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3229d0-aa42-4d83-8a56-9e792f0a6181 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.250713 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3229d0-aa42-4d83-8a56-9e792f0a6181 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.250713 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3229d0-aa42-4d83-8a56-9e792f0a6181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.290871 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-4f3229d0-aa42-4d83-8a56-9e792f0a6181 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:53.292568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-4f3229d0-aa42-4d83-8a56-9e792f0a6181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:53.317460 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:53.324285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e684be-3d39-4788-9d87-3a9a13d3c999 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.398660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc31c39-9483-47c5-923a-bbb61ef5e7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.399707 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc31c39-9483-47c5-923a-bbb61ef5e7b9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.400174 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc31c39-9483-47c5-923a-bbb61ef5e7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.400633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc31c39-9483-47c5-923a-bbb61ef5e7b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.401783 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc31c39-9483-47c5-923a-bbb61ef5e7b9 None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=8ac8cf78ff434568b20062de3ccf65ed) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:53.402324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc31c39-9483-47c5-923a-bbb61ef5e7b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:53.404110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc31c39-9483-47c5-923a-bbb61ef5e7b9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:53.415961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 274/542] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/role_assignments?user.id=8ac8cf78ff434568b20062de3ccf65ed&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:53.428903 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 269/543] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:53.466890 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc31c39-9483-47c5-923a-bbb61ef5e7b9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.600619 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc31c39-9483-47c5-923a-bbb61ef5e7b9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.657603 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e2d71-881c-43d6-b0a9-1b91731249a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.658915 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e2d71-881c-43d6-b0a9-1b91731249a7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.659420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e2d71-881c-43d6-b0a9-1b91731249a7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.659987 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e2d71-881c-43d6-b0a9-1b91731249a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.678931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e2d71-881c-43d6-b0a9-1b91731249a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-645e2d71-881c-43d6-b0a9-1b91731249a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:53.688452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:53.689479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:53.690441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 275/544] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:53.696233 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3229d0-aa42-4d83-8a56-9e792f0a6181 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.702017 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363217-f711-4eea-9b91-ec3a42bad104 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.702631 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363217-f711-4eea-9b91-ec3a42bad104 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.703129 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363217-f711-4eea-9b91-ec3a42bad104 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.704976 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 276/545] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:53.711138 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002c55-7517-4347-9952-cacf916cb251 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.711728 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002c55-7517-4347-9952-cacf916cb251 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.712716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002c55-7517-4347-9952-cacf916cb251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.733627 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-7c002c55-7517-4347-9952-cacf916cb251 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:53.735251 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-7c002c55-7517-4347-9952-cacf916cb251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:53.756697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:53.838767 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 277/546] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:53.853708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:53.859604 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3229d0-aa42-4d83-8a56-9e792f0a6181 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.876922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c002c55-7517-4347-9952-cacf916cb251 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.897977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fe17e-5a26-472d-8ea2-46b1ce7fe7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.897977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe17e-5a26-472d-8ea2-46b1ce7fe7b8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.897977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe17e-5a26-472d-8ea2-46b1ce7fe7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.898369 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe17e-5a26-472d-8ea2-46b1ce7fe7b8 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.898899 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fe17e-5a26-472d-8ea2-46b1ce7fe7b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:53.899214 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fe17e-5a26-472d-8ea2-46b1ce7fe7b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:53.901886 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fe17e-5a26-472d-8ea2-46b1ce7fe7b8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:53.909811 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 270/547] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:53.915210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fe17e-5a26-472d-8ea2-46b1ce7fe7b8 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:54.032526 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fe17e-5a26-472d-8ea2-46b1ce7fe7b8 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:54.074260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc2b17-cab9-4fea-8543-c973e7820605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:54.075245 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc2b17-cab9-4fea-8543-c973e7820605 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.075535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc2b17-cab9-4fea-8543-c973e7820605 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.075811 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc2b17-cab9-4fea-8543-c973e7820605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.088456 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc2b17-cab9-4fea-8543-c973e7820605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:54.089949 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc2b17-cab9-4fea-8543-c973e7820605 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:54.092960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c002c55-7517-4347-9952-cacf916cb251 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-53cc2b17-cab9-4fea-8543-c973e7820605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:54.110269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:54.111319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:54.112288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:54.112288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:54.112288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:54.112288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:54.112288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 271/548] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:54.117821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc2b17-cab9-4fea-8543-c973e7820605 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:54.148331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:54.152923 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47475f-5fcd-45b4-98dd-87be3663113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:54.153737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47475f-5fcd-45b4-98dd-87be3663113b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.154016 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47475f-5fcd-45b4-98dd-87be3663113b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.154292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47475f-5fcd-45b4-98dd-87be3663113b None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.166250 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47475f-5fcd-45b4-98dd-87be3663113b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-5e47475f-5fcd-45b4-98dd-87be3663113b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:54.174113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:54.175163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:54.177497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 278/549] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:54.191716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47475f-5fcd-45b4-98dd-87be3663113b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:54.228595 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:54.271913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc2b17-cab9-4fea-8543-c973e7820605 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:54.309372 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3dd9-cc14-4954-944f-88757e400589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:54.310055 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3dd9-cc14-4954-944f-88757e400589 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.310337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3dd9-cc14-4954-944f-88757e400589 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.310637 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3dd9-cc14-4954-944f-88757e400589 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.311563 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f3dd9-cc14-4954-944f-88757e400589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:54.312191 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f3dd9-cc14-4954-944f-88757e400589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:54.313768 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f3dd9-cc14-4954-944f-88757e400589 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:54.328161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 272/550] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:54.333668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3dd9-cc14-4954-944f-88757e400589 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:54.420079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:54.455732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3dd9-cc14-4954-944f-88757e400589 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:54.464589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47475f-5fcd-45b4-98dd-87be3663113b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:54.493214 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e155e1-b37f-4c83-8314-f7554b503085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:54.494031 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e155e1-b37f-4c83-8314-f7554b503085 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.494317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e155e1-b37f-4c83-8314-f7554b503085 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.494598 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e155e1-b37f-4c83-8314-f7554b503085 None admin] PATH_INFO: `/v3/users/swift` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.502713 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e155e1-b37f-4c83-8314-f7554b503085 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:54.504218 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e155e1-b37f-4c83-8314-f7554b503085 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-28e155e1-b37f-4c83-8314-f7554b503085 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:24:54.520342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:54.521397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:54.522502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:54.522502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:54.522502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:24:54.522502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:24:54.522502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:24:54.522502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:24:54.522502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:24:54.522502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:24:54.522502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:24:54.522502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:54.522502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 273/551] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:24:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:54.527465 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e155e1-b37f-4c83-8314-f7554b503085 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:54.576983 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85057d91-5c0a-4d14-b7b0-df2f882e1ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:54.578144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057d91-5c0a-4d14-b7b0-df2f882e1ebd None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.578681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057d91-5c0a-4d14-b7b0-df2f882e1ebd None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.579191 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057d91-5c0a-4d14-b7b0-df2f882e1ebd None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.580342 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85057d91-5c0a-4d14-b7b0-df2f882e1ebd None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:54.580877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85057d91-5c0a-4d14-b7b0-df2f882e1ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:54.583066 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85057d91-5c0a-4d14-b7b0-df2f882e1ebd None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:54.601987 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 279/552] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:24:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:54.619574 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85057d91-5c0a-4d14-b7b0-df2f882e1ebd None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:54.646283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e155e1-b37f-4c83-8314-f7554b503085 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:54.680247 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:54.686596 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcd9c0-eedd-4def-b18d-345ae4bf8c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:54.687314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd9c0-eedd-4def-b18d-345ae4bf8c23 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.687604 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd9c0-eedd-4def-b18d-345ae4bf8c23 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.687885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd9c0-eedd-4def-b18d-345ae4bf8c23 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.688743 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcd9c0-eedd-4def-b18d-345ae4bf8c23 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:54.689056 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcd9c0-eedd-4def-b18d-345ae4bf8c23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:54.690595 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcd9c0-eedd-4def-b18d-345ae4bf8c23 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:54.711077 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 274/553] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:24:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:54.720033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcd9c0-eedd-4def-b18d-345ae4bf8c23 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:54.779600 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:54.841204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcd9c0-eedd-4def-b18d-345ae4bf8c23 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:54.857536 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85057d91-5c0a-4d14-b7b0-df2f882e1ebd None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:54.881279 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44911c4-d910-4d92-9111-3588acf0b704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:54.881946 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44911c4-d910-4d92-9111-3588acf0b704 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.882230 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44911c4-d910-4d92-9111-3588acf0b704 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.882509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44911c4-d910-4d92-9111-3588acf0b704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.899387 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1948a0b-efc0-49dd-a96a-597aa11d2881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:54.900678 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1948a0b-efc0-49dd-a96a-597aa11d2881 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.901205 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1948a0b-efc0-49dd-a96a-597aa11d2881 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.901690 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1948a0b-efc0-49dd-a96a-597aa11d2881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.915074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1948a0b-efc0-49dd-a96a-597aa11d2881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:54.917367 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1948a0b-efc0-49dd-a96a-597aa11d2881 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-b1948a0b-efc0-49dd-a96a-597aa11d2881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:54.944447 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:54.945652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:54.946854 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:54.946854 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:54.946854 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:54.946854 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:54.950353 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 280/554] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:54.952085 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c072d-09af-409f-9c90-af099ba4061f None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.952377 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c072d-09af-409f-9c90-af099ba4061f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.952657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c072d-09af-409f-9c90-af099ba4061f None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.954579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 281/555] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:54.955379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c072d-09af-409f-9c90-af099ba4061f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:54.962542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:54.978986 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44911c4-d910-4d92-9111-3588acf0b704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:54.981696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44911c4-d910-4d92-9111-3588acf0b704 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:55.093235 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c072d-09af-409f-9c90-af099ba4061f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.103724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 275/556] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:24:55.104913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a4cd-dca2-4cbb-98cb-cb1a200a6f77 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.105206 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a4cd-dca2-4cbb-98cb-cb1a200a6f77 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.105486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a4cd-dca2-4cbb-98cb-cb1a200a6f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.122111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-fec0a4cd-dca2-4cbb-98cb-cb1a200a6f77 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:55.123322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-fec0a4cd-dca2-4cbb-98cb-cb1a200a6f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:55.125505 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:55.135284 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6b951-3ba5-4a06-b69a-220207d7ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.135957 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6b951-3ba5-4a06-b69a-220207d7ea37 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.136244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6b951-3ba5-4a06-b69a-220207d7ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.136607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6b951-3ba5-4a06-b69a-220207d7ea37 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.137258 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6b951-3ba5-4a06-b69a-220207d7ea37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:55.137573 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6b951-3ba5-4a06-b69a-220207d7ea37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:55.139076 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6b951-3ba5-4a06-b69a-220207d7ea37 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:55.151535 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 282/557] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:55.152910 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123738d5-2a45-48e5-be1b-ad90fe9317ac None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.153195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123738d5-2a45-48e5-be1b-ad90fe9317ac None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.153721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123738d5-2a45-48e5-be1b-ad90fe9317ac None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.158856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 283/558] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:55.158856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123738d5-2a45-48e5-be1b-ad90fe9317ac None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.205974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 276/559] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:55.206810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0a4cd-dca2-4cbb-98cb-cb1a200a6f77 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.236194 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:55.275087 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123738d5-2a45-48e5-be1b-ad90fe9317ac None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.311448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af139d-ef3b-42ac-ac30-caeef0e884ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.312248 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af139d-ef3b-42ac-ac30-caeef0e884ce None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.312530 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af139d-ef3b-42ac-ac30-caeef0e884ce None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.312801 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af139d-ef3b-42ac-ac30-caeef0e884ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.323845 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af139d-ef3b-42ac-ac30-caeef0e884ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:55.325334 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af139d-ef3b-42ac-ac30-caeef0e884ce None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:55.325561 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0a4cd-dca2-4cbb-98cb-cb1a200a6f77 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-11af139d-ef3b-42ac-ac30-caeef0e884ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:55.343592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:55.344798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:55.345775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:55.345775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:55.345775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:55.345775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:55.345775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 284/560] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:55.346367 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6167a-3e9d-4692-86cc-e68928f72ff5 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.346672 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6167a-3e9d-4692-86cc-e68928f72ff5 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.346952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6167a-3e9d-4692-86cc-e68928f72ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.366094 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-ddd6167a-3e9d-4692-86cc-e68928f72ff5 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:55.367638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-ddd6167a-3e9d-4692-86cc-e68928f72ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:55.370028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8557dfa-af55-462a-9c18-823db97073b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.370895 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8557dfa-af55-462a-9c18-823db97073b0 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.371181 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8557dfa-af55-462a-9c18-823db97073b0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.371453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8557dfa-af55-462a-9c18-823db97073b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.379434 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8557dfa-af55-462a-9c18-823db97073b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:55.380955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8557dfa-af55-462a-9c18-823db97073b0 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-a8557dfa-af55-462a-9c18-823db97073b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:24:55.397655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:55.399145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:55.400530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:55.400530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:55.400530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:24:55.400530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:24:55.400530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:24:55.400530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:24:55.400530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:24:55.400530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:24:55.400530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:24:55.400530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:55.402885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 277/561] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:55.404658 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8557dfa-af55-462a-9c18-823db97073b0 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.405221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:55.451416 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 285/562] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:55.452549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6167a-3e9d-4692-86cc-e68928f72ff5 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.512932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:55.538325 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8557dfa-af55-462a-9c18-823db97073b0 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.582845 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3a90d-abbc-4986-9639-b31e786a82bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.583139 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6167a-3e9d-4692-86cc-e68928f72ff5 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.583252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a90d-abbc-4986-9639-b31e786a82bc None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.583369 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a90d-abbc-4986-9639-b31e786a82bc None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.583369 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a90d-abbc-4986-9639-b31e786a82bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.596169 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3a90d-abbc-4986-9639-b31e786a82bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-aac3a90d-abbc-4986-9639-b31e786a82bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:55.604189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:55.605930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:55.607144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:55.608260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 278/563] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:55.608735 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3a90d-abbc-4986-9639-b31e786a82bc None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.641429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663a1bf-a62c-4f6a-af5d-2226dc3304cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.642034 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663a1bf-a62c-4f6a-af5d-2226dc3304cf None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.642409 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663a1bf-a62c-4f6a-af5d-2226dc3304cf None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.642892 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663a1bf-a62c-4f6a-af5d-2226dc3304cf None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.645005 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663a1bf-a62c-4f6a-af5d-2226dc3304cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:55.645467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663a1bf-a62c-4f6a-af5d-2226dc3304cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:55.647749 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663a1bf-a62c-4f6a-af5d-2226dc3304cf None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:55.669075 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 286/564] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:55.669075 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663a1bf-a62c-4f6a-af5d-2226dc3304cf None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.712960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:55.722391 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3a90d-abbc-4986-9639-b31e786a82bc None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.760774 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82403ccb-122f-47b8-b68f-7b938c9d033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.761477 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82403ccb-122f-47b8-b68f-7b938c9d033c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.761880 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82403ccb-122f-47b8-b68f-7b938c9d033c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.762163 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82403ccb-122f-47b8-b68f-7b938c9d033c None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.763169 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82403ccb-122f-47b8-b68f-7b938c9d033c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:55.763418 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82403ccb-122f-47b8-b68f-7b938c9d033c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:55.764918 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82403ccb-122f-47b8-b68f-7b938c9d033c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:55.775913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:55.792990 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 279/565] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:55.792990 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82403ccb-122f-47b8-b68f-7b938c9d033c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.814196 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663a1bf-a62c-4f6a-af5d-2226dc3304cf None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.856411 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d1a3f-b00e-477f-a890-882264d6eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.857646 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1a3f-b00e-477f-a890-882264d6eb09 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.858094 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1a3f-b00e-477f-a890-882264d6eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.858524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1a3f-b00e-477f-a890-882264d6eb09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.873307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d1a3f-b00e-477f-a890-882264d6eb09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-be4d1a3f-b00e-477f-a890-882264d6eb09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:55.881922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:55.883070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 287/566] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:55.884490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d1a3f-b00e-477f-a890-882264d6eb09 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.919241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82403ccb-122f-47b8-b68f-7b938c9d033c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.958828 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede44227-d48d-40e9-9c37-7051066b3c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.959755 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede44227-d48d-40e9-9c37-7051066b3c67 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.960222 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede44227-d48d-40e9-9c37-7051066b3c67 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.960507 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede44227-d48d-40e9-9c37-7051066b3c67 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.961456 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede44227-d48d-40e9-9c37-7051066b3c67 None admin] RBAC: Adding query filter params (name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:55.961958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede44227-d48d-40e9-9c37-7051066b3c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:55.963422 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede44227-d48d-40e9-9c37-7051066b3c67 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:55.974148 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 280/567] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:55.974909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede44227-d48d-40e9-9c37-7051066b3c67 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.994246 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.008016 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d1a3f-b00e-477f-a890-882264d6eb09 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.037379 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.043871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefadc0-cc1a-4c76-9682-f53e67ac2561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.049831 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefadc0-cc1a-4c76-9682-f53e67ac2561 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.049831 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefadc0-cc1a-4c76-9682-f53e67ac2561 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.049831 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefadc0-cc1a-4c76-9682-f53e67ac2561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.054264 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefadc0-cc1a-4c76-9682-f53e67ac2561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.055828 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefadc0-cc1a-4c76-9682-f53e67ac2561 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-0eefadc0-cc1a-4c76-9682-f53e67ac2561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:24:56.071307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:56.072382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:56.074122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:24:56.074122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:24:56.074122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:24:56.074122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:24:56.074122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:24:56.074122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:24:56.074122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:56.074122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:56.074122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 288/568] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:56.074122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefadc0-cc1a-4c76-9682-f53e67ac2561 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.091549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede44227-d48d-40e9-9c37-7051066b3c67 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.132209 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e53c8-846a-4322-a988-79c7253d9920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.133093 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e53c8-846a-4322-a988-79c7253d9920 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.133287 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e53c8-846a-4322-a988-79c7253d9920 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.133561 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e53c8-846a-4322-a988-79c7253d9920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.144850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e53c8-846a-4322-a988-79c7253d9920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.146304 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e53c8-846a-4322-a988-79c7253d9920 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-0c8e53c8-846a-4322-a988-79c7253d9920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:56.163985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:56.165004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:56.165969 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:56.165969 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:56.165969 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:56.165969 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:56.165969 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 281/569] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:56.166973 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcccfe-c18f-491b-924f-059c2d124854 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.167263 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcccfe-c18f-491b-924f-059c2d124854 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.167546 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcccfe-c18f-491b-924f-059c2d124854 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.168992 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 282/570] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:56.171448 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcccfe-c18f-491b-924f-059c2d124854 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.201088 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefadc0-cc1a-4c76-9682-f53e67ac2561 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.237007 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde67e14-ff2c-47ce-b041-234f72e330c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.237686 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde67e14-ff2c-47ce-b041-234f72e330c3 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.238479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde67e14-ff2c-47ce-b041-234f72e330c3 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.238863 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde67e14-ff2c-47ce-b041-234f72e330c3 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.239618 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde67e14-ff2c-47ce-b041-234f72e330c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:56.239929 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde67e14-ff2c-47ce-b041-234f72e330c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.241329 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde67e14-ff2c-47ce-b041-234f72e330c3 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.250827 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 289/571] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:56.251685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde67e14-ff2c-47ce-b041-234f72e330c3 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.281736 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.306139 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcccfe-c18f-491b-924f-059c2d124854 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.317077 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.342030 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba3f9e-9f09-44a7-a08d-7ee2b5c8de5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.343037 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3f9e-9f09-44a7-a08d-7ee2b5c8de5c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.343319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3f9e-9f09-44a7-a08d-7ee2b5c8de5c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.343594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3f9e-9f09-44a7-a08d-7ee2b5c8de5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.356996 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba3f9e-9f09-44a7-a08d-7ee2b5c8de5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.358455 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba3f9e-9f09-44a7-a08d-7ee2b5c8de5c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-9aba3f9e-9f09-44a7-a08d-7ee2b5c8de5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:56.376638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:56.377941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:56.379120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:56.379120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:56.379120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:56.379120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:56.379120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 283/572] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:56.379120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba3f9e-9f09-44a7-a08d-7ee2b5c8de5c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.381785 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde67e14-ff2c-47ce-b041-234f72e330c3 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.420170 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c634758-d7a7-4a59-b126-d118a63fa608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.420846 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634758-d7a7-4a59-b126-d118a63fa608 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.421133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634758-d7a7-4a59-b126-d118a63fa608 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.421416 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634758-d7a7-4a59-b126-d118a63fa608 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.422223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c634758-d7a7-4a59-b126-d118a63fa608 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:56.422543 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c634758-d7a7-4a59-b126-d118a63fa608 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.424042 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c634758-d7a7-4a59-b126-d118a63fa608 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.437560 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 290/573] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:56.438956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145dd8-5898-4f0b-a118-221c72827aa1 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.439446 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145dd8-5898-4f0b-a118-221c72827aa1 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.439570 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145dd8-5898-4f0b-a118-221c72827aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.459207 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-0f145dd8-5898-4f0b-a118-221c72827aa1 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:56.460423 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-0f145dd8-5898-4f0b-a118-221c72827aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:56.493203 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba3f9e-9f09-44a7-a08d-7ee2b5c8de5c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.527617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.528073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d3a13-50c6-45fa-99ed-382d7398a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.529164 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d3a13-50c6-45fa-99ed-382d7398a306 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.529164 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d3a13-50c6-45fa-99ed-382d7398a306 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.529406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d3a13-50c6-45fa-99ed-382d7398a306 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.530102 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d3a13-50c6-45fa-99ed-382d7398a306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:56.530416 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d3a13-50c6-45fa-99ed-382d7398a306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.531860 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d3a13-50c6-45fa-99ed-382d7398a306 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.532379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 291/574] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:56.533208 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f145dd8-5898-4f0b-a118-221c72827aa1 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.554047 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 284/575] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:56.555265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d3a13-50c6-45fa-99ed-382d7398a306 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.581496 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.644741 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f145dd8-5898-4f0b-a118-221c72827aa1 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.663051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d3a13-50c6-45fa-99ed-382d7398a306 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.682248 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e0770-a275-4c21-8d15-8047b94a2c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.683097 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e0770-a275-4c21-8d15-8047b94a2c2c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.683381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e0770-a275-4c21-8d15-8047b94a2c2c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.683655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e0770-a275-4c21-8d15-8047b94a2c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.694705 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e0770-a275-4c21-8d15-8047b94a2c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.696177 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e0770-a275-4c21-8d15-8047b94a2c2c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.701309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c88908-61f9-4440-b375-73eb603213bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.701989 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88908-61f9-4440-b375-73eb603213bc None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.702274 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88908-61f9-4440-b375-73eb603213bc None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.702554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88908-61f9-4440-b375-73eb603213bc None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.703324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c88908-61f9-4440-b375-73eb603213bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:56.703635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c88908-61f9-4440-b375-73eb603213bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.705033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c88908-61f9-4440-b375-73eb603213bc None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-624e0770-a275-4c21-8d15-8047b94a2c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:56.716390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:56.723660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:56.724834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:56.724834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:56.724834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:56.724834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:56.725116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 285/576] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:56.725216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 292/577] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:56.725311 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c88908-61f9-4440-b375-73eb603213bc None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.725406 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e0770-a275-4c21-8d15-8047b94a2c2c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.780394 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.821424 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.830232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e0770-a275-4c21-8d15-8047b94a2c2c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.840799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c88908-61f9-4440-b375-73eb603213bc None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.868327 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b601e08-25c2-46d2-8c8c-57952bdde034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.869152 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b601e08-25c2-46d2-8c8c-57952bdde034 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.869439 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b601e08-25c2-46d2-8c8c-57952bdde034 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.869712 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b601e08-25c2-46d2-8c8c-57952bdde034 None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.876265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96226-5222-48fa-bf75-05c53ca8dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.876927 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96226-5222-48fa-bf75-05c53ca8dfd2 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.877207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96226-5222-48fa-bf75-05c53ca8dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.877486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96226-5222-48fa-bf75-05c53ca8dfd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.878343 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d96226-5222-48fa-bf75-05c53ca8dfd2 None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=da8976d2646745feadde336d6164e1da) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:56.878710 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d96226-5222-48fa-bf75-05c53ca8dfd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.880175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d96226-5222-48fa-bf75-05c53ca8dfd2 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.880594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b601e08-25c2-46d2-8c8c-57952bdde034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:56.885958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 286/578] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/role_assignments?user.id=da8976d2646745feadde336d6164e1da&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:56.886802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96226-5222-48fa-bf75-05c53ca8dfd2 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-7b601e08-25c2-46d2-8c8c-57952bdde034 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:56.888640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:56.890381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 293/579] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:56.892606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b601e08-25c2-46d2-8c8c-57952bdde034 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.035428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96226-5222-48fa-bf75-05c53ca8dfd2 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.049078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b601e08-25c2-46d2-8c8c-57952bdde034 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.065487 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:57.081267 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e4cd7-d399-4322-8f83-566eb13d753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.082802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e4cd7-d399-4322-8f83-566eb13d753c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.083095 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e4cd7-d399-4322-8f83-566eb13d753c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.083376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e4cd7-d399-4322-8f83-566eb13d753c None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.093929 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e4cd7-d399-4322-8f83-566eb13d753c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.095350 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e4cd7-d399-4322-8f83-566eb13d753c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.096772 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf800018-a3b5-42dd-a593-28fbd4aac04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.097688 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf800018-a3b5-42dd-a593-28fbd4aac04b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.098096 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf800018-a3b5-42dd-a593-28fbd4aac04b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.098437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf800018-a3b5-42dd-a593-28fbd4aac04b None admin] PATH_INFO: `/v3/users/glance` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.108149 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf800018-a3b5-42dd-a593-28fbd4aac04b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.109677 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf800018-a3b5-42dd-a593-28fbd4aac04b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-ef6e4cd7-d399-4322-8f83-566eb13d753c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:24:57.112307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:57.113292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:57.114255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:24:57.114255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:24:57.114255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:24:57.114255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:24:57.114255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:24:57.114255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:24:57.114255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:57.114255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:57.114255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 287/580] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:57.115921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e4cd7-d399-4322-8f83-566eb13d753c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.124803 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-bf800018-a3b5-42dd-a593-28fbd4aac04b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:24:57.132421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:57.133563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 294/581] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:57.134585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf800018-a3b5-42dd-a593-28fbd4aac04b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.247820 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e4cd7-d399-4322-8f83-566eb13d753c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.266083 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf800018-a3b5-42dd-a593-28fbd4aac04b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.292745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8559664-1c73-447d-83d5-6dabf6be947f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.293433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559664-1c73-447d-83d5-6dabf6be947f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.293720 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559664-1c73-447d-83d5-6dabf6be947f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.294001 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559664-1c73-447d-83d5-6dabf6be947f None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.294802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8559664-1c73-447d-83d5-6dabf6be947f None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:57.295113 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8559664-1c73-447d-83d5-6dabf6be947f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.296793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8559664-1c73-447d-83d5-6dabf6be947f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.308654 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8427c-778c-4b25-a5d5-ea89b70ea26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.310529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8427c-778c-4b25-a5d5-ea89b70ea26b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.311002 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8427c-778c-4b25-a5d5-ea89b70ea26b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.311709 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8427c-778c-4b25-a5d5-ea89b70ea26b None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.312624 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8427c-778c-4b25-a5d5-ea89b70ea26b None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:57.313096 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8427c-778c-4b25-a5d5-ea89b70ea26b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.313899 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 288/582] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:57.314909 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8427c-778c-4b25-a5d5-ea89b70ea26b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.315091 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8559664-1c73-447d-83d5-6dabf6be947f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.326885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 295/583] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:24:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:57.328527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8427c-778c-4b25-a5d5-ea89b70ea26b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.372895 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:57.413882 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:57.454327 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8559664-1c73-447d-83d5-6dabf6be947f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.455570 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8427c-778c-4b25-a5d5-ea89b70ea26b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.498814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb40b-5fde-4876-8b22-b8e07d485150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.499492 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35224725-2892-4ffb-912e-42306ca6890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.499642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb40b-5fde-4876-8b22-b8e07d485150 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.499728 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35224725-2892-4ffb-912e-42306ca6890d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.499813 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb40b-5fde-4876-8b22-b8e07d485150 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.499896 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35224725-2892-4ffb-912e-42306ca6890d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.500050 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb40b-5fde-4876-8b22-b8e07d485150 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.500359 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35224725-2892-4ffb-912e-42306ca6890d None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.500826 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdb40b-5fde-4876-8b22-b8e07d485150 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:57.501025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35224725-2892-4ffb-912e-42306ca6890d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:57.501134 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdb40b-5fde-4876-8b22-b8e07d485150 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.501343 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35224725-2892-4ffb-912e-42306ca6890d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.502576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdb40b-5fde-4876-8b22-b8e07d485150 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.502794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35224725-2892-4ffb-912e-42306ca6890d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.525487 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 296/584] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:24:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:57.525487 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35224725-2892-4ffb-912e-42306ca6890d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.531300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 289/585] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:24:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:57.532488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb40b-5fde-4876-8b22-b8e07d485150 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.636571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:57.646965 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35224725-2892-4ffb-912e-42306ca6890d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.654343 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb40b-5fde-4876-8b22-b8e07d485150 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.687079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:57.690028 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf90936-0cb0-424e-8c5c-040c94b80f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.690912 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf90936-0cb0-424e-8c5c-040c94b80f0e None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.691710 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf90936-0cb0-424e-8c5c-040c94b80f0e None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.691989 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf90936-0cb0-424e-8c5c-040c94b80f0e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.697714 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd6a71-0006-408b-b379-95c812c2752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.698909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6a71-0006-408b-b379-95c812c2752d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.699129 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6a71-0006-408b-b379-95c812c2752d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.699375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6a71-0006-408b-b379-95c812c2752d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.703965 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf90936-0cb0-424e-8c5c-040c94b80f0e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.706218 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf90936-0cb0-424e-8c5c-040c94b80f0e None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.711513 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd6a71-0006-408b-b379-95c812c2752d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.712981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd6a71-0006-408b-b379-95c812c2752d None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-eaf90936-0cb0-424e-8c5c-040c94b80f0e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:24:57.724818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:57.725930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:57.727319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:57.727319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:57.727319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:24:57.727319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:24:57.727319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:24:57.727319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:24:57.727319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:24:57.727319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:24:57.727319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:24:57.727319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:57.730463 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 297/586] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:24:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:57.731420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf90936-0cb0-424e-8c5c-040c94b80f0e None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-f2cd6a71-0006-408b-b379-95c812c2752d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:57.738428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:57.739571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:57.740566 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:57.740566 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:57.740566 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:57.740566 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:57.742982 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 290/587] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:57.744205 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd6a71-0006-408b-b379-95c812c2752d None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.855691 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf90936-0cb0-424e-8c5c-040c94b80f0e None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.870198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd6a71-0006-408b-b379-95c812c2752d None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.903601 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfe640-a48f-48e8-9179-4f9e03719b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.906017 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe640-a48f-48e8-9179-4f9e03719b6a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.906308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe640-a48f-48e8-9179-4f9e03719b6a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.906592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe640-a48f-48e8-9179-4f9e03719b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.915509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ee87-af74-4ed4-bfe9-20280d28d0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.916421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ee87-af74-4ed4-bfe9-20280d28d0f3 None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.916716 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ee87-af74-4ed4-bfe9-20280d28d0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.916986 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ee87-af74-4ed4-bfe9-20280d28d0f3 None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/382eda270f1545718847c9687bd62846/roles/c6d6983e0eaf48da8812725f576ddfb2` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.919165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfe640-a48f-48e8-9179-4f9e03719b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.920848 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfe640-a48f-48e8-9179-4f9e03719b6a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.935879 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674ee87-af74-4ed4-bfe9-20280d28d0f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=382eda270f1545718847c9687bd62846, role_id=c6d6983e0eaf48da8812725f576ddfb2)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.936784 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674ee87-af74-4ed4-bfe9-20280d28d0f3 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-62cfe640-a48f-48e8-9179-4f9e03719b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:57.944588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:57.945566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:57.946522 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:57.946522 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:57.946522 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:57.946522 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:57.946522 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 298/588] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:57.946522 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfe640-a48f-48e8-9179-4f9e03719b6a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.952693 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:58.003021 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 291/589] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:24:57 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/382eda270f1545718847c9687bd62846/roles/c6d6983e0eaf48da8812725f576ddfb2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:58.015624 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ee87-af74-4ed4-bfe9-20280d28d0f3 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:58.056472 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:58.081030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfe640-a48f-48e8-9179-4f9e03719b6a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:58.129521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f164b-f2fb-455b-8134-0b5ec39db5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:58.130644 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f164b-f2fb-455b-8134-0b5ec39db5e8 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:58.131152 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f164b-f2fb-455b-8134-0b5ec39db5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:58.131617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f164b-f2fb-455b-8134-0b5ec39db5e8 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:58.132691 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f164b-f2fb-455b-8134-0b5ec39db5e8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:58.133228 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f164b-f2fb-455b-8134-0b5ec39db5e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:58.135092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f164b-f2fb-455b-8134-0b5ec39db5e8 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:58.160861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 299/590] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:24:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:58.162105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f164b-f2fb-455b-8134-0b5ec39db5e8 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:58.169883 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ee87-af74-4ed4-bfe9-20280d28d0f3 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:58.223438 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b47b8-6317-4755-906c-9d6a7021853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:58.225397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b47b8-6317-4755-906c-9d6a7021853c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:58.225397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b47b8-6317-4755-906c-9d6a7021853c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:58.225896 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b47b8-6317-4755-906c-9d6a7021853c None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:58.226857 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b47b8-6317-4755-906c-9d6a7021853c None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:58.227389 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b47b8-6317-4755-906c-9d6a7021853c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:58.228780 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b47b8-6317-4755-906c-9d6a7021853c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:58.243088 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 292/591] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:58.244028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b47b8-6317-4755-906c-9d6a7021853c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:58.245693 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:58.290039 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f164b-f2fb-455b-8134-0b5ec39db5e8 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:58.337724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b55c6-41d5-4d87-ad67-1b34d682c2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:58.338414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b55c6-41d5-4d87-ad67-1b34d682c2a4 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:58.339018 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b55c6-41d5-4d87-ad67-1b34d682c2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:58.339305 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b55c6-41d5-4d87-ad67-1b34d682c2a4 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:58.340694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b55c6-41d5-4d87-ad67-1b34d682c2a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:58.341042 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b55c6-41d5-4d87-ad67-1b34d682c2a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:58.342915 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b55c6-41d5-4d87-ad67-1b34d682c2a4 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:58.366685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 300/592] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:58.367759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b55c6-41d5-4d87-ad67-1b34d682c2a4 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:58.371643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:58.389714 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b47b8-6317-4755-906c-9d6a7021853c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:58.440087 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f9b4b-8cb5-4c2d-bcb3-6b1a0dfeba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:58.441490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9b4b-8cb5-4c2d-bcb3-6b1a0dfeba7e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:58.441776 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9b4b-8cb5-4c2d-bcb3-6b1a0dfeba7e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:58.442051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9b4b-8cb5-4c2d-bcb3-6b1a0dfeba7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:58.454676 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f9b4b-8cb5-4c2d-bcb3-6b1a0dfeba7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:58.456849 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f9b4b-8cb5-4c2d-bcb3-6b1a0dfeba7e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-f98f9b4b-8cb5-4c2d-bcb3-6b1a0dfeba7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:58.477309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:58.478338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:58.479342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:58.479342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:58.479342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:58.479342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:58.483525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 293/593] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:58.484644 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f9b4b-8cb5-4c2d-bcb3-6b1a0dfeba7e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:58.504285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b55c6-41d5-4d87-ad67-1b34d682c2a4 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:58.529578 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:58.544058 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac78f7a-1104-4822-9b4b-078c84ed8515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:58.545559 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac78f7a-1104-4822-9b4b-078c84ed8515 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:58.545933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac78f7a-1104-4822-9b4b-078c84ed8515 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:58.546412 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac78f7a-1104-4822-9b4b-078c84ed8515 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:58.556427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac78f7a-1104-4822-9b4b-078c84ed8515 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:58.558235 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac78f7a-1104-4822-9b4b-078c84ed8515 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-4ac78f7a-1104-4822-9b4b-078c84ed8515 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:24:58.574904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:58.576321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:58.578414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:58.578414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:58.578414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:24:58.578414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:24:58.578414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:24:58.578414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:24:58.578414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:24:58.578414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:24:58.578414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:24:58.578414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:58.582310 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 301/594] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:58.583576 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac78f7a-1104-4822-9b4b-078c84ed8515 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:58.607737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f9b4b-8cb5-4c2d-bcb3-6b1a0dfeba7e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:58.657748 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9c531-1e2c-4557-a480-21860ee0dcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:58.658583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9c531-1e2c-4557-a480-21860ee0dcd1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:58.658893 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9c531-1e2c-4557-a480-21860ee0dcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:58.659166 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9c531-1e2c-4557-a480-21860ee0dcd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:58.667787 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9c531-1e2c-4557-a480-21860ee0dcd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:58.669337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9c531-1e2c-4557-a480-21860ee0dcd1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:58.672718 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-8ba9c531-1e2c-4557-a480-21860ee0dcd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:24:58.686809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:58.691382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:58.692364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:24:58.692364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:24:58.692364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:24:58.692364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:24:58.692364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:24:58.692364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:24:58.692364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:58.692364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:58.692364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 294/595] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:58.692364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9c531-1e2c-4557-a480-21860ee0dcd1 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:58.728798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac78f7a-1104-4822-9b4b-078c84ed8515 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:58.774304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0da9ee-77be-4e18-b030-ca417c2a4cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:58.775457 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da9ee-77be-4e18-b030-ca417c2a4cc9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:58.775699 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da9ee-77be-4e18-b030-ca417c2a4cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:58.776079 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da9ee-77be-4e18-b030-ca417c2a4cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:58.776903 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0da9ee-77be-4e18-b030-ca417c2a4cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:58.777271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0da9ee-77be-4e18-b030-ca417c2a4cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:58.778983 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0da9ee-77be-4e18-b030-ca417c2a4cc9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:58.803237 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 302/596] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:58.804264 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0da9ee-77be-4e18-b030-ca417c2a4cc9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:58.849663 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9c531-1e2c-4557-a480-21860ee0dcd1 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:58.855855 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:58.896832 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f09e9-5657-470a-ab5b-22a7b85ed460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:58.897521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f09e9-5657-470a-ab5b-22a7b85ed460 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:58.897848 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f09e9-5657-470a-ab5b-22a7b85ed460 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:58.898130 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f09e9-5657-470a-ab5b-22a7b85ed460 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:58.899005 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f09e9-5657-470a-ab5b-22a7b85ed460 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:58.899313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f09e9-5657-470a-ab5b-22a7b85ed460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:58.900758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f09e9-5657-470a-ab5b-22a7b85ed460 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:58.925981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 295/597] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 20:24:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:58.927239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f09e9-5657-470a-ab5b-22a7b85ed460 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:58.935670 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0da9ee-77be-4e18-b030-ca417c2a4cc9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:58.984459 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e067d5-4f65-4c2d-b6ac-8539fd582706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:58.985074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e067d5-4f65-4c2d-b6ac-8539fd582706 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:58.985383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e067d5-4f65-4c2d-b6ac-8539fd582706 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:58.985656 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e067d5-4f65-4c2d-b6ac-8539fd582706 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:58.986509 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e067d5-4f65-4c2d-b6ac-8539fd582706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:58.986867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e067d5-4f65-4c2d-b6ac-8539fd582706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:58.988820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e067d5-4f65-4c2d-b6ac-8539fd582706 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:59.000431 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:59.008613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 303/598] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:24:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:59.009766 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e067d5-4f65-4c2d-b6ac-8539fd582706 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:59.058454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f09e9-5657-470a-ab5b-22a7b85ed460 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:59.112014 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2847fc-25b0-4604-86b9-d98434eebb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:59.114088 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2847fc-25b0-4604-86b9-d98434eebb6d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.114681 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2847fc-25b0-4604-86b9-d98434eebb6d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.115204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2847fc-25b0-4604-86b9-d98434eebb6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.125488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2847fc-25b0-4604-86b9-d98434eebb6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:59.127372 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2847fc-25b0-4604-86b9-d98434eebb6d None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-6f2847fc-25b0-4604-86b9-d98434eebb6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:24:59.145348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:59.146490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:59.147521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:24:59.147521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:24:59.147521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:24:59.147521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:24:59.147521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:24:59.147521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:24:59.147521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:59.147521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:59.150952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 296/599] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:59.152146 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2847fc-25b0-4604-86b9-d98434eebb6d None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:59.178841 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e067d5-4f65-4c2d-b6ac-8539fd582706 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:59.180943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:59.243039 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73e368-7f5d-4155-b26c-9b6b287f82a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:59.243796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e368-7f5d-4155-b26c-9b6b287f82a2 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.244083 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e368-7f5d-4155-b26c-9b6b287f82a2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.244361 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e368-7f5d-4155-b26c-9b6b287f82a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.260729 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73e368-7f5d-4155-b26c-9b6b287f82a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:59.262901 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73e368-7f5d-4155-b26c-9b6b287f82a2 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-be73e368-7f5d-4155-b26c-9b6b287f82a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:59.286515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:59.287610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:59.288585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:59.288585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:59.288585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:59.288585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:24:59.289349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2847fc-25b0-4604-86b9-d98434eebb6d None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:59.292366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 304/600] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:59.293871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73e368-7f5d-4155-b26c-9b6b287f82a2 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:59.310337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:59.333810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d36637-b7c0-491b-bdfd-e94dfc06a3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:59.334764 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d36637-b7c0-491b-bdfd-e94dfc06a3d1 None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.335049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d36637-b7c0-491b-bdfd-e94dfc06a3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.335330 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d36637-b7c0-491b-bdfd-e94dfc06a3d1 None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/dfeabf7571794b87b88276b9902d1c0b/roles/c6d6983e0eaf48da8812725f576ddfb2` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.352630 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d36637-b7c0-491b-bdfd-e94dfc06a3d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=dfeabf7571794b87b88276b9902d1c0b, role_id=c6d6983e0eaf48da8812725f576ddfb2)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:59.354078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d36637-b7c0-491b-bdfd-e94dfc06a3d1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:59.415500 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73e368-7f5d-4155-b26c-9b6b287f82a2 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:59.426739 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 297/601] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:24:59 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/dfeabf7571794b87b88276b9902d1c0b/roles/c6d6983e0eaf48da8812725f576ddfb2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:59.428297 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cce8a-f2f8-4791-bc0e-c39760894fac None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.428599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cce8a-f2f8-4791-bc0e-c39760894fac None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.428876 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cce8a-f2f8-4791-bc0e-c39760894fac None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.430446 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 298/602] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:59.435760 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cce8a-f2f8-4791-bc0e-c39760894fac None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:59.474598 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903241b-8de0-4467-9de0-f6ffffd26fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:59.475875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903241b-8de0-4467-9de0-f6ffffd26fb4 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.476337 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903241b-8de0-4467-9de0-f6ffffd26fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.476791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903241b-8de0-4467-9de0-f6ffffd26fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.477890 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903241b-8de0-4467-9de0-f6ffffd26fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:59.478419 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903241b-8de0-4467-9de0-f6ffffd26fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:59.481274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903241b-8de0-4467-9de0-f6ffffd26fb4 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:59.508330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 305/603] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:59.510149 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c9518-f254-4ff0-a30c-11810350f251 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.511330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c9518-f254-4ff0-a30c-11810350f251 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.511813 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c9518-f254-4ff0-a30c-11810350f251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.536825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-ae3c9518-f254-4ff0-a30c-11810350f251 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:59.539244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-ae3c9518-f254-4ff0-a30c-11810350f251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:59.559735 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:59.598646 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cce8a-f2f8-4791-bc0e-c39760894fac None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:59.642700 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 306/604] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:59.645063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c9518-f254-4ff0-a30c-11810350f251 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:59.646185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933da1-19ff-413a-8712-1c73c73c5b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:59.646905 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933da1-19ff-413a-8712-1c73c73c5b2e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.647190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933da1-19ff-413a-8712-1c73c73c5b2e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.647469 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933da1-19ff-413a-8712-1c73c73c5b2e None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.648222 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933da1-19ff-413a-8712-1c73c73c5b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:59.648533 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933da1-19ff-413a-8712-1c73c73c5b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:59.649924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933da1-19ff-413a-8712-1c73c73c5b2e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:59.666718 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 299/605] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:59.668943 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933da1-19ff-413a-8712-1c73c73c5b2e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:59.713012 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:59.777268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c9518-f254-4ff0-a30c-11810350f251 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:59.811094 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933da1-19ff-413a-8712-1c73c73c5b2e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:59.829874 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57f39-1b63-47ca-abfc-38467eef8304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:59.831413 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57f39-1b63-47ca-abfc-38467eef8304 None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.831857 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57f39-1b63-47ca-abfc-38467eef8304 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.832580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57f39-1b63-47ca-abfc-38467eef8304 None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/c8570414248b45d9917bee9b00cac027/roles/c6d6983e0eaf48da8812725f576ddfb2` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.849846 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed57f39-1b63-47ca-abfc-38467eef8304 None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=c8570414248b45d9917bee9b00cac027, role_id=c6d6983e0eaf48da8812725f576ddfb2)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:59.851647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed57f39-1b63-47ca-abfc-38467eef8304 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:59.854237 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:59.858059 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1ec0-c03d-4833-a8c2-1f2939557f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:59.859067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1ec0-c03d-4833-a8c2-1f2939557f27 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.859413 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1ec0-c03d-4833-a8c2-1f2939557f27 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.859761 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1ec0-c03d-4833-a8c2-1f2939557f27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.869068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1ec0-c03d-4833-a8c2-1f2939557f27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:59.870344 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1ec0-c03d-4833-a8c2-1f2939557f27 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-71be1ec0-c03d-4833-a8c2-1f2939557f27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:24:59.889532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:59.890568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:59.896671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:24:59.896671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:24:59.896671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:24:59.896671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:24:59.896671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:24:59.896671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:24:59.896671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:24:59.896671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:24:59.896671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 300/606] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:24:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:59.896671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1ec0-c03d-4833-a8c2-1f2939557f27 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:59.937538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 307/607] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:24:59 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/c8570414248b45d9917bee9b00cac027/roles/c6d6983e0eaf48da8812725f576ddfb2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:59.938308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57f39-1b63-47ca-abfc-38467eef8304 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.083496 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:00.099033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1ec0-c03d-4833-a8c2-1f2939557f27 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.146980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fedf7-2fa9-4311-b47d-495525350775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:00.147809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fedf7-2fa9-4311-b47d-495525350775 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.148093 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fedf7-2fa9-4311-b47d-495525350775 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.148368 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fedf7-2fa9-4311-b47d-495525350775 None admin] PATH_INFO: `/v3/roles/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.155914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57f39-1b63-47ca-abfc-38467eef8304 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.163954 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fedf7-2fa9-4311-b47d-495525350775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-a36fedf7-2fa9-4311-b47d-495525350775 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:00.174406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:00.176108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:00.177277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 301/608] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:24:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:00.183778 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fedf7-2fa9-4311-b47d-495525350775 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.217374 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758f22-7c73-4c2b-bd58-138c4ce100cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:00.220858 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758f22-7c73-4c2b-bd58-138c4ce100cc None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.220858 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758f22-7c73-4c2b-bd58-138c4ce100cc None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.220858 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758f22-7c73-4c2b-bd58-138c4ce100cc None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.221453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758f22-7c73-4c2b-bd58-138c4ce100cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:00.221779 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758f22-7c73-4c2b-bd58-138c4ce100cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:00.224628 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758f22-7c73-4c2b-bd58-138c4ce100cc None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:00.243750 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 308/609] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:00.249587 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758f22-7c73-4c2b-bd58-138c4ce100cc None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.345898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:00.397145 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758f22-7c73-4c2b-bd58-138c4ce100cc None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.417386 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fedf7-2fa9-4311-b47d-495525350775 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.435506 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268da0b-068c-4b76-be69-0dbefa21ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:00.436419 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268da0b-068c-4b76-be69-0dbefa21ed4a None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.436709 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268da0b-068c-4b76-be69-0dbefa21ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.436991 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268da0b-068c-4b76-be69-0dbefa21ed4a None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/8ac8cf78ff434568b20062de3ccf65ed/roles/c6d6983e0eaf48da8812725f576ddfb2` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.454231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268da0b-068c-4b76-be69-0dbefa21ed4a None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=8ac8cf78ff434568b20062de3ccf65ed, role_id=c6d6983e0eaf48da8812725f576ddfb2)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:00.455758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268da0b-068c-4b76-be69-0dbefa21ed4a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:00.488684 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f656fc-6d3c-47d2-8282-394b748bd844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:00.489382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f656fc-6d3c-47d2-8282-394b748bd844 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.489636 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f656fc-6d3c-47d2-8282-394b748bd844 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.489953 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f656fc-6d3c-47d2-8282-394b748bd844 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.490846 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f656fc-6d3c-47d2-8282-394b748bd844 None admin] RBAC: Adding query filter params (name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:00.491213 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f656fc-6d3c-47d2-8282-394b748bd844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:00.492649 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f656fc-6d3c-47d2-8282-394b748bd844 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:00.505305 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 302/610] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:25:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:00.511734 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f656fc-6d3c-47d2-8282-394b748bd844 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.526083 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:00.544311 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 309/611] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:25:00 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/8ac8cf78ff434568b20062de3ccf65ed/roles/c6d6983e0eaf48da8812725f576ddfb2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:00.545797 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082561a4-e738-4f4e-a768-97927f407174 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.546034 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082561a4-e738-4f4e-a768-97927f407174 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.546316 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082561a4-e738-4f4e-a768-97927f407174 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.556471 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 310/612] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:00.563052 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f343-7ea3-46a3-aa82-e0541333ca4f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.563328 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f343-7ea3-46a3-aa82-e0541333ca4f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.563614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f343-7ea3-46a3-aa82-e0541333ca4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.597409 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-b4a8f343-7ea3-46a3-aa82-e0541333ca4f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:00.599421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-b4a8f343-7ea3-46a3-aa82-e0541333ca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:00.693807 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f656fc-6d3c-47d2-8282-394b748bd844 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.742164 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 311/613] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:25:00.772359 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8f343-7ea3-46a3-aa82-e0541333ca4f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.772600 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b1eec-053e-41b0-a67d-722a369b349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:00.773232 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b1eec-053e-41b0-a67d-722a369b349c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.773524 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b1eec-053e-41b0-a67d-722a369b349c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.773803 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b1eec-053e-41b0-a67d-722a369b349c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.802269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b1eec-053e-41b0-a67d-722a369b349c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:00.803780 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b1eec-053e-41b0-a67d-722a369b349c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:00.828309 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-6b1b1eec-053e-41b0-a67d-722a369b349c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:00.829924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:00.830915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:00.831948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:00.831948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:00.831948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:00.831948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:00.831948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 303/614] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:00.838364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b1eec-053e-41b0-a67d-722a369b349c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.914822 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:00.919703 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8f343-7ea3-46a3-aa82-e0541333ca4f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.975187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0fce0-af99-44d8-9892-93f27cd5c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:00.976370 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0fce0-af99-44d8-9892-93f27cd5c76c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.976651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0fce0-af99-44d8-9892-93f27cd5c76c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.976920 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0fce0-af99-44d8-9892-93f27cd5c76c None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.983008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b1eec-053e-41b0-a67d-722a369b349c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.991896 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0fce0-af99-44d8-9892-93f27cd5c76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-14a0fce0-af99-44d8-9892-93f27cd5c76c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:01.002503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:01.004053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:01.005148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 312/615] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:25:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:01.011392 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0fce0-af99-44d8-9892-93f27cd5c76c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.026642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c10635-37b9-4067-8e07-aaf0172cf370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.028228 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c10635-37b9-4067-8e07-aaf0172cf370 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.028635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c10635-37b9-4067-8e07-aaf0172cf370 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.029041 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c10635-37b9-4067-8e07-aaf0172cf370 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.030324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c10635-37b9-4067-8e07-aaf0172cf370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:01.031055 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c10635-37b9-4067-8e07-aaf0172cf370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:01.032904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c10635-37b9-4067-8e07-aaf0172cf370 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:01.062835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 304/616] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:01.078256 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c10635-37b9-4067-8e07-aaf0172cf370 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.200209 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:01.210213 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0fce0-af99-44d8-9892-93f27cd5c76c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.254363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a7a76-7bf6-4483-969c-53fab3d40c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.255185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a7a76-7bf6-4483-969c-53fab3d40c84 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.255503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a7a76-7bf6-4483-969c-53fab3d40c84 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.256018 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a7a76-7bf6-4483-969c-53fab3d40c84 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.256908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a7a76-7bf6-4483-969c-53fab3d40c84 None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:01.257220 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a7a76-7bf6-4483-969c-53fab3d40c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:01.258791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a7a76-7bf6-4483-969c-53fab3d40c84 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:01.272694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 313/617] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:01.279762 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a7a76-7bf6-4483-969c-53fab3d40c84 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.282293 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c10635-37b9-4067-8e07-aaf0172cf370 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.356880 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:01.402122 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51bfe3-fa3c-40cd-b782-4094d8e037f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.402911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51bfe3-fa3c-40cd-b782-4094d8e037f5 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.403267 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51bfe3-fa3c-40cd-b782-4094d8e037f5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.403555 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51bfe3-fa3c-40cd-b782-4094d8e037f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.412858 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a7a76-7bf6-4483-969c-53fab3d40c84 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.414332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51bfe3-fa3c-40cd-b782-4094d8e037f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:01.416291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51bfe3-fa3c-40cd-b782-4094d8e037f5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-5b51bfe3-fa3c-40cd-b782-4094d8e037f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:01.451149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:01.452216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:01.453239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:01.453239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:01.453239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:01.453239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:01.453239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:01.453239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:01.453239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:01.453239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:01.453239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:01.453239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:01.457550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 305/618] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:01.458904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51bfe3-fa3c-40cd-b782-4094d8e037f5 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.467363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786ef5f-4e21-4c5b-8eb6-e7d5c2871400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.468312 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ef5f-4e21-4c5b-8eb6-e7d5c2871400 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.468598 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ef5f-4e21-4c5b-8eb6-e7d5c2871400 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.468872 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ef5f-4e21-4c5b-8eb6-e7d5c2871400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.494244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786ef5f-4e21-4c5b-8eb6-e7d5c2871400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:01.495946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786ef5f-4e21-4c5b-8eb6-e7d5c2871400 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-7786ef5f-4e21-4c5b-8eb6-e7d5c2871400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:01.528274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:01.529379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:01.530997 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:01.530997 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:01.530997 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:01.530997 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:01.530997 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 314/619] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:01.535582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786ef5f-4e21-4c5b-8eb6-e7d5c2871400 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.554674 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:01.644949 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51bfe3-fa3c-40cd-b782-4094d8e037f5 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.683898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286861d6-1b97-4d51-85cd-9ef289400849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.684592 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286861d6-1b97-4d51-85cd-9ef289400849 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.684865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286861d6-1b97-4d51-85cd-9ef289400849 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.685142 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286861d6-1b97-4d51-85cd-9ef289400849 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.685992 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286861d6-1b97-4d51-85cd-9ef289400849 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:01.686305 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286861d6-1b97-4d51-85cd-9ef289400849 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:01.687775 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286861d6-1b97-4d51-85cd-9ef289400849 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:01.708184 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 306/620] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:01.714744 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286861d6-1b97-4d51-85cd-9ef289400849 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.763267 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786ef5f-4e21-4c5b-8eb6-e7d5c2871400 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.811004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:01.860304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfff0ef-15a9-4677-bd7a-d32662f8cf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.861005 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfff0ef-15a9-4677-bd7a-d32662f8cf3a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.861295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfff0ef-15a9-4677-bd7a-d32662f8cf3a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.861569 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfff0ef-15a9-4677-bd7a-d32662f8cf3a None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.862313 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfff0ef-15a9-4677-bd7a-d32662f8cf3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:01.862681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfff0ef-15a9-4677-bd7a-d32662f8cf3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:01.864093 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfff0ef-15a9-4677-bd7a-d32662f8cf3a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:01.873254 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286861d6-1b97-4d51-85cd-9ef289400849 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.898101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 315/621] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:01.907666 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfff0ef-15a9-4677-bd7a-d32662f8cf3a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.916256 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cdb68-7c95-436a-8504-462c896120ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.917528 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cdb68-7c95-436a-8504-462c896120ca None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.917814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cdb68-7c95-436a-8504-462c896120ca None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.918091 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cdb68-7c95-436a-8504-462c896120ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.943982 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cdb68-7c95-436a-8504-462c896120ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:01.945444 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cdb68-7c95-436a-8504-462c896120ca None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-da0cdb68-7c95-436a-8504-462c896120ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:01.978165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:01.979208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:01.980209 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:01.980209 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:01.980209 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:01.980209 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:01.987393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 307/622] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:01.991427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:01.993621 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cdb68-7c95-436a-8504-462c896120ca None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.031230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfff0ef-15a9-4677-bd7a-d32662f8cf3a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.079769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede69dd3-b479-4a79-9a72-5bd1ef981668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.080585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69dd3-b479-4a79-9a72-5bd1ef981668 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.080860 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69dd3-b479-4a79-9a72-5bd1ef981668 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.081130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69dd3-b479-4a79-9a72-5bd1ef981668 None admin] PATH_INFO: `/v3/users/nova` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.092649 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede69dd3-b479-4a79-9a72-5bd1ef981668 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.094197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede69dd3-b479-4a79-9a72-5bd1ef981668 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-ede69dd3-b479-4a79-9a72-5bd1ef981668 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:02.112053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:02.115117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:02.117415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:02.117415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:02.117415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:02.117415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:02.117415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:02.117415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:02.117415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:02.117415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:02.117415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:02.117415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:02.117415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 316/623] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:02.123731 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede69dd3-b479-4a79-9a72-5bd1ef981668 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.227624 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.240565 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede69dd3-b479-4a79-9a72-5bd1ef981668 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.248600 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cdb68-7c95-436a-8504-462c896120ca None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.275881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.280989 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a250e8-4b8d-41e0-b0b0-4f2870f66c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.281670 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a250e8-4b8d-41e0-b0b0-4f2870f66c08 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.282053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a250e8-4b8d-41e0-b0b0-4f2870f66c08 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.282337 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a250e8-4b8d-41e0-b0b0-4f2870f66c08 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.283354 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a250e8-4b8d-41e0-b0b0-4f2870f66c08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:02.283724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a250e8-4b8d-41e0-b0b0-4f2870f66c08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.285891 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a250e8-4b8d-41e0-b0b0-4f2870f66c08 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.288557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36828374-3a76-47e9-b8d2-d2e382ebcd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.289244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36828374-3a76-47e9-b8d2-d2e382ebcd24 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.289529 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36828374-3a76-47e9-b8d2-d2e382ebcd24 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.289803 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36828374-3a76-47e9-b8d2-d2e382ebcd24 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.290636 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36828374-3a76-47e9-b8d2-d2e382ebcd24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:02.290947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36828374-3a76-47e9-b8d2-d2e382ebcd24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.292323 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36828374-3a76-47e9-b8d2-d2e382ebcd24 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.306298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 308/625] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:02.306564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 317/625] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:02.307974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636b9ba-2482-4338-8712-24577ade26e9 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.308269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636b9ba-2482-4338-8712-24577ade26e9 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.308547 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636b9ba-2482-4338-8712-24577ade26e9 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.314249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 309/626] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:02.315429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636b9ba-2482-4338-8712-24577ade26e9 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.315768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a250e8-4b8d-41e0-b0b0-4f2870f66c08 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.445153 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a250e8-4b8d-41e0-b0b0-4f2870f66c08 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.450174 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636b9ba-2482-4338-8712-24577ade26e9 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.489810 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ecb87-beff-40b3-8a12-63bba488d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.491042 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ecb87-beff-40b3-8a12-63bba488d79c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.491515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ecb87-beff-40b3-8a12-63bba488d79c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.492000 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ecb87-beff-40b3-8a12-63bba488d79c None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.499835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ecb87-beff-40b3-8a12-63bba488d79c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.501557 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ecb87-beff-40b3-8a12-63bba488d79c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.503330 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927010b-a706-4340-920e-2d02166c1f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.504313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927010b-a706-4340-920e-2d02166c1f8a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.504620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927010b-a706-4340-920e-2d02166c1f8a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.504998 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927010b-a706-4340-920e-2d02166c1f8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-999ecb87-beff-40b3-8a12-63bba488d79c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:02.518467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:02.519651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:02.520610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:02.520610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:02.520610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:02.520610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:02.520610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:02.520610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:02.520610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:02.520610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:02.523204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 318/627] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:02.524847 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea881ee-6827-465f-b8f4-d27c4f8d971f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.525352 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea881ee-6827-465f-b8f4-d27c4f8d971f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.525812 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea881ee-6827-465f-b8f4-d27c4f8d971f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.532492 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.545828 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-9ea881ee-6827-465f-b8f4-d27c4f8d971f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:02.547564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-9ea881ee-6827-465f-b8f4-d27c4f8d971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:02.588629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927010b-a706-4340-920e-2d02166c1f8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.590887 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927010b-a706-4340-920e-2d02166c1f8a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.599607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.628833 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 319/628] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:02.635940 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea881ee-6827-465f-b8f4-d27c4f8d971f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.711761 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 310/629] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:02.716966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea44264-c1bc-4e52-877b-d4fb3803896a None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.716966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea44264-c1bc-4e52-877b-d4fb3803896a None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.716966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea44264-c1bc-4e52-877b-d4fb3803896a None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.716966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 311/630] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:02.716966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea44264-c1bc-4e52-877b-d4fb3803896a None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.766995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea881ee-6827-465f-b8f4-d27c4f8d971f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.782759 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.814228 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc48529-ca3b-4671-90de-586836755a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.814936 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc48529-ca3b-4671-90de-586836755a95 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.815219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc48529-ca3b-4671-90de-586836755a95 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.815498 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc48529-ca3b-4671-90de-586836755a95 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.816300 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc48529-ca3b-4671-90de-586836755a95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:02.816617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc48529-ca3b-4671-90de-586836755a95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.818087 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc48529-ca3b-4671-90de-586836755a95 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.836492 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 320/631] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:02.837297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc48529-ca3b-4671-90de-586836755a95 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.850915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea44264-c1bc-4e52-877b-d4fb3803896a None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.881639 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.889035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5756f3-12a3-459f-bece-d4c782ba02b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.889908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5756f3-12a3-459f-bece-d4c782ba02b0 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.890192 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5756f3-12a3-459f-bece-d4c782ba02b0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.890467 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5756f3-12a3-459f-bece-d4c782ba02b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.903400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5756f3-12a3-459f-bece-d4c782ba02b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-9c5756f3-12a3-459f-bece-d4c782ba02b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:02.912375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:02.913454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:02.914366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 312/632] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:02.915161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8fb65-878e-4ed6-a27d-6f6bb404f717 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.915161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8fb65-878e-4ed6-a27d-6f6bb404f717 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.915655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8fb65-878e-4ed6-a27d-6f6bb404f717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.933952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-80b8fb65-878e-4ed6-a27d-6f6bb404f717 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:02.935541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-80b8fb65-878e-4ed6-a27d-6f6bb404f717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:02.963187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc48529-ca3b-4671-90de-586836755a95 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.002586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472ee86-33e4-4571-84c1-cbdb9e06f96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.003449 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472ee86-33e4-4571-84c1-cbdb9e06f96c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.003733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472ee86-33e4-4571-84c1-cbdb9e06f96c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.004110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472ee86-33e4-4571-84c1-cbdb9e06f96c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.011605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 313/633] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:03.012697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8fb65-878e-4ed6-a27d-6f6bb404f717 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.027496 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472ee86-33e4-4571-84c1-cbdb9e06f96c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.030311 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472ee86-33e4-4571-84c1-cbdb9e06f96c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-5472ee86-33e4-4571-84c1-cbdb9e06f96c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:03.055025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:03.056068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:03.057670 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:03.057670 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:03.057670 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:03.057670 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:03.057670 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 321/634] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:03.058252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472ee86-33e4-4571-84c1-cbdb9e06f96c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.065522 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.136707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8fb65-878e-4ed6-a27d-6f6bb404f717 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.168549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.177048 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2165e-0806-40a3-8916-3701f12671f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.177958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2165e-0806-40a3-8916-3701f12671f8 None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.178254 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2165e-0806-40a3-8916-3701f12671f8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.178588 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2165e-0806-40a3-8916-3701f12671f8 None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/da8976d2646745feadde336d6164e1da/roles/c6d6983e0eaf48da8812725f576ddfb2` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.181105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472ee86-33e4-4571-84c1-cbdb9e06f96c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.195173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2165e-0806-40a3-8916-3701f12671f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=da8976d2646745feadde336d6164e1da, role_id=c6d6983e0eaf48da8812725f576ddfb2)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.196802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2165e-0806-40a3-8916-3701f12671f8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.217612 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5652f-79cb-4a55-99d1-50fd72e37d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.218283 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5652f-79cb-4a55-99d1-50fd72e37d5a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.218632 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5652f-79cb-4a55-99d1-50fd72e37d5a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.218908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5652f-79cb-4a55-99d1-50fd72e37d5a None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.219657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5652f-79cb-4a55-99d1-50fd72e37d5a None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:03.219961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5652f-79cb-4a55-99d1-50fd72e37d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.221340 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5652f-79cb-4a55-99d1-50fd72e37d5a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.229897 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 322/635] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:03.230773 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5652f-79cb-4a55-99d1-50fd72e37d5a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.266232 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 314/636] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:25:03 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/da8976d2646745feadde336d6164e1da/roles/c6d6983e0eaf48da8812725f576ddfb2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:03.267186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2165e-0806-40a3-8916-3701f12671f8 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.355345 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5652f-79cb-4a55-99d1-50fd72e37d5a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.397853 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e6853-593f-4cc2-be40-fcad86f4a267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.398711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e6853-593f-4cc2-be40-fcad86f4a267 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.398995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e6853-593f-4cc2-be40-fcad86f4a267 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.399150 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.399296 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e6853-593f-4cc2-be40-fcad86f4a267 None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.409817 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2165e-0806-40a3-8916-3701f12671f8 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.411772 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e6853-593f-4cc2-be40-fcad86f4a267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-0f5e6853-593f-4cc2-be40-fcad86f4a267 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:03.419876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:03.421084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:03.422037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 323/637] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:03.423501 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e6853-593f-4cc2-be40-fcad86f4a267 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.438308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.462857 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbf9b6-f3ce-4668-9c43-0be19d6a0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.463563 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbf9b6-f3ce-4668-9c43-0be19d6a0b14 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.464043 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbf9b6-f3ce-4668-9c43-0be19d6a0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.464333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbf9b6-f3ce-4668-9c43-0be19d6a0b14 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.466077 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbf9b6-f3ce-4668-9c43-0be19d6a0b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:03.466395 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbf9b6-f3ce-4668-9c43-0be19d6a0b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.467861 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbf9b6-f3ce-4668-9c43-0be19d6a0b14 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.483700 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 315/638] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:03.485396 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb7235-c71e-4da6-8c44-c65c46b029b1 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.485695 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb7235-c71e-4da6-8c44-c65c46b029b1 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.485976 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb7235-c71e-4da6-8c44-c65c46b029b1 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.487977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 316/639] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:03.488985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb7235-c71e-4da6-8c44-c65c46b029b1 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.549902 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e6853-593f-4cc2-be40-fcad86f4a267 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.593768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa5d03-18de-443a-9b6b-f73985b1d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.594633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa5d03-18de-443a-9b6b-f73985b1d203 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.594921 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa5d03-18de-443a-9b6b-f73985b1d203 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.595222 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa5d03-18de-443a-9b6b-f73985b1d203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.605591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb7235-c71e-4da6-8c44-c65c46b029b1 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.608276 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa5d03-18de-443a-9b6b-f73985b1d203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.609908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa5d03-18de-443a-9b6b-f73985b1d203 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-3cfa5d03-18de-443a-9b6b-f73985b1d203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:03.629092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:03.630121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:03.631500 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:03.631500 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:03.631500 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:03.631500 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:03.631500 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 324/640] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:03.631500 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa5d03-18de-443a-9b6b-f73985b1d203 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.648391 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac48e3-f438-43ac-9a42-b8d29299bcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.649190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac48e3-f438-43ac-9a42-b8d29299bcb1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.649375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac48e3-f438-43ac-9a42-b8d29299bcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.649639 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac48e3-f438-43ac-9a42-b8d29299bcb1 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.651066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac48e3-f438-43ac-9a42-b8d29299bcb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:03.651066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac48e3-f438-43ac-9a42-b8d29299bcb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.652201 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac48e3-f438-43ac-9a42-b8d29299bcb1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.662749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 317/641] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:03.664041 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc646626-2cc4-43a8-87fc-1223ef33e63c None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.664360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc646626-2cc4-43a8-87fc-1223ef33e63c None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.664462 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc646626-2cc4-43a8-87fc-1223ef33e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.683660 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-fc646626-2cc4-43a8-87fc-1223ef33e63c None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:03.684877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-fc646626-2cc4-43a8-87fc-1223ef33e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:03.697186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.712513 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.755548 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa5d03-18de-443a-9b6b-f73985b1d203 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.783032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 318/642] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:03.785179 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc646626-2cc4-43a8-87fc-1223ef33e63c None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.815080 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5dbf4-9f56-4f93-9463-2cc77d573aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.816444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5dbf4-9f56-4f93-9463-2cc77d573aa5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.816783 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5dbf4-9f56-4f93-9463-2cc77d573aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.817033 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5dbf4-9f56-4f93-9463-2cc77d573aa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.826516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5dbf4-9f56-4f93-9463-2cc77d573aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.828042 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5dbf4-9f56-4f93-9463-2cc77d573aa5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-afb5dbf4-9f56-4f93-9463-2cc77d573aa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:03.848442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:03.849524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:03.851204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:03.851204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:03.851204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:03.851204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:03.851204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:03.851204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:03.851204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:03.851204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:03.851204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 325/643] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:03.851204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5dbf4-9f56-4f93-9463-2cc77d573aa5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.921104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc646626-2cc4-43a8-87fc-1223ef33e63c None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.962293 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64011b-a24a-45c5-8537-f267d43ac7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.963097 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64011b-a24a-45c5-8537-f267d43ac7fb None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.963381 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64011b-a24a-45c5-8537-f267d43ac7fb None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.963655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64011b-a24a-45c5-8537-f267d43ac7fb None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.964387 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64011b-a24a-45c5-8537-f267d43ac7fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:03.964694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64011b-a24a-45c5-8537-f267d43ac7fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.966841 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64011b-a24a-45c5-8537-f267d43ac7fb None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.978038 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5dbf4-9f56-4f93-9463-2cc77d573aa5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.980548 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 319/644] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:03.985745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64011b-a24a-45c5-8537-f267d43ac7fb None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.991139 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.011581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.025680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7888b-7b11-4035-b011-b5dd4b2a3cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.026498 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7888b-7b11-4035-b011-b5dd4b2a3cf3 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.026857 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7888b-7b11-4035-b011-b5dd4b2a3cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.027131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7888b-7b11-4035-b011-b5dd4b2a3cf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.038267 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7888b-7b11-4035-b011-b5dd4b2a3cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.039814 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7888b-7b11-4035-b011-b5dd4b2a3cf3 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-c4f7888b-7b11-4035-b011-b5dd4b2a3cf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:04.061638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:04.062984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:04.064442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:04.064442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:04.064442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:04.064442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:04.064442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 326/645] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:04.064442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7888b-7b11-4035-b011-b5dd4b2a3cf3 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.141708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64011b-a24a-45c5-8537-f267d43ac7fb None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.178405 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7888b-7b11-4035-b011-b5dd4b2a3cf3 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.185850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154f38-5c09-469a-afdb-a0b8bcfa41ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.186693 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154f38-5c09-469a-afdb-a0b8bcfa41ca None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.186976 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154f38-5c09-469a-afdb-a0b8bcfa41ca None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.187249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154f38-5c09-469a-afdb-a0b8bcfa41ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.198640 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12154f38-5c09-469a-afdb-a0b8bcfa41ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-12154f38-5c09-469a-afdb-a0b8bcfa41ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:04.206585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:04.207643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:04.208586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:04.212740 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 320/646] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:04.213538 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154f38-5c09-469a-afdb-a0b8bcfa41ca None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.218370 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492417c5-89c2-4b7b-9a0a-023d6bd692b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.221079 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492417c5-89c2-4b7b-9a0a-023d6bd692b9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.221079 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492417c5-89c2-4b7b-9a0a-023d6bd692b9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.221079 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492417c5-89c2-4b7b-9a0a-023d6bd692b9 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.221079 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492417c5-89c2-4b7b-9a0a-023d6bd692b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:04.221079 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492417c5-89c2-4b7b-9a0a-023d6bd692b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.222329 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492417c5-89c2-4b7b-9a0a-023d6bd692b9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.240633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 327/647] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:04.240633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492417c5-89c2-4b7b-9a0a-023d6bd692b9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.279577 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.291362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.333327 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154f38-5c09-469a-afdb-a0b8bcfa41ca None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.361292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492417c5-89c2-4b7b-9a0a-023d6bd692b9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.369672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394b18a-bc78-4e46-838d-6e76a7920063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.370478 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394b18a-bc78-4e46-838d-6e76a7920063 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.370790 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394b18a-bc78-4e46-838d-6e76a7920063 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.371304 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394b18a-bc78-4e46-838d-6e76a7920063 None admin] PATH_INFO: `/v3/users/glance` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.379694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394b18a-bc78-4e46-838d-6e76a7920063 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.381429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394b18a-bc78-4e46-838d-6e76a7920063 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-a394b18a-bc78-4e46-838d-6e76a7920063 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:04.396557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:04.397597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:04.403614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:04.403614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:04.403614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:04.403614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:04.403614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:04.403614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:04.403614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:04.403614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:04.403614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:25:04.403614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:04.404328 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d959df-3923-43db-9115-153684f8db1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.404328 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d959df-3923-43db-9115-153684f8db1a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.404328 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d959df-3923-43db-9115-153684f8db1a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.404328 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d959df-3923-43db-9115-153684f8db1a None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.404674 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 321/648] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:04.404771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d959df-3923-43db-9115-153684f8db1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:04.404858 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394b18a-bc78-4e46-838d-6e76a7920063 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.404943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d959df-3923-43db-9115-153684f8db1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.404943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d959df-3923-43db-9115-153684f8db1a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.422798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 328/649] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:04.422798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d959df-3923-43db-9115-153684f8db1a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.520540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394b18a-bc78-4e46-838d-6e76a7920063 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.523225 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.530358 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d959df-3923-43db-9115-153684f8db1a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.545644 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.557181 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa046a6-fae5-4727-8134-3f9f83426045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.557993 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa046a6-fae5-4727-8134-3f9f83426045 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.558307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa046a6-fae5-4727-8134-3f9f83426045 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.558554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa046a6-fae5-4727-8134-3f9f83426045 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.559337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa046a6-fae5-4727-8134-3f9f83426045 None admin] RBAC: Adding query filter params (name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:04.559641 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa046a6-fae5-4727-8134-3f9f83426045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.561001 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa046a6-fae5-4727-8134-3f9f83426045 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.569045 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec45c7d-b32b-42f2-a22c-c795a7757ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.570195 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 322/650] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:04.570532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec45c7d-b32b-42f2-a22c-c795a7757ebd None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.571245 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec45c7d-b32b-42f2-a22c-c795a7757ebd None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.571487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa046a6-fae5-4727-8134-3f9f83426045 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.571914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec45c7d-b32b-42f2-a22c-c795a7757ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.572776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec45c7d-b32b-42f2-a22c-c795a7757ebd None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=382eda270f1545718847c9687bd62846) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:04.573095 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec45c7d-b32b-42f2-a22c-c795a7757ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.574557 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec45c7d-b32b-42f2-a22c-c795a7757ebd None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.581884 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 329/651] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/role_assignments?user.id=382eda270f1545718847c9687bd62846&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:04.590778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec45c7d-b32b-42f2-a22c-c795a7757ebd None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.721400 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec45c7d-b32b-42f2-a22c-c795a7757ebd None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.776221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271dc77-3f98-4551-985f-c2c1c6a50877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.777914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271dc77-3f98-4551-985f-c2c1c6a50877 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.778430 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271dc77-3f98-4551-985f-c2c1c6a50877 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.779176 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271dc77-3f98-4551-985f-c2c1c6a50877 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.790986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271dc77-3f98-4551-985f-c2c1c6a50877 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.793584 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271dc77-3f98-4551-985f-c2c1c6a50877 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-9271dc77-3f98-4551-985f-c2c1c6a50877 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:04.816511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:04.817554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 330/652] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:04.820597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271dc77-3f98-4551-985f-c2c1c6a50877 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.842429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.847751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa046a6-fae5-4727-8134-3f9f83426045 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.895086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7778f8-9480-4926-a605-50b0615c668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.895582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7778f8-9480-4926-a605-50b0615c668c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.895972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7778f8-9480-4926-a605-50b0615c668c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.896349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7778f8-9480-4926-a605-50b0615c668c None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.897221 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7778f8-9480-4926-a605-50b0615c668c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:04.897537 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7778f8-9480-4926-a605-50b0615c668c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.899027 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7778f8-9480-4926-a605-50b0615c668c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.921149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 323/653] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:04.922350 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7778f8-9480-4926-a605-50b0615c668c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.947408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271dc77-3f98-4551-985f-c2c1c6a50877 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.977091 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.990207 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7107a25-61c6-451c-b4b5-fc96217308e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.991161 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7107a25-61c6-451c-b4b5-fc96217308e7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.993728 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7107a25-61c6-451c-b4b5-fc96217308e7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.993728 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7107a25-61c6-451c-b4b5-fc96217308e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.003178 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7107a25-61c6-451c-b4b5-fc96217308e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:05.005024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7107a25-61c6-451c-b4b5-fc96217308e7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-c7107a25-61c6-451c-b4b5-fc96217308e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:05.027181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:05.028287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:05.029263 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:05.029263 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:05.029263 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:05.029263 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:05.031795 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 331/654] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:05.033074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7107a25-61c6-451c-b4b5-fc96217308e7 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:05.052340 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7778f8-9480-4926-a605-50b0615c668c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:05.101344 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf08929-b9c6-43dd-a593-874a2bd830a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:05.102251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf08929-b9c6-43dd-a593-874a2bd830a1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.102370 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf08929-b9c6-43dd-a593-874a2bd830a1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.102585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf08929-b9c6-43dd-a593-874a2bd830a1 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.103575 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf08929-b9c6-43dd-a593-874a2bd830a1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:05.103805 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf08929-b9c6-43dd-a593-874a2bd830a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:05.105259 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf08929-b9c6-43dd-a593-874a2bd830a1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:05.119208 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:05.130503 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 324/655] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:05.130503 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf08929-b9c6-43dd-a593-874a2bd830a1 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:05.163572 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7107a25-61c6-451c-b4b5-fc96217308e7 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:05.203479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b9cc6-c9f3-41e6-9962-a92b77d32055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:05.204498 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b9cc6-c9f3-41e6-9962-a92b77d32055 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.205077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b9cc6-c9f3-41e6-9962-a92b77d32055 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.205548 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b9cc6-c9f3-41e6-9962-a92b77d32055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.249719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf08929-b9c6-43dd-a593-874a2bd830a1 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:05.252677 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:05.295823 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20a0c6-1fbb-4f6d-8355-efcb08400656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:05.296847 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20a0c6-1fbb-4f6d-8355-efcb08400656 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.297360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20a0c6-1fbb-4f6d-8355-efcb08400656 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.297856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20a0c6-1fbb-4f6d-8355-efcb08400656 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.298384 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b9cc6-c9f3-41e6-9962-a92b77d32055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:05.299071 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20a0c6-1fbb-4f6d-8355-efcb08400656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:05.299593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20a0c6-1fbb-4f6d-8355-efcb08400656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:05.300450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b9cc6-c9f3-41e6-9962-a92b77d32055 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:05.303175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20a0c6-1fbb-4f6d-8355-efcb08400656 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:05.319610 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 325/656] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:05.321671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20a0c6-1fbb-4f6d-8355-efcb08400656 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:05.388333 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:05.424634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 332/657] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:05.426221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b9cc6-c9f3-41e6-9962-a92b77d32055 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:05.470003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20a0c6-1fbb-4f6d-8355-efcb08400656 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:05.519736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27dfb9-3c84-4eaf-9ae9-731f94a174f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:05.521068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27dfb9-3c84-4eaf-9ae9-731f94a174f8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.521991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27dfb9-3c84-4eaf-9ae9-731f94a174f8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.522477 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27dfb9-3c84-4eaf-9ae9-731f94a174f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.539738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b9cc6-c9f3-41e6-9962-a92b77d32055 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:05.569372 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:05.579921 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2623b10-4842-47d5-a887-d98b9c1b8a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:05.580845 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2623b10-4842-47d5-a887-d98b9c1b8a23 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.581841 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2623b10-4842-47d5-a887-d98b9c1b8a23 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.582120 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2623b10-4842-47d5-a887-d98b9c1b8a23 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.596270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2623b10-4842-47d5-a887-d98b9c1b8a23 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:05.599647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2623b10-4842-47d5-a887-d98b9c1b8a23 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-b2623b10-4842-47d5-a887-d98b9c1b8a23 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:05.622737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:05.623995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 333/658] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:25:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:05.625236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2623b10-4842-47d5-a887-d98b9c1b8a23 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:05.633278 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27dfb9-3c84-4eaf-9ae9-731f94a174f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:05.635208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27dfb9-3c84-4eaf-9ae9-731f94a174f8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:05.657876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:05.732360 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2623b10-4842-47d5-a887-d98b9c1b8a23 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:05.751454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 326/659] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:05.757568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef9d81-8034-4f3a-b145-bfb3c80df8e0 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.757863 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef9d81-8034-4f3a-b145-bfb3c80df8e0 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.758143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef9d81-8034-4f3a-b145-bfb3c80df8e0 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.759497 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 327/660] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:05.762801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef9d81-8034-4f3a-b145-bfb3c80df8e0 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:05.774889 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41a562-9bc2-432f-89e8-35256dfb4e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:05.775734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41a562-9bc2-432f-89e8-35256dfb4e7f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.776019 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41a562-9bc2-432f-89e8-35256dfb4e7f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.776294 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41a562-9bc2-432f-89e8-35256dfb4e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.787167 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41a562-9bc2-432f-89e8-35256dfb4e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:05.788644 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41a562-9bc2-432f-89e8-35256dfb4e7f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-5d41a562-9bc2-432f-89e8-35256dfb4e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:05.813933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:05.814944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:05.817148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:05.817148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:05.817148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:05.817148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:05.817148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 334/661] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:05.817481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41a562-9bc2-432f-89e8-35256dfb4e7f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:05.835112 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:05.880694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef9d81-8034-4f3a-b145-bfb3c80df8e0 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:05.905869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:05.921620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a048ae-b2df-44cf-ab53-71fe8d4d1db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:05.922297 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a048ae-b2df-44cf-ab53-71fe8d4d1db0 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.922577 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a048ae-b2df-44cf-ab53-71fe8d4d1db0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.923054 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a048ae-b2df-44cf-ab53-71fe8d4d1db0 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.923815 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a048ae-b2df-44cf-ab53-71fe8d4d1db0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:05.924105 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a048ae-b2df-44cf-ab53-71fe8d4d1db0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:05.925648 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a048ae-b2df-44cf-ab53-71fe8d4d1db0 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:05.925776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41a562-9bc2-432f-89e8-35256dfb4e7f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:05.944878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 328/662] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 20:25:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:05.946528 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ff671-0235-4654-82b2-43ecc61d4a2b None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.946997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ff671-0235-4654-82b2-43ecc61d4a2b None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.947430 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ff671-0235-4654-82b2-43ecc61d4a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.965588 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-505ff671-0235-4654-82b2-43ecc61d4a2b None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:05.966825 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-505ff671-0235-4654-82b2-43ecc61d4a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:05.970299 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb195b4-fed9-46c8-a0a6-7062a62e11d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:05.971181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb195b4-fed9-46c8-a0a6-7062a62e11d5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.971476 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb195b4-fed9-46c8-a0a6-7062a62e11d5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.972366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb195b4-fed9-46c8-a0a6-7062a62e11d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.985468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb195b4-fed9-46c8-a0a6-7062a62e11d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:05.987249 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb195b4-fed9-46c8-a0a6-7062a62e11d5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-fdb195b4-fed9-46c8-a0a6-7062a62e11d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:06.007212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:06.008851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:06.010484 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:06.010484 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:06.010484 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:06.010484 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:06.013204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 335/663] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:06.013854 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb195b4-fed9-46c8-a0a6-7062a62e11d5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.050777 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 329/664] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:06.050777 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ff671-0235-4654-82b2-43ecc61d4a2b None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.111313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.133251 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb195b4-fed9-46c8-a0a6-7062a62e11d5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.164004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ff671-0235-4654-82b2-43ecc61d4a2b None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.169245 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68155df-2289-4825-b2b2-b5f2388c69f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.169910 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68155df-2289-4825-b2b2-b5f2388c69f3 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.170191 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68155df-2289-4825-b2b2-b5f2388c69f3 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.170462 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68155df-2289-4825-b2b2-b5f2388c69f3 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.171326 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68155df-2289-4825-b2b2-b5f2388c69f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:06.171643 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68155df-2289-4825-b2b2-b5f2388c69f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.173114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68155df-2289-4825-b2b2-b5f2388c69f3 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.174683 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.185598 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 336/665] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:06.186233 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68155df-2289-4825-b2b2-b5f2388c69f3 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.207435 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60bed6-90a4-4da1-959e-72e4d10c6531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.215886 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60bed6-90a4-4da1-959e-72e4d10c6531 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.215886 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60bed6-90a4-4da1-959e-72e4d10c6531 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.215886 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60bed6-90a4-4da1-959e-72e4d10c6531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.282042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60bed6-90a4-4da1-959e-72e4d10c6531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.283675 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60bed6-90a4-4da1-959e-72e4d10c6531 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.294872 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68155df-2289-4825-b2b2-b5f2388c69f3 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.331874 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088cef6-8ec5-4864-a829-c1c32cfa3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.332572 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088cef6-8ec5-4864-a829-c1c32cfa3d85 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.332848 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088cef6-8ec5-4864-a829-c1c32cfa3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.333127 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088cef6-8ec5-4864-a829-c1c32cfa3d85 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.333878 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088cef6-8ec5-4864-a829-c1c32cfa3d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:06.334191 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088cef6-8ec5-4864-a829-c1c32cfa3d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.335640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088cef6-8ec5-4864-a829-c1c32cfa3d85 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.353294 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 337/666] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:06.353294 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088cef6-8ec5-4864-a829-c1c32cfa3d85 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.363098 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.410050 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.429608 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 330/667] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:06.429608 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60bed6-90a4-4da1-959e-72e4d10c6531 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.456887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088cef6-8ec5-4864-a829-c1c32cfa3d85 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.492499 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df960c7-9083-413b-a655-de01d70a6f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.493310 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df960c7-9083-413b-a655-de01d70a6f53 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.493591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df960c7-9083-413b-a655-de01d70a6f53 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.493900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df960c7-9083-413b-a655-de01d70a6f53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.504923 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df960c7-9083-413b-a655-de01d70a6f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-4df960c7-9083-413b-a655-de01d70a6f53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:06.512734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:06.513885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 338/668] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:06.515114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df960c7-9083-413b-a655-de01d70a6f53 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.544213 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60bed6-90a4-4da1-959e-72e4d10c6531 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.581754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5a0b7-cb75-499d-9390-6d409d68162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.582697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5a0b7-cb75-499d-9390-6d409d68162e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.583191 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5a0b7-cb75-499d-9390-6d409d68162e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.583358 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5a0b7-cb75-499d-9390-6d409d68162e None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.591089 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5a0b7-cb75-499d-9390-6d409d68162e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.592530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5a0b7-cb75-499d-9390-6d409d68162e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-86a5a0b7-cb75-499d-9390-6d409d68162e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:06.608703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:06.609727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:06.610770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:06.610770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:06.610770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:06.610770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:06.610770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:06.610770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:06.610770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:06.610770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:06.610770 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 331/669] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:06.611293 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5a0b7-cb75-499d-9390-6d409d68162e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.629815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df960c7-9083-413b-a655-de01d70a6f53 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.632506 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.644417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.664872 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5f4c5-6286-4dc5-928e-1113116a2f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.665918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5f4c5-6286-4dc5-928e-1113116a2f4c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.666382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5f4c5-6286-4dc5-928e-1113116a2f4c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.666836 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5f4c5-6286-4dc5-928e-1113116a2f4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.674104 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5f4c5-6286-4dc5-928e-1113116a2f4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.676634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5f4c5-6286-4dc5-928e-1113116a2f4c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-fae5f4c5-6286-4dc5-928e-1113116a2f4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:06.692295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:06.693511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:06.694734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:06.694734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:06.694734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:06.694734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:06.694734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:06.694734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:06.694734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:06.694734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:06.697316 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 339/670] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:06.698251 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5f4c5-6286-4dc5-928e-1113116a2f4c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.729780 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5a0b7-cb75-499d-9390-6d409d68162e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.767942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6fd45-cf08-4038-9518-4a20ad6dde14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.769034 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fd45-cf08-4038-9518-4a20ad6dde14 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.769495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fd45-cf08-4038-9518-4a20ad6dde14 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.769940 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fd45-cf08-4038-9518-4a20ad6dde14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.782895 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6fd45-cf08-4038-9518-4a20ad6dde14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.785178 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6fd45-cf08-4038-9518-4a20ad6dde14 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-b1f6fd45-cf08-4038-9518-4a20ad6dde14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:06.804485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:06.805433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:06.806392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:06.806392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:06.806392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:06.806392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:06.806392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 332/671] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:06.806730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6fd45-cf08-4038-9518-4a20ad6dde14 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.819043 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5f4c5-6286-4dc5-928e-1113116a2f4c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.860197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303ad9-1fc6-48c4-9b8b-ea8698ba2353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.861390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303ad9-1fc6-48c4-9b8b-ea8698ba2353 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.862304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303ad9-1fc6-48c4-9b8b-ea8698ba2353 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.862780 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303ad9-1fc6-48c4-9b8b-ea8698ba2353 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.863995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23303ad9-1fc6-48c4-9b8b-ea8698ba2353 None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:06.864503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23303ad9-1fc6-48c4-9b8b-ea8698ba2353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.866586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23303ad9-1fc6-48c4-9b8b-ea8698ba2353 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.878919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.879965 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 340/672] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:06.881675 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303ad9-1fc6-48c4-9b8b-ea8698ba2353 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.919877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6fd45-cf08-4038-9518-4a20ad6dde14 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.925928 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.962351 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0107c-667b-4995-a592-d6da5cccc7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.963477 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0107c-667b-4995-a592-d6da5cccc7de None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.963768 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0107c-667b-4995-a592-d6da5cccc7de None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.964054 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0107c-667b-4995-a592-d6da5cccc7de None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.966161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0107c-667b-4995-a592-d6da5cccc7de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:06.966492 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0107c-667b-4995-a592-d6da5cccc7de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.968005 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0107c-667b-4995-a592-d6da5cccc7de None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.983465 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 333/673] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:06.984132 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0107c-667b-4995-a592-d6da5cccc7de None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.001174 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303ad9-1fc6-48c4-9b8b-ea8698ba2353 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.037779 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6fb82-1d51-4ff2-a700-7b8f520e9fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.038542 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fb82-1d51-4ff2-a700-7b8f520e9fb0 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.038843 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fb82-1d51-4ff2-a700-7b8f520e9fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.039111 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fb82-1d51-4ff2-a700-7b8f520e9fb0 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.039903 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6fb82-1d51-4ff2-a700-7b8f520e9fb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:07.040209 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6fb82-1d51-4ff2-a700-7b8f520e9fb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.041652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6fb82-1d51-4ff2-a700-7b8f520e9fb0 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.054140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 341/674] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:07.054972 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6fb82-1d51-4ff2-a700-7b8f520e9fb0 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.092606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0107c-667b-4995-a592-d6da5cccc7de None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.115217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:07.126508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598421bd-7895-454b-8502-977475a01600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.127209 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598421bd-7895-454b-8502-977475a01600 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.127489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598421bd-7895-454b-8502-977475a01600 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.128565 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598421bd-7895-454b-8502-977475a01600 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.129004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598421bd-7895-454b-8502-977475a01600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:07.129308 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598421bd-7895-454b-8502-977475a01600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.130744 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598421bd-7895-454b-8502-977475a01600 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.143340 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 334/675] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:07.144793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598421bd-7895-454b-8502-977475a01600 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.155178 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:07.161255 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6fb82-1d51-4ff2-a700-7b8f520e9fb0 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.197122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe60766-690a-4b64-9560-cb10cb4fd7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.197933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe60766-690a-4b64-9560-cb10cb4fd7a9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.198210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe60766-690a-4b64-9560-cb10cb4fd7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.198481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe60766-690a-4b64-9560-cb10cb4fd7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.208953 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe60766-690a-4b64-9560-cb10cb4fd7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.210394 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe60766-690a-4b64-9560-cb10cb4fd7a9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-6fe60766-690a-4b64-9560-cb10cb4fd7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:07.227803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:07.229130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:07.230369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:07.230369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:07.230369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:07.230369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:07.230369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 342/676] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:07.230369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe44af-4c69-4aa1-bece-46c64d7bc318 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.230889 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe44af-4c69-4aa1-bece-46c64d7bc318 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.230889 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe44af-4c69-4aa1-bece-46c64d7bc318 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.234659 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 343/677] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:07.234659 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe44af-4c69-4aa1-bece-46c64d7bc318 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.250571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598421bd-7895-454b-8502-977475a01600 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.285642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee918-6a7a-4b80-855f-8caf2a6a6d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.286314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee918-6a7a-4b80-855f-8caf2a6a6d19 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.286629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee918-6a7a-4b80-855f-8caf2a6a6d19 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.286913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee918-6a7a-4b80-855f-8caf2a6a6d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.287754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ee918-6a7a-4b80-855f-8caf2a6a6d19 None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=dfeabf7571794b87b88276b9902d1c0b) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:07.288069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ee918-6a7a-4b80-855f-8caf2a6a6d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.289621 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ee918-6a7a-4b80-855f-8caf2a6a6d19 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.295612 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 335/678] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/role_assignments?user.id=dfeabf7571794b87b88276b9902d1c0b&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:07.296429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee918-6a7a-4b80-855f-8caf2a6a6d19 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.344204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe44af-4c69-4aa1-bece-46c64d7bc318 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.353848 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:07.386059 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c6059-7eb9-456e-bd4f-4b9714345d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.386673 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c6059-7eb9-456e-bd4f-4b9714345d07 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.386962 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c6059-7eb9-456e-bd4f-4b9714345d07 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.387240 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c6059-7eb9-456e-bd4f-4b9714345d07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.388103 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c6059-7eb9-456e-bd4f-4b9714345d07 None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=c8570414248b45d9917bee9b00cac027) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:07.388429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c6059-7eb9-456e-bd4f-4b9714345d07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.389924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c6059-7eb9-456e-bd4f-4b9714345d07 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.398655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 344/679] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/role_assignments?user.id=c8570414248b45d9917bee9b00cac027&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:07.398655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c6059-7eb9-456e-bd4f-4b9714345d07 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.417474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:07.432492 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee918-6a7a-4b80-855f-8caf2a6a6d19 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.478451 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4847069-ff9f-4a59-8398-4ba15048be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.479440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4847069-ff9f-4a59-8398-4ba15048be76 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.479790 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4847069-ff9f-4a59-8398-4ba15048be76 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.480139 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4847069-ff9f-4a59-8398-4ba15048be76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.489229 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4847069-ff9f-4a59-8398-4ba15048be76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.491145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4847069-ff9f-4a59-8398-4ba15048be76 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-e4847069-ff9f-4a59-8398-4ba15048be76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:07.509073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:07.510114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:07.511167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:07.511167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:07.511167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:07.511167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:07.511167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:07.511167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:07.511167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:07.511167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:07.511167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 336/680] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:07.512024 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7236-a901-464d-8c75-ce8319718cb1 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.512024 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7236-a901-464d-8c75-ce8319718cb1 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.512291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7236-a901-464d-8c75-ce8319718cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.538344 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-04cf7236-a901-464d-8c75-ce8319718cb1 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:07.538344 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-04cf7236-a901-464d-8c75-ce8319718cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:07.561871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c6059-7eb9-456e-bd4f-4b9714345d07 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.609294 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2f6ea-e634-459b-9b1d-b5ed086d0ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.610650 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2f6ea-e634-459b-9b1d-b5ed086d0ef2 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.610650 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2f6ea-e634-459b-9b1d-b5ed086d0ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.610650 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2f6ea-e634-459b-9b1d-b5ed086d0ef2 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.611254 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2f6ea-e634-459b-9b1d-b5ed086d0ef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:07.611557 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2f6ea-e634-459b-9b1d-b5ed086d0ef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.613530 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2f6ea-e634-459b-9b1d-b5ed086d0ef2 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.626440 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 345/681] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:07.627521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2f6ea-e634-459b-9b1d-b5ed086d0ef2 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.635474 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 337/682] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:07.636481 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf7236-a901-464d-8c75-ce8319718cb1 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.682281 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:07.732013 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:07.755705 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf7236-a901-464d-8c75-ce8319718cb1 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.766929 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2f6ea-e634-459b-9b1d-b5ed086d0ef2 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.806280 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebd3e-d5c6-4001-97b9-5c9339c53515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.807382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebd3e-d5c6-4001-97b9-5c9339c53515 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.807745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebd3e-d5c6-4001-97b9-5c9339c53515 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.808101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebd3e-d5c6-4001-97b9-5c9339c53515 None admin] PATH_INFO: `/v3/users/swift` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.818012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea7667-f94d-4ad9-bb31-dad08486f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.818213 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ebd3e-d5c6-4001-97b9-5c9339c53515 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.819056 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea7667-f94d-4ad9-bb31-dad08486f2e7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.819524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea7667-f94d-4ad9-bb31-dad08486f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.819931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ebd3e-d5c6-4001-97b9-5c9339c53515 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.820115 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea7667-f94d-4ad9-bb31-dad08486f2e7 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.821058 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea7667-f94d-4ad9-bb31-dad08486f2e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:07.821524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea7667-f94d-4ad9-bb31-dad08486f2e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.823897 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea7667-f94d-4ad9-bb31-dad08486f2e7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-a49ebd3e-d5c6-4001-97b9-5c9339c53515 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:07.838265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:07.839605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:07.840853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:07.840853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:07.840853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:07.840853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:07.840853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:07.840853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:07.840853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:07.840853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:07.840853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:07.840853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:07.841560 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 338/683] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:07.841945 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 346/684] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:07.842072 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebd3e-d5c6-4001-97b9-5c9339c53515 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.844732 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea7667-f94d-4ad9-bb31-dad08486f2e7 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.958222 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea7667-f94d-4ad9-bb31-dad08486f2e7 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.975341 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:07.984344 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebd3e-d5c6-4001-97b9-5c9339c53515 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.002859 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:08.008619 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce313703-7a53-4381-af5a-b30571f3adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.009295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce313703-7a53-4381-af5a-b30571f3adee None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.009582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce313703-7a53-4381-af5a-b30571f3adee None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.010067 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce313703-7a53-4381-af5a-b30571f3adee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.010751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce313703-7a53-4381-af5a-b30571f3adee None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=8ac8cf78ff434568b20062de3ccf65ed) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:08.011073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce313703-7a53-4381-af5a-b30571f3adee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.012595 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce313703-7a53-4381-af5a-b30571f3adee None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.026635 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 347/685] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/role_assignments?user.id=8ac8cf78ff434568b20062de3ccf65ed&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:08.026635 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce313703-7a53-4381-af5a-b30571f3adee None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.046990 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858083a4-a928-4325-b035-f6cc5b29bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.047830 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858083a4-a928-4325-b035-f6cc5b29bf22 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.048121 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858083a4-a928-4325-b035-f6cc5b29bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.048405 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858083a4-a928-4325-b035-f6cc5b29bf22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.072552 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858083a4-a928-4325-b035-f6cc5b29bf22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-858083a4-a928-4325-b035-f6cc5b29bf22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:08.080631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:08.081791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:08.082852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:08.084337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 339/686] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:08.092063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858083a4-a928-4325-b035-f6cc5b29bf22 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.207711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce313703-7a53-4381-af5a-b30571f3adee None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.265406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858083a4-a928-4325-b035-f6cc5b29bf22 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.280173 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ade0a-e776-4cdf-845b-79ed5e8667e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.280878 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ade0a-e776-4cdf-845b-79ed5e8667e8 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.281162 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ade0a-e776-4cdf-845b-79ed5e8667e8 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.281445 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ade0a-e776-4cdf-845b-79ed5e8667e8 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.282307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ade0a-e776-4cdf-845b-79ed5e8667e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:08.282641 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ade0a-e776-4cdf-845b-79ed5e8667e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.287442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ade0a-e776-4cdf-845b-79ed5e8667e8 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.312720 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445127-381b-475c-8e95-a97223b8528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.313431 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445127-381b-475c-8e95-a97223b8528b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.313716 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445127-381b-475c-8e95-a97223b8528b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.313993 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445127-381b-475c-8e95-a97223b8528b None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.314817 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63445127-381b-475c-8e95-a97223b8528b None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:08.315128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63445127-381b-475c-8e95-a97223b8528b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.316598 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63445127-381b-475c-8e95-a97223b8528b None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.326481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 348/687] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:08.327858 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 340/688] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:08.332133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ade0a-e776-4cdf-845b-79ed5e8667e8 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.336251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445127-381b-475c-8e95-a97223b8528b None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.368694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:08.400314 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:08.454233 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ade0a-e776-4cdf-845b-79ed5e8667e8 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.478207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445127-381b-475c-8e95-a97223b8528b None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.503122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67945-146b-4564-91fd-a109e0b3eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.503804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67945-146b-4564-91fd-a109e0b3eae0 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.504304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67945-146b-4564-91fd-a109e0b3eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.504427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67945-146b-4564-91fd-a109e0b3eae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.515502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dff7b-8dd9-45a7-a45f-eb959beb42c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.516626 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dff7b-8dd9-45a7-a45f-eb959beb42c7 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.517060 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dff7b-8dd9-45a7-a45f-eb959beb42c7 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.517484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dff7b-8dd9-45a7-a45f-eb959beb42c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.529444 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dff7b-8dd9-45a7-a45f-eb959beb42c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.531143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dff7b-8dd9-45a7-a45f-eb959beb42c7 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-834dff7b-8dd9-45a7-a45f-eb959beb42c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:08.552972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:08.554175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:08.555520 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:08.555520 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:08.555520 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:08.555520 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:08.561854 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 341/689] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:08.563459 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dff7b-8dd9-45a7-a45f-eb959beb42c7 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.580448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d67945-146b-4564-91fd-a109e0b3eae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.582074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d67945-146b-4564-91fd-a109e0b3eae0 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.648607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:08.690090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dff7b-8dd9-45a7-a45f-eb959beb42c7 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.773193 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0bb91-0590-4a21-806c-9eec947bdf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.773193 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0bb91-0590-4a21-806c-9eec947bdf9c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.773514 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0bb91-0590-4a21-806c-9eec947bdf9c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.773709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0bb91-0590-4a21-806c-9eec947bdf9c None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.774477 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0bb91-0590-4a21-806c-9eec947bdf9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:08.779940 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0bb91-0590-4a21-806c-9eec947bdf9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.781443 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0bb91-0590-4a21-806c-9eec947bdf9c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.813394 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 342/690] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:08.816331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0bb91-0590-4a21-806c-9eec947bdf9c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.822818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:08.882214 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 349/691] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:08.888089 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67945-146b-4564-91fd-a109e0b3eae0 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.020175 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67945-146b-4564-91fd-a109e0b3eae0 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.059737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662c03b-cc24-4ae7-a3ab-83f35a2d4c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.060727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0bb91-0590-4a21-806c-9eec947bdf9c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.061483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c03b-cc24-4ae7-a3ab-83f35a2d4c78 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.062026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c03b-cc24-4ae7-a3ab-83f35a2d4c78 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.062707 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c03b-cc24-4ae7-a3ab-83f35a2d4c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.075837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662c03b-cc24-4ae7-a3ab-83f35a2d4c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.077655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662c03b-cc24-4ae7-a3ab-83f35a2d4c78 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-3662c03b-cc24-4ae7-a3ab-83f35a2d4c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:09.097465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:09.098491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:09.099519 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:09.099519 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:09.099519 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:09.099519 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:09.102144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 350/692] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:09.108085 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662c03b-cc24-4ae7-a3ab-83f35a2d4c78 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.121199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:09.170464 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:09.187682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd42bc-0d5e-47ed-a4ee-546afc38fa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.188818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd42bc-0d5e-47ed-a4ee-546afc38fa77 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.189318 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd42bc-0d5e-47ed-a4ee-546afc38fa77 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.189946 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd42bc-0d5e-47ed-a4ee-546afc38fa77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.206511 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd42bc-0d5e-47ed-a4ee-546afc38fa77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.208471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd42bc-0d5e-47ed-a4ee-546afc38fa77 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-57cd42bc-0d5e-47ed-a4ee-546afc38fa77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:09.239173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:09.240298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:09.241793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:09.241793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:09.241793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:09.241793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:09.241793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:09.241793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:09.241793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:09.241793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:09.241793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:09.241793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:09.245664 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 343/693] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:09.251737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd42bc-0d5e-47ed-a4ee-546afc38fa77 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662c03b-cc24-4ae7-a3ab-83f35a2d4c78 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.371469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddda264-dba3-465f-a88a-d37f763a8490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.372161 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddda264-dba3-465f-a88a-d37f763a8490 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.372444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddda264-dba3-465f-a88a-d37f763a8490 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.372721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddda264-dba3-465f-a88a-d37f763a8490 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.373771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddda264-dba3-465f-a88a-d37f763a8490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:09.373771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddda264-dba3-465f-a88a-d37f763a8490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.375192 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddda264-dba3-465f-a88a-d37f763a8490 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.407868 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd42bc-0d5e-47ed-a4ee-546afc38fa77 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.408932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 351/694] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:09.423719 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddda264-dba3-465f-a88a-d37f763a8490 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.457347 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0ae34-88b0-420a-b311-c48d00876ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.458445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ae34-88b0-420a-b311-c48d00876ec6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.459126 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ae34-88b0-420a-b311-c48d00876ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.460378 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ae34-88b0-420a-b311-c48d00876ec6 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.461478 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0ae34-88b0-420a-b311-c48d00876ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:09.462008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0ae34-88b0-420a-b311-c48d00876ec6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.463874 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0ae34-88b0-420a-b311-c48d00876ec6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.486274 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 344/695] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:25:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:09.495933 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0ae34-88b0-420a-b311-c48d00876ec6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.595707 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:09.606964 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:09.673809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0ae34-88b0-420a-b311-c48d00876ec6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.699860 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddda264-dba3-465f-a88a-d37f763a8490 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.715227 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37400e12-0415-488a-8c35-3a0f19572f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.716299 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400e12-0415-488a-8c35-3a0f19572f5f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.716820 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400e12-0415-488a-8c35-3a0f19572f5f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.717322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400e12-0415-488a-8c35-3a0f19572f5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.808600 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4336-afa3-4db0-9bad-5cb290974f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.809732 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4336-afa3-4db0-9bad-5cb290974f34 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.810754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37400e12-0415-488a-8c35-3a0f19572f5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.811276 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4336-afa3-4db0-9bad-5cb290974f34 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.812955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37400e12-0415-488a-8c35-3a0f19572f5f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.813551 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4336-afa3-4db0-9bad-5cb290974f34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.833198 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d4336-afa3-4db0-9bad-5cb290974f34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.835465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d4336-afa3-4db0-9bad-5cb290974f34 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-178d4336-afa3-4db0-9bad-5cb290974f34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:09.856349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:09.857378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:09.858365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:09.858365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:09.858365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:09.858365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:09.858365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:09.858365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:09.858365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:09.858365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:09.864842 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 352/696] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:09.866320 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e912a-86f9-4f1a-8284-96bf1b7de350 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.871077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e912a-86f9-4f1a-8284-96bf1b7de350 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.871077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e912a-86f9-4f1a-8284-96bf1b7de350 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.871077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 353/697] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:09.873250 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e912a-86f9-4f1a-8284-96bf1b7de350 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.905790 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:09.969447 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 345/698] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:09.971171 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecc014-85df-4bce-8cd6-ab3d60c7ef54 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.971735 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecc014-85df-4bce-8cd6-ab3d60c7ef54 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.972260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecc014-85df-4bce-8cd6-ab3d60c7ef54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.993524 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-b4ecc014-85df-4bce-8cd6-ab3d60c7ef54 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:09.994958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-b4ecc014-85df-4bce-8cd6-ab3d60c7ef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:10.039593 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e912a-86f9-4f1a-8284-96bf1b7de350 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.070339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.077230 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 346/699] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:10.082666 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecc014-85df-4bce-8cd6-ab3d60c7ef54 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.084590 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3ed81-6148-448d-a7fb-3d33a5be7f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.085511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3ed81-6148-448d-a7fb-3d33a5be7f8c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.086050 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3ed81-6148-448d-a7fb-3d33a5be7f8c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.086540 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3ed81-6148-448d-a7fb-3d33a5be7f8c None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.087648 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3ed81-6148-448d-a7fb-3d33a5be7f8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:10.088173 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3ed81-6148-448d-a7fb-3d33a5be7f8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.089919 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3ed81-6148-448d-a7fb-3d33a5be7f8c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.108290 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 354/700] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:10.108290 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3eb22-c579-47b3-bb07-e1af7c5de335 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.108548 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3eb22-c579-47b3-bb07-e1af7c5de335 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.109010 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3eb22-c579-47b3-bb07-e1af7c5de335 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.110162 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 355/701] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:10.111406 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3eb22-c579-47b3-bb07-e1af7c5de335 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.166009 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.192521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecc014-85df-4bce-8cd6-ab3d60c7ef54 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.225221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3eb22-c579-47b3-bb07-e1af7c5de335 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.230615 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf14896-2996-4808-bb49-4308d298700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.231441 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf14896-2996-4808-bb49-4308d298700a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.231721 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf14896-2996-4808-bb49-4308d298700a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.232009 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf14896-2996-4808-bb49-4308d298700a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.244420 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf14896-2996-4808-bb49-4308d298700a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.245930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf14896-2996-4808-bb49-4308d298700a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.263080 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd7c81-5d2f-4a41-afc0-df4f6f3535a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.264882 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd7c81-5d2f-4a41-afc0-df4f6f3535a5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.264882 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd7c81-5d2f-4a41-afc0-df4f6f3535a5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.264882 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd7c81-5d2f-4a41-afc0-df4f6f3535a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-2cf14896-2996-4808-bb49-4308d298700a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:10.266426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:10.267457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:10.269952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:10.269952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:10.269952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:10.269952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:10.269952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 347/702] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:10.269952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf14896-2996-4808-bb49-4308d298700a None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.283347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd7c81-5d2f-4a41-afc0-df4f6f3535a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.284861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd7c81-5d2f-4a41-afc0-df4f6f3535a5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-99cd7c81-5d2f-4a41-afc0-df4f6f3535a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:10.310990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:10.318268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:10.319467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:10.319467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:10.319467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:10.319467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:10.319467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 356/703] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:10.319467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad8f2-b2fd-43a5-83bc-db00ce9fcb8f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.319467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad8f2-b2fd-43a5-83bc-db00ce9fcb8f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.319467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad8f2-b2fd-43a5-83bc-db00ce9fcb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.336197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-4a5ad8f2-b2fd-43a5-83bc-db00ce9fcb8f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:10.337635 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-4a5ad8f2-b2fd-43a5-83bc-db00ce9fcb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:10.371758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.396650 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf14896-2996-4808-bb49-4308d298700a None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.414834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 357/704] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:10.415597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ad8f2-b2fd-43a5-83bc-db00ce9fcb8f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.432823 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.439749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf136179-ee01-410e-b68c-ae8c92993909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.441106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136179-ee01-410e-b68c-ae8c92993909 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.441449 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136179-ee01-410e-b68c-ae8c92993909 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.441950 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136179-ee01-410e-b68c-ae8c92993909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.442697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf136179-ee01-410e-b68c-ae8c92993909 None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=da8976d2646745feadde336d6164e1da) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:10.442934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf136179-ee01-410e-b68c-ae8c92993909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.444380 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf136179-ee01-410e-b68c-ae8c92993909 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.450746 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 348/705] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/role_assignments?user.id=da8976d2646745feadde336d6164e1da&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:10.451657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf136179-ee01-410e-b68c-ae8c92993909 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.573364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf136179-ee01-410e-b68c-ae8c92993909 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.588898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ad8f2-b2fd-43a5-83bc-db00ce9fcb8f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.614594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713da4d1-0aa8-4b61-8419-d4ff74f9d409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.615429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713da4d1-0aa8-4b61-8419-d4ff74f9d409 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.615788 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713da4d1-0aa8-4b61-8419-d4ff74f9d409 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.616145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713da4d1-0aa8-4b61-8419-d4ff74f9d409 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.616965 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713da4d1-0aa8-4b61-8419-d4ff74f9d409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:10.617347 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713da4d1-0aa8-4b61-8419-d4ff74f9d409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.618850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713da4d1-0aa8-4b61-8419-d4ff74f9d409 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.637519 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 349/706] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:10.639067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713da4d1-0aa8-4b61-8419-d4ff74f9d409 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.640951 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9deb69-ec3f-41e7-a95a-352f5a234b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.642932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9deb69-ec3f-41e7-a95a-352f5a234b9f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.644502 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9deb69-ec3f-41e7-a95a-352f5a234b9f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.645007 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9deb69-ec3f-41e7-a95a-352f5a234b9f None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.645955 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9deb69-ec3f-41e7-a95a-352f5a234b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:10.646472 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9deb69-ec3f-41e7-a95a-352f5a234b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.647918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9deb69-ec3f-41e7-a95a-352f5a234b9f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.664265 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 358/707] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:10.665114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9deb69-ec3f-41e7-a95a-352f5a234b9f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.697403 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.716517 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.781795 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713da4d1-0aa8-4b61-8419-d4ff74f9d409 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.801708 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9deb69-ec3f-41e7-a95a-352f5a234b9f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.839528 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164d18-686e-439b-aeb1-eee587484728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.839860 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3e52e-f614-405a-a907-1991f15e9f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.840521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3e52e-f614-405a-a907-1991f15e9f6c None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.840806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3e52e-f614-405a-a907-1991f15e9f6c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.841083 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3e52e-f614-405a-a907-1991f15e9f6c None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.841807 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3e52e-f614-405a-a907-1991f15e9f6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.842225 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164d18-686e-439b-aeb1-eee587484728 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.842752 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164d18-686e-439b-aeb1-eee587484728 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.843255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164d18-686e-439b-aeb1-eee587484728 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.843375 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3e52e-f614-405a-a907-1991f15e9f6c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.844248 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04164d18-686e-439b-aeb1-eee587484728 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.846124 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04164d18-686e-439b-aeb1-eee587484728 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-04164d18-686e-439b-aeb1-eee587484728 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:10.864599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:10.871324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:10.872261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 350/708] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:10.873204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164d18-686e-439b-aeb1-eee587484728 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.937625 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 359/709] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:25:10 2022] POST /identity/v3/users => generated 254 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:10.937625 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3e52e-f614-405a-a907-1991f15e9f6c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.990555 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164d18-686e-439b-aeb1-eee587484728 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.013844 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:11.036767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0d1c6-8533-46c2-a13a-29bcf459b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.037597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d1c6-8533-46c2-a13a-29bcf459b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.037883 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d1c6-8533-46c2-a13a-29bcf459b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.038164 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d1c6-8533-46c2-a13a-29bcf459b4e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.047207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0d1c6-8533-46c2-a13a-29bcf459b4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.048794 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0d1c6-8533-46c2-a13a-29bcf459b4e2 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.062931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-8eb0d1c6-8533-46c2-a13a-29bcf459b4e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:11.065579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:11.066856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:11.068051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:11.068051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:11.068051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:11.068051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:11.068051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:11.068051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:11.068051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:11.068051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:11.068051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 351/710] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:11.068641 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4fed3-45f1-405a-95ad-ad8917bbc17c None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.068939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4fed3-45f1-405a-95ad-ad8917bbc17c None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.069219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4fed3-45f1-405a-95ad-ad8917bbc17c None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.074878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 352/711] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:11.076228 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4fed3-45f1-405a-95ad-ad8917bbc17c None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:11.088293 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3e52e-f614-405a-a907-1991f15e9f6c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.141896 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452525c0-694a-4099-bf24-f63f44e7f13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.142937 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452525c0-694a-4099-bf24-f63f44e7f13b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.143918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452525c0-694a-4099-bf24-f63f44e7f13b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.144393 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452525c0-694a-4099-bf24-f63f44e7f13b None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.145590 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452525c0-694a-4099-bf24-f63f44e7f13b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:11.146189 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452525c0-694a-4099-bf24-f63f44e7f13b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.148418 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452525c0-694a-4099-bf24-f63f44e7f13b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.157139 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 360/712] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:11.158556 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad7005-5659-4987-87fa-aaa413905a76 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.158851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad7005-5659-4987-87fa-aaa413905a76 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.159105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad7005-5659-4987-87fa-aaa413905a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.186894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-7bad7005-5659-4987-87fa-aaa413905a76 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:11.188484 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-7bad7005-5659-4987-87fa-aaa413905a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:11.213297 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4fed3-45f1-405a-95ad-ad8917bbc17c None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.259700 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1000e-217e-4339-b025-f6c0b9170cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.260800 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1000e-217e-4339-b025-f6c0b9170cb2 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.261328 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1000e-217e-4339-b025-f6c0b9170cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.261618 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1000e-217e-4339-b025-f6c0b9170cb2 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.262437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1000e-217e-4339-b025-f6c0b9170cb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:11.262806 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1000e-217e-4339-b025-f6c0b9170cb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.264266 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1000e-217e-4339-b025-f6c0b9170cb2 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.270255 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 361/713] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:11.272021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad7005-5659-4987-87fa-aaa413905a76 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:11.278977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 353/714] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:11.291521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1000e-217e-4339-b025-f6c0b9170cb2 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:11.347334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:11.367694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:11.396036 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad7005-5659-4987-87fa-aaa413905a76 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.420288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1000e-217e-4339-b025-f6c0b9170cb2 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.437191 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c91444-b565-4976-9a7b-f1c515b41899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.438050 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c91444-b565-4976-9a7b-f1c515b41899 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.438376 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c91444-b565-4976-9a7b-f1c515b41899 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.438750 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c91444-b565-4976-9a7b-f1c515b41899 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.439545 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c91444-b565-4976-9a7b-f1c515b41899 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:11.439925 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c91444-b565-4976-9a7b-f1c515b41899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.441476 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c91444-b565-4976-9a7b-f1c515b41899 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.448607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 362/715] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:25:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:11.452677 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c91444-b565-4976-9a7b-f1c515b41899 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:11.493453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5cb0-172b-4966-bdfb-ee484096ac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.494213 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5cb0-172b-4966-bdfb-ee484096ac13 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.494506 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5cb0-172b-4966-bdfb-ee484096ac13 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.494816 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5cb0-172b-4966-bdfb-ee484096ac13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.495694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c5cb0-172b-4966-bdfb-ee484096ac13 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=382eda270f1545718847c9687bd62846) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:11.496013 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c5cb0-172b-4966-bdfb-ee484096ac13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.497509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c5cb0-172b-4966-bdfb-ee484096ac13 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.510830 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 354/716] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:11 2022] GET /identity/v3/role_assignments?user.id=382eda270f1545718847c9687bd62846&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:11.624228 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c91444-b565-4976-9a7b-f1c515b41899 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.664654 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1be76-8eb3-4d62-a9f4-9fcc6e7611cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.665390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1be76-8eb3-4d62-a9f4-9fcc6e7611cb None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.665671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1be76-8eb3-4d62-a9f4-9fcc6e7611cb None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.665947 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1be76-8eb3-4d62-a9f4-9fcc6e7611cb None admin] PATH_INFO: `/v3/services/network` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.666660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1be76-8eb3-4d62-a9f4-9fcc6e7611cb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.668066 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1be76-8eb3-4d62-a9f4-9fcc6e7611cb None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-96d1be76-8eb3-4d62-a9f4-9fcc6e7611cb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:11.683796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:11.684949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:11.685880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 363/717] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:11 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:11.691607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5cb0-172b-4966-bdfb-ee484096ac13 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:11.847678 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5cb0-172b-4966-bdfb-ee484096ac13 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.850926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:11.892142 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dbcb9-449d-473c-967f-19e4ea7f9bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.892853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dbcb9-449d-473c-967f-19e4ea7f9bd2 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.893139 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dbcb9-449d-473c-967f-19e4ea7f9bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.893948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dbcb9-449d-473c-967f-19e4ea7f9bd2 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.894698 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dbcb9-449d-473c-967f-19e4ea7f9bd2 None admin] RBAC: Adding query filter params (name=network) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:11.895016 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dbcb9-449d-473c-967f-19e4ea7f9bd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.896402 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dbcb9-449d-473c-967f-19e4ea7f9bd2 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.905928 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 355/718] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:11.915875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1be76-8eb3-4d62-a9f4-9fcc6e7611cb None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:11.925715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:12.065911 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1be76-8eb3-4d62-a9f4-9fcc6e7611cb None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:12.102026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9393dc-f61e-49cc-8def-724e0bd31c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:12.102735 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9393dc-f61e-49cc-8def-724e0bd31c05 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.103021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9393dc-f61e-49cc-8def-724e0bd31c05 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.103303 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9393dc-f61e-49cc-8def-724e0bd31c05 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.104017 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9393dc-f61e-49cc-8def-724e0bd31c05 None admin] RBAC: Adding query filter params (type=network) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:12.104323 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9393dc-f61e-49cc-8def-724e0bd31c05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:12.105712 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9393dc-f61e-49cc-8def-724e0bd31c05 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:12.111142 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 364/719] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:13.332027 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676338-0454-406e-9d17-4a970f9d63cf None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:13.333085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676338-0454-406e-9d17-4a970f9d63cf None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:13.333591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676338-0454-406e-9d17-4a970f9d63cf None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:13.335456 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 356/720] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:13.352573 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf615c-57b5-4324-863e-ad80bb7f0d30 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:13.353083 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf615c-57b5-4324-863e-ad80bb7f0d30 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:13.353167 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf615c-57b5-4324-863e-ad80bb7f0d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:13.373453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-90cf615c-57b5-4324-863e-ad80bb7f0d30 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:13.374725 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-90cf615c-57b5-4324-863e-ad80bb7f0d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:13.442910 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:13.447697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 365/721] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:13.482857 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d676338-0454-406e-9d17-4a970f9d63cf None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:13.592277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d676338-0454-406e-9d17-4a970f9d63cf None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:13.628503 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4ba77-384e-4b20-91de-5d864a5d3744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:13.629317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4ba77-384e-4b20-91de-5d864a5d3744 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:13.629663 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4ba77-384e-4b20-91de-5d864a5d3744 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:13.629941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4ba77-384e-4b20-91de-5d864a5d3744 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:13.640847 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4ba77-384e-4b20-91de-5d864a5d3744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-10e4ba77-384e-4b20-91de-5d864a5d3744 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:13.648877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:13.650006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:13.650962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 357/722] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:13.656831 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf615c-57b5-4324-863e-ad80bb7f0d30 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:13.765294 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf615c-57b5-4324-863e-ad80bb7f0d30 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:13.806854 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bfa20-637a-46c9-ae18-bc2bd5bc16da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:13.807543 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bfa20-637a-46c9-ae18-bc2bd5bc16da None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:13.807825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bfa20-637a-46c9-ae18-bc2bd5bc16da None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:13.808106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bfa20-637a-46c9-ae18-bc2bd5bc16da None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:13.808869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bfa20-637a-46c9-ae18-bc2bd5bc16da None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:13.809173 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bfa20-637a-46c9-ae18-bc2bd5bc16da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:13.810555 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bfa20-637a-46c9-ae18-bc2bd5bc16da None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:13.820207 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 366/723] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:13.827940 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4ba77-384e-4b20-91de-5d864a5d3744 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:13.869618 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:13.894052 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167c53f-7eb7-425d-8cef-85f595b337a7 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:13.894751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167c53f-7eb7-425d-8cef-85f595b337a7 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:13.895270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167c53f-7eb7-425d-8cef-85f595b337a7 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:13.897106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 367/724] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:13.903240 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0da8cd-c557-4346-8f47-bf0e1e82cccb None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:13.904046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0da8cd-c557-4346-8f47-bf0e1e82cccb None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:13.904532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0da8cd-c557-4346-8f47-bf0e1e82cccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:13.923374 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-ae0da8cd-c557-4346-8f47-bf0e1e82cccb None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:13.925493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-ae0da8cd-c557-4346-8f47-bf0e1e82cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:14.017252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4ba77-384e-4b20-91de-5d864a5d3744 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:14.038429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:14.056950 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 368/725] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:14.082865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648fd9-367b-44c8-a76e-7278bf8a220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:14.083697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648fd9-367b-44c8-a76e-7278bf8a220c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.083984 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648fd9-367b-44c8-a76e-7278bf8a220c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.084266 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648fd9-367b-44c8-a76e-7278bf8a220c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.087798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0da8cd-c557-4346-8f47-bf0e1e82cccb None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:14.103477 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7648fd9-367b-44c8-a76e-7278bf8a220c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:14.104963 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7648fd9-367b-44c8-a76e-7278bf8a220c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-d7648fd9-367b-44c8-a76e-7278bf8a220c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:14.140611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:14.141609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:14.142591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:14.142591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:14.142591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:14.142591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:14.142591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 358/726] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:14.148127 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648fd9-367b-44c8-a76e-7278bf8a220c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:14.215538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0da8cd-c557-4346-8f47-bf0e1e82cccb None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:14.287870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53d3d-c8bd-461e-a3bc-9ea29e1101ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:14.289068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53d3d-c8bd-461e-a3bc-9ea29e1101ce None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.289671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53d3d-c8bd-461e-a3bc-9ea29e1101ce None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.290979 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53d3d-c8bd-461e-a3bc-9ea29e1101ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.308117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f53d3d-c8bd-461e-a3bc-9ea29e1101ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-65f53d3d-c8bd-461e-a3bc-9ea29e1101ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:14.317549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:14.318695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:14.319596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:14.322775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 369/727] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:25:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:14.329180 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53d3d-c8bd-461e-a3bc-9ea29e1101ce None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:14.373408 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:14.400057 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648fd9-367b-44c8-a76e-7278bf8a220c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:14.442925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d89cb-d2e7-474e-989d-19f4cb23dd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:14.443609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d89cb-d2e7-474e-989d-19f4cb23dd54 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.443892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d89cb-d2e7-474e-989d-19f4cb23dd54 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.444169 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d89cb-d2e7-474e-989d-19f4cb23dd54 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.444904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d89cb-d2e7-474e-989d-19f4cb23dd54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:14.445210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d89cb-d2e7-474e-989d-19f4cb23dd54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:14.446574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d89cb-d2e7-474e-989d-19f4cb23dd54 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:14.466708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 359/728] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:14.466708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069309-4bd2-418c-9d63-d1fbb942a33d None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.466708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069309-4bd2-418c-9d63-d1fbb942a33d None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.466708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069309-4bd2-418c-9d63-d1fbb942a33d None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.466708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 360/729] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:14.466708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c069309-4bd2-418c-9d63-d1fbb942a33d None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:14.521280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:14.572177 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53d3d-c8bd-461e-a3bc-9ea29e1101ce None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:14.606101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c069309-4bd2-418c-9d63-d1fbb942a33d None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:14.607060 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5af15f-9e17-409e-ac9c-fe292617de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:14.607731 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5af15f-9e17-409e-ac9c-fe292617de64 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.608012 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5af15f-9e17-409e-ac9c-fe292617de64 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.608343 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5af15f-9e17-409e-ac9c-fe292617de64 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.609045 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5af15f-9e17-409e-ac9c-fe292617de64 None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:14.609351 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5af15f-9e17-409e-ac9c-fe292617de64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:14.610748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5af15f-9e17-409e-ac9c-fe292617de64 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:14.623495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 370/730] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:25:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:14.623495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbad83-ea8a-4f21-9e02-f22e0b340d57 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.623495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbad83-ea8a-4f21-9e02-f22e0b340d57 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.623495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbad83-ea8a-4f21-9e02-f22e0b340d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.639915 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-dfbbad83-ea8a-4f21-9e02-f22e0b340d57 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:14.641108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-dfbbad83-ea8a-4f21-9e02-f22e0b340d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:14.650868 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c1636-8bea-49b0-a733-c2ce300503ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:14.651609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c1636-8bea-49b0-a733-c2ce300503ff None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.651898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c1636-8bea-49b0-a733-c2ce300503ff None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.652175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c1636-8bea-49b0-a733-c2ce300503ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.663569 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c1636-8bea-49b0-a733-c2ce300503ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:14.665055 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c1636-8bea-49b0-a733-c2ce300503ff None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:14.667434 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-6d1c1636-8bea-49b0-a733-c2ce300503ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:14.682525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:14.683877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:14.684910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:14.684910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:14.684910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:14.684910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:14.684910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:14.684910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:14.684910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:14.684910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:14.684910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:14.684910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:14.688753 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 361/731] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:14.690800 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23623d2-ff6a-4ad6-b7ba-a3acd3550a75 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.691098 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23623d2-ff6a-4ad6-b7ba-a3acd3550a75 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.691379 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23623d2-ff6a-4ad6-b7ba-a3acd3550a75 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.697678 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 362/732] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:14.697678 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23623d2-ff6a-4ad6-b7ba-a3acd3550a75 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:14.727739 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 371/733] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:14.728435 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbad83-ea8a-4f21-9e02-f22e0b340d57 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:14.783666 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:14.825817 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23623d2-ff6a-4ad6-b7ba-a3acd3550a75 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:14.849915 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbad83-ea8a-4f21-9e02-f22e0b340d57 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:14.862457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6f2b9-9825-4639-bcd8-034279d27c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:14.863427 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f2b9-9825-4639-bcd8-034279d27c7e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.863717 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f2b9-9825-4639-bcd8-034279d27c7e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.863997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f2b9-9825-4639-bcd8-034279d27c7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.874935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6f2b9-9825-4639-bcd8-034279d27c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:14.876376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6f2b9-9825-4639-bcd8-034279d27c7e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:14.886874 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15568ee2-b999-47d3-9b6e-b306d9b59dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:14.887555 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15568ee2-b999-47d3-9b6e-b306d9b59dad None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.887838 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15568ee2-b999-47d3-9b6e-b306d9b59dad None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.888108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15568ee2-b999-47d3-9b6e-b306d9b59dad None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.889010 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15568ee2-b999-47d3-9b6e-b306d9b59dad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:14.889371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15568ee2-b999-47d3-9b6e-b306d9b59dad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:14.892558 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15568ee2-b999-47d3-9b6e-b306d9b59dad None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-35f6f2b9-9825-4639-bcd8-034279d27c7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:14.894670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:14.895745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:14.897284 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:14.897284 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:14.897284 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:14.897284 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:14.897284 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 363/734] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:14.897585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ac243-b252-4d96-9c6c-ddb63c042980 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.897787 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ac243-b252-4d96-9c6c-ddb63c042980 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.898099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ac243-b252-4d96-9c6c-ddb63c042980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.917394 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 372/735] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:25:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:14.917394 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15568ee2-b999-47d3-9b6e-b306d9b59dad None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:14.917676 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-9e6ac243-b252-4d96-9c6c-ddb63c042980 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:14.917676 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-9e6ac243-b252-4d96-9c6c-ddb63c042980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:14.963992 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:14.984456 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 364/736] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:14.985889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03216c-44bc-486d-9d33-51af44c33209 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:14.992248 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03216c-44bc-486d-9d33-51af44c33209 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:14.992248 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03216c-44bc-486d-9d33-51af44c33209 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:14.992248 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 365/737] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:14.992248 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03216c-44bc-486d-9d33-51af44c33209 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:15.025850 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15568ee2-b999-47d3-9b6e-b306d9b59dad None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:15.027444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:15.061194 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37557b-1fbc-4224-a3e5-5d5e31b28d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:15.061994 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37557b-1fbc-4224-a3e5-5d5e31b28d2b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:15.062278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37557b-1fbc-4224-a3e5-5d5e31b28d2b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:15.062555 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37557b-1fbc-4224-a3e5-5d5e31b28d2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:15.073408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37557b-1fbc-4224-a3e5-5d5e31b28d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-dd37557b-1fbc-4224-a3e5-5d5e31b28d2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:15.081685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:15.082804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 373/738] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:15.083734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37557b-1fbc-4224-a3e5-5d5e31b28d2b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:15.098261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03216c-44bc-486d-9d33-51af44c33209 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:15.133471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31594ea-fd6c-4876-948e-f4f7903d778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:15.134149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31594ea-fd6c-4876-948e-f4f7903d778e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:15.134429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31594ea-fd6c-4876-948e-f4f7903d778e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:15.134736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31594ea-fd6c-4876-948e-f4f7903d778e None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:15.135466 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31594ea-fd6c-4876-948e-f4f7903d778e None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:15.135777 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31594ea-fd6c-4876-948e-f4f7903d778e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:15.137153 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31594ea-fd6c-4876-948e-f4f7903d778e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:15.153589 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 366/739] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:15.153589 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c34fd-c81b-4969-907c-d7f2ac43f6be None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:15.153589 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c34fd-c81b-4969-907c-d7f2ac43f6be None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:15.153589 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c34fd-c81b-4969-907c-d7f2ac43f6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:15.168917 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-b88c34fd-c81b-4969-907c-d7f2ac43f6be None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:15.170049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-b88c34fd-c81b-4969-907c-d7f2ac43f6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:15.186545 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37557b-1fbc-4224-a3e5-5d5e31b28d2b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:15.205384 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:15.221684 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37d4de-c6f9-49f9-94cc-4256d094ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:15.222341 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37d4de-c6f9-49f9-94cc-4256d094ba4d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:15.222659 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37d4de-c6f9-49f9-94cc-4256d094ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:15.222940 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37d4de-c6f9-49f9-94cc-4256d094ba4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:15.239117 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 367/740] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:15.239977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c34fd-c81b-4969-907c-d7f2ac43f6be None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:15.264824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:15.303267 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37d4de-c6f9-49f9-94cc-4256d094ba4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:15.304745 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37d4de-c6f9-49f9-94cc-4256d094ba4d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:15.343509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c34fd-c81b-4969-907c-d7f2ac43f6be None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:15.377166 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811ee16-f43d-4f11-8353-825860dfe2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:15.378363 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ee16-f43d-4f11-8353-825860dfe2e5 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:15.378680 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ee16-f43d-4f11-8353-825860dfe2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:15.378964 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ee16-f43d-4f11-8353-825860dfe2e5 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:15.379695 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811ee16-f43d-4f11-8353-825860dfe2e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:15.381074 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811ee16-f43d-4f11-8353-825860dfe2e5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:15.405131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 374/741] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:15.406014 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37d4de-c6f9-49f9-94cc-4256d094ba4d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:15.465591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 368/742] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:25:15 2022] POST /identity/v3/services => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:15.466095 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:15.466594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811ee16-f43d-4f11-8353-825860dfe2e5 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:15.515666 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:15.516094 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37d4de-c6f9-49f9-94cc-4256d094ba4d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:15.566364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d39968-8050-4ca2-8b04-7bd8ff01b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:15.567327 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39968-8050-4ca2-8b04-7bd8ff01b38d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:15.567544 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39968-8050-4ca2-8b04-7bd8ff01b38d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:15.567890 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39968-8050-4ca2-8b04-7bd8ff01b38d None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:15.568753 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d39968-8050-4ca2-8b04-7bd8ff01b38d None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:15.569139 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d39968-8050-4ca2-8b04-7bd8ff01b38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:15.570744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d39968-8050-4ca2-8b04-7bd8ff01b38d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:15.581332 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 375/743] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:15.582455 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d39968-8050-4ca2-8b04-7bd8ff01b38d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:15.604870 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811ee16-f43d-4f11-8353-825860dfe2e5 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:15.645874 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468823-5e92-4dea-a9bb-c7bb0f10c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:15.647227 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468823-5e92-4dea-a9bb-c7bb0f10c7ef None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:15.647697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468823-5e92-4dea-a9bb-c7bb0f10c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:15.647977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468823-5e92-4dea-a9bb-c7bb0f10c7ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:15.656435 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468823-5e92-4dea-a9bb-c7bb0f10c7ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:15.657875 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468823-5e92-4dea-a9bb-c7bb0f10c7ef None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-cf468823-5e92-4dea-a9bb-c7bb0f10c7ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:15.675890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:15.677400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 369/744] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:25:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:15.678541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468823-5e92-4dea-a9bb-c7bb0f10c7ef None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:15.694557 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d39968-8050-4ca2-8b04-7bd8ff01b38d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:15.716597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:15.734340 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7ead-cef8-43e4-b8e0-56cdb43af350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:15.735138 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7ead-cef8-43e4-b8e0-56cdb43af350 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:15.735436 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7ead-cef8-43e4-b8e0-56cdb43af350 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:15.735720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7ead-cef8-43e4-b8e0-56cdb43af350 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:15.736467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd7ead-cef8-43e4-b8e0-56cdb43af350 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:15.738394 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd7ead-cef8-43e4-b8e0-56cdb43af350 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:15.780400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:15.790743 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468823-5e92-4dea-a9bb-c7bb0f10c7ef None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:15.809799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 376/745] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:25:15 2022] POST /identity/v3/services => generated 240 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:15.813433 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7ead-cef8-43e4-b8e0-56cdb43af350 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:15.855068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030538d8-420b-4b88-b38e-a63dea44fcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:15.856214 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030538d8-420b-4b88-b38e-a63dea44fcb0 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:15.856659 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030538d8-420b-4b88-b38e-a63dea44fcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:15.857212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030538d8-420b-4b88-b38e-a63dea44fcb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:15.871121 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030538d8-420b-4b88-b38e-a63dea44fcb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:15.873064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030538d8-420b-4b88-b38e-a63dea44fcb0 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-030538d8-420b-4b88-b38e-a63dea44fcb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:15.895069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:15.896244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:15.897234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:15.897234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:15.897234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:15.897234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:15.899837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 370/746] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:15.901121 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030538d8-420b-4b88-b38e-a63dea44fcb0 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:15.961350 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7ead-cef8-43e4-b8e0-56cdb43af350 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.001720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff8ce5-386b-4105-a2c9-c66a37d8328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.003117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8ce5-386b-4105-a2c9-c66a37d8328d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.003475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8ce5-386b-4105-a2c9-c66a37d8328d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.003827 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8ce5-386b-4105-a2c9-c66a37d8328d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.017418 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff8ce5-386b-4105-a2c9-c66a37d8328d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.019747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff8ce5-386b-4105-a2c9-c66a37d8328d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.027545 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030538d8-420b-4b88-b38e-a63dea44fcb0 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-ccff8ce5-386b-4105-a2c9-c66a37d8328d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:16.040105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:16.041231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:16.042211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:16.042211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:16.042211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:16.042211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:16.046202 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 377/747] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:16.047051 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff8ce5-386b-4105-a2c9-c66a37d8328d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.069628 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3985b91-2650-42b3-a111-915cad9784f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.070797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3985b91-2650-42b3-a111-915cad9784f9 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.071088 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3985b91-2650-42b3-a111-915cad9784f9 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.071370 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3985b91-2650-42b3-a111-915cad9784f9 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.072247 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3985b91-2650-42b3-a111-915cad9784f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:16.072565 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3985b91-2650-42b3-a111-915cad9784f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.074012 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3985b91-2650-42b3-a111-915cad9784f9 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.085315 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.086831 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.095848 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 371/748] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:25:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:16.097003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3985b91-2650-42b3-a111-915cad9784f9 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.192352 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff8ce5-386b-4105-a2c9-c66a37d8328d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.227119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3985b91-2650-42b3-a111-915cad9784f9 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.230743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4413be-d57d-4714-9f12-6a7450f0c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.231388 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4413be-d57d-4714-9f12-6a7450f0c30c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.231675 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4413be-d57d-4714-9f12-6a7450f0c30c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.231957 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4413be-d57d-4714-9f12-6a7450f0c30c None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.232694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4413be-d57d-4714-9f12-6a7450f0c30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:16.233013 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4413be-d57d-4714-9f12-6a7450f0c30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.234407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4413be-d57d-4714-9f12-6a7450f0c30c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.256606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 378/749] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:16.256606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4413be-d57d-4714-9f12-6a7450f0c30c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.286930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23b358-135f-4743-a074-1a41ad3b6944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.287767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23b358-135f-4743-a074-1a41ad3b6944 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.288159 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23b358-135f-4743-a074-1a41ad3b6944 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.288784 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23b358-135f-4743-a074-1a41ad3b6944 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.290579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23b358-135f-4743-a074-1a41ad3b6944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:16.291031 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23b358-135f-4743-a074-1a41ad3b6944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.292971 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23b358-135f-4743-a074-1a41ad3b6944 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.314703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 372/750] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:16.316858 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23b358-135f-4743-a074-1a41ad3b6944 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.358779 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.369339 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4413be-d57d-4714-9f12-6a7450f0c30c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.405646 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.410555 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb7161-c95c-4f56-b889-32cef4aafc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.411902 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7161-c95c-4f56-b889-32cef4aafc23 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.412523 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7161-c95c-4f56-b889-32cef4aafc23 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.413071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7161-c95c-4f56-b889-32cef4aafc23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.459435 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23b358-135f-4743-a074-1a41ad3b6944 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.501166 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3eda-2a4f-48c5-96ba-53aab6dedd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.502130 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3eda-2a4f-48c5-96ba-53aab6dedd87 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.502415 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3eda-2a4f-48c5-96ba-53aab6dedd87 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.502798 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3eda-2a4f-48c5-96ba-53aab6dedd87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.511480 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f3eda-2a4f-48c5-96ba-53aab6dedd87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.511629 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb7161-c95c-4f56-b889-32cef4aafc23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.512849 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f3eda-2a4f-48c5-96ba-53aab6dedd87 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.513442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb7161-c95c-4f56-b889-32cef4aafc23 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-519f3eda-2a4f-48c5-96ba-53aab6dedd87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:16.531352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:16.532576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:16.533657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:16.533657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:16.533657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:16.533657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:16.533657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:16.533657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:16.533657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:16.533657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:16.538126 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 373/751] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:16.539023 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3eda-2a4f-48c5-96ba-53aab6dedd87 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.632800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.645805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 379/752] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:25:16.646720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb7161-c95c-4f56-b889-32cef4aafc23 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.662486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3eda-2a4f-48c5-96ba-53aab6dedd87 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.683558 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.705134 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc647ee-33f0-4bf1-916e-10fb10360207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.706904 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc647ee-33f0-4bf1-916e-10fb10360207 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.707432 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc647ee-33f0-4bf1-916e-10fb10360207 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.707948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc647ee-33f0-4bf1-916e-10fb10360207 None admin] PATH_INFO: `/v3/users/nova` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.716684 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc647ee-33f0-4bf1-916e-10fb10360207 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.719552 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc647ee-33f0-4bf1-916e-10fb10360207 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-dfc647ee-33f0-4bf1-916e-10fb10360207 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:16.738593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:16.739797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:16.740833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:16.740833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:16.740833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:16.740833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:16.740833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:16.740833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:16.740833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:16.740833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:16.740833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:16.740833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:16.748673 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 374/753] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:16.750042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc647ee-33f0-4bf1-916e-10fb10360207 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.758696 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb7161-c95c-4f56-b889-32cef4aafc23 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.798073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab71c00-ede0-46d3-8c1c-7015e9eed18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.798073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab71c00-ede0-46d3-8c1c-7015e9eed18e None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.798073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab71c00-ede0-46d3-8c1c-7015e9eed18e None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.798073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab71c00-ede0-46d3-8c1c-7015e9eed18e None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.798492 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab71c00-ede0-46d3-8c1c-7015e9eed18e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:16.798492 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab71c00-ede0-46d3-8c1c-7015e9eed18e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.800080 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab71c00-ede0-46d3-8c1c-7015e9eed18e None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.818891 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 380/754] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:16.819820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab71c00-ede0-46d3-8c1c-7015e9eed18e None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.878218 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.882539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc647ee-33f0-4bf1-916e-10fb10360207 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.921198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559457b-733c-4ebe-9dce-372d2edb4d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.923932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559457b-733c-4ebe-9dce-372d2edb4d24 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.923932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559457b-733c-4ebe-9dce-372d2edb4d24 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.923932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559457b-733c-4ebe-9dce-372d2edb4d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.927804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab71c00-ede0-46d3-8c1c-7015e9eed18e None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.937606 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559457b-733c-4ebe-9dce-372d2edb4d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.939707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559457b-733c-4ebe-9dce-372d2edb4d24 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-5559457b-733c-4ebe-9dce-372d2edb4d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:16.962334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:16.963620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:16.964641 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:16.964641 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:16.964641 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:16.964641 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:16.965647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13636af-04c9-4185-8fb8-256d9bad3dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.966325 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13636af-04c9-4185-8fb8-256d9bad3dc7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.966634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13636af-04c9-4185-8fb8-256d9bad3dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.966905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13636af-04c9-4185-8fb8-256d9bad3dc7 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.967749 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13636af-04c9-4185-8fb8-256d9bad3dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:16.968056 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13636af-04c9-4185-8fb8-256d9bad3dc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.968719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 375/755] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:16.969576 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13636af-04c9-4185-8fb8-256d9bad3dc7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.970064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559457b-733c-4ebe-9dce-372d2edb4d24 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.992844 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 381/756] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:16.993922 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13636af-04c9-4185-8fb8-256d9bad3dc7 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.004411 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.091914 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559457b-733c-4ebe-9dce-372d2edb4d24 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.103350 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13636af-04c9-4185-8fb8-256d9bad3dc7 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.114556 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.133236 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d30d81-5a8b-4197-a666-c889be513c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.134289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d30d81-5a8b-4197-a666-c889be513c07 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.134836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d30d81-5a8b-4197-a666-c889be513c07 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.135389 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d30d81-5a8b-4197-a666-c889be513c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.136772 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d30d81-5a8b-4197-a666-c889be513c07 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=da8976d2646745feadde336d6164e1da) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:17.137308 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d30d81-5a8b-4197-a666-c889be513c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.138855 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e7b89-2648-44a8-a8bc-4302cf8863aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.139526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7b89-2648-44a8-a8bc-4302cf8863aa None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.139758 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d30d81-5a8b-4197-a666-c889be513c07 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.139869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7b89-2648-44a8-a8bc-4302cf8863aa None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.140063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7b89-2648-44a8-a8bc-4302cf8863aa None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.140790 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e7b89-2648-44a8-a8bc-4302cf8863aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:17.141133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e7b89-2648-44a8-a8bc-4302cf8863aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.142515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e7b89-2648-44a8-a8bc-4302cf8863aa None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.148446 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 376/757] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/role_assignments?user.id=da8976d2646745feadde336d6164e1da&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:17.149737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d30d81-5a8b-4197-a666-c889be513c07 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.169185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 382/758] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:17.174742 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e7b89-2648-44a8-a8bc-4302cf8863aa None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.264566 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.276123 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d30d81-5a8b-4197-a666-c889be513c07 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.320480 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad26e4-163c-4b05-b7f2-633e084de6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.321683 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad26e4-163c-4b05-b7f2-633e084de6f4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.322330 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad26e4-163c-4b05-b7f2-633e084de6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.322924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad26e4-163c-4b05-b7f2-633e084de6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.336999 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad26e4-163c-4b05-b7f2-633e084de6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.338987 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad26e4-163c-4b05-b7f2-633e084de6f4 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-e8ad26e4-163c-4b05-b7f2-633e084de6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:17.359912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:17.360947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:17.361989 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:17.361989 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:17.361989 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:17.361989 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:17.364532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 377/759] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:17.370075 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e7b89-2648-44a8-a8bc-4302cf8863aa None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.370578 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad26e4-163c-4b05-b7f2-633e084de6f4 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.476852 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a333702-8fc4-4a0a-aef5-32a5892aacfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.477676 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333702-8fc4-4a0a-aef5-32a5892aacfc None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.477956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333702-8fc4-4a0a-aef5-32a5892aacfc None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.478230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333702-8fc4-4a0a-aef5-32a5892aacfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.493313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad26e4-163c-4b05-b7f2-633e084de6f4 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.495844 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a333702-8fc4-4a0a-aef5-32a5892aacfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.497579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a333702-8fc4-4a0a-aef5-32a5892aacfc None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-8a333702-8fc4-4a0a-aef5-32a5892aacfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:17.525617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:17.526781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:17.527751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:17.527751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:17.527751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:17.527751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:17.527751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:17.527751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:17.527751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:17.527751 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:17.536646 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 383/760] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:17.541969 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a333702-8fc4-4a0a-aef5-32a5892aacfc None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.567022 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5274d58-310f-44d2-a45d-ecbe265ecfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.568134 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5274d58-310f-44d2-a45d-ecbe265ecfc6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.568635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5274d58-310f-44d2-a45d-ecbe265ecfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.569323 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5274d58-310f-44d2-a45d-ecbe265ecfc6 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.571001 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5274d58-310f-44d2-a45d-ecbe265ecfc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:17.571798 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5274d58-310f-44d2-a45d-ecbe265ecfc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.576199 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5274d58-310f-44d2-a45d-ecbe265ecfc6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.597482 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.600557 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 378/761] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:17.606746 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5274d58-310f-44d2-a45d-ecbe265ecfc6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.616448 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.754742 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5274d58-310f-44d2-a45d-ecbe265ecfc6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.784974 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a333702-8fc4-4a0a-aef5-32a5892aacfc None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.802060 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012deea-97b5-49e6-a8e1-5787e153dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.803176 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012deea-97b5-49e6-a8e1-5787e153dc26 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.803661 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012deea-97b5-49e6-a8e1-5787e153dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.804206 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012deea-97b5-49e6-a8e1-5787e153dc26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.812249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012deea-97b5-49e6-a8e1-5787e153dc26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.813977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012deea-97b5-49e6-a8e1-5787e153dc26 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-5012deea-97b5-49e6-a8e1-5787e153dc26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:17.842934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:17.843981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:17.844966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:17.844966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:17.844966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:17.844966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:17.844966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:17.844966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:17.844966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:17.844966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:17.849640 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 379/762] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:17.851505 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f8822-d62a-41d6-955c-169cf27a06a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.852983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012deea-97b5-49e6-a8e1-5787e153dc26 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.856046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8822-d62a-41d6-955c-169cf27a06a7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.856583 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8822-d62a-41d6-955c-169cf27a06a7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.857064 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8822-d62a-41d6-955c-169cf27a06a7 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.858931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f8822-d62a-41d6-955c-169cf27a06a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:17.860686 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f8822-d62a-41d6-955c-169cf27a06a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.866429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f8822-d62a-41d6-955c-169cf27a06a7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.889257 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 384/763] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:17.890703 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dbf6d-d414-43b3-8e4c-bf0560050bb2 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.891071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dbf6d-d414-43b3-8e4c-bf0560050bb2 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.891465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dbf6d-d414-43b3-8e4c-bf0560050bb2 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.893288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 385/764] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:17.896381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dbf6d-d414-43b3-8e4c-bf0560050bb2 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.943486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.987551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012deea-97b5-49e6-a8e1-5787e153dc26 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:18.025983 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:18.032926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecda26-7aca-4a9c-ab7f-09d6215a93af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:18.034959 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecda26-7aca-4a9c-ab7f-09d6215a93af None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:18.035550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecda26-7aca-4a9c-ab7f-09d6215a93af None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:18.036001 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecda26-7aca-4a9c-ab7f-09d6215a93af None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:18.037192 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecda26-7aca-4a9c-ab7f-09d6215a93af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:18.038425 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecda26-7aca-4a9c-ab7f-09d6215a93af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:18.038528 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dbf6d-d414-43b3-8e4c-bf0560050bb2 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:18.039742 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecda26-7aca-4a9c-ab7f-09d6215a93af None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:18.063700 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 380/765] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:18.064521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491db6-00ba-4797-a9e9-cc02d89615a1 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:18.064739 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491db6-00ba-4797-a9e9-cc02d89615a1 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:18.065016 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491db6-00ba-4797-a9e9-cc02d89615a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:18.088503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd9f4b-593a-422c-8134-930985fa72be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:18.089179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd9f4b-593a-422c-8134-930985fa72be None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:18.089470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd9f4b-593a-422c-8134-930985fa72be None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:18.089747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd9f4b-593a-422c-8134-930985fa72be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:18.090696 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd9f4b-593a-422c-8134-930985fa72be None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=9fdd44a5966c4276b572250fd4147fc9) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:18.091018 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd9f4b-593a-422c-8134-930985fa72be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:18.092544 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd9f4b-593a-422c-8134-930985fa72be None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:18.093496 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-84491db6-00ba-4797-a9e9-cc02d89615a1 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:18.095277 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-84491db6-00ba-4797-a9e9-cc02d89615a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:18.105589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 386/766] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:17 2022] GET /identity/v3/role_assignments?user.id=9fdd44a5966c4276b572250fd4147fc9&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:18.105589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd9f4b-593a-422c-8134-930985fa72be None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:18.249061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 381/767] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:18.257352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b6288-33c0-45f6-9405-0d56efef7558 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:18.262930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b6288-33c0-45f6-9405-0d56efef7558 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:18.262930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b6288-33c0-45f6-9405-0d56efef7558 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:18.262930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 382/768] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:18.267156 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd7366-0be1-4c76-ac44-377cbee8fd9d None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:18.267696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd7366-0be1-4c76-ac44-377cbee8fd9d None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:18.268221 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd7366-0be1-4c76-ac44-377cbee8fd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:18.303501 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-89dd7366-0be1-4c76-ac44-377cbee8fd9d None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:18.304717 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-89dd7366-0be1-4c76-ac44-377cbee8fd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:18.305837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd9f4b-593a-422c-8134-930985fa72be None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:18.350479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447abaa-5308-4e48-a4cd-034a54aeddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:18.351522 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447abaa-5308-4e48-a4cd-034a54aeddf2 None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:18.351814 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447abaa-5308-4e48-a4cd-034a54aeddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:18.352153 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447abaa-5308-4e48-a4cd-034a54aeddf2 None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/382eda270f1545718847c9687bd62846/roles/59689ee7c4f5409692318371dac5cbc7` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:18.355066 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447abaa-5308-4e48-a4cd-034a54aeddf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=382eda270f1545718847c9687bd62846, role_id=59689ee7c4f5409692318371dac5cbc7)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:18.356520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447abaa-5308-4e48-a4cd-034a54aeddf2 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:18.363253 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:18.381326 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 383/769] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:18.382261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd7366-0be1-4c76-ac44-377cbee8fd9d None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:18.431211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 387/770] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:25:18 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/382eda270f1545718847c9687bd62846/roles/59689ee7c4f5409692318371dac5cbc7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:18.432257 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447abaa-5308-4e48-a4cd-034a54aeddf2 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:18.454343 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:18.520496 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd7366-0be1-4c76-ac44-377cbee8fd9d None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:18.571946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447abaa-5308-4e48-a4cd-034a54aeddf2 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:18.615464 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f69ea-c124-4348-ae4b-96f97992816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:18.616388 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f69ea-c124-4348-ae4b-96f97992816e None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:18.616685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f69ea-c124-4348-ae4b-96f97992816e None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:18.616969 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f69ea-c124-4348-ae4b-96f97992816e None admin] PATH_INFO: `/v3/services/network` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:18.617761 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f69ea-c124-4348-ae4b-96f97992816e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:18.619353 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f69ea-c124-4348-ae4b-96f97992816e None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:18.627443 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a300a4c-8a0d-479d-a2e9-5a8310a716a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:18.628718 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300a4c-8a0d-479d-a2e9-5a8310a716a6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:18.629235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300a4c-8a0d-479d-a2e9-5a8310a716a6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:18.629727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300a4c-8a0d-479d-a2e9-5a8310a716a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:18.630665 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a300a4c-8a0d-479d-a2e9-5a8310a716a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:18.632308 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a300a4c-8a0d-479d-a2e9-5a8310a716a6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-121f69ea-c124-4348-ae4b-96f97992816e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:18.632738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:18.633777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:18.635155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 388/771] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:18 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:18.640496 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f69ea-c124-4348-ae4b-96f97992816e None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-7a300a4c-8a0d-479d-a2e9-5a8310a716a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:18.655576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:18.656765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:18.657685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:18.661416 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 384/772] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 20:25:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:18.667293 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a300a4c-8a0d-479d-a2e9-5a8310a716a6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:18.739320 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:18.743026 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:18.782149 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f69ea-c124-4348-ae4b-96f97992816e None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:18.833584 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a300a4c-8a0d-479d-a2e9-5a8310a716a6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:18.859107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8105fe0-d004-42d3-9f4f-50dfc058c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:18.859781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8105fe0-d004-42d3-9f4f-50dfc058c43a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:18.860067 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8105fe0-d004-42d3-9f4f-50dfc058c43a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:18.860346 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8105fe0-d004-42d3-9f4f-50dfc058c43a None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:18.861068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8105fe0-d004-42d3-9f4f-50dfc058c43a None admin] RBAC: Adding query filter params (name=network) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:18.861374 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8105fe0-d004-42d3-9f4f-50dfc058c43a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:18.862824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8105fe0-d004-42d3-9f4f-50dfc058c43a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:18.875677 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 389/773] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:18.881313 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8105fe0-d004-42d3-9f4f-50dfc058c43a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:18.903019 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a490af-2567-4345-870b-a793bd0d5fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:18.903706 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a490af-2567-4345-870b-a793bd0d5fb8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:18.903990 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a490af-2567-4345-870b-a793bd0d5fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:18.904273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a490af-2567-4345-870b-a793bd0d5fb8 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:18.904993 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a490af-2567-4345-870b-a793bd0d5fb8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:18.905414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a490af-2567-4345-870b-a793bd0d5fb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:18.906811 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a490af-2567-4345-870b-a793bd0d5fb8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:18.912136 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 385/774] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:25:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:18.917538 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a490af-2567-4345-870b-a793bd0d5fb8 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:19.060966 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8105fe0-d004-42d3-9f4f-50dfc058c43a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:19.099520 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a490af-2567-4345-870b-a793bd0d5fb8 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:19.129175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:19.133767 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0b75c-d7af-4fd2-b345-590a0b70d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:19.134547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0b75c-d7af-4fd2-b345-590a0b70d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:19.136119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0b75c-d7af-4fd2-b345-590a0b70d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:19.136395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0b75c-d7af-4fd2-b345-590a0b70d2a7 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:19.137115 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0b75c-d7af-4fd2-b345-590a0b70d2a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:19.137422 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0b75c-d7af-4fd2-b345-590a0b70d2a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:19.138953 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0b75c-d7af-4fd2-b345-590a0b70d2a7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:19.145422 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 390/775] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:19.151320 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0b75c-d7af-4fd2-b345-590a0b70d2a7 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:19.160787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:19.195380 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c723d-cf3f-4013-87c2-8ba677440314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:19.196087 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c723d-cf3f-4013-87c2-8ba677440314 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:19.196375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c723d-cf3f-4013-87c2-8ba677440314 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:19.196657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c723d-cf3f-4013-87c2-8ba677440314 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:19.197497 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c723d-cf3f-4013-87c2-8ba677440314 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:19.197810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c723d-cf3f-4013-87c2-8ba677440314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:19.199231 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c723d-cf3f-4013-87c2-8ba677440314 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:19.217197 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 386/776] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:25:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:19.222803 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c723d-cf3f-4013-87c2-8ba677440314 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:19.262773 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0b75c-d7af-4fd2-b345-590a0b70d2a7 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:19.300178 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4010e-f1a6-41d0-b7e3-e77c7e089ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:19.300995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4010e-f1a6-41d0-b7e3-e77c7e089ddc None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:19.301646 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4010e-f1a6-41d0-b7e3-e77c7e089ddc None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:19.301928 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4010e-f1a6-41d0-b7e3-e77c7e089ddc None admin] PATH_INFO: `/v3/endpoints` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:19.302761 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4010e-f1a6-41d0-b7e3-e77c7e089ddc None admin] RBAC: Adding query filter params (interface=public, service_id=fe2dcb6394ad440fb7804ee28e6ba0a8, region_id=RegionOne) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:19.303075 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4010e-f1a6-41d0-b7e3-e77c7e089ddc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:19.304665 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4010e-f1a6-41d0-b7e3-e77c7e089ddc None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:19.313983 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 391/777] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:25:19 2022] GET /identity/v3/endpoints?service_id=fe2dcb6394ad440fb7804ee28e6ba0a8&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:19.324338 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4010e-f1a6-41d0-b7e3-e77c7e089ddc None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:19.449218 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c723d-cf3f-4013-87c2-8ba677440314 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:19.464488 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:19.511808 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4010e-f1a6-41d0-b7e3-e77c7e089ddc None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:19.542953 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f694b44-d11e-4ccf-8455-c7ab1a6f2f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:19.544365 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694b44-d11e-4ccf-8455-c7ab1a6f2f7e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:19.544895 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694b44-d11e-4ccf-8455-c7ab1a6f2f7e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:19.545410 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694b44-d11e-4ccf-8455-c7ab1a6f2f7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:19.546552 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f694b44-d11e-4ccf-8455-c7ab1a6f2f7e None admin] RBAC: Adding query filter params (interface=public, service_id=7eb53f9abc9449829d564aabc2e0de87, region_id=RegionOne) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:19.547187 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f694b44-d11e-4ccf-8455-c7ab1a6f2f7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:19.549330 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f694b44-d11e-4ccf-8455-c7ab1a6f2f7e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:19.558637 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af7385-9774-4eb1-bb5b-2f782c29b4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:19.558637 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af7385-9774-4eb1-bb5b-2f782c29b4b0 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:19.558637 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af7385-9774-4eb1-bb5b-2f782c29b4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:19.558637 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af7385-9774-4eb1-bb5b-2f782c29b4b0 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:19.559093 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af7385-9774-4eb1-bb5b-2f782c29b4b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:19.559093 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af7385-9774-4eb1-bb5b-2f782c29b4b0 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:19.560411 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 392/778] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:25:19 2022] GET /identity/v3/services => generated 772 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:19.578789 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 387/779] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:25:19 2022] GET /identity/v3/endpoints?service_id=7eb53f9abc9449829d564aabc2e0de87&interface=public®ion_id=RegionOne => generated 194 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:19.584748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af7385-9774-4eb1-bb5b-2f782c29b4b0 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:19.717356 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af7385-9774-4eb1-bb5b-2f782c29b4b0 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:19.756211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ace68-e7e2-4417-bec9-ece8c4bc4df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:19.756888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ace68-e7e2-4417-bec9-ece8c4bc4df8 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:19.757168 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ace68-e7e2-4417-bec9-ece8c4bc4df8 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:19.757438 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ace68-e7e2-4417-bec9-ece8c4bc4df8 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:19.758132 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ace68-e7e2-4417-bec9-ece8c4bc4df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:19.759660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ace68-e7e2-4417-bec9-ece8c4bc4df8 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:19.765928 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:19.766252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 393/780] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:25:19 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:19.859355 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac31a-c68c-4bd0-967e-7e7eeb4fefd1 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:19.859948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac31a-c68c-4bd0-967e-7e7eeb4fefd1 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:19.860467 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac31a-c68c-4bd0-967e-7e7eeb4fefd1 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:19.862167 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 388/781] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:19.868787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dc9fb-d2ef-4e53-9c74-6d2f16f4bf3c None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:19.869444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dc9fb-d2ef-4e53-9c74-6d2f16f4bf3c None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:19.869444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dc9fb-d2ef-4e53-9c74-6d2f16f4bf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:19.896022 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-186dc9fb-d2ef-4e53-9c74-6d2f16f4bf3c None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:19.897649 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-186dc9fb-d2ef-4e53-9c74-6d2f16f4bf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:20.004635 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 394/782] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:20.028380 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac31a-c68c-4bd0-967e-7e7eeb4fefd1 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.080907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:20.151902 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac31a-c68c-4bd0-967e-7e7eeb4fefd1 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:20.189018 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e9c9-b1b8-4fbb-b98b-e1b767e6977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:20.189885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e9c9-b1b8-4fbb-b98b-e1b767e6977b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.190698 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e9c9-b1b8-4fbb-b98b-e1b767e6977b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.190977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e9c9-b1b8-4fbb-b98b-e1b767e6977b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.202217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9e9c9-b1b8-4fbb-b98b-e1b767e6977b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-b8e9e9c9-b1b8-4fbb-b98b-e1b767e6977b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:20.210033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:20.211107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:20.212198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 389/783] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:20.219462 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dc9fb-d2ef-4e53-9c74-6d2f16f4bf3c None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.328235 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dc9fb-d2ef-4e53-9c74-6d2f16f4bf3c None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:20.359607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:20.364772 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf390c-68a8-4f7f-99f7-d31e40357869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:20.365452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf390c-68a8-4f7f-99f7-d31e40357869 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.365733 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf390c-68a8-4f7f-99f7-d31e40357869 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.366009 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf390c-68a8-4f7f-99f7-d31e40357869 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.366799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf390c-68a8-4f7f-99f7-d31e40357869 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:20.367241 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf390c-68a8-4f7f-99f7-d31e40357869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:20.368835 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf390c-68a8-4f7f-99f7-d31e40357869 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:20.378732 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 395/784] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:20.387980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e9c9-b1b8-4fbb-b98b-e1b767e6977b None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.498643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:20.505600 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e9c9-b1b8-4fbb-b98b-e1b767e6977b None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:20.550732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6f30a-ee2f-4037-85f2-7132195784bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:20.551819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6f30a-ee2f-4037-85f2-7132195784bc None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.552103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6f30a-ee2f-4037-85f2-7132195784bc None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.552379 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6f30a-ee2f-4037-85f2-7132195784bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.566591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6f30a-ee2f-4037-85f2-7132195784bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:20.568087 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6f30a-ee2f-4037-85f2-7132195784bc None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-6dd6f30a-ee2f-4037-85f2-7132195784bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:20.598808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:20.600892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:20.602955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:20.602955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:20.602955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:20.602955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:20.602955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 390/785] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:20.609397 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf390c-68a8-4f7f-99f7-d31e40357869 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.736349 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf390c-68a8-4f7f-99f7-d31e40357869 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:20.776173 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eadced-4915-4ae2-b265-7299eca9e03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:20.777183 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eadced-4915-4ae2-b265-7299eca9e03b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.777683 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eadced-4915-4ae2-b265-7299eca9e03b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.778154 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eadced-4915-4ae2-b265-7299eca9e03b None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.779127 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eadced-4915-4ae2-b265-7299eca9e03b None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:20.779630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eadced-4915-4ae2-b265-7299eca9e03b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:20.781225 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eadced-4915-4ae2-b265-7299eca9e03b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:20.807970 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 396/786] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:20.813566 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6f30a-ee2f-4037-85f2-7132195784bc None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.961780 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6f30a-ee2f-4037-85f2-7132195784bc None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.024445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fce5-7ff4-431b-a9eb-47905871ee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.025675 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fce5-7ff4-431b-a9eb-47905871ee0c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.026241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fce5-7ff4-431b-a9eb-47905871ee0c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.026768 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fce5-7ff4-431b-a9eb-47905871ee0c None admin] PATH_INFO: `/v3/users/swift` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.038087 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14fce5-7ff4-431b-a9eb-47905871ee0c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.039919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14fce5-7ff4-431b-a9eb-47905871ee0c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.050728 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ce22-e98f-4c25-acdc-667d59ea610b None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.051535 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ce22-e98f-4c25-acdc-667d59ea610b None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.051535 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ce22-e98f-4c25-acdc-667d59ea610b None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.052937 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 397/787] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:21.060678 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def46165-059e-419a-8e19-cbed7d904851 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.060966 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def46165-059e-419a-8e19-cbed7d904851 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.061241 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def46165-059e-419a-8e19-cbed7d904851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-da14fce5-7ff4-431b-a9eb-47905871ee0c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:21.068672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:21.069799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:21.070983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:21.070983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:21.070983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:21.070983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:21.070983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:21.070983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:21.070983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:21.070983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:21.070983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:21.070983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:21.074739 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 391/788] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:21.076008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fce5-7ff4-431b-a9eb-47905871ee0c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.098949 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.099181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-def46165-059e-419a-8e19-cbed7d904851 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:21.100179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-def46165-059e-419a-8e19-cbed7d904851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:21.197414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.221408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 398/789] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:21.223285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58af611-edec-410a-9352-774d81d9bda2 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.223871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58af611-edec-410a-9352-774d81d9bda2 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.224382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58af611-edec-410a-9352-774d81d9bda2 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.226219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 399/790] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:21.234555 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fce5-7ff4-431b-a9eb-47905871ee0c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.236397 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49488-e7d9-4529-8292-c697670a8230 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.236968 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49488-e7d9-4529-8292-c697670a8230 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.237452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49488-e7d9-4529-8292-c697670a8230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.262004 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-3df49488-e7d9-4529-8292-c697670a8230 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:21.263299 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-3df49488-e7d9-4529-8292-c697670a8230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:21.283210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2988244-007d-4275-8191-c76d3e741991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.284180 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2988244-007d-4275-8191-c76d3e741991 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.284491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2988244-007d-4275-8191-c76d3e741991 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.285201 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2988244-007d-4275-8191-c76d3e741991 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.286065 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2988244-007d-4275-8191-c76d3e741991 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:21.286422 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2988244-007d-4275-8191-c76d3e741991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.288489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2988244-007d-4275-8191-c76d3e741991 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.309610 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 392/791] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:21.310492 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2988244-007d-4275-8191-c76d3e741991 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.340558 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 400/792] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:21.341438 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df49488-e7d9-4529-8292-c697670a8230 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.423656 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.462643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2988244-007d-4275-8191-c76d3e741991 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.479543 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df49488-e7d9-4529-8292-c697670a8230 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.490953 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.508745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c4f2a-f94b-468b-9387-bcb6e2f6af1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.509688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4f2a-f94b-468b-9387-bcb6e2f6af1e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.509977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4f2a-f94b-468b-9387-bcb6e2f6af1e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.510257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4f2a-f94b-468b-9387-bcb6e2f6af1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.529848 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c4f2a-f94b-468b-9387-bcb6e2f6af1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-fb2c4f2a-f94b-468b-9387-bcb6e2f6af1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:21.540398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:21.541485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 393/793] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:21.542398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c4f2a-f94b-468b-9387-bcb6e2f6af1e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.563518 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ff9a-43da-4a5d-8efa-73a628507962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.564772 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ff9a-43da-4a5d-8efa-73a628507962 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.565315 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ff9a-43da-4a5d-8efa-73a628507962 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.565823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ff9a-43da-4a5d-8efa-73a628507962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.619646 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928ff9a-43da-4a5d-8efa-73a628507962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.621524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928ff9a-43da-4a5d-8efa-73a628507962 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-9928ff9a-43da-4a5d-8efa-73a628507962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:21.660823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:21.661871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:21.663471 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:21.663471 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:21.663471 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:21.663471 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:21.667520 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 401/794] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:21.668653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ff9a-43da-4a5d-8efa-73a628507962 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.670378 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c4f2a-f94b-468b-9387-bcb6e2f6af1e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.721092 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.732424 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1dcdb-f0b7-4e57-9039-061d42090a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.741299 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1dcdb-f0b7-4e57-9039-061d42090a7c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.741299 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1dcdb-f0b7-4e57-9039-061d42090a7c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.741299 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1dcdb-f0b7-4e57-9039-061d42090a7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.746524 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1dcdb-f0b7-4e57-9039-061d42090a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-e1f1dcdb-f0b7-4e57-9039-061d42090a7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:21.754889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:21.756064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:21.756997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:21.760631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 394/795] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:21.761708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1dcdb-f0b7-4e57-9039-061d42090a7c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.866639 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ff9a-43da-4a5d-8efa-73a628507962 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.910142 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310daf32-2887-4049-8fe1-ee0717fb9c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.910859 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310daf32-2887-4049-8fe1-ee0717fb9c65 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.911146 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310daf32-2887-4049-8fe1-ee0717fb9c65 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.911429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310daf32-2887-4049-8fe1-ee0717fb9c65 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.912202 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310daf32-2887-4049-8fe1-ee0717fb9c65 None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:21.912589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310daf32-2887-4049-8fe1-ee0717fb9c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.914057 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310daf32-2887-4049-8fe1-ee0717fb9c65 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.926136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 402/796] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:21.928146 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310daf32-2887-4049-8fe1-ee0717fb9c65 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.953289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1dcdb-f0b7-4e57-9039-061d42090a7c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.961974 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.010652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45742bec-1b78-4d8d-a9df-35023ec5a7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.010652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45742bec-1b78-4d8d-a9df-35023ec5a7c9 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.010652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45742bec-1b78-4d8d-a9df-35023ec5a7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.010652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45742bec-1b78-4d8d-a9df-35023ec5a7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.011649 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45742bec-1b78-4d8d-a9df-35023ec5a7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:22.012342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45742bec-1b78-4d8d-a9df-35023ec5a7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.015941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45742bec-1b78-4d8d-a9df-35023ec5a7c9 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.036639 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 395/797] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:22.036639 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45742bec-1b78-4d8d-a9df-35023ec5a7c9 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.066695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310daf32-2887-4049-8fe1-ee0717fb9c65 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.107201 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18a990-365f-4b3b-9a13-12add6172216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.108233 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a990-365f-4b3b-9a13-12add6172216 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.108723 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a990-365f-4b3b-9a13-12add6172216 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.109207 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a990-365f-4b3b-9a13-12add6172216 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.110163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18a990-365f-4b3b-9a13-12add6172216 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:22.110699 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18a990-365f-4b3b-9a13-12add6172216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.112418 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18a990-365f-4b3b-9a13-12add6172216 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.113048 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.123593 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 403/798] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:22.129279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18a990-365f-4b3b-9a13-12add6172216 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.179705 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45742bec-1b78-4d8d-a9df-35023ec5a7c9 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.222883 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3d30e-1bc1-4311-bb85-c3d1970f3d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.226082 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3d30e-1bc1-4311-bb85-c3d1970f3d80 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.226369 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3d30e-1bc1-4311-bb85-c3d1970f3d80 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.226811 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3d30e-1bc1-4311-bb85-c3d1970f3d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.239472 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.243584 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3d30e-1bc1-4311-bb85-c3d1970f3d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.245186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3d30e-1bc1-4311-bb85-c3d1970f3d80 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.261155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18a990-365f-4b3b-9a13-12add6172216 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-46c3d30e-1bc1-4311-bb85-c3d1970f3d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:22.272939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:22.274035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:22.275531 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:22.275531 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:22.275531 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:22.275531 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:22.275531 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 396/799] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:22.276455 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3d30e-1bc1-4311-bb85-c3d1970f3d80 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.349342 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c97a70-91bf-4f26-8502-e038fec49b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.349342 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c97a70-91bf-4f26-8502-e038fec49b59 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.349342 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c97a70-91bf-4f26-8502-e038fec49b59 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.349342 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c97a70-91bf-4f26-8502-e038fec49b59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.361118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c97a70-91bf-4f26-8502-e038fec49b59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.361118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c97a70-91bf-4f26-8502-e038fec49b59 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-47c97a70-91bf-4f26-8502-e038fec49b59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:22.382563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:22.383866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:22.385104 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:22.385104 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:22.385104 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:22.385104 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:22.385104 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:22.385104 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:22.385104 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:22.385104 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:22.385104 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 404/800] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:22.385104 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c97a70-91bf-4f26-8502-e038fec49b59 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.457053 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3d30e-1bc1-4311-bb85-c3d1970f3d80 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.459301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.497430 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59983532-fcc0-47f6-b74d-cf4f64ef0e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.498246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983532-fcc0-47f6-b74d-cf4f64ef0e70 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.498534 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983532-fcc0-47f6-b74d-cf4f64ef0e70 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.498847 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983532-fcc0-47f6-b74d-cf4f64ef0e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.510210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59983532-fcc0-47f6-b74d-cf4f64ef0e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.512522 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59983532-fcc0-47f6-b74d-cf4f64ef0e70 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.519974 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c97a70-91bf-4f26-8502-e038fec49b59 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-59983532-fcc0-47f6-b74d-cf4f64ef0e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:22.533103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:22.534730 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:22.536393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:22.536393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:22.536393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:22.536393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:22.536393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 397/801] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:22.536393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59983532-fcc0-47f6-b74d-cf4f64ef0e70 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.562475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c5356-6b3e-4a82-9fa4-24e26a02b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.563303 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5356-6b3e-4a82-9fa4-24e26a02b699 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.563585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5356-6b3e-4a82-9fa4-24e26a02b699 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.563865 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5356-6b3e-4a82-9fa4-24e26a02b699 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.564597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c5356-6b3e-4a82-9fa4-24e26a02b699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:22.564972 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c5356-6b3e-4a82-9fa4-24e26a02b699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.566357 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c5356-6b3e-4a82-9fa4-24e26a02b699 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.582931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 405/802] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:22.582931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616afd1-758c-4406-abff-e17f30522886 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.582931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616afd1-758c-4406-abff-e17f30522886 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.582931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616afd1-758c-4406-abff-e17f30522886 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.582931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 406/803] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:22.582931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616afd1-758c-4406-abff-e17f30522886 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.594703 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.661672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59983532-fcc0-47f6-b74d-cf4f64ef0e70 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.689281 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616afd1-758c-4406-abff-e17f30522886 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.695720 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a4e84-148f-44ce-a58e-bf7cb52f4ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.696459 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a4e84-148f-44ce-a58e-bf7cb52f4ede None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.696743 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a4e84-148f-44ce-a58e-bf7cb52f4ede None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.697019 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a4e84-148f-44ce-a58e-bf7cb52f4ede None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.697812 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a4e84-148f-44ce-a58e-bf7cb52f4ede None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:22.698130 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a4e84-148f-44ce-a58e-bf7cb52f4ede None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.699673 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a4e84-148f-44ce-a58e-bf7cb52f4ede None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.711636 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 398/804] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:22.712688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafec92c-9044-435a-b0e1-1c9e0cc3ed77 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.712975 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafec92c-9044-435a-b0e1-1c9e0cc3ed77 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.713253 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafec92c-9044-435a-b0e1-1c9e0cc3ed77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.728615 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5e54d-5007-457e-87f8-597f41f5146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.729288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e54d-5007-457e-87f8-597f41f5146b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.729574 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e54d-5007-457e-87f8-597f41f5146b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.729764 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-aafec92c-9044-435a-b0e1-1c9e0cc3ed77 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:22.729875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e54d-5007-457e-87f8-597f41f5146b None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.730708 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5e54d-5007-457e-87f8-597f41f5146b None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:22.730991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-aafec92c-9044-435a-b0e1-1c9e0cc3ed77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:22.731106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5e54d-5007-457e-87f8-597f41f5146b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.732384 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5e54d-5007-457e-87f8-597f41f5146b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.741035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.745408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 407/805] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:22.746238 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5e54d-5007-457e-87f8-597f41f5146b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.800515 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 399/806] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:22.802252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce7ac5-890a-467f-8ddb-467f97c00060 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.802509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce7ac5-890a-467f-8ddb-467f97c00060 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.802804 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce7ac5-890a-467f-8ddb-467f97c00060 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.804203 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 400/807] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:22.804763 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce7ac5-890a-467f-8ddb-467f97c00060 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.822711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.857876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5e54d-5007-457e-87f8-597f41f5146b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.893794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d5554-e72f-4c9a-8677-3bfe819c5055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.894638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5554-e72f-4c9a-8677-3bfe819c5055 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.894924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5554-e72f-4c9a-8677-3bfe819c5055 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.895204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5554-e72f-4c9a-8677-3bfe819c5055 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.902440 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d5554-e72f-4c9a-8677-3bfe819c5055 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.903924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d5554-e72f-4c9a-8677-3bfe819c5055 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.909168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce7ac5-890a-467f-8ddb-467f97c00060 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-566d5554-e72f-4c9a-8677-3bfe819c5055 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:22.919383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:22.920633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 408/808] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:22.921887 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d5554-e72f-4c9a-8677-3bfe819c5055 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.947544 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67235fce-dc7a-4038-b552-0b0c276091c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.950078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67235fce-dc7a-4038-b552-0b0c276091c9 None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.950078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67235fce-dc7a-4038-b552-0b0c276091c9 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.950078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67235fce-dc7a-4038-b552-0b0c276091c9 None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/da8976d2646745feadde336d6164e1da/roles/59689ee7c4f5409692318371dac5cbc7` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.951034 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67235fce-dc7a-4038-b552-0b0c276091c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=da8976d2646745feadde336d6164e1da, role_id=59689ee7c4f5409692318371dac5cbc7)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.952469 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67235fce-dc7a-4038-b552-0b0c276091c9 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.023743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d5554-e72f-4c9a-8677-3bfe819c5055 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.027204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 401/809] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:25:22 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/da8976d2646745feadde336d6164e1da/roles/59689ee7c4f5409692318371dac5cbc7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:23.028491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27086e-7edb-4959-b3aa-3a6980fe8a4e None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.028784 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27086e-7edb-4959-b3aa-3a6980fe8a4e None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.029067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27086e-7edb-4959-b3aa-3a6980fe8a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.035813 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.048383 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-4b27086e-7edb-4959-b3aa-3a6980fe8a4e None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:23.049642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-4b27086e-7edb-4959-b3aa-3a6980fe8a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:23.065215 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.076240 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9c1b2-153c-49cb-825e-974ffea04ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.077060 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9c1b2-153c-49cb-825e-974ffea04ab4 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.077345 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9c1b2-153c-49cb-825e-974ffea04ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.077670 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9c1b2-153c-49cb-825e-974ffea04ab4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.086701 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9c1b2-153c-49cb-825e-974ffea04ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.088222 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9c1b2-153c-49cb-825e-974ffea04ab4 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-a4b9c1b2-153c-49cb-825e-974ffea04ab4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:23.105880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:23.107200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 409/810] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:23.113429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9c1b2-153c-49cb-825e-974ffea04ab4 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.146184 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 402/811] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:23.146184 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27086e-7edb-4959-b3aa-3a6980fe8a4e None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.251938 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9c1b2-153c-49cb-825e-974ffea04ab4 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.259734 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27086e-7edb-4959-b3aa-3a6980fe8a4e None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.291317 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab097-fd80-4996-a8a3-fca55ccfa2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.292134 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab097-fd80-4996-a8a3-fca55ccfa2fa None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.292417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab097-fd80-4996-a8a3-fca55ccfa2fa None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.292705 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab097-fd80-4996-a8a3-fca55ccfa2fa None admin] PATH_INFO: `/v3/services/network` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.293361 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ab097-fd80-4996-a8a3-fca55ccfa2fa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.294788 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ab097-fd80-4996-a8a3-fca55ccfa2fa None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.300499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79600b21-6ad5-4d70-8567-63091d8a55ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.301444 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600b21-6ad5-4d70-8567-63091d8a55ea None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.301741 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600b21-6ad5-4d70-8567-63091d8a55ea None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.302022 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600b21-6ad5-4d70-8567-63091d8a55ea None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.302917 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79600b21-6ad5-4d70-8567-63091d8a55ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:23.303237 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79600b21-6ad5-4d70-8567-63091d8a55ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.304910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79600b21-6ad5-4d70-8567-63091d8a55ea None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.306942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-1a1ab097-fd80-4996-a8a3-fca55ccfa2fa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:23.307697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:23.308781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:23.309716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 410/812] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:23.311990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab097-fd80-4996-a8a3-fca55ccfa2fa None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.332184 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 403/813] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:23.333095 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79600b21-6ad5-4d70-8567-63091d8a55ea None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.374662 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.429513 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab097-fd80-4996-a8a3-fca55ccfa2fa None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.440359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79600b21-6ad5-4d70-8567-63091d8a55ea None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.466737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c042f8a-d0ba-42e1-bf7f-b8fbe18cb8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.467425 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042f8a-d0ba-42e1-bf7f-b8fbe18cb8fe None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.467687 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042f8a-d0ba-42e1-bf7f-b8fbe18cb8fe None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.467960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042f8a-d0ba-42e1-bf7f-b8fbe18cb8fe None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.468809 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c042f8a-d0ba-42e1-bf7f-b8fbe18cb8fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:23.469115 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c042f8a-d0ba-42e1-bf7f-b8fbe18cb8fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.470545 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c042f8a-d0ba-42e1-bf7f-b8fbe18cb8fe None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.479796 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed0e0b-aced-42f2-b42a-09be3d6753c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.481589 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed0e0b-aced-42f2-b42a-09be3d6753c6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.481979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed0e0b-aced-42f2-b42a-09be3d6753c6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.482361 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed0e0b-aced-42f2-b42a-09be3d6753c6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.483179 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed0e0b-aced-42f2-b42a-09be3d6753c6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.484667 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed0e0b-aced-42f2-b42a-09be3d6753c6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.493571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 411/814] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:23.494229 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c042f8a-d0ba-42e1-bf7f-b8fbe18cb8fe None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-1bed0e0b-aced-42f2-b42a-09be3d6753c6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:23.498101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:23.499360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:23.503349 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 404/815] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:23.504309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed0e0b-aced-42f2-b42a-09be3d6753c6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.563694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.611161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed0e0b-aced-42f2-b42a-09be3d6753c6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.614082 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c042f8a-d0ba-42e1-bf7f-b8fbe18cb8fe None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.624579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.647270 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e24266-9ea3-4b92-8d91-93af61421d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.648086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24266-9ea3-4b92-8d91-93af61421d44 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.648369 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24266-9ea3-4b92-8d91-93af61421d44 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.648830 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24266-9ea3-4b92-8d91-93af61421d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.653017 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd02cee-5fa5-4ae6-8f37-bd0b4727cffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.653682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd02cee-5fa5-4ae6-8f37-bd0b4727cffc None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.653963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd02cee-5fa5-4ae6-8f37-bd0b4727cffc None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.654236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd02cee-5fa5-4ae6-8f37-bd0b4727cffc None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.654991 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd02cee-5fa5-4ae6-8f37-bd0b4727cffc None admin] RBAC: Adding query filter params (name=network) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:23.655299 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd02cee-5fa5-4ae6-8f37-bd0b4727cffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.656671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd02cee-5fa5-4ae6-8f37-bd0b4727cffc None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.661666 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 412/816] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:23.662498 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd02cee-5fa5-4ae6-8f37-bd0b4727cffc None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.667657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e24266-9ea3-4b92-8d91-93af61421d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.669211 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e24266-9ea3-4b92-8d91-93af61421d44 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-39e24266-9ea3-4b92-8d91-93af61421d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:23.690633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:23.691818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:23.693003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:23.693003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:23.693003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:23.693003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:23.696405 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 405/817] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:23.697131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e24266-9ea3-4b92-8d91-93af61421d44 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.775190 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd02cee-5fa5-4ae6-8f37-bd0b4727cffc None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.812995 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e24266-9ea3-4b92-8d91-93af61421d44 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.817598 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eaa6c-e4d5-481f-abfe-0795f3d7230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.818332 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eaa6c-e4d5-481f-abfe-0795f3d7230b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.818710 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eaa6c-e4d5-481f-abfe-0795f3d7230b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.819045 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eaa6c-e4d5-481f-abfe-0795f3d7230b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.822935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.848744 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045a09-d0ab-42c9-b1f7-4beb3221f7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.849530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045a09-d0ab-42c9-b1f7-4beb3221f7dc None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.849886 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045a09-d0ab-42c9-b1f7-4beb3221f7dc None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.850519 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045a09-d0ab-42c9-b1f7-4beb3221f7dc None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.851059 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66045a09-d0ab-42c9-b1f7-4beb3221f7dc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:23.851508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66045a09-d0ab-42c9-b1f7-4beb3221f7dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.852882 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66045a09-d0ab-42c9-b1f7-4beb3221f7dc None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.863250 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 406/818] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:23.863250 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045a09-d0ab-42c9-b1f7-4beb3221f7dc None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.868791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.897228 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613eaa6c-e4d5-481f-abfe-0795f3d7230b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.899015 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613eaa6c-e4d5-481f-abfe-0795f3d7230b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.992494 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045a09-d0ab-42c9-b1f7-4beb3221f7dc None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.021579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 413/819] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:25:24.022787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eaa6c-e4d5-481f-abfe-0795f3d7230b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.045370 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00c7e4-e0f6-4677-a229-c3a15281b61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.046256 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c7e4-e0f6-4677-a229-c3a15281b61f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.046733 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c7e4-e0f6-4677-a229-c3a15281b61f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.047205 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c7e4-e0f6-4677-a229-c3a15281b61f None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.048427 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c7e4-e0f6-4677-a229-c3a15281b61f None admin] RBAC: Adding query filter params (type=network) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:24.048932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c7e4-e0f6-4677-a229-c3a15281b61f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.050799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c7e4-e0f6-4677-a229-c3a15281b61f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.057312 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 407/820] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:24.058112 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00c7e4-e0f6-4677-a229-c3a15281b61f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.113575 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.119476 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.153274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eaa6c-e4d5-481f-abfe-0795f3d7230b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.194798 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00c7e4-e0f6-4677-a229-c3a15281b61f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.196115 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365fb9f-7186-4669-94b2-bad475b17ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.196786 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365fb9f-7186-4669-94b2-bad475b17ff9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.197068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365fb9f-7186-4669-94b2-bad475b17ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.197340 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365fb9f-7186-4669-94b2-bad475b17ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.198112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365fb9f-7186-4669-94b2-bad475b17ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:24.198420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365fb9f-7186-4669-94b2-bad475b17ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.200023 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365fb9f-7186-4669-94b2-bad475b17ff9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.212840 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 414/821] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:24.212840 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365fb9f-7186-4669-94b2-bad475b17ff9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.244055 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43009486-2092-4672-8944-c3dd2093023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.244832 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43009486-2092-4672-8944-c3dd2093023d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.245644 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43009486-2092-4672-8944-c3dd2093023d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.246004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43009486-2092-4672-8944-c3dd2093023d None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.247041 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43009486-2092-4672-8944-c3dd2093023d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:24.247587 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43009486-2092-4672-8944-c3dd2093023d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.249090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43009486-2092-4672-8944-c3dd2093023d None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.262769 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 408/822] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:24.263818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43009486-2092-4672-8944-c3dd2093023d None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.339009 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365fb9f-7186-4669-94b2-bad475b17ff9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.369545 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.373131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.374935 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27994e29-aab4-4272-81b6-7404f1dc34cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.375741 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994e29-aab4-4272-81b6-7404f1dc34cb None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.376026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994e29-aab4-4272-81b6-7404f1dc34cb None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.376317 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994e29-aab4-4272-81b6-7404f1dc34cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.377643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43009486-2092-4672-8944-c3dd2093023d None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.387958 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27994e29-aab4-4272-81b6-7404f1dc34cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.389428 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27994e29-aab4-4272-81b6-7404f1dc34cb None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-27994e29-aab4-4272-81b6-7404f1dc34cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:24.408529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:24.409724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:24.410971 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:24.410971 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:24.410971 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:24.410971 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:24.410971 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 415/823] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:24.410971 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27994e29-aab4-4272-81b6-7404f1dc34cb None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.417110 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362868a-51f4-4c9f-a4c9-815330ba6696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.417869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362868a-51f4-4c9f-a4c9-815330ba6696 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.418221 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362868a-51f4-4c9f-a4c9-815330ba6696 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.418568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362868a-51f4-4c9f-a4c9-815330ba6696 None admin] PATH_INFO: `/v3/endpoints` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.419468 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362868a-51f4-4c9f-a4c9-815330ba6696 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.420918 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362868a-51f4-4c9f-a4c9-815330ba6696 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.512009 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27994e29-aab4-4272-81b6-7404f1dc34cb None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.522498 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 409/824] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:25:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:24.523514 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362868a-51f4-4c9f-a4c9-815330ba6696 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.557910 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3acb89-e80a-448d-baaa-00a66f3602f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.559369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3acb89-e80a-448d-baaa-00a66f3602f6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.559778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3acb89-e80a-448d-baaa-00a66f3602f6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.560257 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3acb89-e80a-448d-baaa-00a66f3602f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.571557 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3acb89-e80a-448d-baaa-00a66f3602f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.574152 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3acb89-e80a-448d-baaa-00a66f3602f6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-3e3acb89-e80a-448d-baaa-00a66f3602f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:24.595681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:24.596856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:24.598021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:24.598021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:24.598021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:24.598021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:24.598021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:24.598021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:24.598021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:24.598021 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:24.600421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 416/825] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:24.601523 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3acb89-e80a-448d-baaa-00a66f3602f6 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.655090 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.665621 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362868a-51f4-4c9f-a4c9-815330ba6696 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.708387 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daad3a-3b8f-4e51-8c14-00f2f7160daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.709156 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daad3a-3b8f-4e51-8c14-00f2f7160daa None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.709595 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daad3a-3b8f-4e51-8c14-00f2f7160daa None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.709990 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daad3a-3b8f-4e51-8c14-00f2f7160daa None admin] PATH_INFO: `/v3/endpoints` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.710885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daad3a-3b8f-4e51-8c14-00f2f7160daa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.712490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daad3a-3b8f-4e51-8c14-00f2f7160daa None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.720086 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3acb89-e80a-448d-baaa-00a66f3602f6 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.759720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2920848-a995-49ec-9f5e-6235cf08b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.760630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920848-a995-49ec-9f5e-6235cf08b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.760970 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920848-a995-49ec-9f5e-6235cf08b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.761305 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920848-a995-49ec-9f5e-6235cf08b4d2 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.762097 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920848-a995-49ec-9f5e-6235cf08b4d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:24.762472 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920848-a995-49ec-9f5e-6235cf08b4d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.764026 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920848-a995-49ec-9f5e-6235cf08b4d2 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.777262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 417/826] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:24.778172 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2920848-a995-49ec-9f5e-6235cf08b4d2 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.789596 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 410/827] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:25:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:24.790844 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daad3a-3b8f-4e51-8c14-00f2f7160daa None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.820495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.919886 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.924779 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2920848-a995-49ec-9f5e-6235cf08b4d2 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.970184 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daad3a-3b8f-4e51-8c14-00f2f7160daa None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.970736 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09129e87-cf3a-46f3-9e69-21126aa7edd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.973847 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09129e87-cf3a-46f3-9e69-21126aa7edd8 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.974421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09129e87-cf3a-46f3-9e69-21126aa7edd8 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.975316 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09129e87-cf3a-46f3-9e69-21126aa7edd8 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.976415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09129e87-cf3a-46f3-9e69-21126aa7edd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:24.976961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09129e87-cf3a-46f3-9e69-21126aa7edd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.978819 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09129e87-cf3a-46f3-9e69-21126aa7edd8 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.994200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 418/828] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:25.000008 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09129e87-cf3a-46f3-9e69-21126aa7edd8 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.023380 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf2bc9-33d9-4c6d-8e7c-4c09fc52d72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.025186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf2bc9-33d9-4c6d-8e7c-4c09fc52d72a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.025476 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf2bc9-33d9-4c6d-8e7c-4c09fc52d72a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.025753 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf2bc9-33d9-4c6d-8e7c-4c09fc52d72a None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.036807 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf2bc9-33d9-4c6d-8e7c-4c09fc52d72a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.038249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf2bc9-33d9-4c6d-8e7c-4c09fc52d72a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-2edf2bc9-33d9-4c6d-8e7c-4c09fc52d72a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:25.054819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:25.055909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:25.056909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:25.056909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:25.056909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:25.056909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:25.056909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:25.056909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:25.056909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:25.056909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:25.056909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 411/829] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:25.066486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf2bc9-33d9-4c6d-8e7c-4c09fc52d72a None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.141992 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09129e87-cf3a-46f3-9e69-21126aa7edd8 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.144028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:25.187454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf2bc9-33d9-4c6d-8e7c-4c09fc52d72a None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.201326 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd27313-962f-46a6-a25d-00be121c9bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.202948 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27313-962f-46a6-a25d-00be121c9bae None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.203989 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27313-962f-46a6-a25d-00be121c9bae None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.204762 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27313-962f-46a6-a25d-00be121c9bae None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/9fdd44a5966c4276b572250fd4147fc9/roles/c6d6983e0eaf48da8812725f576ddfb2` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.221364 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd27313-962f-46a6-a25d-00be121c9bae None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=9fdd44a5966c4276b572250fd4147fc9, role_id=c6d6983e0eaf48da8812725f576ddfb2)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.227095 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd27313-962f-46a6-a25d-00be121c9bae None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.230449 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ed7a4-ef71-41b6-9a1c-cec758975e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.231351 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ed7a4-ef71-41b6-9a1c-cec758975e82 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.231812 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ed7a4-ef71-41b6-9a1c-cec758975e82 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.232248 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ed7a4-ef71-41b6-9a1c-cec758975e82 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.233211 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ed7a4-ef71-41b6-9a1c-cec758975e82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:25.233677 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ed7a4-ef71-41b6-9a1c-cec758975e82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.235281 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ed7a4-ef71-41b6-9a1c-cec758975e82 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.255013 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 412/830] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:25.256635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ed7a4-ef71-41b6-9a1c-cec758975e82 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.299827 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 419/831] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:25:24 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/9fdd44a5966c4276b572250fd4147fc9/roles/c6d6983e0eaf48da8812725f576ddfb2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:25.353302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a76fe-faee-47d4-9872-9806b87bf563 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.353576 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a76fe-faee-47d4-9872-9806b87bf563 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.353860 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a76fe-faee-47d4-9872-9806b87bf563 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.355648 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 420/832] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:25.361951 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd28222-f92d-4d22-8c81-c51bf6eec2f9 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.362236 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd28222-f92d-4d22-8c81-c51bf6eec2f9 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.362795 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd28222-f92d-4d22-8c81-c51bf6eec2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.377862 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:25.385507 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-6fd28222-f92d-4d22-8c81-c51bf6eec2f9 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:25.389508 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-6fd28222-f92d-4d22-8c81-c51bf6eec2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:25.394856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ed7a4-ef71-41b6-9a1c-cec758975e82 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.443451 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:25.451423 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d5fa0-6bec-4ba2-b1b7-0e30c1d8ed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.452495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5fa0-6bec-4ba2-b1b7-0e30c1d8ed43 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.453646 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5fa0-6bec-4ba2-b1b7-0e30c1d8ed43 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.454127 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5fa0-6bec-4ba2-b1b7-0e30c1d8ed43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.455649 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d5fa0-6bec-4ba2-b1b7-0e30c1d8ed43 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=382eda270f1545718847c9687bd62846) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:25.456155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d5fa0-6bec-4ba2-b1b7-0e30c1d8ed43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.459194 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d5fa0-6bec-4ba2-b1b7-0e30c1d8ed43 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.470839 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 413/833] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/role_assignments?user.id=382eda270f1545718847c9687bd62846&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:25.483001 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 421/834] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:25.502898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d5fa0-6bec-4ba2-b1b7-0e30c1d8ed43 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.631292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d5fa0-6bec-4ba2-b1b7-0e30c1d8ed43 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.679278 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f281c-786e-4599-afcb-5797ef65fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.680098 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f281c-786e-4599-afcb-5797ef65fc2e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.680384 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f281c-786e-4599-afcb-5797ef65fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.680665 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f281c-786e-4599-afcb-5797ef65fc2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.694467 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f281c-786e-4599-afcb-5797ef65fc2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-3a6f281c-786e-4599-afcb-5797ef65fc2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:25.703128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:25.704392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:25.705470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:25.707336 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 414/835] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:25.712408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd28222-f92d-4d22-8c81-c51bf6eec2f9 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.827129 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd28222-f92d-4d22-8c81-c51bf6eec2f9 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.865187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf51c8-2c34-4ab4-9cf8-5c2a90496091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.866160 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf51c8-2c34-4ab4-9cf8-5c2a90496091 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.866630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf51c8-2c34-4ab4-9cf8-5c2a90496091 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.867086 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf51c8-2c34-4ab4-9cf8-5c2a90496091 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.867995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf51c8-2c34-4ab4-9cf8-5c2a90496091 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:25.868475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf51c8-2c34-4ab4-9cf8-5c2a90496091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.870029 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf51c8-2c34-4ab4-9cf8-5c2a90496091 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.872690 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:25.880194 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 422/836] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:25.885887 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f281c-786e-4599-afcb-5797ef65fc2e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.943940 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:25.995416 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f281c-786e-4599-afcb-5797ef65fc2e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:26.036926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8415e41-ea32-48fb-844e-d252990695fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:26.037881 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8415e41-ea32-48fb-844e-d252990695fa None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.038266 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8415e41-ea32-48fb-844e-d252990695fa None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.038660 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8415e41-ea32-48fb-844e-d252990695fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.050472 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8415e41-ea32-48fb-844e-d252990695fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:26.052397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8415e41-ea32-48fb-844e-d252990695fa None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-f8415e41-ea32-48fb-844e-d252990695fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:26.070855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:26.071932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:26.072921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:26.072921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:26.072921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:26.072921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:26.072921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 415/837] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:26.079696 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf51c8-2c34-4ab4-9cf8-5c2a90496091 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:26.189740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf51c8-2c34-4ab4-9cf8-5c2a90496091 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:26.227498 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e1149-23a5-4099-aebe-6856524c3791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:26.236526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1149-23a5-4099-aebe-6856524c3791 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.236526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1149-23a5-4099-aebe-6856524c3791 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.236526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1149-23a5-4099-aebe-6856524c3791 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.236526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e1149-23a5-4099-aebe-6856524c3791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:26.236526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e1149-23a5-4099-aebe-6856524c3791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:26.236526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e1149-23a5-4099-aebe-6856524c3791 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:26.244923 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 423/838] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:26.251784 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8415e41-ea32-48fb-844e-d252990695fa None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:26.358735 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8415e41-ea32-48fb-844e-d252990695fa None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:26.396807 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:26.411185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c10ca-35d4-4960-822a-bddffbaf17f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:26.412058 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c10ca-35d4-4960-822a-bddffbaf17f8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.412339 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c10ca-35d4-4960-822a-bddffbaf17f8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.412609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c10ca-35d4-4960-822a-bddffbaf17f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.420710 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c10ca-35d4-4960-822a-bddffbaf17f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:26.422161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c10ca-35d4-4960-822a-bddffbaf17f8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-7c9c10ca-35d4-4960-822a-bddffbaf17f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:26.436951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:26.438183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:26.439301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:26.439301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:26.439301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:26.439301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:26.439301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:26.439301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:26.439301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:26.439301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:26.439301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:26.439301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:26.439301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 416/839] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:26.444991 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e1149-23a5-4099-aebe-6856524c3791 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:26.509453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:26.560110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e1149-23a5-4099-aebe-6856524c3791 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:26.600666 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea5abf-368d-4c5b-9905-7e21ed5016c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:26.601657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5abf-368d-4c5b-9905-7e21ed5016c4 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.602112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5abf-368d-4c5b-9905-7e21ed5016c4 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.602552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5abf-368d-4c5b-9905-7e21ed5016c4 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.603633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea5abf-368d-4c5b-9905-7e21ed5016c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:26.604113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea5abf-368d-4c5b-9905-7e21ed5016c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:26.605744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea5abf-368d-4c5b-9905-7e21ed5016c4 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:26.624964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 424/840] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:25:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:26.631131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c10ca-35d4-4960-822a-bddffbaf17f8 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:26.736172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c10ca-35d4-4960-822a-bddffbaf17f8 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:26.774189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38da56-f303-4d05-bf9e-b9a326027467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:26.774814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38da56-f303-4d05-bf9e-b9a326027467 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.775103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38da56-f303-4d05-bf9e-b9a326027467 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.775384 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38da56-f303-4d05-bf9e-b9a326027467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.822596 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:26.864326 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38da56-f303-4d05-bf9e-b9a326027467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:26.865800 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38da56-f303-4d05-bf9e-b9a326027467 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:26.971031 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 417/841] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:25:26.976342 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea5abf-368d-4c5b-9905-7e21ed5016c4 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.084318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea5abf-368d-4c5b-9905-7e21ed5016c4 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.103951 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.124544 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edeb6e1-ad82-4d6c-95c5-fbddc376122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.125375 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeb6e1-ad82-4d6c-95c5-fbddc376122d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.125659 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeb6e1-ad82-4d6c-95c5-fbddc376122d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.133682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeb6e1-ad82-4d6c-95c5-fbddc376122d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.138441 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edeb6e1-ad82-4d6c-95c5-fbddc376122d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.139966 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edeb6e1-ad82-4d6c-95c5-fbddc376122d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-7edeb6e1-ad82-4d6c-95c5-fbddc376122d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:27.159227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:27.160318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:27.161324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:27.161324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:27.161324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:27.161324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:27.161324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 425/842] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:27.166111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38da56-f303-4d05-bf9e-b9a326027467 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.238150 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.290999 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38da56-f303-4d05-bf9e-b9a326027467 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.318509 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3565d-1dd1-4cb6-90b5-7cf8e86b934b None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.319109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3565d-1dd1-4cb6-90b5-7cf8e86b934b None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.319109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3565d-1dd1-4cb6-90b5-7cf8e86b934b None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.320947 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 426/843] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:27.326698 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685c0a4-77b4-4050-89a1-a6ab18d08767 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.326985 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685c0a4-77b4-4050-89a1-a6ab18d08767 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.327325 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685c0a4-77b4-4050-89a1-a6ab18d08767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.345011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679e8bb-ad88-46ce-8f02-21d0042c9c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.345550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679e8bb-ad88-46ce-8f02-21d0042c9c8f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.345863 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679e8bb-ad88-46ce-8f02-21d0042c9c8f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.346132 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679e8bb-ad88-46ce-8f02-21d0042c9c8f None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.346901 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679e8bb-ad88-46ce-8f02-21d0042c9c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:27.347204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679e8bb-ad88-46ce-8f02-21d0042c9c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.348586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679e8bb-ad88-46ce-8f02-21d0042c9c8f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.351538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-b685c0a4-77b4-4050-89a1-a6ab18d08767 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:27.353605 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-b685c0a4-77b4-4050-89a1-a6ab18d08767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:27.366973 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 418/844] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:27.368674 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679e8bb-ad88-46ce-8f02-21d0042c9c8f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.464999 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 427/845] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:27.486300 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685c0a4-77b4-4050-89a1-a6ab18d08767 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.518184 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679e8bb-ad88-46ce-8f02-21d0042c9c8f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.554368 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.568342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826a57f-f512-41aa-b0d8-6208943db57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.569468 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a57f-f512-41aa-b0d8-6208943db57e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.569763 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a57f-f512-41aa-b0d8-6208943db57e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.570049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a57f-f512-41aa-b0d8-6208943db57e None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.579721 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826a57f-f512-41aa-b0d8-6208943db57e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.582785 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826a57f-f512-41aa-b0d8-6208943db57e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-2826a57f-f512-41aa-b0d8-6208943db57e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:27.601079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:27.602111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:27.603766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:27.603766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:27.603766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:27.603766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:27.603766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:27.603766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:27.603766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:27.603766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:27.608112 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 419/846] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:27.608552 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826a57f-f512-41aa-b0d8-6208943db57e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.626485 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.631746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685c0a4-77b4-4050-89a1-a6ab18d08767 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.671469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9809ce6-4ece-48e7-ab8f-2eb2158766de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.672296 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809ce6-4ece-48e7-ab8f-2eb2158766de None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.672574 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809ce6-4ece-48e7-ab8f-2eb2158766de None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.672842 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809ce6-4ece-48e7-ab8f-2eb2158766de None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.673505 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9809ce6-4ece-48e7-ab8f-2eb2158766de None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.675239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9809ce6-4ece-48e7-ab8f-2eb2158766de None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-b9809ce6-4ece-48e7-ab8f-2eb2158766de None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:27.688875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:27.690453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:27.691900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:27.695219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 428/847] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:27.696572 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9809ce6-4ece-48e7-ab8f-2eb2158766de None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.760282 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826a57f-f512-41aa-b0d8-6208943db57e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.809725 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845df0c-9862-41d6-a859-80a14a6e407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.810761 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845df0c-9862-41d6-a859-80a14a6e407e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.811215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845df0c-9862-41d6-a859-80a14a6e407e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.811496 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845df0c-9862-41d6-a859-80a14a6e407e None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.812303 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845df0c-9862-41d6-a859-80a14a6e407e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:27.812643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845df0c-9862-41d6-a859-80a14a6e407e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.814084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845df0c-9862-41d6-a859-80a14a6e407e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.831607 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 420/848] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:27.832970 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e73308-b594-4cbd-9a78-3efa8a5c4d99 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.833262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e73308-b594-4cbd-9a78-3efa8a5c4d99 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.833534 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e73308-b594-4cbd-9a78-3efa8a5c4d99 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.835007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 421/849] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:27.840328 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06a53d-9536-47ba-93ca-e3e1e42075ab None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.840635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06a53d-9536-47ba-93ca-e3e1e42075ab None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.840896 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06a53d-9536-47ba-93ca-e3e1e42075ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.847368 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9809ce6-4ece-48e7-ab8f-2eb2158766de None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.861555 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-bc06a53d-9536-47ba-93ca-e3e1e42075ab None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:27.862802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-bc06a53d-9536-47ba-93ca-e3e1e42075ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:27.890781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bead38-6b2b-401e-b971-c619e21adf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.891091 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bead38-6b2b-401e-b971-c619e21adf6d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.891973 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bead38-6b2b-401e-b971-c619e21adf6d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.891973 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bead38-6b2b-401e-b971-c619e21adf6d None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.893503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bead38-6b2b-401e-b971-c619e21adf6d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:27.893817 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bead38-6b2b-401e-b971-c619e21adf6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.895782 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bead38-6b2b-401e-b971-c619e21adf6d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.902120 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 429/850] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:27.903063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bead38-6b2b-401e-b971-c619e21adf6d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.915737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.944193 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.953222 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 422/851] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:27.954377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06a53d-9536-47ba-93ca-e3e1e42075ab None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.021019 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bead38-6b2b-401e-b971-c619e21adf6d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.056251 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91adc8ff-ef93-401a-9183-212c12e45aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.056918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adc8ff-ef93-401a-9183-212c12e45aab None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.057205 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adc8ff-ef93-401a-9183-212c12e45aab None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.057485 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adc8ff-ef93-401a-9183-212c12e45aab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.058328 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adc8ff-ef93-401a-9183-212c12e45aab None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=da8976d2646745feadde336d6164e1da) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.058676 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adc8ff-ef93-401a-9183-212c12e45aab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.060131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adc8ff-ef93-401a-9183-212c12e45aab None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.066866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 430/852] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/role_assignments?user.id=da8976d2646745feadde336d6164e1da&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.067044 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06a53d-9536-47ba-93ca-e3e1e42075ab None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.068341 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c1cc-89ff-4a61-ab21-95dc4dbe155f None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.068806 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c1cc-89ff-4a61-ab21-95dc4dbe155f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.069088 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c1cc-89ff-4a61-ab21-95dc4dbe155f None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.070643 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 431/853] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:28.071318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6c1cc-89ff-4a61-ab21-95dc4dbe155f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.121686 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f0a57-72a7-4c3a-be9b-e83d0d7d33c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.123032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0a57-72a7-4c3a-be9b-e83d0d7d33c6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.123032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0a57-72a7-4c3a-be9b-e83d0d7d33c6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.123032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0a57-72a7-4c3a-be9b-e83d0d7d33c6 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.123724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f0a57-72a7-4c3a-be9b-e83d0d7d33c6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.124030 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f0a57-72a7-4c3a-be9b-e83d0d7d33c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.125479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f0a57-72a7-4c3a-be9b-e83d0d7d33c6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.143165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 423/854] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.143165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07d073-0339-4689-aec0-fd4e365a51dc None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.143165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07d073-0339-4689-aec0-fd4e365a51dc None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.143165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07d073-0339-4689-aec0-fd4e365a51dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.174804 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-aa07d073-0339-4689-aec0-fd4e365a51dc None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:28.177728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-aa07d073-0339-4689-aec0-fd4e365a51dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:28.238297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.244944 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.262792 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6c1cc-89ff-4a61-ab21-95dc4dbe155f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.305109 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 424/855] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:28.318728 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abde4b5-ce6a-4099-b934-f362cd32e133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.319567 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abde4b5-ce6a-4099-b934-f362cd32e133 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.319851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abde4b5-ce6a-4099-b934-f362cd32e133 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.320136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abde4b5-ce6a-4099-b934-f362cd32e133 None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.330319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07d073-0339-4689-aec0-fd4e365a51dc None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.335674 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abde4b5-ce6a-4099-b934-f362cd32e133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-3abde4b5-ce6a-4099-b934-f362cd32e133 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:28.344077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:28.345199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:28.346165 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 432/856] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:28.353329 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abde4b5-ce6a-4099-b934-f362cd32e133 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.464855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07d073-0339-4689-aec0-fd4e365a51dc None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.488150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abde4b5-ce6a-4099-b934-f362cd32e133 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.518535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e993c-3088-4c6d-b0b1-02fc4e808cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.519442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e993c-3088-4c6d-b0b1-02fc4e808cb6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.519900 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e993c-3088-4c6d-b0b1-02fc4e808cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.520281 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e993c-3088-4c6d-b0b1-02fc4e808cb6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.520968 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e993c-3088-4c6d-b0b1-02fc4e808cb6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.523144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e993c-3088-4c6d-b0b1-02fc4e808cb6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.531949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296798f-f5e2-48cf-ac15-877efa839a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.533022 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296798f-f5e2-48cf-ac15-877efa839a64 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.534047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296798f-f5e2-48cf-ac15-877efa839a64 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.534518 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296798f-f5e2-48cf-ac15-877efa839a64 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.535499 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296798f-f5e2-48cf-ac15-877efa839a64 None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.536001 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296798f-f5e2-48cf-ac15-877efa839a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.537661 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296798f-f5e2-48cf-ac15-877efa839a64 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-9a2e993c-3088-4c6d-b0b1-02fc4e808cb6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:28.537908 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:28.539207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:28.540140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 425/857] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:28.546376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e993c-3088-4c6d-b0b1-02fc4e808cb6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.558717 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 433/858] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.562779 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296798f-f5e2-48cf-ac15-877efa839a64 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.580075 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.597074 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.674459 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296798f-f5e2-48cf-ac15-877efa839a64 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.693828 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e993c-3088-4c6d-b0b1-02fc4e808cb6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.716844 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ed788-c4e9-4033-81ca-91bc04555834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.717977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ed788-c4e9-4033-81ca-91bc04555834 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.718466 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ed788-c4e9-4033-81ca-91bc04555834 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.719108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ed788-c4e9-4033-81ca-91bc04555834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.732269 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ed788-c4e9-4033-81ca-91bc04555834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.734404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ed788-c4e9-4033-81ca-91bc04555834 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.737255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b8905-635e-4862-8bc3-1da9082c48ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.737945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b8905-635e-4862-8bc3-1da9082c48ed None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.738227 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b8905-635e-4862-8bc3-1da9082c48ed None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.738504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b8905-635e-4862-8bc3-1da9082c48ed None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.739250 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b8905-635e-4862-8bc3-1da9082c48ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.739562 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b8905-635e-4862-8bc3-1da9082c48ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.740940 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b8905-635e-4862-8bc3-1da9082c48ed None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.750950 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 426/859] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.751899 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b8905-635e-4862-8bc3-1da9082c48ed None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-461ed788-c4e9-4033-81ca-91bc04555834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:28.756694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:28.757714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:28.758729 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:28.758729 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:28.758729 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:28.758729 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:28.761219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 434/860] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:28.768303 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ed788-c4e9-4033-81ca-91bc04555834 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.867132 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.900288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.903839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ed788-c4e9-4033-81ca-91bc04555834 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.909247 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b8905-635e-4862-8bc3-1da9082c48ed None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.953603 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070d078-3a26-4a92-8add-76125f20503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.954287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070d078-3a26-4a92-8add-76125f20503e None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.954578 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070d078-3a26-4a92-8add-76125f20503e None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.954902 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070d078-3a26-4a92-8add-76125f20503e None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.956359 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070d078-3a26-4a92-8add-76125f20503e None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.956983 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070d078-3a26-4a92-8add-76125f20503e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.958990 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070d078-3a26-4a92-8add-76125f20503e None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.962885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7c2e3-463d-4d3a-9ce3-69344c802fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.963867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7c2e3-463d-4d3a-9ce3-69344c802fc3 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.964374 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7c2e3-463d-4d3a-9ce3-69344c802fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.964870 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7c2e3-463d-4d3a-9ce3-69344c802fc3 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.965819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7c2e3-463d-4d3a-9ce3-69344c802fc3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.966332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7c2e3-463d-4d3a-9ce3-69344c802fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.968798 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7c2e3-463d-4d3a-9ce3-69344c802fc3 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.981094 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 435/861] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.981736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 427/862] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.982110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070d078-3a26-4a92-8add-76125f20503e None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.123125 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070d078-3a26-4a92-8add-76125f20503e None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.153556 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:29.166742 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc09b1-eeae-439c-a583-44a63d636ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.167598 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc09b1-eeae-439c-a583-44a63d636ced None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.167882 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc09b1-eeae-439c-a583-44a63d636ced None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.168158 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc09b1-eeae-439c-a583-44a63d636ced None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.177221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc09b1-eeae-439c-a583-44a63d636ced None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.178744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc09b1-eeae-439c-a583-44a63d636ced None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-a5cc09b1-eeae-439c-a583-44a63d636ced None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:29.195302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:29.196442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:29.197483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:29.197483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:29.197483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:29.197483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:29.197483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:29.197483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:29.197483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:29.197483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:29.197483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:29.197483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:29.197483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 436/863] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:29.207920 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7c2e3-463d-4d3a-9ce3-69344c802fc3 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.324244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7c2e3-463d-4d3a-9ce3-69344c802fc3 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.378738 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622dec-f775-440b-b833-ef1136a727a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.379450 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622dec-f775-440b-b833-ef1136a727a2 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.379737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622dec-f775-440b-b833-ef1136a727a2 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.380021 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622dec-f775-440b-b833-ef1136a727a2 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.380883 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8622dec-f775-440b-b833-ef1136a727a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:29.381199 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8622dec-f775-440b-b833-ef1136a727a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.382678 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8622dec-f775-440b-b833-ef1136a727a2 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.405176 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 428/864] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:29.411042 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc09b1-eeae-439c-a583-44a63d636ced None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.530385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc09b1-eeae-439c-a583-44a63d636ced None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.574807 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f3b49-9d37-4782-b2ed-3e88747ed787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.574807 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f3b49-9d37-4782-b2ed-3e88747ed787 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.574807 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f3b49-9d37-4782-b2ed-3e88747ed787 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.574807 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f3b49-9d37-4782-b2ed-3e88747ed787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.627888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:29.645530 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f3b49-9d37-4782-b2ed-3e88747ed787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.652702 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f3b49-9d37-4782-b2ed-3e88747ed787 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.757744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 437/865] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:25:29.769717 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622dec-f775-440b-b833-ef1136a727a2 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.821491 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:29.970539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622dec-f775-440b-b833-ef1136a727a2 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.026391 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658e66-fb8d-43ec-930c-14eb8dc6b17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.027246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658e66-fb8d-43ec-930c-14eb8dc6b17d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.028289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658e66-fb8d-43ec-930c-14eb8dc6b17d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.028289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658e66-fb8d-43ec-930c-14eb8dc6b17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.054464 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed658e66-fb8d-43ec-930c-14eb8dc6b17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.055989 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed658e66-fb8d-43ec-930c-14eb8dc6b17d None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-ed658e66-fb8d-43ec-930c-14eb8dc6b17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:30.096850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:30.097919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:30.098931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:30.098931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:30.098931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:30.098931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:30.104136 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 429/866] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:30.105146 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f3b49-9d37-4782-b2ed-3e88747ed787 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.279086 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:30.285494 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f3b49-9d37-4782-b2ed-3e88747ed787 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.321481 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951df4c3-8930-48a5-b6d0-f8b6b9317365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.322156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951df4c3-8930-48a5-b6d0-f8b6b9317365 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.322437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951df4c3-8930-48a5-b6d0-f8b6b9317365 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.322746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951df4c3-8930-48a5-b6d0-f8b6b9317365 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.323490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951df4c3-8930-48a5-b6d0-f8b6b9317365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:30.324220 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951df4c3-8930-48a5-b6d0-f8b6b9317365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.325673 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951df4c3-8930-48a5-b6d0-f8b6b9317365 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.338487 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 438/867] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:30.344818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658e66-fb8d-43ec-930c-14eb8dc6b17d None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.425327 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:30.467068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658e66-fb8d-43ec-930c-14eb8dc6b17d None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.507428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee1396-4222-41e2-8839-a2ec2ee1deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.508598 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee1396-4222-41e2-8839-a2ec2ee1deb2 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.509101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee1396-4222-41e2-8839-a2ec2ee1deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.509583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee1396-4222-41e2-8839-a2ec2ee1deb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.518370 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee1396-4222-41e2-8839-a2ec2ee1deb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.520156 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee1396-4222-41e2-8839-a2ec2ee1deb2 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-ecee1396-4222-41e2-8839-a2ec2ee1deb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:30.535850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:30.536862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:30.537831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:30.537831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:30.537831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:30.537831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:30.537831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:30.537831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:30.537831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:30.537831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:30.540241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 430/868] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:30.546365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951df4c3-8930-48a5-b6d0-f8b6b9317365 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.619817 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659242-ded5-4627-b146-eddc85cdf5ad None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.620106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659242-ded5-4627-b146-eddc85cdf5ad None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.620394 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659242-ded5-4627-b146-eddc85cdf5ad None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.623246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 431/869] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:30.627586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19410e1-d05e-45e5-a584-fd46447ff618 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.627887 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19410e1-d05e-45e5-a584-fd46447ff618 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.628177 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19410e1-d05e-45e5-a584-fd46447ff618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.646858 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-b19410e1-d05e-45e5-a584-fd46447ff618 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:30.648481 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-b19410e1-d05e-45e5-a584-fd46447ff618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:30.669758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951df4c3-8930-48a5-b6d0-f8b6b9317365 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.709192 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f70b2a-6ba2-4ff4-a8fa-f097f0938ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.709897 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70b2a-6ba2-4ff4-a8fa-f097f0938ab9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.710184 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70b2a-6ba2-4ff4-a8fa-f097f0938ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.710460 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70b2a-6ba2-4ff4-a8fa-f097f0938ab9 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.711335 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f70b2a-6ba2-4ff4-a8fa-f097f0938ab9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:30.711655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f70b2a-6ba2-4ff4-a8fa-f097f0938ab9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.713143 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f70b2a-6ba2-4ff4-a8fa-f097f0938ab9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.728926 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 439/870] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:30.730326 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083c066-d0c3-4b3d-8e38-c9a6849948a8 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.730638 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083c066-d0c3-4b3d-8e38-c9a6849948a8 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.730978 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083c066-d0c3-4b3d-8e38-c9a6849948a8 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.732480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 440/871] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:30.737470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083c066-d0c3-4b3d-8e38-c9a6849948a8 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.741125 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 432/872] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:30.741423 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed5a3-7b60-4522-bb0a-06244d6c112c None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.741789 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed5a3-7b60-4522-bb0a-06244d6c112c None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.742142 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed5a3-7b60-4522-bb0a-06244d6c112c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.747897 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:30.759981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-2c3ed5a3-7b60-4522-bb0a-06244d6c112c None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:30.761530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-2c3ed5a3-7b60-4522-bb0a-06244d6c112c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:30.850578 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:30.863471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 433/873] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:30.864440 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ed5a3-7b60-4522-bb0a-06244d6c112c None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.890707 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083c066-d0c3-4b3d-8e38-c9a6849948a8 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.938304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939daa5-a047-4276-b31e-d3c20f3d8cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.939110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939daa5-a047-4276-b31e-d3c20f3d8cad None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.939911 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939daa5-a047-4276-b31e-d3c20f3d8cad None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.940199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939daa5-a047-4276-b31e-d3c20f3d8cad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.941042 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939daa5-a047-4276-b31e-d3c20f3d8cad None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=9fdd44a5966c4276b572250fd4147fc9) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:30.941362 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939daa5-a047-4276-b31e-d3c20f3d8cad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.942870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939daa5-a047-4276-b31e-d3c20f3d8cad None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.962658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 441/874] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/role_assignments?user.id=9fdd44a5966c4276b572250fd4147fc9&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:30.962658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939daa5-a047-4276-b31e-d3c20f3d8cad None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.992066 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ed5a3-7b60-4522-bb0a-06244d6c112c None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.045153 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7b6a5-1500-4b14-bdf2-a4e793a2bc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.046010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7b6a5-1500-4b14-bdf2-a4e793a2bc39 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.046299 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7b6a5-1500-4b14-bdf2-a4e793a2bc39 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.046579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7b6a5-1500-4b14-bdf2-a4e793a2bc39 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.047293 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7b6a5-1500-4b14-bdf2-a4e793a2bc39 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.048797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7b6a5-1500-4b14-bdf2-a4e793a2bc39 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-cca7b6a5-1500-4b14-bdf2-a4e793a2bc39 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:31.068376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:31.070471 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:31.072289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 434/875] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:31.075798 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7b6a5-1500-4b14-bdf2-a4e793a2bc39 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.084084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.142695 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.164640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939daa5-a047-4276-b31e-d3c20f3d8cad None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.207497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca5a5b-c6e7-4619-94e1-4913d3dd3fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.207920 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7b6a5-1500-4b14-bdf2-a4e793a2bc39 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.208847 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca5a5b-c6e7-4619-94e1-4913d3dd3fe9 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.209360 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca5a5b-c6e7-4619-94e1-4913d3dd3fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.209876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca5a5b-c6e7-4619-94e1-4913d3dd3fe9 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.210862 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca5a5b-c6e7-4619-94e1-4913d3dd3fe9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.212467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca5a5b-c6e7-4619-94e1-4913d3dd3fe9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.249418 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9ddf2-6d0c-40f4-8e57-933dd1df8bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.250215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9ddf2-6d0c-40f4-8e57-933dd1df8bd8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.250488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9ddf2-6d0c-40f4-8e57-933dd1df8bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.250793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9ddf2-6d0c-40f4-8e57-933dd1df8bd8 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.251553 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9ddf2-6d0c-40f4-8e57-933dd1df8bd8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:31.251951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9ddf2-6d0c-40f4-8e57-933dd1df8bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.253421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9ddf2-6d0c-40f4-8e57-933dd1df8bd8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.259391 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 435/876] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:25:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:31.264955 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9ddf2-6d0c-40f4-8e57-933dd1df8bd8 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.278891 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 442/877] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:25:30 2022] POST /identity/v3/services => generated 251 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:31.397534 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9ddf2-6d0c-40f4-8e57-933dd1df8bd8 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.430497 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.447746 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1cef4-c869-4473-82ca-bca2adcdcd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.448465 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1cef4-c869-4473-82ca-bca2adcdcd6c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.448756 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1cef4-c869-4473-82ca-bca2adcdcd6c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.449039 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1cef4-c869-4473-82ca-bca2adcdcd6c None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.449790 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1cef4-c869-4473-82ca-bca2adcdcd6c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:31.450330 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1cef4-c869-4473-82ca-bca2adcdcd6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.451808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1cef4-c869-4473-82ca-bca2adcdcd6c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.458850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 436/878] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:25:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:31.668511 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ae1a-e9ed-4166-a41c-436f1c89ecdf None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.669037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ae1a-e9ed-4166-a41c-436f1c89ecdf None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.669239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ae1a-e9ed-4166-a41c-436f1c89ecdf None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.670944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 443/879] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:31.676732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c180fd-5a5b-4204-85fc-8a8907a40987 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.677016 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c180fd-5a5b-4204-85fc-8a8907a40987 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.677298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c180fd-5a5b-4204-85fc-8a8907a40987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.695691 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-c4c180fd-5a5b-4204-85fc-8a8907a40987 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:31.696893 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-c4c180fd-5a5b-4204-85fc-8a8907a40987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:31.769975 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 437/880] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:31.792758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ae1a-e9ed-4166-a41c-436f1c89ecdf None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.915596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ae1a-e9ed-4166-a41c-436f1c89ecdf None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.944745 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.953604 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b6936-8264-4815-a800-a0d7b0b9557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.954280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b6936-8264-4815-a800-a0d7b0b9557a None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.954683 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b6936-8264-4815-a800-a0d7b0b9557a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.955077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b6936-8264-4815-a800-a0d7b0b9557a None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.967045 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b6936-8264-4815-a800-a0d7b0b9557a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.967045 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b6936-8264-4815-a800-a0d7b0b9557a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:32.075414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 444/881] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:25:31 2022] POST /identity/v3/services => generated 269 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:33.494104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430c886-eaf8-4524-b1d7-a5c6b9d6d3c1 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.495153 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430c886-eaf8-4524-b1d7-a5c6b9d6d3c1 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.495669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430c886-eaf8-4524-b1d7-a5c6b9d6d3c1 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.497599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 438/882] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:33.504480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9203-b3fc-436d-9f8d-3122de20ae37 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.505401 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9203-b3fc-436d-9f8d-3122de20ae37 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.505893 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9203-b3fc-436d-9f8d-3122de20ae37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.523532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-851b9203-b3fc-436d-9f8d-3122de20ae37 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:33.525227 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-851b9203-b3fc-436d-9f8d-3122de20ae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:33.604493 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 445/883] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:33.630056 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430c886-eaf8-4524-b1d7-a5c6b9d6d3c1 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:33.674157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aef19-f4aa-44d8-9a67-3ac21e730b2a None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.674508 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aef19-f4aa-44d8-9a67-3ac21e730b2a None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.674779 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aef19-f4aa-44d8-9a67-3ac21e730b2a None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.676565 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 446/884] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:33.683350 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9b9e-09b1-4ff2-b91b-86b1057eb79f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.683639 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9b9e-09b1-4ff2-b91b-86b1057eb79f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.683921 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9b9e-09b1-4ff2-b91b-86b1057eb79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.706408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-34ee9b9e-09b1-4ff2-b91b-86b1057eb79f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:33.707849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-34ee9b9e-09b1-4ff2-b91b-86b1057eb79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:33.750580 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430c886-eaf8-4524-b1d7-a5c6b9d6d3c1 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:33.762630 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:33.789258 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e04e96-c77b-4205-bf5a-013500d158b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:33.790483 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04e96-c77b-4205-bf5a-013500d158b9 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.791150 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04e96-c77b-4205-bf5a-013500d158b9 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.791688 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04e96-c77b-4205-bf5a-013500d158b9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.808981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e04e96-c77b-4205-bf5a-013500d158b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:33.814710 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 447/885] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:33.816240 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b320a-3c32-4b33-b339-135e1d0338ac None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.816538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b320a-3c32-4b33-b339-135e1d0338ac None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.816822 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b320a-3c32-4b33-b339-135e1d0338ac None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-66e04e96-c77b-4205-bf5a-013500d158b9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:33.817332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:33.818335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:25:33.819878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:33.820616 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 448/886] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:33.822917 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 439/887] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:25:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:33.824004 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c288cc-a2a8-4cfe-aa8c-dd547012082e None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.824298 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c288cc-a2a8-4cfe-aa8c-dd547012082e None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.824572 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c288cc-a2a8-4cfe-aa8c-dd547012082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.824741 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e04e96-c77b-4205-bf5a-013500d158b9 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:33.841717 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-75c288cc-a2a8-4cfe-aa8c-dd547012082e None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:33.842988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-75c288cc-a2a8-4cfe-aa8c-dd547012082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:33.898101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:33.929610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 449/888] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:33.930505 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c288cc-a2a8-4cfe-aa8c-dd547012082e None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:33.965112 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e04e96-c77b-4205-bf5a-013500d158b9 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.004470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d052bc-1b3e-4231-8194-8457e489c468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.005703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d052bc-1b3e-4231-8194-8457e489c468 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.006053 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d052bc-1b3e-4231-8194-8457e489c468 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.006332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d052bc-1b3e-4231-8194-8457e489c468 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.007186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d052bc-1b3e-4231-8194-8457e489c468 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:34.007499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d052bc-1b3e-4231-8194-8457e489c468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.008930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d052bc-1b3e-4231-8194-8457e489c468 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.018778 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 440/889] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:25:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:34.019641 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d052bc-1b3e-4231-8194-8457e489c468 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.048595 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c288cc-a2a8-4cfe-aa8c-dd547012082e None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.055398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.091609 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37469b-97f3-4d34-8361-7b836414005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.092420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37469b-97f3-4d34-8361-7b836414005c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.092698 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37469b-97f3-4d34-8361-7b836414005c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.092965 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37469b-97f3-4d34-8361-7b836414005c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.093625 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37469b-97f3-4d34-8361-7b836414005c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.095053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37469b-97f3-4d34-8361-7b836414005c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-6e37469b-97f3-4d34-8361-7b836414005c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:34.108030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:34.114964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:34.116131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 450/890] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:25:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:34.117167 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37469b-97f3-4d34-8361-7b836414005c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.141544 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d052bc-1b3e-4231-8194-8457e489c468 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.158504 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.181581 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef825613-f14a-455c-8661-dc376f957077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.182258 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef825613-f14a-455c-8661-dc376f957077 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.182540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef825613-f14a-455c-8661-dc376f957077 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.182845 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef825613-f14a-455c-8661-dc376f957077 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.183580 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef825613-f14a-455c-8661-dc376f957077 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.185047 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef825613-f14a-455c-8661-dc376f957077 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.239866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37469b-97f3-4d34-8361-7b836414005c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.251828 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 441/891] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:25:34 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:34.264152 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef825613-f14a-455c-8661-dc376f957077 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.302048 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a092da-341e-489e-affa-ef89ae28db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.302895 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a092da-341e-489e-affa-ef89ae28db5b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.303188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a092da-341e-489e-affa-ef89ae28db5b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.303464 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a092da-341e-489e-affa-ef89ae28db5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.316296 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a092da-341e-489e-affa-ef89ae28db5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.318045 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a092da-341e-489e-affa-ef89ae28db5b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-78a092da-341e-489e-affa-ef89ae28db5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:34.338880 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:34.340223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:34.341415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:34.341415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:34.341415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:34.341415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:34.345185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 451/892] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:34.346943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a092da-341e-489e-affa-ef89ae28db5b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.402954 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.415657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef825613-f14a-455c-8661-dc376f957077 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.449817 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.459282 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de44947-d0ab-4fec-92db-3fa523463b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.460366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de44947-d0ab-4fec-92db-3fa523463b77 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.460812 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de44947-d0ab-4fec-92db-3fa523463b77 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.461251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de44947-d0ab-4fec-92db-3fa523463b77 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.462153 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de44947-d0ab-4fec-92db-3fa523463b77 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:34.462635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de44947-d0ab-4fec-92db-3fa523463b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.464468 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de44947-d0ab-4fec-92db-3fa523463b77 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.467818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a092da-341e-489e-affa-ef89ae28db5b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.471014 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 442/893] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:34.472379 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066e44f-dc8b-4cee-a12d-90bb33544faf None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.472669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066e44f-dc8b-4cee-a12d-90bb33544faf None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.472947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066e44f-dc8b-4cee-a12d-90bb33544faf None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.474376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 443/894] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:34.479183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066e44f-dc8b-4cee-a12d-90bb33544faf None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.511722 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaee3d-4a10-43de-a3c8-f52f0fab9093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.512408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaee3d-4a10-43de-a3c8-f52f0fab9093 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.512696 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaee3d-4a10-43de-a3c8-f52f0fab9093 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.512977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaee3d-4a10-43de-a3c8-f52f0fab9093 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.513715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaee3d-4a10-43de-a3c8-f52f0fab9093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:34.514031 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaee3d-4a10-43de-a3c8-f52f0fab9093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.515550 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaee3d-4a10-43de-a3c8-f52f0fab9093 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.528849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 452/895] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:34.530158 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a836-78d9-4c9a-b80f-2aa55ea7315f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.530450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a836-78d9-4c9a-b80f-2aa55ea7315f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.530793 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a836-78d9-4c9a-b80f-2aa55ea7315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.548201 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-44a1a836-78d9-4c9a-b80f-2aa55ea7315f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:34.549434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-44a1a836-78d9-4c9a-b80f-2aa55ea7315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:34.604816 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066e44f-dc8b-4cee-a12d-90bb33544faf None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.622639 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 453/896] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:34.623769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1a836-78d9-4c9a-b80f-2aa55ea7315f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.650133 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d5bc-d5cf-4ef1-964d-9943c5501def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.650853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d5bc-d5cf-4ef1-964d-9943c5501def None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.651165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d5bc-d5cf-4ef1-964d-9943c5501def None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.651414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d5bc-d5cf-4ef1-964d-9943c5501def None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.652131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d5bc-d5cf-4ef1-964d-9943c5501def None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:34.652437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d5bc-d5cf-4ef1-964d-9943c5501def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.653812 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d5bc-d5cf-4ef1-964d-9943c5501def None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.659482 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 444/897] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:34.662797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d5bc-d5cf-4ef1-964d-9943c5501def None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.683295 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.735610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.759916 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1a836-78d9-4c9a-b80f-2aa55ea7315f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.804555 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1fa3d-864d-48cb-b8fc-bcdc4267fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.805657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fa3d-864d-48cb-b8fc-bcdc4267fc89 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.806030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fa3d-864d-48cb-b8fc-bcdc4267fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.806402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fa3d-864d-48cb-b8fc-bcdc4267fc89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.816605 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1fa3d-864d-48cb-b8fc-bcdc4267fc89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.818211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1fa3d-864d-48cb-b8fc-bcdc4267fc89 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.832415 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d5bc-d5cf-4ef1-964d-9943c5501def None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-25b1fa3d-864d-48cb-b8fc-bcdc4267fc89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:34.836581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:34.837680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:34.839185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:34.839185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:34.839185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:34.839185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:34.839185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:34.839185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:34.839185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:34.839185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:34.839185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:34.839185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:34.842719 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 454/898] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:34.843479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1fa3d-864d-48cb-b8fc-bcdc4267fc89 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.877654 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e126c3-c2e8-4090-b504-420f58ea93e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.878489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e126c3-c2e8-4090-b504-420f58ea93e6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.878799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e126c3-c2e8-4090-b504-420f58ea93e6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.879074 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e126c3-c2e8-4090-b504-420f58ea93e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.879738 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e126c3-c2e8-4090-b504-420f58ea93e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.881140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e126c3-c2e8-4090-b504-420f58ea93e6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-06e126c3-c2e8-4090-b504-420f58ea93e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:34.894988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:34.896143 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:34.897061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:34.901672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 445/899] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:34.902666 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e126c3-c2e8-4090-b504-420f58ea93e6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.963334 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1fa3d-864d-48cb-b8fc-bcdc4267fc89 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.005488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.007090 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33fde1-b874-4054-a216-857fe5092b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.007684 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33fde1-b874-4054-a216-857fe5092b57 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.008135 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33fde1-b874-4054-a216-857fe5092b57 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.008415 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33fde1-b874-4054-a216-857fe5092b57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.009235 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33fde1-b874-4054-a216-857fe5092b57 None admin] RBAC: Adding query filter params (interface=public, service_id=f680e1e6e91c49c3a063d7dee0527a11, region_id=RegionOne) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:35.009554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33fde1-b874-4054-a216-857fe5092b57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.010989 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33fde1-b874-4054-a216-857fe5092b57 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.013687 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.021539 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 455/900] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/endpoints?service_id=f680e1e6e91c49c3a063d7dee0527a11&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:35.021539 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33fde1-b874-4054-a216-857fe5092b57 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.031157 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e126c3-c2e8-4090-b504-420f58ea93e6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.076452 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de0c12-435f-4007-9c30-e1af682bb30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.077108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de0c12-435f-4007-9c30-e1af682bb30b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.077399 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de0c12-435f-4007-9c30-e1af682bb30b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.077681 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de0c12-435f-4007-9c30-e1af682bb30b None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.078553 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de0c12-435f-4007-9c30-e1af682bb30b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:35.078901 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de0c12-435f-4007-9c30-e1af682bb30b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.080415 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de0c12-435f-4007-9c30-e1af682bb30b None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.107386 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 446/901] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:35.107386 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de0c12-435f-4007-9c30-e1af682bb30b None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.143721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33fde1-b874-4054-a216-857fe5092b57 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.182812 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d151a-a8f0-434b-b9f6-500bc727eadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.183627 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d151a-a8f0-434b-b9f6-500bc727eadf None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.183899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d151a-a8f0-434b-b9f6-500bc727eadf None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.184178 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d151a-a8f0-434b-b9f6-500bc727eadf None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.185019 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d151a-a8f0-434b-b9f6-500bc727eadf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:35.185331 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d151a-a8f0-434b-b9f6-500bc727eadf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.186742 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d151a-a8f0-434b-b9f6-500bc727eadf None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.197498 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 456/902] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:35.197498 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d151a-a8f0-434b-b9f6-500bc727eadf None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.220932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de0c12-435f-4007-9c30-e1af682bb30b None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.259942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81512e-ae89-4f1c-b143-ddcc1d4ba44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.260691 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81512e-ae89-4f1c-b143-ddcc1d4ba44c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.260981 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81512e-ae89-4f1c-b143-ddcc1d4ba44c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.261262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81512e-ae89-4f1c-b143-ddcc1d4ba44c None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.262085 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81512e-ae89-4f1c-b143-ddcc1d4ba44c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.263548 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81512e-ae89-4f1c-b143-ddcc1d4ba44c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.267384 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.269747 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 447/903] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:25:35.270558 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81512e-ae89-4f1c-b143-ddcc1d4ba44c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.285424 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.329916 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d151a-a8f0-434b-b9f6-500bc727eadf None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.382271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cb807-b969-43ec-93eb-a2239f701a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.383563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cb807-b969-43ec-93eb-a2239f701a78 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.383695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cb807-b969-43ec-93eb-a2239f701a78 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.383984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cb807-b969-43ec-93eb-a2239f701a78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.428508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81512e-ae89-4f1c-b143-ddcc1d4ba44c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.480337 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cb807-b969-43ec-93eb-a2239f701a78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.481845 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cb807-b969-43ec-93eb-a2239f701a78 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.485168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eec23e-2790-4b16-a94d-d812ba83aa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.486768 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eec23e-2790-4b16-a94d-d812ba83aa85 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.487342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eec23e-2790-4b16-a94d-d812ba83aa85 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.487847 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eec23e-2790-4b16-a94d-d812ba83aa85 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.489620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eec23e-2790-4b16-a94d-d812ba83aa85 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:35.490165 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eec23e-2790-4b16-a94d-d812ba83aa85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.491857 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eec23e-2790-4b16-a94d-d812ba83aa85 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.497845 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 448/904] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:35.506288 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eec23e-2790-4b16-a94d-d812ba83aa85 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.574704 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.602628 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.638333 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 457/905] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:25:35.644861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cb807-b969-43ec-93eb-a2239f701a78 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.646073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eec23e-2790-4b16-a94d-d812ba83aa85 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.694696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9da1a0-a9e0-4f62-8291-81085cbb06c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.696131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9da1a0-a9e0-4f62-8291-81085cbb06c0 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.696522 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9da1a0-a9e0-4f62-8291-81085cbb06c0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.696902 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9da1a0-a9e0-4f62-8291-81085cbb06c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.698258 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9da1a0-a9e0-4f62-8291-81085cbb06c0 None admin] RBAC: Adding query filter params (interface=public, service_id=3f6584fb2346445497a4b32adca1280f, region_id=RegionOne) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:35.698706 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9da1a0-a9e0-4f62-8291-81085cbb06c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.700945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9da1a0-a9e0-4f62-8291-81085cbb06c0 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.709411 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 449/906] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/endpoints?service_id=3f6584fb2346445497a4b32adca1280f&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:35.715993 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9da1a0-a9e0-4f62-8291-81085cbb06c0 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.801448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cb807-b969-43ec-93eb-a2239f701a78 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.843667 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9da1a0-a9e0-4f62-8291-81085cbb06c0 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.847140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59b5c5-f661-40be-9cfb-3f126fce14b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.848854 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b5c5-f661-40be-9cfb-3f126fce14b5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.849144 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b5c5-f661-40be-9cfb-3f126fce14b5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.849425 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b5c5-f661-40be-9cfb-3f126fce14b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.863366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59b5c5-f661-40be-9cfb-3f126fce14b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.865162 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59b5c5-f661-40be-9cfb-3f126fce14b5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.880537 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-6c59b5c5-f661-40be-9cfb-3f126fce14b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:35.886101 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:35.891898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:35.893486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:35.893486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:35.893486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:35.893486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:35.893791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5523a-cc7d-4829-968e-15f3c405df82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.893791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5523a-cc7d-4829-968e-15f3c405df82 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.893979 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 458/907] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:35.894073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5523a-cc7d-4829-968e-15f3c405df82 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.894073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5523a-cc7d-4829-968e-15f3c405df82 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.894073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5523a-cc7d-4829-968e-15f3c405df82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.894073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5523a-cc7d-4829-968e-15f3c405df82 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.896443 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59b5c5-f661-40be-9cfb-3f126fce14b5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.902540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 450/908] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 20:25:35.943029 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:36.053824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59b5c5-f661-40be-9cfb-3f126fce14b5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.095625 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db27218-4d66-4cab-917d-99a1c56049fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.096317 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db27218-4d66-4cab-917d-99a1c56049fc None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.096660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db27218-4d66-4cab-917d-99a1c56049fc None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.096935 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db27218-4d66-4cab-917d-99a1c56049fc None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.097748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db27218-4d66-4cab-917d-99a1c56049fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:36.098062 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db27218-4d66-4cab-917d-99a1c56049fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.099515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db27218-4d66-4cab-917d-99a1c56049fc None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.112833 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 459/909] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:36.119266 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5523a-cc7d-4829-968e-15f3c405df82 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.229891 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5523a-cc7d-4829-968e-15f3c405df82 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.265836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108086e-8856-4611-b7c0-90bf40074e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.266672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108086e-8856-4611-b7c0-90bf40074e3a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.266960 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108086e-8856-4611-b7c0-90bf40074e3a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.267789 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108086e-8856-4611-b7c0-90bf40074e3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.274983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108086e-8856-4611-b7c0-90bf40074e3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.276439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108086e-8856-4611-b7c0-90bf40074e3a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-4108086e-8856-4611-b7c0-90bf40074e3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:36.291559 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:36.292697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:36.293679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:36.293679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:36.293679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:36.293679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:36.293679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:36.293679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:36.293679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:36.293679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:36.293679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 451/910] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:36.299037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db27218-4d66-4cab-917d-99a1c56049fc None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.385556 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:36.409614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db27218-4d66-4cab-917d-99a1c56049fc None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.450325 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac363aa-be3c-4bfb-a9a6-367b082c502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.451093 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac363aa-be3c-4bfb-a9a6-367b082c502c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.451377 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac363aa-be3c-4bfb-a9a6-367b082c502c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.451651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac363aa-be3c-4bfb-a9a6-367b082c502c None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.452473 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac363aa-be3c-4bfb-a9a6-367b082c502c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:36.452790 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac363aa-be3c-4bfb-a9a6-367b082c502c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.454283 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac363aa-be3c-4bfb-a9a6-367b082c502c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.469440 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 460/911] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:36.475024 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108086e-8856-4611-b7c0-90bf40074e3a None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.539137 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:36.584851 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108086e-8856-4611-b7c0-90bf40074e3a None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.620389 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb21c91-8aa9-46aa-be17-6722bebfbab3 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.620917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb21c91-8aa9-46aa-be17-6722bebfbab3 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.620917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb21c91-8aa9-46aa-be17-6722bebfbab3 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.621959 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1933a-c0a8-4036-b64f-057af67e9295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.622456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 461/912] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:36.622673 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1933a-c0a8-4036-b64f-057af67e9295 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.623942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1933a-c0a8-4036-b64f-057af67e9295 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.623942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1933a-c0a8-4036-b64f-057af67e9295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.624139 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1933a-c0a8-4036-b64f-057af67e9295 None admin] RBAC: Adding query filter params (role.id=4929d71337674b21b9c568fd0cf3b00f, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=9fdd44a5966c4276b572250fd4147fc9) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:36.624339 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1933a-c0a8-4036-b64f-057af67e9295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.625788 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1933a-c0a8-4036-b64f-057af67e9295 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.629556 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8434b-a812-4d59-b339-8b2aa76da12a None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.630128 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8434b-a812-4d59-b339-8b2aa76da12a None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.630659 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8434b-a812-4d59-b339-8b2aa76da12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.632751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 452/913] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/role_assignments?user.id=9fdd44a5966c4276b572250fd4147fc9&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=4929d71337674b21b9c568fd0cf3b00f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:36.649718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-3fc8434b-a812-4d59-b339-8b2aa76da12a None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:36.651395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-3fc8434b-a812-4d59-b339-8b2aa76da12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:36.734500 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 462/914] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:36.758520 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1933a-c0a8-4036-b64f-057af67e9295 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.884687 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1933a-c0a8-4036-b64f-057af67e9295 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.906063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:36.921586 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc392f-69d0-48d5-8326-d7cdea8600a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.922414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc392f-69d0-48d5-8326-d7cdea8600a0 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.922716 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc392f-69d0-48d5-8326-d7cdea8600a0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.923092 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc392f-69d0-48d5-8326-d7cdea8600a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.924283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc392f-69d0-48d5-8326-d7cdea8600a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.925721 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc392f-69d0-48d5-8326-d7cdea8600a0 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-dbdc392f-69d0-48d5-8326-d7cdea8600a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:36.943291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:36.944433 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:36.945388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 453/915] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:36.953040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8434b-a812-4d59-b339-8b2aa76da12a None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.022826 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.062134 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8434b-a812-4d59-b339-8b2aa76da12a None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.103480 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08e53-690c-4f00-8c5b-3886ffcc02a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.104171 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08e53-690c-4f00-8c5b-3886ffcc02a9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.104453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08e53-690c-4f00-8c5b-3886ffcc02a9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.104730 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08e53-690c-4f00-8c5b-3886ffcc02a9 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.105460 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08e53-690c-4f00-8c5b-3886ffcc02a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:37.105770 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08e53-690c-4f00-8c5b-3886ffcc02a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.107223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08e53-690c-4f00-8c5b-3886ffcc02a9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.113861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 463/916] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:37.119470 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc392f-69d0-48d5-8326-d7cdea8600a0 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.230331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc392f-69d0-48d5-8326-d7cdea8600a0 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.272127 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157efbd-527e-4945-8627-dffc982f28db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.273133 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157efbd-527e-4945-8627-dffc982f28db None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.273604 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157efbd-527e-4945-8627-dffc982f28db None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.274057 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157efbd-527e-4945-8627-dffc982f28db None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.275026 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157efbd-527e-4945-8627-dffc982f28db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:37.275514 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157efbd-527e-4945-8627-dffc982f28db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.277295 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157efbd-527e-4945-8627-dffc982f28db None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.284196 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 454/917] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:37.295371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08e53-690c-4f00-8c5b-3886ffcc02a9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.403736 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08e53-690c-4f00-8c5b-3886ffcc02a9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.434988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.441616 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d40300-fd37-4885-8db9-f58e9b33e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.442282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d40300-fd37-4885-8db9-f58e9b33e4cb None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.442566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d40300-fd37-4885-8db9-f58e9b33e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.442888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d40300-fd37-4885-8db9-f58e9b33e4cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.443686 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d40300-fd37-4885-8db9-f58e9b33e4cb None admin] RBAC: Adding query filter params (interface=public, service_id=dbcb6f8bc4eb4912a3d68a8419c28424, region_id=RegionOne) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:37.444001 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d40300-fd37-4885-8db9-f58e9b33e4cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.445389 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d40300-fd37-4885-8db9-f58e9b33e4cb None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.451122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 464/918] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/endpoints?service_id=dbcb6f8bc4eb4912a3d68a8419c28424&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:37.456577 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157efbd-527e-4945-8627-dffc982f28db None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.518870 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.577098 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157efbd-527e-4945-8627-dffc982f28db None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.614970 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299af256-4623-4bdc-ba1e-26530166fbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.615658 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299af256-4623-4bdc-ba1e-26530166fbde None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.615948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299af256-4623-4bdc-ba1e-26530166fbde None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.616231 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299af256-4623-4bdc-ba1e-26530166fbde None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.616929 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299af256-4623-4bdc-ba1e-26530166fbde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.618305 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299af256-4623-4bdc-ba1e-26530166fbde None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.625035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 455/919] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:25:37.736988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47734c40-aac9-4a1d-b967-bec613c959e9 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.737517 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47734c40-aac9-4a1d-b967-bec613c959e9 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.737517 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47734c40-aac9-4a1d-b967-bec613c959e9 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.739269 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 465/920] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:37.745129 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1763388-e511-4fee-b6a7-045c944053c7 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.745502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1763388-e511-4fee-b6a7-045c944053c7 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.745692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1763388-e511-4fee-b6a7-045c944053c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.764357 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-d1763388-e511-4fee-b6a7-045c944053c7 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:37.765604 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-d1763388-e511-4fee-b6a7-045c944053c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:37.855747 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 456/921] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:37.880891 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47734c40-aac9-4a1d-b967-bec613c959e9 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.006843 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47734c40-aac9-4a1d-b967-bec613c959e9 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.065193 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7366e-e891-47a5-84ad-87d84af21d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.065936 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7366e-e891-47a5-84ad-87d84af21d2d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.066220 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7366e-e891-47a5-84ad-87d84af21d2d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.066495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7366e-e891-47a5-84ad-87d84af21d2d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.067400 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7366e-e891-47a5-84ad-87d84af21d2d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.069869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7366e-e891-47a5-84ad-87d84af21d2d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-ffa7366e-e891-47a5-84ad-87d84af21d2d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:38.090740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:38.092275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:38.093274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 466/922] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:38.098458 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1763388-e511-4fee-b6a7-045c944053c7 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.148596 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:38.215446 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1763388-e511-4fee-b6a7-045c944053c7 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.256393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fda440-edcc-48bb-ab1a-48370d698e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.257473 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fda440-edcc-48bb-ab1a-48370d698e2f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.258012 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fda440-edcc-48bb-ab1a-48370d698e2f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.258505 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fda440-edcc-48bb-ab1a-48370d698e2f None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.259543 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fda440-edcc-48bb-ab1a-48370d698e2f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:38.260083 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fda440-edcc-48bb-ab1a-48370d698e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.261720 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fda440-edcc-48bb-ab1a-48370d698e2f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.268254 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 457/923] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:38.276755 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7366e-e891-47a5-84ad-87d84af21d2d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.355999 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:38.412952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7366e-e891-47a5-84ad-87d84af21d2d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.453363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f0239-0c79-4cf7-84d6-53e7652c731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.454043 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f0239-0c79-4cf7-84d6-53e7652c731d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.454326 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f0239-0c79-4cf7-84d6-53e7652c731d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.454703 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f0239-0c79-4cf7-84d6-53e7652c731d None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.455438 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f0239-0c79-4cf7-84d6-53e7652c731d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:38.455750 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f0239-0c79-4cf7-84d6-53e7652c731d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.457138 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f0239-0c79-4cf7-84d6-53e7652c731d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.463105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 467/924] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:38.468563 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fda440-edcc-48bb-ab1a-48370d698e2f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.538821 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c8c8-c3da-4a75-b93e-16156f20d928 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.539175 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c8c8-c3da-4a75-b93e-16156f20d928 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.539513 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c8c8-c3da-4a75-b93e-16156f20d928 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.541343 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 468/925] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:38.547083 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be7470-20ff-496b-aaa6-2ac386641707 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.547427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be7470-20ff-496b-aaa6-2ac386641707 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.547644 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be7470-20ff-496b-aaa6-2ac386641707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.567301 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-f3be7470-20ff-496b-aaa6-2ac386641707 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:38.568536 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-f3be7470-20ff-496b-aaa6-2ac386641707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:38.588164 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fda440-edcc-48bb-ab1a-48370d698e2f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.598064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:38.634455 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940c7c1-8c0a-44ee-b761-0738fb8530a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.635224 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940c7c1-8c0a-44ee-b761-0738fb8530a1 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.635511 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940c7c1-8c0a-44ee-b761-0738fb8530a1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.635779 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940c7c1-8c0a-44ee-b761-0738fb8530a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.636558 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940c7c1-8c0a-44ee-b761-0738fb8530a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.638073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940c7c1-8c0a-44ee-b761-0738fb8530a1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.659558 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 469/926] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:38.684317 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be7470-20ff-496b-aaa6-2ac386641707 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.726920 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 458/927] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:25:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:38.758951 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:38.822998 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be7470-20ff-496b-aaa6-2ac386641707 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.876852 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631ce19-1ace-4c88-9e5c-cc0c6c8ffd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.878248 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ce19-1ace-4c88-9e5c-cc0c6c8ffd6c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.878819 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ce19-1ace-4c88-9e5c-cc0c6c8ffd6c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.879348 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ce19-1ace-4c88-9e5c-cc0c6c8ffd6c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.880279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631ce19-1ace-4c88-9e5c-cc0c6c8ffd6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.882015 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631ce19-1ace-4c88-9e5c-cc0c6c8ffd6c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-b631ce19-1ace-4c88-9e5c-cc0c6c8ffd6c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:38.897181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:38.898282 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:38.899271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:38.902576 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 470/928] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:38.909900 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940c7c1-8c0a-44ee-b761-0738fb8530a1 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.033894 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940c7c1-8c0a-44ee-b761-0738fb8530a1 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.073432 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b8592-a90d-4ba4-ad34-e518800a406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.074592 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b8592-a90d-4ba4-ad34-e518800a406d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.075185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b8592-a90d-4ba4-ad34-e518800a406d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.075690 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b8592-a90d-4ba4-ad34-e518800a406d None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.076679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b8592-a90d-4ba4-ad34-e518800a406d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:39.077204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b8592-a90d-4ba4-ad34-e518800a406d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.078855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b8592-a90d-4ba4-ad34-e518800a406d None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.085103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 459/929] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:39.091280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631ce19-1ace-4c88-9e5c-cc0c6c8ffd6c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.210018 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e842cb-c007-4fed-81c4-b3e361da0237 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.210206 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e842cb-c007-4fed-81c4-b3e361da0237 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.210483 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e842cb-c007-4fed-81c4-b3e361da0237 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.217244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 460/930] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:39.218635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a611ae-62f9-445b-aceb-5d7a335a330f None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.218945 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a611ae-62f9-445b-aceb-5d7a335a330f None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.219230 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a611ae-62f9-445b-aceb-5d7a335a330f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.219561 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631ce19-1ace-4c88-9e5c-cc0c6c8ffd6c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.237549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:39.242447 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-39a611ae-62f9-445b-aceb-5d7a335a330f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:39.244105 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-39a611ae-62f9-445b-aceb-5d7a335a330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:39.260753 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d492012-eb94-4cc1-b62e-ccab49c9e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.261334 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492012-eb94-4cc1-b62e-ccab49c9e912 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.261617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492012-eb94-4cc1-b62e-ccab49c9e912 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.261895 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d492012-eb94-4cc1-b62e-ccab49c9e912 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.262626 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d492012-eb94-4cc1-b62e-ccab49c9e912 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:39.262947 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d492012-eb94-4cc1-b62e-ccab49c9e912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.264340 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d492012-eb94-4cc1-b62e-ccab49c9e912 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.272316 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 471/931] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:25:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:39.283302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:39.283469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d492012-eb94-4cc1-b62e-ccab49c9e912 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.354168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 461/932] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:39.383023 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a611ae-62f9-445b-aceb-5d7a335a330f None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.408402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d492012-eb94-4cc1-b62e-ccab49c9e912 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.459898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec60df9-982a-44a0-a68d-8824fb171e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.460645 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec60df9-982a-44a0-a68d-8824fb171e3a None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.460869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec60df9-982a-44a0-a68d-8824fb171e3a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.461146 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec60df9-982a-44a0-a68d-8824fb171e3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.462257 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec60df9-982a-44a0-a68d-8824fb171e3a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.464011 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec60df9-982a-44a0-a68d-8824fb171e3a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.504238 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a611ae-62f9-445b-aceb-5d7a335a330f None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.545091 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e36a6-ebe1-4216-a357-ded10832c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.545939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e36a6-ebe1-4216-a357-ded10832c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.546225 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e36a6-ebe1-4216-a357-ded10832c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.546502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e36a6-ebe1-4216-a357-ded10832c0a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.558926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e36a6-ebe1-4216-a357-ded10832c0a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-d13e36a6-ebe1-4216-a357-ded10832c0a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:39.567510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:39.568634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:39.569550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 462/933] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:25:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:39.574645 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e36a6-ebe1-4216-a357-ded10832c0a7 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.580530 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 472/934] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:25:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:25:39.600406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:39.714323 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e36a6-ebe1-4216-a357-ded10832c0a7 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.764732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd1fe7-19a3-41b1-80de-ae5e861cc1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.765844 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1fe7-19a3-41b1-80de-ae5e861cc1b6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.766361 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1fe7-19a3-41b1-80de-ae5e861cc1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.766887 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1fe7-19a3-41b1-80de-ae5e861cc1b6 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.767929 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd1fe7-19a3-41b1-80de-ae5e861cc1b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:39.768463 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd1fe7-19a3-41b1-80de-ae5e861cc1b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.770111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd1fe7-19a3-41b1-80de-ae5e861cc1b6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.780703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 463/935] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:25:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:39.786807 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec60df9-982a-44a0-a68d-8824fb171e3a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.828150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:39.922799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec60df9-982a-44a0-a68d-8824fb171e3a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.990949 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76703b71-f7fe-4252-b1f6-b23198b6e0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.992204 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703b71-f7fe-4252-b1f6-b23198b6e0e6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.992694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703b71-f7fe-4252-b1f6-b23198b6e0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.993183 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703b71-f7fe-4252-b1f6-b23198b6e0e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.015378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76703b71-f7fe-4252-b1f6-b23198b6e0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.018775 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76703b71-f7fe-4252-b1f6-b23198b6e0e6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-76703b71-f7fe-4252-b1f6-b23198b6e0e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:40.048395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:40.050221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:40.052393 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:40.052393 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:40.052393 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:40.052393 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:40.052393 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 473/936] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:40.059001 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd1fe7-19a3-41b1-80de-ae5e861cc1b6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.159983 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532478-246d-417b-83c1-4a123a0c3ad4 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.160254 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532478-246d-417b-83c1-4a123a0c3ad4 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.160598 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532478-246d-417b-83c1-4a123a0c3ad4 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.162226 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 474/937] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:40.167799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14264-74d1-4229-a2d6-f839155c27e9 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.168093 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14264-74d1-4229-a2d6-f839155c27e9 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.168345 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14264-74d1-4229-a2d6-f839155c27e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.187566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-9ad14264-74d1-4229-a2d6-f839155c27e9 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:40.188717 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-9ad14264-74d1-4229-a2d6-f839155c27e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:40.203108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:40.251274 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd1fe7-19a3-41b1-80de-ae5e861cc1b6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:40.278630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 475/938] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:40.301695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad14264-74d1-4229-a2d6-f839155c27e9 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.311755 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22a663-7c1d-4df2-b455-6662991dde21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:40.313136 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22a663-7c1d-4df2-b455-6662991dde21 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.313659 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22a663-7c1d-4df2-b455-6662991dde21 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.314293 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22a663-7c1d-4df2-b455-6662991dde21 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.315355 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22a663-7c1d-4df2-b455-6662991dde21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:40.315786 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22a663-7c1d-4df2-b455-6662991dde21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.317355 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22a663-7c1d-4df2-b455-6662991dde21 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.327526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:40.331800 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 464/939] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:40.338311 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22a663-7c1d-4df2-b455-6662991dde21 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.424121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad14264-74d1-4229-a2d6-f839155c27e9 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:40.467196 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22a663-7c1d-4df2-b455-6662991dde21 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:40.467786 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d580abe-0477-40e4-81c2-42206757c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:40.469148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d580abe-0477-40e4-81c2-42206757c68b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.471138 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d580abe-0477-40e4-81c2-42206757c68b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.471647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d580abe-0477-40e4-81c2-42206757c68b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.472549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d580abe-0477-40e4-81c2-42206757c68b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.474173 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d580abe-0477-40e4-81c2-42206757c68b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-8d580abe-0477-40e4-81c2-42206757c68b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:40.491954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:40.493119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:40.494047 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:40.498641 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 476/940] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:40.504515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d580abe-0477-40e4-81c2-42206757c68b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.516828 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88173128-6dfb-41ed-a33d-ef4e165d0db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:40.518502 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173128-6dfb-41ed-a33d-ef4e165d0db7 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.519034 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173128-6dfb-41ed-a33d-ef4e165d0db7 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.519525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173128-6dfb-41ed-a33d-ef4e165d0db7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.522250 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:40.529170 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88173128-6dfb-41ed-a33d-ef4e165d0db7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.530939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88173128-6dfb-41ed-a33d-ef4e165d0db7 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-88173128-6dfb-41ed-a33d-ef4e165d0db7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:40.547859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:40.549046 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:40.550090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:40.550090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:40.550090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:40.550090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:40.550090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:40.550090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:40.550090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:40.550090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:40.550090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:40.550090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:40.553225 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 465/941] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:40.559028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88173128-6dfb-41ed-a33d-ef4e165d0db7 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.621119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:40.652099 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d580abe-0477-40e4-81c2-42206757c68b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:40.677522 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88173128-6dfb-41ed-a33d-ef4e165d0db7 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:40.697336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0e70b-dd04-4b7d-a75d-4cf6ae9c850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:40.698396 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0e70b-dd04-4b7d-a75d-4cf6ae9c850b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.698953 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0e70b-dd04-4b7d-a75d-4cf6ae9c850b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.699461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0e70b-dd04-4b7d-a75d-4cf6ae9c850b None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.700404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0e70b-dd04-4b7d-a75d-4cf6ae9c850b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:40.700925 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0e70b-dd04-4b7d-a75d-4cf6ae9c850b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.702587 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0e70b-dd04-4b7d-a75d-4cf6ae9c850b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.708787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 477/942] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:40.715230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0e70b-dd04-4b7d-a75d-4cf6ae9c850b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.730353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9f87-1cf9-4811-b52b-123f565f2e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:40.731212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9f87-1cf9-4811-b52b-123f565f2e11 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.731504 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9f87-1cf9-4811-b52b-123f565f2e11 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.731838 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9f87-1cf9-4811-b52b-123f565f2e11 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.733331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea9f87-1cf9-4811-b52b-123f565f2e11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:40.733652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea9f87-1cf9-4811-b52b-123f565f2e11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.735445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea9f87-1cf9-4811-b52b-123f565f2e11 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.770089 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 466/943] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:40.771672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9f87-1cf9-4811-b52b-123f565f2e11 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.846726 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0e70b-dd04-4b7d-a75d-4cf6ae9c850b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:40.863081 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:40.889503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992e3f9-1c99-4173-bdb2-73a6e4bfc6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:40.890693 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992e3f9-1c99-4173-bdb2-73a6e4bfc6cd None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.891317 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992e3f9-1c99-4173-bdb2-73a6e4bfc6cd None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.891903 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992e3f9-1c99-4173-bdb2-73a6e4bfc6cd None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.893024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992e3f9-1c99-4173-bdb2-73a6e4bfc6cd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:40.893600 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992e3f9-1c99-4173-bdb2-73a6e4bfc6cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.895355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992e3f9-1c99-4173-bdb2-73a6e4bfc6cd None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.903553 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 478/944] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:40.909765 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992e3f9-1c99-4173-bdb2-73a6e4bfc6cd None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.923076 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:40.934986 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9f87-1cf9-4811-b52b-123f565f2e11 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:40.982451 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8948de6-e319-4980-a6f1-07f331ab8772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:40.983660 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8948de6-e319-4980-a6f1-07f331ab8772 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.984191 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8948de6-e319-4980-a6f1-07f331ab8772 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.984650 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8948de6-e319-4980-a6f1-07f331ab8772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.996808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8948de6-e319-4980-a6f1-07f331ab8772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.998697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8948de6-e319-4980-a6f1-07f331ab8772 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-f8948de6-e319-4980-a6f1-07f331ab8772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:41.022525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:41.023582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:41.024643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:41.024643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:41.024643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:41.024643 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:41.031984 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 467/945] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:41.033831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8948de6-e319-4980-a6f1-07f331ab8772 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:41.046486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992e3f9-1c99-4173-bdb2-73a6e4bfc6cd None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:41.091070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c292391-8672-492c-a7d5-ef27575501ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:41.091753 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c292391-8672-492c-a7d5-ef27575501ed None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.092041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c292391-8672-492c-a7d5-ef27575501ed None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.092321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c292391-8672-492c-a7d5-ef27575501ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.093087 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c292391-8672-492c-a7d5-ef27575501ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:41.094582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c292391-8672-492c-a7d5-ef27575501ed None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:41.156522 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8948de6-e319-4980-a6f1-07f331ab8772 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:41.159939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:41.190756 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 479/946] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:25:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:41.206724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea3f54-ea6d-40b0-8135-911ab0d176b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:41.207791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea3f54-ea6d-40b0-8135-911ab0d176b5 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.208242 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea3f54-ea6d-40b0-8135-911ab0d176b5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.208675 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea3f54-ea6d-40b0-8135-911ab0d176b5 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.209718 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea3f54-ea6d-40b0-8135-911ab0d176b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:41.210204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea3f54-ea6d-40b0-8135-911ab0d176b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:41.212376 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea3f54-ea6d-40b0-8135-911ab0d176b5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:41.229746 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 468/947] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:41.239784 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c292391-8672-492c-a7d5-ef27575501ed None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:41.323290 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:41.366514 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c292391-8672-492c-a7d5-ef27575501ed None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:41.407030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36f075-1bc3-4378-ae90-658621db45ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:41.407902 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36f075-1bc3-4378-ae90-658621db45ed None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.408187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36f075-1bc3-4378-ae90-658621db45ed None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.408463 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36f075-1bc3-4378-ae90-658621db45ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.417148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36f075-1bc3-4378-ae90-658621db45ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:41.418748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36f075-1bc3-4378-ae90-658621db45ed None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-7b36f075-1bc3-4378-ae90-658621db45ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:41.435563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:41.436805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:41.438092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:41.438092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:41.438092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:41.438092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:41.438092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:41.438092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:41.438092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:41.438092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:41.438092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 480/948] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:41.443999 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea3f54-ea6d-40b0-8135-911ab0d176b5 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:41.561489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea3f54-ea6d-40b0-8135-911ab0d176b5 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:41.600161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54e5a3-799c-4c7f-a648-87db3de1f6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:41.600709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54e5a3-799c-4c7f-a648-87db3de1f6b4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.600995 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54e5a3-799c-4c7f-a648-87db3de1f6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.601272 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54e5a3-799c-4c7f-a648-87db3de1f6b4 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.602176 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54e5a3-799c-4c7f-a648-87db3de1f6b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:41.602485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54e5a3-799c-4c7f-a648-87db3de1f6b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:41.603947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54e5a3-799c-4c7f-a648-87db3de1f6b4 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:41.618998 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 469/949] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:41.624876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36f075-1bc3-4378-ae90-658621db45ed None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:41.627946 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2bdab-b7f4-4f6f-9725-1fec07eaf9fd None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.628231 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2bdab-b7f4-4f6f-9725-1fec07eaf9fd None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.628509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2bdab-b7f4-4f6f-9725-1fec07eaf9fd None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.630228 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 470/950] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:41.637573 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bcd35-d533-4c4e-9d9c-e1bddd30a390 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.637950 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bcd35-d533-4c4e-9d9c-e1bddd30a390 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.638311 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bcd35-d533-4c4e-9d9c-e1bddd30a390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.659088 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-e75bcd35-d533-4c4e-9d9c-e1bddd30a390 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:41.660564 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-e75bcd35-d533-4c4e-9d9c-e1bddd30a390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:41.679198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:41.751132 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 471/951] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:41.778181 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bcd35-d533-4c4e-9d9c-e1bddd30a390 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:41.810428 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36f075-1bc3-4378-ae90-658621db45ed None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:41.848036 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:41.864270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57823046-02f1-456c-a6dc-1300787b658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:41.864270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57823046-02f1-456c-a6dc-1300787b658d None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.864270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57823046-02f1-456c-a6dc-1300787b658d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.864270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57823046-02f1-456c-a6dc-1300787b658d None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/9fdd44a5966c4276b572250fd4147fc9/roles/4929d71337674b21b9c568fd0cf3b00f` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.866742 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57823046-02f1-456c-a6dc-1300787b658d None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=9fdd44a5966c4276b572250fd4147fc9, role_id=4929d71337674b21b9c568fd0cf3b00f)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:41.868450 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57823046-02f1-456c-a6dc-1300787b658d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:41.922671 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bcd35-d533-4c4e-9d9c-e1bddd30a390 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:41.963163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 481/952] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:25:41 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/9fdd44a5966c4276b572250fd4147fc9/roles/4929d71337674b21b9c568fd0cf3b00f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:41.978520 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044f1ae-e7d6-485d-a809-55efbfe676c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:41.979249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044f1ae-e7d6-485d-a809-55efbfe676c7 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.979588 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044f1ae-e7d6-485d-a809-55efbfe676c7 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.979872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044f1ae-e7d6-485d-a809-55efbfe676c7 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.980674 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044f1ae-e7d6-485d-a809-55efbfe676c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:41.982281 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044f1ae-e7d6-485d-a809-55efbfe676c7 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:41.983780 dv-cinder-841302-4-smb devstack@keystone.service[220180]: WARNING keystone.server.flask.common [None req-4044f1ae-e7d6-485d-a809-55efbfe676c7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 20:25:42.044448 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.sql.core [None req-4044f1ae-e7d6-485d-a809-55efbfe676c7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:25:42.044448 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 20:25:42.044448 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [parameters: {'id': 'eee4c01748cd464997204ba3b67a4b4b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 20:25:42.044448 dv-cinder-841302-4-smb devstack@keystone.service[220180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=220180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-4044f1ae-e7d6-485d-a809-55efbfe676c7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eee4c01748cd464997204ba3b67a4b4b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eee4c01748cd464997204ba3b67a4b4b. May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application conn.query(q) May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:25:42.053629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application result.read() May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 20:25:42.054633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application next(self.gen) May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application yield resource May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application next(self.gen) May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise self.value May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application session.commit() May 19 20:25:42.055757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self.session.flush() May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application compat.raise_( May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:25:42.056978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:25:42.057994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application conn.query(q) May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application result.read() May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:25:42.060331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [parameters: {'id': 'eee4c01748cd464997204ba3b67a4b4b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:42.062631 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:42.065158 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:42.069302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:42.069302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 20:25:42.069302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 20:25:42.069302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:42.069302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:42.069302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 20:25:42.069302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 20:25:42.069302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eee4c01748cd464997204ba3b67a4b4b. May 19 20:25:42.069302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:42.069302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 472/953] 10.222.0.89 () {60 vars in 1140 bytes} [Thu May 19 20:25:41 2022] POST /identity/v3/projects => generated 262 bytes in 290 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:42.078695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57823046-02f1-456c-a6dc-1300787b658d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:42.090939 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2d695-9c57-425e-b19a-0c1e43d31a9a None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.091229 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2d695-9c57-425e-b19a-0c1e43d31a9a None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.091511 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2d695-9c57-425e-b19a-0c1e43d31a9a None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.096893 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 473/954] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:42.102965 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1412d4-8323-4ba1-ac13-df0e0b629c2b None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.103271 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1412d4-8323-4ba1-ac13-df0e0b629c2b None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.103581 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1412d4-8323-4ba1-ac13-df0e0b629c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.120210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:42.127233 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-8a1412d4-8323-4ba1-ac13-df0e0b629c2b None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:42.129541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-8a1412d4-8323-4ba1-ac13-df0e0b629c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:42.211913 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57823046-02f1-456c-a6dc-1300787b658d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:42.233286 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 474/955] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:42.256819 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1412d4-8323-4ba1-ac13-df0e0b629c2b None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:42.259889 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01982d2c-d14e-4914-a2d7-6bc8882247ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:42.261778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01982d2c-d14e-4914-a2d7-6bc8882247ce None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.262278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01982d2c-d14e-4914-a2d7-6bc8882247ce None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.262821 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01982d2c-d14e-4914-a2d7-6bc8882247ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.272348 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01982d2c-d14e-4914-a2d7-6bc8882247ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:42.274839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01982d2c-d14e-4914-a2d7-6bc8882247ce None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-01982d2c-d14e-4914-a2d7-6bc8882247ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:42.294771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:42.295956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:42.297157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:42.297157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:42.297157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:42.297157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:42.297157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:42.297157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:42.297157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:42.297157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:42.300238 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 482/956] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:42.307296 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01982d2c-d14e-4914-a2d7-6bc8882247ce None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:42.362136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:42.385072 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1412d4-8323-4ba1-ac13-df0e0b629c2b None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:42.430740 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01982d2c-d14e-4914-a2d7-6bc8882247ce None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:42.431681 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943543d1-3262-4dbe-9685-f68fb3f432e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:42.432690 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943543d1-3262-4dbe-9685-f68fb3f432e4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.433653 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943543d1-3262-4dbe-9685-f68fb3f432e4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.434103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943543d1-3262-4dbe-9685-f68fb3f432e4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.436642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943543d1-3262-4dbe-9685-f68fb3f432e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:42.438353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943543d1-3262-4dbe-9685-f68fb3f432e4 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:42.442243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-943543d1-3262-4dbe-9685-f68fb3f432e4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:42.455719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:42.459679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:42.460601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 475/957] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:42.463848 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943543d1-3262-4dbe-9685-f68fb3f432e4 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:42.481454 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091a71c-322c-42f1-8dba-a3dda52fa38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:42.482136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091a71c-322c-42f1-8dba-a3dda52fa38b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.482421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091a71c-322c-42f1-8dba-a3dda52fa38b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.482756 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091a71c-322c-42f1-8dba-a3dda52fa38b None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.483943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091a71c-322c-42f1-8dba-a3dda52fa38b None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:42.484258 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091a71c-322c-42f1-8dba-a3dda52fa38b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:42.486632 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091a71c-322c-42f1-8dba-a3dda52fa38b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:42.511644 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 483/958] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:42.608244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943543d1-3262-4dbe-9685-f68fb3f432e4 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:42.651651 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd577f-487e-41b9-8977-0337d4fa5174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:42.652279 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd577f-487e-41b9-8977-0337d4fa5174 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.652637 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd577f-487e-41b9-8977-0337d4fa5174 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.652914 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd577f-487e-41b9-8977-0337d4fa5174 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.653656 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd577f-487e-41b9-8977-0337d4fa5174 None admin] RBAC: Adding query filter params (name=compute) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:42.653964 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd577f-487e-41b9-8977-0337d4fa5174 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:42.655420 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd577f-487e-41b9-8977-0337d4fa5174 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:42.661786 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 476/959] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:42.668210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091a71c-322c-42f1-8dba-a3dda52fa38b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:42.793851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091a71c-322c-42f1-8dba-a3dda52fa38b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:42.800167 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:42.837523 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b1f15-4ed9-45ba-9f5a-80a3932b3c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:42.838209 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b1f15-4ed9-45ba-9f5a-80a3932b3c79 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.838496 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b1f15-4ed9-45ba-9f5a-80a3932b3c79 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.838805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b1f15-4ed9-45ba-9f5a-80a3932b3c79 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.839637 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b1f15-4ed9-45ba-9f5a-80a3932b3c79 None admin] RBAC: Adding query filter params (type=compute) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:42.839956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b1f15-4ed9-45ba-9f5a-80a3932b3c79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:42.841398 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b1f15-4ed9-45ba-9f5a-80a3932b3c79 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:42.851103 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 484/960] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:43.849882 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84712f79-e28b-40b9-abf8-a7f043ee6522 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.850404 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84712f79-e28b-40b9-abf8-a7f043ee6522 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.850518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84712f79-e28b-40b9-abf8-a7f043ee6522 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.852149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 477/961] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:43.857665 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18c55c-cb92-4025-bff7-7fde4aafe112 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.858094 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18c55c-cb92-4025-bff7-7fde4aafe112 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.858297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18c55c-cb92-4025-bff7-7fde4aafe112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.875201 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-bb18c55c-cb92-4025-bff7-7fde4aafe112 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:43.876915 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-bb18c55c-cb92-4025-bff7-7fde4aafe112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:43.958734 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 485/962] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:43.973753 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84712f79-e28b-40b9-abf8-a7f043ee6522 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.042578 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:44.084714 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84712f79-e28b-40b9-abf8-a7f043ee6522 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.119541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2e537-59c0-4af3-a5c2-b7046ea85eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.120364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e537-59c0-4af3-a5c2-b7046ea85eee None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.120645 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e537-59c0-4af3-a5c2-b7046ea85eee None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.120916 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e537-59c0-4af3-a5c2-b7046ea85eee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.121574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2e537-59c0-4af3-a5c2-b7046ea85eee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:44.122979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2e537-59c0-4af3-a5c2-b7046ea85eee None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-dca2e537-59c0-4af3-a5c2-b7046ea85eee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:44.136360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:44.137508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:44.138535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:44.142789 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 478/963] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:25:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:44.144266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18c55c-cb92-4025-bff7-7fde4aafe112 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.248111 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:44.255231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18c55c-cb92-4025-bff7-7fde4aafe112 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.292543 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9132e-31a0-4b7b-a99c-e4a6b2d6d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.293622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9132e-31a0-4b7b-a99c-e4a6b2d6d4ab None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.294131 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9132e-31a0-4b7b-a99c-e4a6b2d6d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.294683 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9132e-31a0-4b7b-a99c-e4a6b2d6d4ab None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.295639 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9132e-31a0-4b7b-a99c-e4a6b2d6d4ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:44.296162 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9132e-31a0-4b7b-a99c-e4a6b2d6d4ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:44.297914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9132e-31a0-4b7b-a99c-e4a6b2d6d4ab None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:44.304722 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 486/964] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:44.312018 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2e537-59c0-4af3-a5c2-b7046ea85eee None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.364263 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2353fb-6764-43ee-90c1-cf069cc496da None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.364912 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2353fb-6764-43ee-90c1-cf069cc496da None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.365413 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2353fb-6764-43ee-90c1-cf069cc496da None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.367577 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 487/965] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:44.373674 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfa068-abb3-41d0-854f-4f8cadacf569 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.374292 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfa068-abb3-41d0-854f-4f8cadacf569 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.374833 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfa068-abb3-41d0-854f-4f8cadacf569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.395899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-b2cfa068-abb3-41d0-854f-4f8cadacf569 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:44.398787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-b2cfa068-abb3-41d0-854f-4f8cadacf569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:44.435530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2e537-59c0-4af3-a5c2-b7046ea85eee None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.476709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:44.488864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ffb2f-ab8d-421b-af31-5a6cdc4eacc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.489724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ffb2f-ab8d-421b-af31-5a6cdc4eacc5 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.490010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ffb2f-ab8d-421b-af31-5a6cdc4eacc5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.490291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ffb2f-ab8d-421b-af31-5a6cdc4eacc5 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.491151 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ffb2f-ab8d-421b-af31-5a6cdc4eacc5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:44.491467 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ffb2f-ab8d-421b-af31-5a6cdc4eacc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:44.493483 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ffb2f-ab8d-421b-af31-5a6cdc4eacc5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:44.498780 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 488/966] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:44.499827 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 479/967] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:44.506360 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfa068-abb3-41d0-854f-4f8cadacf569 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.522976 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ffb2f-ab8d-421b-af31-5a6cdc4eacc5 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.628052 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:44.641192 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfa068-abb3-41d0-854f-4f8cadacf569 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.654831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ffb2f-ab8d-421b-af31-5a6cdc4eacc5 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.690655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06671df-fed9-4eca-a57e-4accc71a73f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.691783 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06671df-fed9-4eca-a57e-4accc71a73f9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.692077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06671df-fed9-4eca-a57e-4accc71a73f9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.692354 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06671df-fed9-4eca-a57e-4accc71a73f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.693451 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06671df-fed9-4eca-a57e-4accc71a73f9 None admin] RBAC: Adding query filter params (interface=admin, service_id=dbcb6f8bc4eb4912a3d68a8419c28424, region_id=RegionOne) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:44.693771 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06671df-fed9-4eca-a57e-4accc71a73f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:44.695523 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06671df-fed9-4eca-a57e-4accc71a73f9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:44.698079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55912ed3-fd2d-425f-abde-6b915caac5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.699457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912ed3-fd2d-425f-abde-6b915caac5f4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.699980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912ed3-fd2d-425f-abde-6b915caac5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.700507 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912ed3-fd2d-425f-abde-6b915caac5f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.702641 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 489/968] 10.222.0.89 () {56 vars in 1249 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/endpoints?service_id=dbcb6f8bc4eb4912a3d68a8419c28424&interface=admin®ion_id=RegionOne => generated 193 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:44.709273 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06671df-fed9-4eca-a57e-4accc71a73f9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.721988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55912ed3-fd2d-425f-abde-6b915caac5f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-55912ed3-fd2d-425f-abde-6b915caac5f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:44.733551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:44.734935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:25:44.736020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:44.737001 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 480/969] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:44.743036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55912ed3-fd2d-425f-abde-6b915caac5f4 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.847839 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:44.874789 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06671df-fed9-4eca-a57e-4accc71a73f9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.909584 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55912ed3-fd2d-425f-abde-6b915caac5f4 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.918551 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc6e39-f694-4e69-b733-943774d04f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.919615 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc6e39-f694-4e69-b733-943774d04f66 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.920062 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc6e39-f694-4e69-b733-943774d04f66 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.920523 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc6e39-f694-4e69-b733-943774d04f66 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.921396 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc6e39-f694-4e69-b733-943774d04f66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:44.923280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc6e39-f694-4e69-b733-943774d04f66 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:44.938134 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 490/970] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/services => generated 1497 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:25:44.951392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605b9a0-a2cf-4372-9e9d-be70a8d80903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.952264 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605b9a0-a2cf-4372-9e9d-be70a8d80903 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.952693 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605b9a0-a2cf-4372-9e9d-be70a8d80903 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.953123 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605b9a0-a2cf-4372-9e9d-be70a8d80903 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.954024 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605b9a0-a2cf-4372-9e9d-be70a8d80903 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:44.955018 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605b9a0-a2cf-4372-9e9d-be70a8d80903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:44.956563 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605b9a0-a2cf-4372-9e9d-be70a8d80903 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:44.967342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 481/971] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:44.973376 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc6e39-f694-4e69-b733-943774d04f66 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.996908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.053111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1c25-904f-4dd4-a79d-794a90934515 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.053696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1c25-904f-4dd4-a79d-794a90934515 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.054160 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1c25-904f-4dd4-a79d-794a90934515 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.056337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 482/972] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:45.062344 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5487615-e03a-4937-adf9-e7dcd8b01aaa None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.062929 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5487615-e03a-4937-adf9-e7dcd8b01aaa None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.063399 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5487615-e03a-4937-adf9-e7dcd8b01aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.083829 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-f5487615-e03a-4937-adf9-e7dcd8b01aaa None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:45.085344 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-f5487615-e03a-4937-adf9-e7dcd8b01aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:45.111969 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc6e39-f694-4e69-b733-943774d04f66 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.173366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e6a5-8627-4078-9bba-9f5b1f9e76dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.174430 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e6a5-8627-4078-9bba-9f5b1f9e76dd None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.174948 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e6a5-8627-4078-9bba-9f5b1f9e76dd None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.175387 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e6a5-8627-4078-9bba-9f5b1f9e76dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.192067 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0e6a5-8627-4078-9bba-9f5b1f9e76dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.194002 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0e6a5-8627-4078-9bba-9f5b1f9e76dd None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.198661 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 483/973] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-46f0e6a5-8627-4078-9bba-9f5b1f9e76dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:45.219239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:45.220456 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:45.221650 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:45.221650 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:45.221650 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:45.221650 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:45.223312 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 491/974] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:45.228650 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5487615-e03a-4937-adf9-e7dcd8b01aaa None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.231652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e6a5-8627-4078-9bba-9f5b1f9e76dd None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.283877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.318159 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.348007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5487615-e03a-4937-adf9-e7dcd8b01aaa None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.350313 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e6a5-8627-4078-9bba-9f5b1f9e76dd None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.386239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cafae-bf8a-406a-a9e3-5e4f5118519b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.386952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cafae-bf8a-406a-a9e3-5e4f5118519b None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.387235 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cafae-bf8a-406a-a9e3-5e4f5118519b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.387445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f802155-ce87-4874-80aa-11d966d79c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.387560 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cafae-bf8a-406a-a9e3-5e4f5118519b None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.388216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cafae-bf8a-406a-a9e3-5e4f5118519b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.388373 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f802155-ce87-4874-80aa-11d966d79c59 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.388774 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f802155-ce87-4874-80aa-11d966d79c59 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.389151 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f802155-ce87-4874-80aa-11d966d79c59 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.389676 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cafae-bf8a-406a-a9e3-5e4f5118519b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.390081 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f802155-ce87-4874-80aa-11d966d79c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:45.390494 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f802155-ce87-4874-80aa-11d966d79c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.391034 dv-cinder-841302-4-smb devstack@keystone.service[220179]: WARNING keystone.server.flask.common [None req-aa6cafae-bf8a-406a-a9e3-5e4f5118519b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 20:25:45.392622 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f802155-ce87-4874-80aa-11d966d79c59 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.408149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 484/975] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:45.412068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bd9b3-568b-4e70-88e7-c37584bffaba None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.412068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bd9b3-568b-4e70-88e7-c37584bffaba None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.412068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bd9b3-568b-4e70-88e7-c37584bffaba None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.412068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 485/976] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:45.413683 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bd9b3-568b-4e70-88e7-c37584bffaba None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.437943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.sql.core [None req-aa6cafae-bf8a-406a-a9e3-5e4f5118519b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:25:45.437943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 20:25:45.437943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [parameters: {'user_id': 'd522fe2f159b4cac99b2da095f892c18', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 20:25:45.437943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=220179) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-aa6cafae-bf8a-406a-a9e3-5e4f5118519b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application conn.query(q) May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application result.read() May 19 20:25:45.455864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:25:45.457078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application next(self.gen) May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application yield resource May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application next(self.gen) May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise self.value May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application session.commit() May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:25:45.458114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self.session.flush() May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application compat.raise_( May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:25:45.459268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:25:45.460278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application conn.query(q) May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application result.read() May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:25:45.461385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd522fe2f159b4cac99b2da095f892c18', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:45.462589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 20:25:45.463614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 20:25:45.464794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 20:25:45.464794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 20:25:45.464794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:25:45.464794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:25:45.464794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 20:25:45.464794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:45.464794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 492/977] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:25:45 2022] POST /identity/v3/users => generated 160 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:45.464794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2f66e-1183-47bd-a97f-4a98d05a6eff None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.464794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2f66e-1183-47bd-a97f-4a98d05a6eff None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.464794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2f66e-1183-47bd-a97f-4a98d05a6eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.480167 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-46d2f66e-1183-47bd-a97f-4a98d05a6eff None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:45.481940 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-46d2f66e-1183-47bd-a97f-4a98d05a6eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:45.565476 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bd9b3-568b-4e70-88e7-c37584bffaba None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.568360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.573547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 493/978] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:45.574512 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2f66e-1183-47bd-a97f-4a98d05a6eff None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.628764 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5319a0f-9a2b-4de1-be50-3f5f47528dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.629723 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5319a0f-9a2b-4de1-be50-3f5f47528dfb None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.630093 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5319a0f-9a2b-4de1-be50-3f5f47528dfb None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.630510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5319a0f-9a2b-4de1-be50-3f5f47528dfb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.639212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5319a0f-9a2b-4de1-be50-3f5f47528dfb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.641664 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5319a0f-9a2b-4de1-be50-3f5f47528dfb None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.651490 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-c5319a0f-9a2b-4de1-be50-3f5f47528dfb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:45.661867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:45.663921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:45.665652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:45.665652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:45.665652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:45.665652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:45.665652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:45.665652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:45.665652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:45.665652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:45.665652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:45.665652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:45.665652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 486/979] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:25:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:45.671322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5319a0f-9a2b-4de1-be50-3f5f47528dfb None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.707671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2f66e-1183-47bd-a97f-4a98d05a6eff None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.740657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5a42-c200-4532-bf98-e79b6fc57b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.741477 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5a42-c200-4532-bf98-e79b6fc57b7a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.741761 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5a42-c200-4532-bf98-e79b6fc57b7a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.742032 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5a42-c200-4532-bf98-e79b6fc57b7a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.750237 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf5a42-c200-4532-bf98-e79b6fc57b7a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.752516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf5a42-c200-4532-bf98-e79b6fc57b7a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-21cf5a42-c200-4532-bf98-e79b6fc57b7a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:45.767829 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:45.769118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 494/980] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:25:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:45.770336 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5a42-c200-4532-bf98-e79b6fc57b7a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.806195 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5319a0f-9a2b-4de1-be50-3f5f47528dfb None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.845958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c384c-4e18-4a15-9585-cd3a00aa42bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.846799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c384c-4e18-4a15-9585-cd3a00aa42bf None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.847144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c384c-4e18-4a15-9585-cd3a00aa42bf None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.847426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c384c-4e18-4a15-9585-cd3a00aa42bf None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.848186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c384c-4e18-4a15-9585-cd3a00aa42bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.849604 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c384c-4e18-4a15-9585-cd3a00aa42bf None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.917917 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 487/981] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:25:45 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:45.919463 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c384c-4e18-4a15-9585-cd3a00aa42bf None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.948258 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5a42-c200-4532-bf98-e79b6fc57b7a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.957109 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.996759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:46.025162 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468f098-668c-4733-a801-3eaa1d1cf132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.025918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468f098-668c-4733-a801-3eaa1d1cf132 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.026202 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468f098-668c-4733-a801-3eaa1d1cf132 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.026471 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468f098-668c-4733-a801-3eaa1d1cf132 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.027484 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468f098-668c-4733-a801-3eaa1d1cf132 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:46.028000 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468f098-668c-4733-a801-3eaa1d1cf132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.029857 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468f098-668c-4733-a801-3eaa1d1cf132 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.053567 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 495/982] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:25:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:46.059497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468f098-668c-4733-a801-3eaa1d1cf132 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:46.082169 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c384c-4e18-4a15-9585-cd3a00aa42bf None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.127806 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5256ecd-3743-4e5b-96d4-21daede4e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.128506 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5256ecd-3743-4e5b-96d4-21daede4e6bb None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.128794 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5256ecd-3743-4e5b-96d4-21daede4e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.129077 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5256ecd-3743-4e5b-96d4-21daede4e6bb None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.130235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5256ecd-3743-4e5b-96d4-21daede4e6bb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:46.130370 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5256ecd-3743-4e5b-96d4-21daede4e6bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.132597 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5256ecd-3743-4e5b-96d4-21daede4e6bb None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.175278 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 488/983] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:25:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:46.193742 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468f098-668c-4733-a801-3eaa1d1cf132 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.241461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063a2f7-8aaa-4d19-b420-3729df319cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.242463 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063a2f7-8aaa-4d19-b420-3729df319cbe None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.242941 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063a2f7-8aaa-4d19-b420-3729df319cbe None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.243392 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063a2f7-8aaa-4d19-b420-3729df319cbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.303276 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:46.331640 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063a2f7-8aaa-4d19-b420-3729df319cbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.333510 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063a2f7-8aaa-4d19-b420-3729df319cbe None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.446346 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 496/984] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:25:46.452212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5256ecd-3743-4e5b-96d4-21daede4e6bb None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:46.552708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:46.573832 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5256ecd-3743-4e5b-96d4-21daede4e6bb None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.607721 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f03c0-e609-4603-bf26-917edf20c77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.608533 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f03c0-e609-4603-bf26-917edf20c77f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.608821 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f03c0-e609-4603-bf26-917edf20c77f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.609102 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f03c0-e609-4603-bf26-917edf20c77f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.619781 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f03c0-e609-4603-bf26-917edf20c77f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.621257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f03c0-e609-4603-bf26-917edf20c77f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-598f03c0-e609-4603-bf26-917edf20c77f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:46.641414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:46.642576 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:46.643664 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:46.643664 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:46.643664 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:46.643664 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:46.646713 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 489/985] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:46.648579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063a2f7-8aaa-4d19-b420-3729df319cbe None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:46.729083 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:46.753953 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063a2f7-8aaa-4d19-b420-3729df319cbe None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.799171 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c540-a711-4eb1-becb-8c32d1b2f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.799970 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c540-a711-4eb1-becb-8c32d1b2f047 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.800324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c540-a711-4eb1-becb-8c32d1b2f047 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.800675 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c540-a711-4eb1-becb-8c32d1b2f047 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.801927 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8c540-a711-4eb1-becb-8c32d1b2f047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:46.802160 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8c540-a711-4eb1-becb-8c32d1b2f047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.803659 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8c540-a711-4eb1-becb-8c32d1b2f047 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.820613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 497/986] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:46.822267 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f03c0-e609-4603-bf26-917edf20c77f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:46.926541 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f03c0-e609-4603-bf26-917edf20c77f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.961437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a02163-b38f-4ad3-9af2-2929c3108b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.962240 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a02163-b38f-4ad3-9af2-2929c3108b02 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.962526 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a02163-b38f-4ad3-9af2-2929c3108b02 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.962845 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a02163-b38f-4ad3-9af2-2929c3108b02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.964838 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:46.971420 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a02163-b38f-4ad3-9af2-2929c3108b02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.972887 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a02163-b38f-4ad3-9af2-2929c3108b02 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-92a02163-b38f-4ad3-9af2-2929c3108b02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:46.987106 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:46.988371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:46.994186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:46.994186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:46.994186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:46.994186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:46.994186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:46.994186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:46.994186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:46.994186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:46.994186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 490/987] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:46.996347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c540-a711-4eb1-becb-8c32d1b2f047 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.104205 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c540-a711-4eb1-becb-8c32d1b2f047 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.141577 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cf9c3-0f01-4f6b-8c03-93dde64654ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.142855 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf9c3-0f01-4f6b-8c03-93dde64654ff None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.143170 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf9c3-0f01-4f6b-8c03-93dde64654ff None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.143454 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf9c3-0f01-4f6b-8c03-93dde64654ff None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.144380 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cf9c3-0f01-4f6b-8c03-93dde64654ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:47.144697 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cf9c3-0f01-4f6b-8c03-93dde64654ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.146263 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cf9c3-0f01-4f6b-8c03-93dde64654ff None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.149655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:47.167214 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 498/988] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:47.169001 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a02163-b38f-4ad3-9af2-2929c3108b02 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.275109 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a02163-b38f-4ad3-9af2-2929c3108b02 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.311173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d2cc0-0a1c-42e9-aae8-88818c1e6c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.311847 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2cc0-0a1c-42e9-aae8-88818c1e6c97 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.312133 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2cc0-0a1c-42e9-aae8-88818c1e6c97 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.312411 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2cc0-0a1c-42e9-aae8-88818c1e6c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.313264 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d2cc0-0a1c-42e9-aae8-88818c1e6c97 None admin] RBAC: Adding query filter params (role.id=4929d71337674b21b9c568fd0cf3b00f, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=9fdd44a5966c4276b572250fd4147fc9) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:47.314118 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d2cc0-0a1c-42e9-aae8-88818c1e6c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.315588 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d2cc0-0a1c-42e9-aae8-88818c1e6c97 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.330391 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 491/989] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:47 2022] GET /identity/v3/role_assignments?user.id=9fdd44a5966c4276b572250fd4147fc9&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=4929d71337674b21b9c568fd0cf3b00f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:47.337501 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb992f4-f2b8-4a5d-a8aa-cedbb880dcde None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.337796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb992f4-f2b8-4a5d-a8aa-cedbb880dcde None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.338061 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb992f4-f2b8-4a5d-a8aa-cedbb880dcde None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.339572 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 499/990] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:47.345786 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5b004-d051-42c2-86d9-9cacdc5bc2f4 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.346102 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5b004-d051-42c2-86d9-9cacdc5bc2f4 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.346356 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5b004-d051-42c2-86d9-9cacdc5bc2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.364962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-4ff5b004-d051-42c2-86d9-9cacdc5bc2f4 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:47.366211 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-4ff5b004-d051-42c2-86d9-9cacdc5bc2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:47.428897 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:47.445000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 492/991] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:47.468955 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb992f4-f2b8-4a5d-a8aa-cedbb880dcde None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.581791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb992f4-f2b8-4a5d-a8aa-cedbb880dcde None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.628613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa9a20-b669-42e2-abda-d176972f3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.629813 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa9a20-b669-42e2-abda-d176972f3f04 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.630347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa9a20-b669-42e2-abda-d176972f3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.630869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa9a20-b669-42e2-abda-d176972f3f04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.631747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa9a20-b669-42e2-abda-d176972f3f04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.633343 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa9a20-b669-42e2-abda-d176972f3f04 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-6cfa9a20-b669-42e2-abda-d176972f3f04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:47.646986 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:47.648112 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:25:47.649078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:47.652153 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 500/992] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:25:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:47.658010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5b004-d051-42c2-86d9-9cacdc5bc2f4 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.765259 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5b004-d051-42c2-86d9-9cacdc5bc2f4 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.811064 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d791-3df2-4dd2-81a4-ad7084f7b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.811747 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d791-3df2-4dd2-81a4-ad7084f7b902 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.812037 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d791-3df2-4dd2-81a4-ad7084f7b902 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.812318 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d791-3df2-4dd2-81a4-ad7084f7b902 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.813044 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2d791-3df2-4dd2-81a4-ad7084f7b902 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:47.813362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2d791-3df2-4dd2-81a4-ad7084f7b902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.815353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2d791-3df2-4dd2-81a4-ad7084f7b902 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.825314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 493/993] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:25:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:47.826690 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa9a20-b669-42e2-abda-d176972f3f04 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.911766 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:47.987412 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa9a20-b669-42e2-abda-d176972f3f04 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:48.047953 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ac94-f18d-4bde-94f8-9a22b6d7bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:48.049654 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ac94-f18d-4bde-94f8-9a22b6d7bfbc None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.050170 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ac94-f18d-4bde-94f8-9a22b6d7bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.050709 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ac94-f18d-4bde-94f8-9a22b6d7bfbc None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.052370 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ac94-f18d-4bde-94f8-9a22b6d7bfbc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:48.052942 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ac94-f18d-4bde-94f8-9a22b6d7bfbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:48.055573 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ac94-f18d-4bde-94f8-9a22b6d7bfbc None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:48.069985 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 501/994] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:25:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:48.071407 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d791-3df2-4dd2-81a4-ad7084f7b902 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:48.132701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:48.186702 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d791-3df2-4dd2-81a4-ad7084f7b902 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:48.221516 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ac320-b713-4d14-b7d6-e6061729a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:48.222261 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ac320-b713-4d14-b7d6-e6061729a9f8 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.226685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ac320-b713-4d14-b7d6-e6061729a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.226685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ac320-b713-4d14-b7d6-e6061729a9f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.226685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ac320-b713-4d14-b7d6-e6061729a9f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:48.226685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ac320-b713-4d14-b7d6-e6061729a9f8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:48.276274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0d6e-cae1-44cc-bae2-06c29d6e69c2 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.276560 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0d6e-cae1-44cc-bae2-06c29d6e69c2 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.276844 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0d6e-cae1-44cc-bae2-06c29d6e69c2 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.278234 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 502/995] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:48.283630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a416-e983-4360-accd-dfddc5edbc5d None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.284082 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a416-e983-4360-accd-dfddc5edbc5d None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.284363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a416-e983-4360-accd-dfddc5edbc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.331080 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 494/996] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:25:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:48.334194 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-7f58a416-e983-4360-accd-dfddc5edbc5d None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:48.335452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-7f58a416-e983-4360-accd-dfddc5edbc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:48.427041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 503/997] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:48.445475 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ac320-b713-4d14-b7d6-e6061729a9f8 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:48.564352 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ac320-b713-4d14-b7d6-e6061729a9f8 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:48.578353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:48.600657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e5769-0e87-492c-8ce9-70a290214477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:48.601542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5769-0e87-492c-8ce9-70a290214477 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.601827 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5769-0e87-492c-8ce9-70a290214477 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.602101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5769-0e87-492c-8ce9-70a290214477 None admin] PATH_INFO: `/v3/services/compute` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.602797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e5769-0e87-492c-8ce9-70a290214477 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:48.604188 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e5769-0e87-492c-8ce9-70a290214477 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-991e5769-0e87-492c-8ce9-70a290214477 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:48.617525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:48.618809 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:48.620008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 495/998] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:48.624830 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58a416-e983-4360-accd-dfddc5edbc5d None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:48.681580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:48.732437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58a416-e983-4360-accd-dfddc5edbc5d None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:48.767951 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02168f-63a7-43f1-80e4-3a7a509f4038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:48.768631 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02168f-63a7-43f1-80e4-3a7a509f4038 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.768916 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02168f-63a7-43f1-80e4-3a7a509f4038 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.769193 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02168f-63a7-43f1-80e4-3a7a509f4038 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.769909 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02168f-63a7-43f1-80e4-3a7a509f4038 None admin] RBAC: Adding query filter params (name=compute) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:48.770217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02168f-63a7-43f1-80e4-3a7a509f4038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:48.771633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02168f-63a7-43f1-80e4-3a7a509f4038 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:48.781304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 504/999] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:48.783160 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e5769-0e87-492c-8ce9-70a290214477 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:48.893348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e5769-0e87-492c-8ce9-70a290214477 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:48.929764 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a76bc-1936-40ee-9b90-6babe85847cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:48.930803 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a76bc-1936-40ee-9b90-6babe85847cd None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.931245 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a76bc-1936-40ee-9b90-6babe85847cd None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.931678 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a76bc-1936-40ee-9b90-6babe85847cd None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.932564 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a76bc-1936-40ee-9b90-6babe85847cd None admin] RBAC: Adding query filter params (type=compute) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:48.933040 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a76bc-1936-40ee-9b90-6babe85847cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:48.934575 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a76bc-1936-40ee-9b90-6babe85847cd None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:48.944705 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 496/1000] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:48.946110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02168f-63a7-43f1-80e4-3a7a509f4038 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:49.055202 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02168f-63a7-43f1-80e4-3a7a509f4038 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:49.070812 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:49.095585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b1e53-ed2f-46f1-a0b8-39fdf1840cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:49.096307 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b1e53-ed2f-46f1-a0b8-39fdf1840cf0 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.096712 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b1e53-ed2f-46f1-a0b8-39fdf1840cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.096941 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b1e53-ed2f-46f1-a0b8-39fdf1840cf0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.097787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b1e53-ed2f-46f1-a0b8-39fdf1840cf0 None admin] RBAC: Adding query filter params (interface=public, service_id=e179cb6d0e1849f09f9c010008f0379b, region_id=RegionOne) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:49.098102 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b1e53-ed2f-46f1-a0b8-39fdf1840cf0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:49.099601 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b1e53-ed2f-46f1-a0b8-39fdf1840cf0 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:49.111683 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 505/1001] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:25:48 2022] GET /identity/v3/endpoints?service_id=e179cb6d0e1849f09f9c010008f0379b&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:49.112988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a76bc-1936-40ee-9b90-6babe85847cd None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:49.157838 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:49.221350 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a76bc-1936-40ee-9b90-6babe85847cd None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:49.256825 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3f566-4a78-4d84-a814-d89aa2f615ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:49.262592 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3f566-4a78-4d84-a814-d89aa2f615ca None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.262592 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3f566-4a78-4d84-a814-d89aa2f615ca None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.262592 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3f566-4a78-4d84-a814-d89aa2f615ca None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.262592 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3f566-4a78-4d84-a814-d89aa2f615ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:49.262592 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3f566-4a78-4d84-a814-d89aa2f615ca None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:49.274701 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 497/1002] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:25:49 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:25:49.643543 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f9f28-0784-4222-a094-de0915f6c331 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.643889 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f9f28-0784-4222-a094-de0915f6c331 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.644107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f9f28-0784-4222-a094-de0915f6c331 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.645652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 506/1003] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:49.650952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9572a37-6b03-4263-9dcf-4029434c685d None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.651244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9572a37-6b03-4263-9dcf-4029434c685d None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.651527 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9572a37-6b03-4263-9dcf-4029434c685d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.668927 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-a9572a37-6b03-4263-9dcf-4029434c685d None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:49.670132 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-a9572a37-6b03-4263-9dcf-4029434c685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:49.740065 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 498/1004] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:49.762464 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f9f28-0784-4222-a094-de0915f6c331 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:49.878959 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f9f28-0784-4222-a094-de0915f6c331 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:49.914124 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6fdf3-d522-4f6e-8cb1-7351278cb76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:49.914866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fdf3-d522-4f6e-8cb1-7351278cb76d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.915150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fdf3-d522-4f6e-8cb1-7351278cb76d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.915426 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fdf3-d522-4f6e-8cb1-7351278cb76d None admin] PATH_INFO: `/v3/services/image` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.916179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6fdf3-d522-4f6e-8cb1-7351278cb76d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:49.917621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6fdf3-d522-4f6e-8cb1-7351278cb76d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-3db6fdf3-d522-4f6e-8cb1-7351278cb76d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:49.930266 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:49.931610 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:25:49.932564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:49.934972 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 507/1005] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 20:25:49 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:49.937508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9572a37-6b03-4263-9dcf-4029434c685d None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:49.973854 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:50.045246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9572a37-6b03-4263-9dcf-4029434c685d None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:50.082421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d9a7c-a6e3-418e-83c2-677e574b1f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.083314 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d9a7c-a6e3-418e-83c2-677e574b1f0f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.083710 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d9a7c-a6e3-418e-83c2-677e574b1f0f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.083993 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d9a7c-a6e3-418e-83c2-677e574b1f0f None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.084716 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d9a7c-a6e3-418e-83c2-677e574b1f0f None admin] RBAC: Adding query filter params (name=image) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:50.085028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d9a7c-a6e3-418e-83c2-677e574b1f0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.086443 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d9a7c-a6e3-418e-83c2-677e574b1f0f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.097727 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 499/1006] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:50.099674 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6fdf3-d522-4f6e-8cb1-7351278cb76d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.149756 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:50.210211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6fdf3-d522-4f6e-8cb1-7351278cb76d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:50.245735 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a25915-93fc-4c43-a077-c8ad4ce7e8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.246359 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25915-93fc-4c43-a077-c8ad4ce7e8e7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.246665 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25915-93fc-4c43-a077-c8ad4ce7e8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.246963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25915-93fc-4c43-a077-c8ad4ce7e8e7 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.247668 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a25915-93fc-4c43-a077-c8ad4ce7e8e7 None admin] RBAC: Adding query filter params (type=image) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:50.247978 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a25915-93fc-4c43-a077-c8ad4ce7e8e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.249362 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a25915-93fc-4c43-a077-c8ad4ce7e8e7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.262643 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 508/1007] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:50.640963 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25661-d41c-485b-88a1-84ab507d8dcd None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.641515 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25661-d41c-485b-88a1-84ab507d8dcd None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.641515 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25661-d41c-485b-88a1-84ab507d8dcd None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.643088 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 500/1008] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:50.648325 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b086-75b5-476a-932b-80857c8e608e None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.648614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b086-75b5-476a-932b-80857c8e608e None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.648888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b086-75b5-476a-932b-80857c8e608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.666618 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-8376b086-75b5-476a-932b-80857c8e608e None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:50.667858 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-8376b086-75b5-476a-932b-80857c8e608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:50.740936 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 509/1009] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:50.764225 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d25661-d41c-485b-88a1-84ab507d8dcd None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.868769 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:50.873707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d25661-d41c-485b-88a1-84ab507d8dcd None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:50.909244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f85b0f-603f-47c5-a989-185e51053fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.909979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85b0f-603f-47c5-a989-185e51053fac None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.910334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85b0f-603f-47c5-a989-185e51053fac None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.910632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85b0f-603f-47c5-a989-185e51053fac None admin] PATH_INFO: `/v3/domains/default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.911853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85b0f-603f-47c5-a989-185e51053fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.913308 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85b0f-603f-47c5-a989-185e51053fac None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.915219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 501/1010] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:50.920747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b086-75b5-476a-932b-80857c8e608e None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.957256 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:51.027196 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b086-75b5-476a-932b-80857c8e608e None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.064509 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23f752-04ea-4339-b33f-c265d1f86106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.065183 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f752-04ea-4339-b33f-c265d1f86106 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.065468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f752-04ea-4339-b33f-c265d1f86106 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.065748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f752-04ea-4339-b33f-c265d1f86106 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.066491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23f752-04ea-4339-b33f-c265d1f86106 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:51.067977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23f752-04ea-4339-b33f-c265d1f86106 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:51.178453 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 510/1011] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:25:50 2022] POST /identity/v3/projects => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:51.595645 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905c44a-f9be-4d4b-9bdb-896a058443a3 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.596001 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905c44a-f9be-4d4b-9bdb-896a058443a3 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.596187 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905c44a-f9be-4d4b-9bdb-896a058443a3 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.597706 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 502/1012] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:51.603032 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5c12b-37db-43df-a8ab-59c61a475b61 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.603326 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5c12b-37db-43df-a8ab-59c61a475b61 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.603669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5c12b-37db-43df-a8ab-59c61a475b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.622927 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-cdd5c12b-37db-43df-a8ab-59c61a475b61 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:51.624166 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-cdd5c12b-37db-43df-a8ab-59c61a475b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:51.700018 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 511/1013] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:51.724885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905c44a-f9be-4d4b-9bdb-896a058443a3 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.847219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905c44a-f9be-4d4b-9bdb-896a058443a3 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.884378 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019b30-169b-469d-8a2b-a6b192367a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.885191 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019b30-169b-469d-8a2b-a6b192367a09 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.885478 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019b30-169b-469d-8a2b-a6b192367a09 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.885755 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019b30-169b-469d-8a2b-a6b192367a09 None admin] PATH_INFO: `/v3/services/compute` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.886413 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59019b30-169b-469d-8a2b-a6b192367a09 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:51.887833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59019b30-169b-469d-8a2b-a6b192367a09 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-59019b30-169b-469d-8a2b-a6b192367a09 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:51.900439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:51.901668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:51.903377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 503/1014] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:51.907804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5c12b-37db-43df-a8ab-59c61a475b61 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.928132 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:52.020314 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5c12b-37db-43df-a8ab-59c61a475b61 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.057521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54cc72-f8cf-4d97-99ef-1d47f09bb1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.058216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54cc72-f8cf-4d97-99ef-1d47f09bb1d5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.058502 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54cc72-f8cf-4d97-99ef-1d47f09bb1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.058803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54cc72-f8cf-4d97-99ef-1d47f09bb1d5 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.059536 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54cc72-f8cf-4d97-99ef-1d47f09bb1d5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:52.059847 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54cc72-f8cf-4d97-99ef-1d47f09bb1d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.061257 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54cc72-f8cf-4d97-99ef-1d47f09bb1d5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:52.072318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 512/1015] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:52.073295 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019b30-169b-469d-8a2b-a6b192367a09 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.108155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:52.182869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019b30-169b-469d-8a2b-a6b192367a09 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.219089 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6094d-e78a-4156-839f-2174228f0be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.219911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6094d-e78a-4156-839f-2174228f0be1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.220194 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6094d-e78a-4156-839f-2174228f0be1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.220475 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6094d-e78a-4156-839f-2174228f0be1 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.221190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6094d-e78a-4156-839f-2174228f0be1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:52.221498 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6094d-e78a-4156-839f-2174228f0be1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.222895 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6094d-e78a-4156-839f-2174228f0be1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:52.233133 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 504/1016] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:25:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:52.234766 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54cc72-f8cf-4d97-99ef-1d47f09bb1d5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.324753 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:52.355321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54cc72-f8cf-4d97-99ef-1d47f09bb1d5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.418769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bdf4b-e8cb-4296-ba04-4e05dbaa288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.419802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bdf4b-e8cb-4296-ba04-4e05dbaa288c None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.420246 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bdf4b-e8cb-4296-ba04-4e05dbaa288c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.420709 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bdf4b-e8cb-4296-ba04-4e05dbaa288c None admin] PATH_INFO: `/v3/endpoints` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.422109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bdf4b-e8cb-4296-ba04-4e05dbaa288c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.425252 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bdf4b-e8cb-4296-ba04-4e05dbaa288c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:52.510907 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 513/1017] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:25:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:25:52.546050 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0e93-f9d1-4c8d-aea7-6ccea704988c None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.546393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0e93-f9d1-4c8d-aea7-6ccea704988c None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.546768 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0e93-f9d1-4c8d-aea7-6ccea704988c None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.548765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 505/1018] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:52.555341 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d14b0-4e01-4a2f-b201-d6269bde6539 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.555658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d14b0-4e01-4a2f-b201-d6269bde6539 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.555894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d14b0-4e01-4a2f-b201-d6269bde6539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.575846 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-772d14b0-4e01-4a2f-b201-d6269bde6539 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:52.577126 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-772d14b0-4e01-4a2f-b201-d6269bde6539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:52.667233 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 514/1019] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:52.689099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0e93-f9d1-4c8d-aea7-6ccea704988c None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.799988 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:52.808501 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0e93-f9d1-4c8d-aea7-6ccea704988c None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.846748 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ab9d0-63c4-4097-8081-5af7d9f9cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.847444 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab9d0-63c4-4097-8081-5af7d9f9cdf3 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.847800 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab9d0-63c4-4097-8081-5af7d9f9cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.848004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab9d0-63c4-4097-8081-5af7d9f9cdf3 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.848773 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ab9d0-63c4-4097-8081-5af7d9f9cdf3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.850899 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ab9d0-63c4-4097-8081-5af7d9f9cdf3 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:52.961065 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 506/1020] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:25:52 2022] POST /identity/v3/services => generated 242 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:53.611538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c809af-3b9f-4907-8dd7-2907191a633e None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.612130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c809af-3b9f-4907-8dd7-2907191a633e None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.612130 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c809af-3b9f-4907-8dd7-2907191a633e None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.613647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 515/1021] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:53.619052 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a34fa-b9a6-4db7-af05-41f6aa21eeb1 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.619347 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a34fa-b9a6-4db7-af05-41f6aa21eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.619627 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a34fa-b9a6-4db7-af05-41f6aa21eeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.637642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-2b0a34fa-b9a6-4db7-af05-41f6aa21eeb1 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:53.638889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-2b0a34fa-b9a6-4db7-af05-41f6aa21eeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:53.721008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 507/1022] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:53.747267 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c809af-3b9f-4907-8dd7-2907191a633e None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:53.823139 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:53.869084 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c809af-3b9f-4907-8dd7-2907191a633e None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:53.907946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969f8f1-bd89-40f1-b8c3-03c5eb66b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:53.908764 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969f8f1-bd89-40f1-b8c3-03c5eb66b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.909046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969f8f1-bd89-40f1-b8c3-03c5eb66b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.909319 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969f8f1-bd89-40f1-b8c3-03c5eb66b6a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.910534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969f8f1-bd89-40f1-b8c3-03c5eb66b6a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:53.912039 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969f8f1-bd89-40f1-b8c3-03c5eb66b6a1 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:53.913901 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 516/1023] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:53.919494 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a34fa-b9a6-4db7-af05-41f6aa21eeb1 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:54.008889 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:54.028118 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a34fa-b9a6-4db7-af05-41f6aa21eeb1 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:54.065166 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0141926-1c7b-4d61-be77-68278a7b4ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:54.065863 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0141926-1c7b-4d61-be77-68278a7b4ddc None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.066144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0141926-1c7b-4d61-be77-68278a7b4ddc None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.066422 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0141926-1c7b-4d61-be77-68278a7b4ddc None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:54.067187 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0141926-1c7b-4d61-be77-68278a7b4ddc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:54.068646 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0141926-1c7b-4d61-be77-68278a7b4ddc None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:54.185275 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 508/1024] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:25:53 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:54.980800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee760c-8df7-41e1-a8ef-a5e9325aefd4 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.981366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee760c-8df7-41e1-a8ef-a5e9325aefd4 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.981366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee760c-8df7-41e1-a8ef-a5e9325aefd4 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:54.982952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 517/1025] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:54.988193 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582863-97ba-4a8a-8fb5-08309ebe996f None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.988634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582863-97ba-4a8a-8fb5-08309ebe996f None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.988748 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582863-97ba-4a8a-8fb5-08309ebe996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.007211 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-86582863-97ba-4a8a-8fb5-08309ebe996f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:55.008431 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-86582863-97ba-4a8a-8fb5-08309ebe996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:55.082492 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 509/1026] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:55.106409 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee760c-8df7-41e1-a8ef-a5e9325aefd4 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.219889 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee760c-8df7-41e1-a8ef-a5e9325aefd4 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.251797 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:55.257675 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8069407-de77-4628-b756-27b77d89868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.264280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8069407-de77-4628-b756-27b77d89868d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.264280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8069407-de77-4628-b756-27b77d89868d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.264280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8069407-de77-4628-b756-27b77d89868d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.271063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8069407-de77-4628-b756-27b77d89868d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-c8069407-de77-4628-b756-27b77d89868d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:55.279486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:55.280613 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:55.281586 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 518/1027] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:55.288943 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86582863-97ba-4a8a-8fb5-08309ebe996f None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.299870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716ad7-5409-4597-8518-1e0e37dd74d5 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.300668 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716ad7-5409-4597-8518-1e0e37dd74d5 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.301207 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716ad7-5409-4597-8518-1e0e37dd74d5 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.302668 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 519/1028] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:55.308355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11848c98-ee51-439c-b489-42bfc4361023 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.308643 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11848c98-ee51-439c-b489-42bfc4361023 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.308918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11848c98-ee51-439c-b489-42bfc4361023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.328041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-11848c98-ee51-439c-b489-42bfc4361023 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:55.329294 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-11848c98-ee51-439c-b489-42bfc4361023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:55.368773 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:55.407385 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86582863-97ba-4a8a-8fb5-08309ebe996f None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.411542 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 520/1029] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:55.434788 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11848c98-ee51-439c-b489-42bfc4361023 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.444665 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eba896-7742-4b81-948b-b128b4418cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.445354 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eba896-7742-4b81-948b-b128b4418cd4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.445676 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eba896-7742-4b81-948b-b128b4418cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.445959 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eba896-7742-4b81-948b-b128b4418cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.446754 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eba896-7742-4b81-948b-b128b4418cd4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:55.447068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eba896-7742-4b81-948b-b128b4418cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.448458 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eba896-7742-4b81-948b-b128b4418cd4 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.461677 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 510/1030] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:55.462800 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eba896-7742-4b81-948b-b128b4418cd4 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.544616 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11848c98-ee51-439c-b489-42bfc4361023 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.569772 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:55.575692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eba896-7742-4b81-948b-b128b4418cd4 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.582521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f3ef7-ea8c-46c8-bd8a-6fde2c1e1b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.584541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f3ef7-ea8c-46c8-bd8a-6fde2c1e1b69 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.584541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f3ef7-ea8c-46c8-bd8a-6fde2c1e1b69 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.584541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f3ef7-ea8c-46c8-bd8a-6fde2c1e1b69 None admin] PATH_INFO: `/v3/services/image` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.584995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f3ef7-ea8c-46c8-bd8a-6fde2c1e1b69 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.586402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f3ef7-ea8c-46c8-bd8a-6fde2c1e1b69 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-7f7f3ef7-ea8c-46c8-bd8a-6fde2c1e1b69 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:55.600156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:55.601474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:55.602824 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 521/1031] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:55.607996 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f3ef7-ea8c-46c8-bd8a-6fde2c1e1b69 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.611359 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:55.621931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ac616-59ef-4769-9cf5-3e8f19c8c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.621931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ac616-59ef-4769-9cf5-3e8f19c8c2fd None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.621931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ac616-59ef-4769-9cf5-3e8f19c8c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.621931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ac616-59ef-4769-9cf5-3e8f19c8c2fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.632849 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ac616-59ef-4769-9cf5-3e8f19c8c2fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.634431 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ac616-59ef-4769-9cf5-3e8f19c8c2fd None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-c53ac616-59ef-4769-9cf5-3e8f19c8c2fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:55.653814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:55.655035 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:55.656032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:55.656032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:55.656032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:55.656032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:55.656032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 511/1032] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:55.661369 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ac616-59ef-4769-9cf5-3e8f19c8c2fd None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.725801 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f3ef7-ea8c-46c8-bd8a-6fde2c1e1b69 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.764514 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c2be3-e064-430d-894d-72fe4276c698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.765183 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c2be3-e064-430d-894d-72fe4276c698 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.765470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c2be3-e064-430d-894d-72fe4276c698 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.765748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c2be3-e064-430d-894d-72fe4276c698 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.766491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c2be3-e064-430d-894d-72fe4276c698 None admin] RBAC: Adding query filter params (name=image) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:55.766834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c2be3-e064-430d-894d-72fe4276c698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.768230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c2be3-e064-430d-894d-72fe4276c698 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.772015 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ac616-59ef-4769-9cf5-3e8f19c8c2fd None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.773421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 522/1033] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:55.778871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c2be3-e064-430d-894d-72fe4276c698 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.814799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab2476-2429-4028-8a5d-f1221f901ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.815511 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab2476-2429-4028-8a5d-f1221f901ca6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.815857 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab2476-2429-4028-8a5d-f1221f901ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.816140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab2476-2429-4028-8a5d-f1221f901ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.816876 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab2476-2429-4028-8a5d-f1221f901ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:55.817183 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab2476-2429-4028-8a5d-f1221f901ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.818553 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab2476-2429-4028-8a5d-f1221f901ca6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.832027 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 512/1034] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:55.837633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab2476-2429-4028-8a5d-f1221f901ca6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.843641 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:55.884168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:55.900931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c2be3-e064-430d-894d-72fe4276c698 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.939711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ec126-5095-44e9-8fd3-dac63e5a69df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.940394 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec126-5095-44e9-8fd3-dac63e5a69df None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.940683 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec126-5095-44e9-8fd3-dac63e5a69df None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.940964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec126-5095-44e9-8fd3-dac63e5a69df None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.941686 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ec126-5095-44e9-8fd3-dac63e5a69df None admin] RBAC: Adding query filter params (type=image) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:55.942003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ec126-5095-44e9-8fd3-dac63e5a69df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.943446 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ec126-5095-44e9-8fd3-dac63e5a69df None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.947401 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab2476-2429-4028-8a5d-f1221f901ca6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.954281 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 523/1035] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:55.955366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ec126-5095-44e9-8fd3-dac63e5a69df None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.986840 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2d9f9-d9c8-4113-8534-bab72dc290fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.987659 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2d9f9-d9c8-4113-8534-bab72dc290fc None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.987940 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2d9f9-d9c8-4113-8534-bab72dc290fc None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.988221 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2d9f9-d9c8-4113-8534-bab72dc290fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.996220 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2d9f9-d9c8-4113-8534-bab72dc290fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.997669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2d9f9-d9c8-4113-8534-bab72dc290fc None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-26d2d9f9-d9c8-4113-8534-bab72dc290fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:56.013382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:56.014518 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:56.015617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:56.015617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:56.015617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:56.015617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:56.015617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:56.015617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:56.015617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:56.015617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:56.015617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:56.015617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:56.015617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 513/1036] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:56.020851 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2d9f9-d9c8-4113-8534-bab72dc290fc None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.068483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ec126-5095-44e9-8fd3-dac63e5a69df None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.083624 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:56.106851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b174d6-d421-491b-9623-214ee804ae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.107523 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b174d6-d421-491b-9623-214ee804ae22 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.107818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b174d6-d421-491b-9623-214ee804ae22 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.108105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b174d6-d421-491b-9623-214ee804ae22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.108867 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b174d6-d421-491b-9623-214ee804ae22 None admin] RBAC: Adding query filter params (interface=public, service_id=93bd3663407d465d899990ec4e0acf84, region_id=RegionOne) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:56.109177 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b174d6-d421-491b-9623-214ee804ae22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:56.110706 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b174d6-d421-491b-9623-214ee804ae22 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:56.120532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 524/1037] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/endpoints?service_id=93bd3663407d465d899990ec4e0acf84&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:56.121682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b174d6-d421-491b-9623-214ee804ae22 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.129006 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:56.133053 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2d9f9-d9c8-4113-8534-bab72dc290fc None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.180282 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2d6ea-69a8-45a7-97cd-b39a699f4194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.181135 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2d6ea-69a8-45a7-97cd-b39a699f4194 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.181423 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2d6ea-69a8-45a7-97cd-b39a699f4194 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.182115 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2d6ea-69a8-45a7-97cd-b39a699f4194 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.183273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2d6ea-69a8-45a7-97cd-b39a699f4194 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:56.183585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2d6ea-69a8-45a7-97cd-b39a699f4194 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:56.186039 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2d6ea-69a8-45a7-97cd-b39a699f4194 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:56.214642 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 514/1038] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:56.218628 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2d6ea-69a8-45a7-97cd-b39a699f4194 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.244199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b174d6-d421-491b-9623-214ee804ae22 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.285776 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b5490-914c-4f90-80dc-73ab6fae2346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.286455 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5490-914c-4f90-80dc-73ab6fae2346 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.286840 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5490-914c-4f90-80dc-73ab6fae2346 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.287122 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5490-914c-4f90-80dc-73ab6fae2346 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.287869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b5490-914c-4f90-80dc-73ab6fae2346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:56.289278 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b5490-914c-4f90-80dc-73ab6fae2346 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:56.296624 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 525/1039] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/services => generated 1957 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:25:56.351036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2d6ea-69a8-45a7-97cd-b39a699f4194 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.393389 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7c2f4-7608-4186-a618-036511d78928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.394070 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c2f4-7608-4186-a618-036511d78928 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.394353 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c2f4-7608-4186-a618-036511d78928 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.394652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c2f4-7608-4186-a618-036511d78928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.427413 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:56.477443 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7c2f4-7608-4186-a618-036511d78928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:56.479262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7c2f4-7608-4186-a618-036511d78928 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:56.534019 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50199e1e-7c17-4a9d-95fe-061673f6ec36 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.534304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50199e1e-7c17-4a9d-95fe-061673f6ec36 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.534588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50199e1e-7c17-4a9d-95fe-061673f6ec36 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.536436 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 526/1040] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:56.542756 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0937d-1bc5-49d1-b619-413458095a4b None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.543064 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0937d-1bc5-49d1-b619-413458095a4b None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.543316 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0937d-1bc5-49d1-b619-413458095a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.563957 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-53f0937d-1bc5-49d1-b619-413458095a4b None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:56.565893 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-53f0937d-1bc5-49d1-b619-413458095a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:56.599699 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 515/1041] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:25:56.601067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7c2f4-7608-4186-a618-036511d78928 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.603684 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:56.639114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 527/1042] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:56.664620 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0937d-1bc5-49d1-b619-413458095a4b None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.671043 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:56.721364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7c2f4-7608-4186-a618-036511d78928 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.758529 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dba375-c5db-49b2-9cd4-cc6ac2cf8cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.759282 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dba375-c5db-49b2-9cd4-cc6ac2cf8cc7 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.759573 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dba375-c5db-49b2-9cd4-cc6ac2cf8cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.759857 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dba375-c5db-49b2-9cd4-cc6ac2cf8cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.771388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dba375-c5db-49b2-9cd4-cc6ac2cf8cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:56.772855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dba375-c5db-49b2-9cd4-cc6ac2cf8cc7 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:56.782179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0937d-1bc5-49d1-b619-413458095a4b None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-b5dba375-c5db-49b2-9cd4-cc6ac2cf8cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:56.793119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:56.794175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:56.800859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:56.800859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:56.800859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:56.800859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:56.800859 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 516/1043] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:56.803485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dba375-c5db-49b2-9cd4-cc6ac2cf8cc7 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.825397 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dbff6-b036-42ff-a146-365d46d9479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.826320 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dbff6-b036-42ff-a146-365d46d9479a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.826627 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dbff6-b036-42ff-a146-365d46d9479a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.826917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dbff6-b036-42ff-a146-365d46d9479a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.838370 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dbff6-b036-42ff-a146-365d46d9479a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-735dbff6-b036-42ff-a146-365d46d9479a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:56.846365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:56.847495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:25:56.848434 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 528/1044] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:56.853304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dbff6-b036-42ff-a146-365d46d9479a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.888348 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:56.925315 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dba375-c5db-49b2-9cd4-cc6ac2cf8cc7 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.939135 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:56.963580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dbff6-b036-42ff-a146-365d46d9479a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.964964 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbea38-7613-4912-b741-3f3fb97f5037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.965756 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbea38-7613-4912-b741-3f3fb97f5037 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.966073 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbea38-7613-4912-b741-3f3fb97f5037 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.966354 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbea38-7613-4912-b741-3f3fb97f5037 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.967117 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbea38-7613-4912-b741-3f3fb97f5037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:56.967422 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbea38-7613-4912-b741-3f3fb97f5037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:56.968816 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbea38-7613-4912-b741-3f3fb97f5037 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:56.984303 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 517/1045] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:56.990139 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbea38-7613-4912-b741-3f3fb97f5037 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.005724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351aee5-f87b-4a5e-854e-ebc894acac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.006421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351aee5-f87b-4a5e-854e-ebc894acac94 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.006753 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351aee5-f87b-4a5e-854e-ebc894acac94 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.007056 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351aee5-f87b-4a5e-854e-ebc894acac94 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.007833 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351aee5-f87b-4a5e-854e-ebc894acac94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:57.008148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351aee5-f87b-4a5e-854e-ebc894acac94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.009615 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351aee5-f87b-4a5e-854e-ebc894acac94 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.018668 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 529/1046] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:57.027708 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351aee5-f87b-4a5e-854e-ebc894acac94 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.115447 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbea38-7613-4912-b741-3f3fb97f5037 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.133773 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.140554 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351aee5-f87b-4a5e-854e-ebc894acac94 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.155131 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab57f5-aa5a-4112-b0ce-f4b9ec4a53d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.155961 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab57f5-aa5a-4112-b0ce-f4b9ec4a53d8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.156255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab57f5-aa5a-4112-b0ce-f4b9ec4a53d8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.156534 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab57f5-aa5a-4112-b0ce-f4b9ec4a53d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.166681 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab57f5-aa5a-4112-b0ce-f4b9ec4a53d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.168765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab57f5-aa5a-4112-b0ce-f4b9ec4a53d8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.180628 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301fb8-55b6-417e-899f-ed854a7223bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.181517 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301fb8-55b6-417e-899f-ed854a7223bc None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.181801 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301fb8-55b6-417e-899f-ed854a7223bc None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.182082 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301fb8-55b6-417e-899f-ed854a7223bc None admin] PATH_INFO: `/v3/users/57583cf634cb41c583131f09ba97a0e7` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-e8ab57f5-aa5a-4112-b0ce-f4b9ec4a53d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:57.184801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:57.185771 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:57.186810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:57.186810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:57.186810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:57.186810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:57.186810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:57.186810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:57.186810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:57.186810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:57.186810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 518/1047] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:57.191903 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab57f5-aa5a-4112-b0ce-f4b9ec4a53d8 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.200171 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0301fb8-55b6-417e-899f-ed854a7223bc None admin] RBAC: Authorizing `identity:get_user(user_id=57583cf634cb41c583131f09ba97a0e7)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.201645 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0301fb8-55b6-417e-899f-ed854a7223bc None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.203629 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 530/1048] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/users/57583cf634cb41c583131f09ba97a0e7 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:57.209056 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301fb8-55b6-417e-899f-ed854a7223bc None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.228105 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.305934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab57f5-aa5a-4112-b0ce-f4b9ec4a53d8 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.322379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301fb8-55b6-417e-899f-ed854a7223bc None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.348340 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f8b1a-ef51-4628-ba3a-f8c48c146a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.349356 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f8b1a-ef51-4628-ba3a-f8c48c146a5f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.349693 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f8b1a-ef51-4628-ba3a-f8c48c146a5f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.349978 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f8b1a-ef51-4628-ba3a-f8c48c146a5f None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.351474 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f8b1a-ef51-4628-ba3a-f8c48c146a5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:57.351802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f8b1a-ef51-4628-ba3a-f8c48c146a5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.353799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f8b1a-ef51-4628-ba3a-f8c48c146a5f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.359289 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ac95-0c47-467b-8f1a-3b8382dcdb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.359994 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ac95-0c47-467b-8f1a-3b8382dcdb29 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.360805 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ac95-0c47-467b-8f1a-3b8382dcdb29 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.361058 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ac95-0c47-467b-8f1a-3b8382dcdb29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.370184 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 519/1049] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:57.376279 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f8b1a-ef51-4628-ba3a-f8c48c146a5f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.390646 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.451935 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1ac95-0c47-467b-8f1a-3b8382dcdb29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.453416 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1ac95-0c47-467b-8f1a-3b8382dcdb29 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.485498 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.495778 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f8b1a-ef51-4628-ba3a-f8c48c146a5f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.540693 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7f727-4d10-461c-aa48-ef434da6b66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.541374 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7f727-4d10-461c-aa48-ef434da6b66e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.541657 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7f727-4d10-461c-aa48-ef434da6b66e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.541936 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7f727-4d10-461c-aa48-ef434da6b66e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.542808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7f727-4d10-461c-aa48-ef434da6b66e None admin] RBAC: Adding query filter params (role.id=4929d71337674b21b9c568fd0cf3b00f, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=382eda270f1545718847c9687bd62846) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:57.543121 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7f727-4d10-461c-aa48-ef434da6b66e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.544564 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7f727-4d10-461c-aa48-ef434da6b66e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.551419 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 520/1050] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/role_assignments?user.id=382eda270f1545718847c9687bd62846&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=4929d71337674b21b9c568fd0cf3b00f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:57.566731 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 531/1051] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:25:57.572832 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7f727-4d10-461c-aa48-ef434da6b66e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.712236 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7f727-4d10-461c-aa48-ef434da6b66e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.759421 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6848a9-fe12-4cba-a3c4-322736ee6dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.760311 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6848a9-fe12-4cba-a3c4-322736ee6dfc None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.760600 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6848a9-fe12-4cba-a3c4-322736ee6dfc None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.760872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6848a9-fe12-4cba-a3c4-322736ee6dfc None admin] PATH_INFO: `/v3/projects/9f5815f3832c491d9a440a243469002f` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.762109 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6848a9-fe12-4cba-a3c4-322736ee6dfc None admin] RBAC: Authorizing `identity:get_project(project_id=9f5815f3832c491d9a440a243469002f)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.763579 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6848a9-fe12-4cba-a3c4-322736ee6dfc None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.765482 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 521/1052] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/projects/9f5815f3832c491d9a440a243469002f => generated 311 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:57.772439 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ac95-0c47-467b-8f1a-3b8382dcdb29 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.840562 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.890343 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ac95-0c47-467b-8f1a-3b8382dcdb29 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.927238 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b57ddd-e602-462b-8964-d1d909424302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.927909 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57ddd-e602-462b-8964-d1d909424302 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.928190 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57ddd-e602-462b-8964-d1d909424302 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.928462 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57ddd-e602-462b-8964-d1d909424302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.929305 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b57ddd-e602-462b-8964-d1d909424302 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=9f5815f3832c491d9a440a243469002f, user.id=57583cf634cb41c583131f09ba97a0e7) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:57.929614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b57ddd-e602-462b-8964-d1d909424302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.931248 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b57ddd-e602-462b-8964-d1d909424302 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.942701 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 532/1053] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/role_assignments?user.id=57583cf634cb41c583131f09ba97a0e7&scope.project.id=9f5815f3832c491d9a440a243469002f&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:58.618459 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cfd10-bccd-47a3-935c-2e0f8da891cb None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.619082 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cfd10-bccd-47a3-935c-2e0f8da891cb None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.619082 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cfd10-bccd-47a3-935c-2e0f8da891cb None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.620623 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 522/1054] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:58.626767 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e84b39-61dd-4132-a9e1-a6c02bd76470 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.627293 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e84b39-61dd-4132-a9e1-a6c02bd76470 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.627293 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e84b39-61dd-4132-a9e1-a6c02bd76470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.646542 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-b2e84b39-61dd-4132-a9e1-a6c02bd76470 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:58.647765 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-b2e84b39-61dd-4132-a9e1-a6c02bd76470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:58.728119 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 533/1055] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:58.751629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cfd10-bccd-47a3-935c-2e0f8da891cb None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:58.779203 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:58.871426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cfd10-bccd-47a3-935c-2e0f8da891cb None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:58.906683 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efe95b-3d37-4b02-9f29-95b4c9bdf85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:58.908019 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efe95b-3d37-4b02-9f29-95b4c9bdf85c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.908295 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efe95b-3d37-4b02-9f29-95b4c9bdf85c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.908561 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efe95b-3d37-4b02-9f29-95b4c9bdf85c None admin] PATH_INFO: `/v3/services/image` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.909240 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efe95b-3d37-4b02-9f29-95b4c9bdf85c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:58.910650 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efe95b-3d37-4b02-9f29-95b4c9bdf85c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-57efe95b-3d37-4b02-9f29-95b4c9bdf85c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:58.922489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:58.924217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:25:58.925172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:25:58.929719 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 523/1056] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 20:25:58 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:58.930820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e84b39-61dd-4132-a9e1-a6c02bd76470 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:58.978969 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:59.034787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e84b39-61dd-4132-a9e1-a6c02bd76470 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:59.070868 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ac428-e5b8-4276-9aaf-d62fb40a9953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:59.071576 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ac428-e5b8-4276-9aaf-d62fb40a9953 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:59.071857 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ac428-e5b8-4276-9aaf-d62fb40a9953 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:59.072127 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ac428-e5b8-4276-9aaf-d62fb40a9953 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:59.072837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ac428-e5b8-4276-9aaf-d62fb40a9953 None admin] RBAC: Adding query filter params (name=image) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:59.073142 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ac428-e5b8-4276-9aaf-d62fb40a9953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:59.074521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ac428-e5b8-4276-9aaf-d62fb40a9953 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:59.085276 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 534/1057] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:59.086709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efe95b-3d37-4b02-9f29-95b4c9bdf85c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:59.181387 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:59.197726 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efe95b-3d37-4b02-9f29-95b4c9bdf85c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:59.234229 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af657c-f8ee-43b1-b1c1-62194158fa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:59.235517 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af657c-f8ee-43b1-b1c1-62194158fa87 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:59.235845 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af657c-f8ee-43b1-b1c1-62194158fa87 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:59.236121 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af657c-f8ee-43b1-b1c1-62194158fa87 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:59.236842 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af657c-f8ee-43b1-b1c1-62194158fa87 None admin] RBAC: Adding query filter params (type=image) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:59.237146 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af657c-f8ee-43b1-b1c1-62194158fa87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:59.238521 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af657c-f8ee-43b1-b1c1-62194158fa87 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:59.245203 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 524/1058] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:25:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:59.251423 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ac428-e5b8-4276-9aaf-d62fb40a9953 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:59.357673 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ac428-e5b8-4276-9aaf-d62fb40a9953 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:59.369879 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:59.394261 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12e4b8-dea5-4ef8-9fdb-261687a1af93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:59.394981 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e4b8-dea5-4ef8-9fdb-261687a1af93 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:59.395277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e4b8-dea5-4ef8-9fdb-261687a1af93 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:59.395552 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e4b8-dea5-4ef8-9fdb-261687a1af93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:59.396313 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12e4b8-dea5-4ef8-9fdb-261687a1af93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:59.397704 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12e4b8-dea5-4ef8-9fdb-261687a1af93 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:59.502714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 535/1059] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:25:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:59.850019 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d9af2-2ed3-4601-972e-aae5b41274b3 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:59.850680 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d9af2-2ed3-4601-972e-aae5b41274b3 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:59.850680 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d9af2-2ed3-4601-972e-aae5b41274b3 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:59.852084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 525/1060] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:59.857689 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fa6e-e4ca-4302-a420-a172a81aa29f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:59.858157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fa6e-e4ca-4302-a420-a172a81aa29f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:59.858264 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fa6e-e4ca-4302-a420-a172a81aa29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:59.876231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-9295fa6e-e4ca-4302-a420-a172a81aa29f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:59.877429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-9295fa6e-e4ca-4302-a420-a172a81aa29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:59.964571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 536/1061] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:25:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:59.988065 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d9af2-2ed3-4601-972e-aae5b41274b3 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:00.102841 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d9af2-2ed3-4601-972e-aae5b41274b3 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:00.138389 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c57f0-2fa3-4af9-ae9d-409758837071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:00.139240 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c57f0-2fa3-4af9-ae9d-409758837071 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.139588 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c57f0-2fa3-4af9-ae9d-409758837071 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.139865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c57f0-2fa3-4af9-ae9d-409758837071 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.151260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c57f0-2fa3-4af9-ae9d-409758837071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-a70c57f0-2fa3-4af9-ae9d-409758837071 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:00.159757 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:00.160792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:00.161831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:26:00.166065 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 526/1062] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:25:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:00.166927 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fa6e-e4ca-4302-a420-a172a81aa29f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:00.255601 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f618c8-5394-4f28-a8ec-ad818b65afab None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.255966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f618c8-5394-4f28-a8ec-ad818b65afab None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.256172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f618c8-5394-4f28-a8ec-ad818b65afab None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.257762 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 527/1063] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:00.261884 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:00.262738 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ccc99-e406-4333-a605-781063171a7c None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.268132 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ccc99-e406-4333-a605-781063171a7c None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.268132 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ccc99-e406-4333-a605-781063171a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.273070 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fa6e-e4ca-4302-a420-a172a81aa29f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:00.281837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-b61ccc99-e406-4333-a605-781063171a7c None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:00.283080 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-b61ccc99-e406-4333-a605-781063171a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:00.286209 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:00.309908 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ef20a-d644-4695-a620-d60ad962157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:00.311298 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ef20a-d644-4695-a620-d60ad962157f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.311611 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ef20a-d644-4695-a620-d60ad962157f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.312061 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ef20a-d644-4695-a620-d60ad962157f None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.313745 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ef20a-d644-4695-a620-d60ad962157f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:00.314917 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ef20a-d644-4695-a620-d60ad962157f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:00.321407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ef20a-d644-4695-a620-d60ad962157f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:00.330543 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 537/1064] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:26:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:00.331741 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ef20a-d644-4695-a620-d60ad962157f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:00.360323 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 528/1065] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:00.383396 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ccc99-e406-4333-a605-781063171a7c None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:00.439910 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ef20a-d644-4695-a620-d60ad962157f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:00.478127 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aac4f-fdf2-4b12-a6fe-40b4f8f1775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:00.478966 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aac4f-fdf2-4b12-a6fe-40b4f8f1775a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.479251 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aac4f-fdf2-4b12-a6fe-40b4f8f1775a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.479529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aac4f-fdf2-4b12-a6fe-40b4f8f1775a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.490627 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689aac4f-fdf2-4b12-a6fe-40b4f8f1775a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:00.491596 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ccc99-e406-4333-a605-781063171a7c None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:00.492096 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689aac4f-fdf2-4b12-a6fe-40b4f8f1775a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-689aac4f-fdf2-4b12-a6fe-40b4f8f1775a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:00.510461 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:00.511682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:00.512706 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:00.512706 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:00.512706 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:00.512706 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:00.512706 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 538/1066] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:00.517843 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aac4f-fdf2-4b12-a6fe-40b4f8f1775a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:00.527169 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:00.535071 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860f52a-3ba5-4f00-993c-fbd2349c8700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:00.535881 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860f52a-3ba5-4f00-993c-fbd2349c8700 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.538897 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860f52a-3ba5-4f00-993c-fbd2349c8700 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.538897 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860f52a-3ba5-4f00-993c-fbd2349c8700 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.547893 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:00.551946 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860f52a-3ba5-4f00-993c-fbd2349c8700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-7860f52a-3ba5-4f00-993c-fbd2349c8700 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:00.560084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:00.561116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:26:00.562283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 529/1067] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:26:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:00.568360 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860f52a-3ba5-4f00-993c-fbd2349c8700 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:00.636464 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aac4f-fdf2-4b12-a6fe-40b4f8f1775a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:00.680078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fb225-7e25-4f7f-bffd-c873d1001f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:00.681076 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fb225-7e25-4f7f-bffd-c873d1001f30 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.681516 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fb225-7e25-4f7f-bffd-c873d1001f30 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.681950 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fb225-7e25-4f7f-bffd-c873d1001f30 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.682650 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860f52a-3ba5-4f00-993c-fbd2349c8700 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:00.683074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fb225-7e25-4f7f-bffd-c873d1001f30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:00.683577 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fb225-7e25-4f7f-bffd-c873d1001f30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:00.685389 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fb225-7e25-4f7f-bffd-c873d1001f30 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:00.702105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 539/1068] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:00.708366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fb225-7e25-4f7f-bffd-c873d1001f30 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:00.729999 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef66b3e-d868-43b4-b9dd-2f7a43092b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:00.730712 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef66b3e-d868-43b4-b9dd-2f7a43092b71 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.730999 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef66b3e-d868-43b4-b9dd-2f7a43092b71 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.731269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef66b3e-d868-43b4-b9dd-2f7a43092b71 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.732034 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef66b3e-d868-43b4-b9dd-2f7a43092b71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:00.732342 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef66b3e-d868-43b4-b9dd-2f7a43092b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:00.734670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef66b3e-d868-43b4-b9dd-2f7a43092b71 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:00.749658 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 530/1069] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:00.750888 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef66b3e-d868-43b4-b9dd-2f7a43092b71 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:00.780366 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:00.820720 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fb225-7e25-4f7f-bffd-c873d1001f30 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:00.837660 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:00.861462 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886d991-b92d-4a81-b986-c1b0b0937091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:00.862267 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886d991-b92d-4a81-b986-c1b0b0937091 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.862547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886d991-b92d-4a81-b986-c1b0b0937091 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.862850 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886d991-b92d-4a81-b986-c1b0b0937091 None admin] PATH_INFO: `/v3/users/nova` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.870981 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886d991-b92d-4a81-b986-c1b0b0937091 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:00.872477 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886d991-b92d-4a81-b986-c1b0b0937091 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:00.888456 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef66b3e-d868-43b4-b9dd-2f7a43092b71 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-5886d991-b92d-4a81-b986-c1b0b0937091 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:26:00.889470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:00.890448 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:00.892140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:00.892140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:00.892140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:26:00.892140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:26:00.892140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:26:00.892140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:26:00.892140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:26:00.892140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:26:00.892140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:26:00.892140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:00.892140 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 540/1070] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:26:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:00.897106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886d991-b92d-4a81-b986-c1b0b0937091 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:00.929532 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc46165-af99-42b8-8a35-af8fe36ac55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:00.930424 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc46165-af99-42b8-8a35-af8fe36ac55e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.930747 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc46165-af99-42b8-8a35-af8fe36ac55e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.931028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc46165-af99-42b8-8a35-af8fe36ac55e None admin] PATH_INFO: `/v3/users/57583cf634cb41c583131f09ba97a0e7` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.932262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc46165-af99-42b8-8a35-af8fe36ac55e None admin] RBAC: Authorizing `identity:get_user(user_id=57583cf634cb41c583131f09ba97a0e7)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:00.933708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc46165-af99-42b8-8a35-af8fe36ac55e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:00.935583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 531/1071] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:00 2022] GET /identity/v3/users/57583cf634cb41c583131f09ba97a0e7 => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:00.942173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc46165-af99-42b8-8a35-af8fe36ac55e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:01.009878 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886d991-b92d-4a81-b986-c1b0b0937091 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:01.041849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:01.052902 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dddf74-4880-4161-891e-e3826b24a076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:01.053694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dddf74-4880-4161-891e-e3826b24a076 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.057529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dddf74-4880-4161-891e-e3826b24a076 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.057529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dddf74-4880-4161-891e-e3826b24a076 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.057529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dddf74-4880-4161-891e-e3826b24a076 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:01.057529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dddf74-4880-4161-891e-e3826b24a076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:01.057529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dddf74-4880-4161-891e-e3826b24a076 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:01.063975 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc46165-af99-42b8-8a35-af8fe36ac55e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:01.081603 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 541/1072] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:26:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:01.083017 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dddf74-4880-4161-891e-e3826b24a076 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:01.100484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:01.107454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196348f4-fd65-4495-a061-6289424c0c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:01.108454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196348f4-fd65-4495-a061-6289424c0c25 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.108781 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196348f4-fd65-4495-a061-6289424c0c25 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.109155 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196348f4-fd65-4495-a061-6289424c0c25 None admin] PATH_INFO: `/v3/projects/9f5815f3832c491d9a440a243469002f` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.110398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196348f4-fd65-4495-a061-6289424c0c25 None admin] RBAC: Authorizing `identity:get_project(project_id=9f5815f3832c491d9a440a243469002f)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:01.111993 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196348f4-fd65-4495-a061-6289424c0c25 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:01.114804 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 532/1073] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:26:00 2022] GET /identity/v3/projects/9f5815f3832c491d9a440a243469002f => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:01.119740 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196348f4-fd65-4495-a061-6289424c0c25 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:01.195849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dddf74-4880-4161-891e-e3826b24a076 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:01.231051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196348f4-fd65-4495-a061-6289424c0c25 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:01.232557 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9376b1-431a-4736-a636-56bf0c2f71d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:01.233408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9376b1-431a-4736-a636-56bf0c2f71d9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.233712 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9376b1-431a-4736-a636-56bf0c2f71d9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.234010 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9376b1-431a-4736-a636-56bf0c2f71d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.245602 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9376b1-431a-4736-a636-56bf0c2f71d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:01.247124 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9376b1-431a-4736-a636-56bf0c2f71d9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-fb9376b1-431a-4736-a636-56bf0c2f71d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:01.266219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:01.267395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:01.268588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:01.268588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:01.268588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:01.268588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:01.270718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 542/1074] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:01.273354 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b540082-0d59-4374-9406-58ff5a0e54cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:01.274270 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b540082-0d59-4374-9406-58ff5a0e54cf None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.274554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b540082-0d59-4374-9406-58ff5a0e54cf None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.274885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b540082-0d59-4374-9406-58ff5a0e54cf None admin] PATH_INFO: `/v3/projects/9f5815f3832c491d9a440a243469002f/users/57583cf634cb41c583131f09ba97a0e7/roles/59689ee7c4f5409692318371dac5cbc7` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.276463 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9376b1-431a-4736-a636-56bf0c2f71d9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:01.276996 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b540082-0d59-4374-9406-58ff5a0e54cf None admin] RBAC: Authorizing `identity:create_grant(project_id=9f5815f3832c491d9a440a243469002f, user_id=57583cf634cb41c583131f09ba97a0e7, role_id=59689ee7c4f5409692318371dac5cbc7)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:01.278457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b540082-0d59-4374-9406-58ff5a0e54cf None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:01.315294 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:01.364835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 533/1075] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:26:01 2022] PUT /identity/v3/projects/9f5815f3832c491d9a440a243469002f/users/57583cf634cb41c583131f09ba97a0e7/roles/59689ee7c4f5409692318371dac5cbc7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:26:01.396558 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9376b1-431a-4736-a636-56bf0c2f71d9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:01.439160 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a16149-0617-4419-ac4e-2a298fcaf234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:01.439849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a16149-0617-4419-ac4e-2a298fcaf234 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.440134 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a16149-0617-4419-ac4e-2a298fcaf234 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.440407 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a16149-0617-4419-ac4e-2a298fcaf234 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.441181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a16149-0617-4419-ac4e-2a298fcaf234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:01.441487 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a16149-0617-4419-ac4e-2a298fcaf234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:01.443054 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a16149-0617-4419-ac4e-2a298fcaf234 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:01.462777 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 543/1076] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:01.464443 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b540082-0d59-4374-9406-58ff5a0e54cf None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:01.539100 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:01.592561 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b540082-0d59-4374-9406-58ff5a0e54cf None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:01.632818 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b9877-e4f9-4abd-af48-a7cd4214100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:01.633684 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b9877-e4f9-4abd-af48-a7cd4214100a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.634111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b9877-e4f9-4abd-af48-a7cd4214100a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.634389 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b9877-e4f9-4abd-af48-a7cd4214100a None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.643527 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b9877-e4f9-4abd-af48-a7cd4214100a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:01.645089 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b9877-e4f9-4abd-af48-a7cd4214100a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-eb8b9877-e4f9-4abd-af48-a7cd4214100a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:26:01.661574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:01.662711 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:01.663852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:26:01.663852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:26:01.663852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:26:01.663852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:26:01.663852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:26:01.663852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:26:01.663852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:01.663852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:26:01.663852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 534/1077] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:01.670730 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a16149-0617-4419-ac4e-2a298fcaf234 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:01.782965 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:01.794301 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a16149-0617-4419-ac4e-2a298fcaf234 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:01.835251 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2e496-4507-4eb6-b43a-326ba60e5f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:01.835923 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2e496-4507-4eb6-b43a-326ba60e5f91 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.836209 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2e496-4507-4eb6-b43a-326ba60e5f91 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.836594 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2e496-4507-4eb6-b43a-326ba60e5f91 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.837437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2e496-4507-4eb6-b43a-326ba60e5f91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:01.837754 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2e496-4507-4eb6-b43a-326ba60e5f91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:01.839250 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2e496-4507-4eb6-b43a-326ba60e5f91 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:01.852935 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 544/1078] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:01.858502 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2e496-4507-4eb6-b43a-326ba60e5f91 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:01.858976 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdbac5-65bf-476e-b8aa-4fe939c8b70f None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.859272 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdbac5-65bf-476e-b8aa-4fe939c8b70f None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.859560 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdbac5-65bf-476e-b8aa-4fe939c8b70f None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.861652 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 535/1079] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:01.867016 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27014ecd-98de-4540-a1b1-3c8312428b97 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.867303 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27014ecd-98de-4540-a1b1-3c8312428b97 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.867590 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27014ecd-98de-4540-a1b1-3c8312428b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.885105 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-27014ecd-98de-4540-a1b1-3c8312428b97 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:01.886316 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-27014ecd-98de-4540-a1b1-3c8312428b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:01.970649 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 536/1080] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:01.984597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2e496-4507-4eb6-b43a-326ba60e5f91 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:01.989453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27014ecd-98de-4540-a1b1-3c8312428b97 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:02.024031 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c870d-542d-4981-a7cf-44fd9afa3c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.024988 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c870d-542d-4981-a7cf-44fd9afa3c64 None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.025272 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c870d-542d-4981-a7cf-44fd9afa3c64 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.025543 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c870d-542d-4981-a7cf-44fd9afa3c64 None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/382eda270f1545718847c9687bd62846/roles/4929d71337674b21b9c568fd0cf3b00f` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.027831 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c870d-542d-4981-a7cf-44fd9afa3c64 None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=382eda270f1545718847c9687bd62846, role_id=4929d71337674b21b9c568fd0cf3b00f)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.029291 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c870d-542d-4981-a7cf-44fd9afa3c64 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.045492 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:02.096208 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27014ecd-98de-4540-a1b1-3c8312428b97 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:02.099658 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 545/1081] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:26:01 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/382eda270f1545718847c9687bd62846/roles/4929d71337674b21b9c568fd0cf3b00f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:26:02.144226 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a1428-bbd9-4839-9e2c-b063d0b1508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.144907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a1428-bbd9-4839-9e2c-b063d0b1508a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.145188 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a1428-bbd9-4839-9e2c-b063d0b1508a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.145469 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a1428-bbd9-4839-9e2c-b063d0b1508a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.225860 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a1428-bbd9-4839-9e2c-b063d0b1508a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.229067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a1428-bbd9-4839-9e2c-b063d0b1508a None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.283174 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:02.342481 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 537/1082] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:26:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:26:02.348831 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c870d-542d-4981-a7cf-44fd9afa3c64 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:02.367663 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:02.455060 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c870d-542d-4981-a7cf-44fd9afa3c64 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:02.490289 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619e31e-45ec-433a-a40f-64fb9096efea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.491161 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e31e-45ec-433a-a40f-64fb9096efea None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.491445 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e31e-45ec-433a-a40f-64fb9096efea None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.491721 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e31e-45ec-433a-a40f-64fb9096efea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.503386 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619e31e-45ec-433a-a40f-64fb9096efea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.504865 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619e31e-45ec-433a-a40f-64fb9096efea None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-0619e31e-45ec-433a-a40f-64fb9096efea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:02.523738 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:02.524778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:02.525754 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:02.525754 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:02.525754 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:02.525754 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:02.529904 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 546/1083] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:02.531263 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a1428-bbd9-4839-9e2c-b063d0b1508a None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:02.689581 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a1428-bbd9-4839-9e2c-b063d0b1508a None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:02.724816 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3ea4b-888c-4517-8319-4b94725efd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.725490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3ea4b-888c-4517-8319-4b94725efd97 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.725774 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3ea4b-888c-4517-8319-4b94725efd97 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.726052 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3ea4b-888c-4517-8319-4b94725efd97 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.726802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3ea4b-888c-4517-8319-4b94725efd97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:02.727137 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3ea4b-888c-4517-8319-4b94725efd97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.728514 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3ea4b-888c-4517-8319-4b94725efd97 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.750929 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 538/1084] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:03.676722 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7fb71-9c16-4b35-8183-1421cfaaa5b1 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.677306 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7fb71-9c16-4b35-8183-1421cfaaa5b1 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.677306 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7fb71-9c16-4b35-8183-1421cfaaa5b1 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.678872 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 547/1085] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:03.684378 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65683b4-aa74-49f2-ac3a-ec70e7aa5b9f None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.684852 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65683b4-aa74-49f2-ac3a-ec70e7aa5b9f None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.684958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65683b4-aa74-49f2-ac3a-ec70e7aa5b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.701725 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-c65683b4-aa74-49f2-ac3a-ec70e7aa5b9f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:03.702941 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-c65683b4-aa74-49f2-ac3a-ec70e7aa5b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:03.705474 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:03.774995 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 539/1086] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:03.799374 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7fb71-9c16-4b35-8183-1421cfaaa5b1 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:03.868500 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:03.903201 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7fb71-9c16-4b35-8183-1421cfaaa5b1 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:03.938660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efc43a-0597-48da-a4ee-fbf5a84901f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:03.939371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efc43a-0597-48da-a4ee-fbf5a84901f2 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.939654 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efc43a-0597-48da-a4ee-fbf5a84901f2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.939925 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efc43a-0597-48da-a4ee-fbf5a84901f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.950332 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efc43a-0597-48da-a4ee-fbf5a84901f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-96efc43a-0597-48da-a4ee-fbf5a84901f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:03.958596 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:03.959791 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:03.960888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 548/1087] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:26:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:03.965777 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65683b4-aa74-49f2-ac3a-ec70e7aa5b9f None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.068734 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65683b4-aa74-49f2-ac3a-ec70e7aa5b9f None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.103698 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26305bf-d2ad-4131-81ea-1a1e29c11014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.104398 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26305bf-d2ad-4131-81ea-1a1e29c11014 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.104665 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26305bf-d2ad-4131-81ea-1a1e29c11014 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.104985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26305bf-d2ad-4131-81ea-1a1e29c11014 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.105699 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26305bf-d2ad-4131-81ea-1a1e29c11014 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:04.106009 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26305bf-d2ad-4131-81ea-1a1e29c11014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:04.107410 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26305bf-d2ad-4131-81ea-1a1e29c11014 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:04.112704 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:04.116265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 540/1088] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:04.122247 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efc43a-0597-48da-a4ee-fbf5a84901f2 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.231774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efc43a-0597-48da-a4ee-fbf5a84901f2 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.259849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:04.267649 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc46c5-c62c-459c-b79f-baa39cfabfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.268663 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc46c5-c62c-459c-b79f-baa39cfabfe2 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.268981 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc46c5-c62c-459c-b79f-baa39cfabfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.269261 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc46c5-c62c-459c-b79f-baa39cfabfe2 None admin] PATH_INFO: `/v3/users/57583cf634cb41c583131f09ba97a0e7` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.270466 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc46c5-c62c-459c-b79f-baa39cfabfe2 None admin] RBAC: Authorizing `identity:get_user(user_id=57583cf634cb41c583131f09ba97a0e7)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:04.271996 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc46c5-c62c-459c-b79f-baa39cfabfe2 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:04.273800 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 549/1089] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/users/57583cf634cb41c583131f09ba97a0e7 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:04.279717 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26305bf-d2ad-4131-81ea-1a1e29c11014 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.381742 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26305bf-d2ad-4131-81ea-1a1e29c11014 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.385553 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c24a7-79e8-412a-a098-8ed754bd9815 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.385850 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c24a7-79e8-412a-a098-8ed754bd9815 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.386135 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c24a7-79e8-412a-a098-8ed754bd9815 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.387563 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 550/1090] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:04.392798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e015439-7508-4b42-aebe-da6d113bc270 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.393095 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e015439-7508-4b42-aebe-da6d113bc270 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.393378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e015439-7508-4b42-aebe-da6d113bc270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.410078 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-5e015439-7508-4b42-aebe-da6d113bc270 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:04.411312 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-5e015439-7508-4b42-aebe-da6d113bc270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:04.416484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c852a2-36c5-4bc1-bc2b-c36b0d69f2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.417144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c852a2-36c5-4bc1-bc2b-c36b0d69f2ce None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.417429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c852a2-36c5-4bc1-bc2b-c36b0d69f2ce None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.417707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c852a2-36c5-4bc1-bc2b-c36b0d69f2ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.481065 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 551/1091] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:04.486364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:04.488751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c852a2-36c5-4bc1-bc2b-c36b0d69f2ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:04.490244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c852a2-36c5-4bc1-bc2b-c36b0d69f2ce None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:04.504591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e015439-7508-4b42-aebe-da6d113bc270 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.592699 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 541/1092] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:04.599078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c852a2-36c5-4bc1-bc2b-c36b0d69f2ce None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.611742 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e015439-7508-4b42-aebe-da6d113bc270 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.639642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:04.648856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c7c1e-2b8d-4eee-96c8-81bd6486f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.651397 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c7c1e-2b8d-4eee-96c8-81bd6486f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.651397 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c7c1e-2b8d-4eee-96c8-81bd6486f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.651397 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c7c1e-2b8d-4eee-96c8-81bd6486f8b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.660651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c7c1e-2b8d-4eee-96c8-81bd6486f8b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-135c7c1e-2b8d-4eee-96c8-81bd6486f8b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:04.669027 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:04.670106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:04.671074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 552/1093] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:04.676633 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c7c1e-2b8d-4eee-96c8-81bd6486f8b5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.698552 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:04.701602 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c852a2-36c5-4bc1-bc2b-c36b0d69f2ce None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.737636 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dddd2-0bf4-47a2-ac84-e6f4bc6250b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.738422 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dddd2-0bf4-47a2-ac84-e6f4bc6250b6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.738741 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dddd2-0bf4-47a2-ac84-e6f4bc6250b6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.739023 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dddd2-0bf4-47a2-ac84-e6f4bc6250b6 None admin] PATH_INFO: `/v3/projects/9f5815f3832c491d9a440a243469002f` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.740230 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dddd2-0bf4-47a2-ac84-e6f4bc6250b6 None admin] RBAC: Authorizing `identity:get_project(project_id=9f5815f3832c491d9a440a243469002f)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:04.741675 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dddd2-0bf4-47a2-ac84-e6f4bc6250b6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:04.744733 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 542/1094] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/projects/9f5815f3832c491d9a440a243469002f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:04.749553 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dddd2-0bf4-47a2-ac84-e6f4bc6250b6 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.780715 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c7c1e-2b8d-4eee-96c8-81bd6486f8b5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.816704 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879bc7f-67fb-4cd5-9c79-fecb84d97a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.817388 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879bc7f-67fb-4cd5-9c79-fecb84d97a0a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.817671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879bc7f-67fb-4cd5-9c79-fecb84d97a0a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.817941 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879bc7f-67fb-4cd5-9c79-fecb84d97a0a None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.818726 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879bc7f-67fb-4cd5-9c79-fecb84d97a0a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:04.819035 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879bc7f-67fb-4cd5-9c79-fecb84d97a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:04.820429 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879bc7f-67fb-4cd5-9c79-fecb84d97a0a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:04.831074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 553/1095] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:04.836804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879bc7f-67fb-4cd5-9c79-fecb84d97a0a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.854098 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dddd2-0bf4-47a2-ac84-e6f4bc6250b6 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.887179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:04.889151 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e270b-8587-4fc5-a6e2-5828787def46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.889814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e270b-8587-4fc5-a6e2-5828787def46 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.890096 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e270b-8587-4fc5-a6e2-5828787def46 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.890370 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e270b-8587-4fc5-a6e2-5828787def46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.892103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e270b-8587-4fc5-a6e2-5828787def46 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=9f5815f3832c491d9a440a243469002f, user.id=57583cf634cb41c583131f09ba97a0e7) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:04.892418 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e270b-8587-4fc5-a6e2-5828787def46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:04.893850 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e270b-8587-4fc5-a6e2-5828787def46 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:04.899931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 543/1096] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/role_assignments?user.id=57583cf634cb41c583131f09ba97a0e7&scope.project.id=9f5815f3832c491d9a440a243469002f&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:04.948106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879bc7f-67fb-4cd5-9c79-fecb84d97a0a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.985564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555fe1b-5984-40b3-82f2-cd24e917bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.986379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555fe1b-5984-40b3-82f2-cd24e917bebf None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.986688 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555fe1b-5984-40b3-82f2-cd24e917bebf None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.986960 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555fe1b-5984-40b3-82f2-cd24e917bebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.999129 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555fe1b-5984-40b3-82f2-cd24e917bebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:05.001136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555fe1b-5984-40b3-82f2-cd24e917bebf None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-c555fe1b-5984-40b3-82f2-cd24e917bebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:05.019752 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:05.021024 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:05.022055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:05.022055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:05.022055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:05.022055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:05.022055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 554/1097] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:05.027283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e270b-8587-4fc5-a6e2-5828787def46 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:05.062415 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:05.136086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e270b-8587-4fc5-a6e2-5828787def46 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:05.170292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd423e-80fc-4897-8a68-ad75f69c53b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:05.171012 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd423e-80fc-4897-8a68-ad75f69c53b1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:05.171299 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd423e-80fc-4897-8a68-ad75f69c53b1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:05.171575 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd423e-80fc-4897-8a68-ad75f69c53b1 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:05.172824 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd423e-80fc-4897-8a68-ad75f69c53b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:05.173132 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd423e-80fc-4897-8a68-ad75f69c53b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:05.174503 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd423e-80fc-4897-8a68-ad75f69c53b1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:05.186280 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 544/1098] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:05.192609 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555fe1b-5984-40b3-82f2-cd24e917bebf None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:05.293943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:05.297871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555fe1b-5984-40b3-82f2-cd24e917bebf None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:05.332342 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328a7a8-4399-4dcc-81e7-77059695c116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:05.333136 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328a7a8-4399-4dcc-81e7-77059695c116 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:05.333419 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328a7a8-4399-4dcc-81e7-77059695c116 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:05.333693 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328a7a8-4399-4dcc-81e7-77059695c116 None admin] PATH_INFO: `/v3/users/nova` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:05.341727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328a7a8-4399-4dcc-81e7-77059695c116 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:05.343226 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328a7a8-4399-4dcc-81e7-77059695c116 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-9328a7a8-4399-4dcc-81e7-77059695c116 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:26:05.357799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:05.359212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:05.361037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:05.361037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:05.361037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:26:05.361037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:26:05.361037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:26:05.361037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:26:05.361037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:26:05.361037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:26:05.361037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:26:05.361037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:05.361885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 555/1099] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:26:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:05.365321 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd423e-80fc-4897-8a68-ad75f69c53b1 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:05.471400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:05.486577 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd423e-80fc-4897-8a68-ad75f69c53b1 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:05.543912 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b9085-d854-4427-91fa-dd30363abebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:05.544651 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b9085-d854-4427-91fa-dd30363abebd None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:05.544878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b9085-d854-4427-91fa-dd30363abebd None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:05.545151 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b9085-d854-4427-91fa-dd30363abebd None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:05.546000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b9085-d854-4427-91fa-dd30363abebd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:05.546308 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b9085-d854-4427-91fa-dd30363abebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:05.548441 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b9085-d854-4427-91fa-dd30363abebd None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:05.566453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 545/1100] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:26:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:05.572452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328a7a8-4399-4dcc-81e7-77059695c116 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:05.673181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328a7a8-4399-4dcc-81e7-77059695c116 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:05.707175 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9527cd-9c82-46cb-aa81-30f8b8f304f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:05.707823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9527cd-9c82-46cb-aa81-30f8b8f304f3 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:05.708102 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9527cd-9c82-46cb-aa81-30f8b8f304f3 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:05.708372 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9527cd-9c82-46cb-aa81-30f8b8f304f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:05.738193 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:05.780166 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9527cd-9c82-46cb-aa81-30f8b8f304f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:05.782507 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9527cd-9c82-46cb-aa81-30f8b8f304f3 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:05.890682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 556/1101] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:26:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:05.896572 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b9085-d854-4427-91fa-dd30363abebd None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:05.998964 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b9085-d854-4427-91fa-dd30363abebd None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:06.036885 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1f6bb-f52d-42f4-b3f3-6d44ee480540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:06.037695 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1f6bb-f52d-42f4-b3f3-6d44ee480540 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.037983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1f6bb-f52d-42f4-b3f3-6d44ee480540 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.038269 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1f6bb-f52d-42f4-b3f3-6d44ee480540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.049689 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1f6bb-f52d-42f4-b3f3-6d44ee480540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:06.051510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1f6bb-f52d-42f4-b3f3-6d44ee480540 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-88b1f6bb-f52d-42f4-b3f3-6d44ee480540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:06.069439 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:06.070679 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:06.071865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:06.071865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:06.071865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:06.071865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:26:06.071865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 546/1102] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:06.076654 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9527cd-9c82-46cb-aa81-30f8b8f304f3 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:06.138761 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:06.182795 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9527cd-9c82-46cb-aa81-30f8b8f304f3 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:06.218061 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be3f27-20b3-4118-aa7e-88fb907a40ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:06.218764 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be3f27-20b3-4118-aa7e-88fb907a40ae None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.219560 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be3f27-20b3-4118-aa7e-88fb907a40ae None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.219838 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be3f27-20b3-4118-aa7e-88fb907a40ae None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.220578 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be3f27-20b3-4118-aa7e-88fb907a40ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:06.220888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be3f27-20b3-4118-aa7e-88fb907a40ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:06.222295 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be3f27-20b3-4118-aa7e-88fb907a40ae None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:06.234297 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 557/1103] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:06.240696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1f6bb-f52d-42f4-b3f3-6d44ee480540 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:06.243665 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:06.342386 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1f6bb-f52d-42f4-b3f3-6d44ee480540 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:06.377012 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20635070-b6fe-4573-b850-031d7b4bf906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:06.377812 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20635070-b6fe-4573-b850-031d7b4bf906 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.378100 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20635070-b6fe-4573-b850-031d7b4bf906 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.378379 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20635070-b6fe-4573-b850-031d7b4bf906 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.385114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20635070-b6fe-4573-b850-031d7b4bf906 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:06.386558 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20635070-b6fe-4573-b850-031d7b4bf906 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-20635070-b6fe-4573-b850-031d7b4bf906 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:26:06.400234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:06.401382 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:06.402539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:26:06.402539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:26:06.402539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:26:06.402539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:26:06.402539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:26:06.402539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:26:06.402539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:06.402539 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:26:06.406212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 547/1104] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:06.407999 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be3f27-20b3-4118-aa7e-88fb907a40ae None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:06.514580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be3f27-20b3-4118-aa7e-88fb907a40ae None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:06.535895 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:06.550065 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51872d30-5edc-4f80-af5b-b73e1933fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:06.550764 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872d30-5edc-4f80-af5b-b73e1933fd27 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.551315 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872d30-5edc-4f80-af5b-b73e1933fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.551590 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872d30-5edc-4f80-af5b-b73e1933fd27 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.552383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51872d30-5edc-4f80-af5b-b73e1933fd27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:06.552695 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51872d30-5edc-4f80-af5b-b73e1933fd27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:06.554142 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51872d30-5edc-4f80-af5b-b73e1933fd27 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:06.566724 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 558/1105] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:06.573381 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20635070-b6fe-4573-b850-031d7b4bf906 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:06.635621 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:06.676150 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20635070-b6fe-4573-b850-031d7b4bf906 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:06.710540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ccdaf-1b5a-4454-b46e-4a8990089c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:06.711326 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ccdaf-1b5a-4454-b46e-4a8990089c92 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.711593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ccdaf-1b5a-4454-b46e-4a8990089c92 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.711868 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ccdaf-1b5a-4454-b46e-4a8990089c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.712712 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ccdaf-1b5a-4454-b46e-4a8990089c92 None admin] RBAC: Adding query filter params (role.id=4929d71337674b21b9c568fd0cf3b00f, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=382eda270f1545718847c9687bd62846) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:06.713028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ccdaf-1b5a-4454-b46e-4a8990089c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:06.714467 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ccdaf-1b5a-4454-b46e-4a8990089c92 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:06.721328 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 548/1106] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:26:06 2022] GET /identity/v3/role_assignments?user.id=382eda270f1545718847c9687bd62846&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=4929d71337674b21b9c568fd0cf3b00f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:07.224330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d57185-618b-423e-a922-b0df03dfab67 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.224857 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d57185-618b-423e-a922-b0df03dfab67 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.224857 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d57185-618b-423e-a922-b0df03dfab67 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.230118 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 559/1107] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:07.231788 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f035-28d2-4e02-8a54-069cbe9fb82c None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.232224 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f035-28d2-4e02-8a54-069cbe9fb82c None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.232328 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f035-28d2-4e02-8a54-069cbe9fb82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.250512 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-e825f035-28d2-4e02-8a54-069cbe9fb82c None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:07.254257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-e825f035-28d2-4e02-8a54-069cbe9fb82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:07.323375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 549/1108] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:07.350302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d57185-618b-423e-a922-b0df03dfab67 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:07.458113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d57185-618b-423e-a922-b0df03dfab67 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:07.495719 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db557b-d4e5-4da2-8111-97674409bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:07.496443 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db557b-d4e5-4da2-8111-97674409bb7f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.496723 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db557b-d4e5-4da2-8111-97674409bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.496998 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db557b-d4e5-4da2-8111-97674409bb7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.498187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db557b-d4e5-4da2-8111-97674409bb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:07.499651 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db557b-d4e5-4da2-8111-97674409bb7f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:07.501341 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 560/1109] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:26:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:07.507335 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825f035-28d2-4e02-8a54-069cbe9fb82c None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:07.569709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:07.614937 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825f035-28d2-4e02-8a54-069cbe9fb82c None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:07.651078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaa468-6e10-449f-aacf-4e31c4a55650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:07.651751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa468-6e10-449f-aacf-4e31c4a55650 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.652031 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa468-6e10-449f-aacf-4e31c4a55650 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.652301 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa468-6e10-449f-aacf-4e31c4a55650 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.653011 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaa468-6e10-449f-aacf-4e31c4a55650 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:07.654460 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaa468-6e10-449f-aacf-4e31c4a55650 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:07.737680 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 550/1110] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:26:07 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:10.026172 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de8bc1-3e54-461b-9eec-3075f6cee036 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:10.026762 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de8bc1-3e54-461b-9eec-3075f6cee036 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:10.026762 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de8bc1-3e54-461b-9eec-3075f6cee036 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:10.028125 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 561/1111] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:10.033992 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9dca-b02d-4037-a72e-f4419249e910 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:10.034403 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9dca-b02d-4037-a72e-f4419249e910 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:10.034547 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9dca-b02d-4037-a72e-f4419249e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:10.052077 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-b23a9dca-b02d-4037-a72e-f4419249e910 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:10.053215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-b23a9dca-b02d-4037-a72e-f4419249e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:10.118627 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 551/1112] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:10.141642 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de8bc1-3e54-461b-9eec-3075f6cee036 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:10.192547 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:10.244548 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de8bc1-3e54-461b-9eec-3075f6cee036 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:10.278417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e34e6b-77a6-4e8e-83d1-48e33a50a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:10.279294 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e34e6b-77a6-4e8e-83d1-48e33a50a12d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:10.279573 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e34e6b-77a6-4e8e-83d1-48e33a50a12d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:10.279841 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e34e6b-77a6-4e8e-83d1-48e33a50a12d None admin] PATH_INFO: `/v3/roles/920e2cadf3044abda66c715e1c89f4e3` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:10.281893 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e34e6b-77a6-4e8e-83d1-48e33a50a12d None admin] RBAC: Authorizing `identity:get_role(role_id=920e2cadf3044abda66c715e1c89f4e3)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:10.283298 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e34e6b-77a6-4e8e-83d1-48e33a50a12d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:10.284675 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 562/1113] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:10 2022] GET /identity/v3/roles/920e2cadf3044abda66c715e1c89f4e3 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:10.290553 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a9dca-b02d-4037-a72e-f4419249e910 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:10.333682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:10.388776 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a9dca-b02d-4037-a72e-f4419249e910 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:10.422795 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cd6f5-cecc-4ae0-a3bf-0b478872390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:10.423664 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd6f5-cecc-4ae0-a3bf-0b478872390f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:10.423947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd6f5-cecc-4ae0-a3bf-0b478872390f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:10.424221 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd6f5-cecc-4ae0-a3bf-0b478872390f None admin] PATH_INFO: `/v3/users/cabbd86fa06d4e678d3cff6a208ac5cc` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:10.437640 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cd6f5-cecc-4ae0-a3bf-0b478872390f None admin] RBAC: Authorizing `identity:get_user(user_id=cabbd86fa06d4e678d3cff6a208ac5cc)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:10.439109 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cd6f5-cecc-4ae0-a3bf-0b478872390f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:10.440777 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 552/1114] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:10 2022] GET /identity/v3/users/cabbd86fa06d4e678d3cff6a208ac5cc => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:10.446636 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e34e6b-77a6-4e8e-83d1-48e33a50a12d None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:10.548186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e34e6b-77a6-4e8e-83d1-48e33a50a12d None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:10.566546 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:10.584350 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88290a4-964c-4da2-a3dd-759314439f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:10.584943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88290a4-964c-4da2-a3dd-759314439f99 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:10.585225 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88290a4-964c-4da2-a3dd-759314439f99 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:10.585500 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88290a4-964c-4da2-a3dd-759314439f99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:10.652068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88290a4-964c-4da2-a3dd-759314439f99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:10.653537 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88290a4-964c-4da2-a3dd-759314439f99 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:10.752051 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 563/1115] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:26:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:10.757990 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cd6f5-cecc-4ae0-a3bf-0b478872390f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:10.855485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:10.858298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cd6f5-cecc-4ae0-a3bf-0b478872390f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:10.892295 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08da5aa-576f-4483-a5b8-36457dac9cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:10.893172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08da5aa-576f-4483-a5b8-36457dac9cce None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:10.893759 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08da5aa-576f-4483-a5b8-36457dac9cce None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:10.894034 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08da5aa-576f-4483-a5b8-36457dac9cce None admin] PATH_INFO: `/v3/projects/9f5815f3832c491d9a440a243469002f` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:10.895240 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08da5aa-576f-4483-a5b8-36457dac9cce None admin] RBAC: Authorizing `identity:get_project(project_id=9f5815f3832c491d9a440a243469002f)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:10.896653 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08da5aa-576f-4483-a5b8-36457dac9cce None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:10.898451 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 553/1116] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:26:10 2022] GET /identity/v3/projects/9f5815f3832c491d9a440a243469002f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:10.904741 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88290a4-964c-4da2-a3dd-759314439f99 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:10.923190 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:11.003929 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88290a4-964c-4da2-a3dd-759314439f99 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:11.037951 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bab7e-2317-4d6f-800e-f3234dd2a14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:11.038598 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bab7e-2317-4d6f-800e-f3234dd2a14a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.038907 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bab7e-2317-4d6f-800e-f3234dd2a14a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.039180 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bab7e-2317-4d6f-800e-f3234dd2a14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.040013 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bab7e-2317-4d6f-800e-f3234dd2a14a None admin] RBAC: Adding query filter params (role.id=920e2cadf3044abda66c715e1c89f4e3, scope.project.id=9f5815f3832c491d9a440a243469002f, user.id=cabbd86fa06d4e678d3cff6a208ac5cc) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:11.040325 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bab7e-2317-4d6f-800e-f3234dd2a14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:11.041763 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bab7e-2317-4d6f-800e-f3234dd2a14a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:11.047414 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 564/1117] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:26:10 2022] GET /identity/v3/role_assignments?user.id=cabbd86fa06d4e678d3cff6a208ac5cc&scope.project.id=9f5815f3832c491d9a440a243469002f&role.id=920e2cadf3044abda66c715e1c89f4e3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:13.271692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14752fc-db10-4e69-ba2b-359b41c2a34b None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.272234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14752fc-db10-4e69-ba2b-359b41c2a34b None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.272234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14752fc-db10-4e69-ba2b-359b41c2a34b None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.273674 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 554/1118] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:13.279120 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091a5f9-d2ae-49b4-aea3-f89114f35e0a None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.279578 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091a5f9-d2ae-49b4-aea3-f89114f35e0a None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.279689 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091a5f9-d2ae-49b4-aea3-f89114f35e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.297243 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-3091a5f9-d2ae-49b4-aea3-f89114f35e0a None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:13.298444 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-3091a5f9-d2ae-49b4-aea3-f89114f35e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:13.366709 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 565/1119] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:13.390262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14752fc-db10-4e69-ba2b-359b41c2a34b None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.492357 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14752fc-db10-4e69-ba2b-359b41c2a34b None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:13.529145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ea8b2-29aa-4292-b70a-70a1b1a4e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:13.529931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ea8b2-29aa-4292-b70a-70a1b1a4e8a5 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.530215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ea8b2-29aa-4292-b70a-70a1b1a4e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.530490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ea8b2-29aa-4292-b70a-70a1b1a4e8a5 None admin] PATH_INFO: `/v3/roles/920e2cadf3044abda66c715e1c89f4e3` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.532584 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ea8b2-29aa-4292-b70a-70a1b1a4e8a5 None admin] RBAC: Authorizing `identity:get_role(role_id=920e2cadf3044abda66c715e1c89f4e3)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:13.533962 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ea8b2-29aa-4292-b70a-70a1b1a4e8a5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:13.535416 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 555/1120] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:13 2022] GET /identity/v3/roles/920e2cadf3044abda66c715e1c89f4e3 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:13.541495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091a5f9-d2ae-49b4-aea3-f89114f35e0a None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.554413 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:13.643124 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091a5f9-d2ae-49b4-aea3-f89114f35e0a None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:13.677968 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3906-f6bf-4544-9499-d86d402832a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:13.678967 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3906-f6bf-4544-9499-d86d402832a3 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.679246 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3906-f6bf-4544-9499-d86d402832a3 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.679521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3906-f6bf-4544-9499-d86d402832a3 None admin] PATH_INFO: `/v3/users/cabbd86fa06d4e678d3cff6a208ac5cc` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.680875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3906-f6bf-4544-9499-d86d402832a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cabbd86fa06d4e678d3cff6a208ac5cc)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:13.682356 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3906-f6bf-4544-9499-d86d402832a3 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:13.684063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 566/1121] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:13 2022] GET /identity/v3/users/cabbd86fa06d4e678d3cff6a208ac5cc => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:13.690400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ea8b2-29aa-4292-b70a-70a1b1a4e8a5 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.734942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:13.801008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ea8b2-29aa-4292-b70a-70a1b1a4e8a5 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:13.835190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bd864-c81f-483d-b4d9-ddb1b3816ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:13.836062 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bd864-c81f-483d-b4d9-ddb1b3816ce5 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.836344 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bd864-c81f-483d-b4d9-ddb1b3816ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.836617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bd864-c81f-483d-b4d9-ddb1b3816ce5 None admin] PATH_INFO: `/v3/projects/9f5815f3832c491d9a440a243469002f` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.837811 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bd864-c81f-483d-b4d9-ddb1b3816ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=9f5815f3832c491d9a440a243469002f)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:13.839283 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bd864-c81f-483d-b4d9-ddb1b3816ce5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:13.840987 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 556/1122] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:26:13 2022] GET /identity/v3/projects/9f5815f3832c491d9a440a243469002f => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:13.847432 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3906-f6bf-4544-9499-d86d402832a3 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.926215 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:13.947494 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3906-f6bf-4544-9499-d86d402832a3 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:13.982381 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde8583-a2ae-4736-a47c-26ca687b8781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:13.983288 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8583-a2ae-4736-a47c-26ca687b8781 None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.983570 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8583-a2ae-4736-a47c-26ca687b8781 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.983840 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8583-a2ae-4736-a47c-26ca687b8781 None admin] PATH_INFO: `/v3/projects/9f5815f3832c491d9a440a243469002f/users/cabbd86fa06d4e678d3cff6a208ac5cc/roles/920e2cadf3044abda66c715e1c89f4e3` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.986875 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde8583-a2ae-4736-a47c-26ca687b8781 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f5815f3832c491d9a440a243469002f, user_id=cabbd86fa06d4e678d3cff6a208ac5cc, role_id=920e2cadf3044abda66c715e1c89f4e3)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:13.988326 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde8583-a2ae-4736-a47c-26ca687b8781 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:14.077406 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 567/1123] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:26:13 2022] PUT /identity/v3/projects/9f5815f3832c491d9a440a243469002f/users/cabbd86fa06d4e678d3cff6a208ac5cc/roles/920e2cadf3044abda66c715e1c89f4e3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:26:16.319542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea81084-3726-4ea7-b91f-0143de20a3ad None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.320086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea81084-3726-4ea7-b91f-0143de20a3ad None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.320086 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea81084-3726-4ea7-b91f-0143de20a3ad None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.321468 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 557/1124] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:16.326930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c777-1f8c-45de-92e2-fca0426c09c8 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.327365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c777-1f8c-45de-92e2-fca0426c09c8 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.327464 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c777-1f8c-45de-92e2-fca0426c09c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.346120 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-9fc9c777-1f8c-45de-92e2-fca0426c09c8 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:16.347321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-9fc9c777-1f8c-45de-92e2-fca0426c09c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:16.419105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 568/1125] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:16.443367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea81084-3726-4ea7-b91f-0143de20a3ad None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:16.547265 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea81084-3726-4ea7-b91f-0143de20a3ad None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:16.549604 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:16.582531 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1053c7-7408-465b-a420-d83292f401cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:16.583394 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1053c7-7408-465b-a420-d83292f401cb None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.583686 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1053c7-7408-465b-a420-d83292f401cb None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.583966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1053c7-7408-465b-a420-d83292f401cb None admin] PATH_INFO: `/v3/roles/920e2cadf3044abda66c715e1c89f4e3` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.585738 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1053c7-7408-465b-a420-d83292f401cb None admin] RBAC: Authorizing `identity:get_role(role_id=920e2cadf3044abda66c715e1c89f4e3)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:16.587624 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1053c7-7408-465b-a420-d83292f401cb None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:16.589019 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 558/1126] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:16 2022] GET /identity/v3/roles/920e2cadf3044abda66c715e1c89f4e3 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:16.594896 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c777-1f8c-45de-92e2-fca0426c09c8 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:16.663055 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:16.703648 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c777-1f8c-45de-92e2-fca0426c09c8 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:16.739615 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eac560-6c28-4827-a7cc-4086049292ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:16.740614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eac560-6c28-4827-a7cc-4086049292ed None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.740900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eac560-6c28-4827-a7cc-4086049292ed None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.741179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eac560-6c28-4827-a7cc-4086049292ed None admin] PATH_INFO: `/v3/users/cabbd86fa06d4e678d3cff6a208ac5cc` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.742390 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eac560-6c28-4827-a7cc-4086049292ed None admin] RBAC: Authorizing `identity:get_user(user_id=cabbd86fa06d4e678d3cff6a208ac5cc)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:16.743919 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eac560-6c28-4827-a7cc-4086049292ed None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:16.745575 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 569/1127] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:16 2022] GET /identity/v3/users/cabbd86fa06d4e678d3cff6a208ac5cc => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:16.752041 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1053c7-7408-465b-a420-d83292f401cb None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:16.857324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1053c7-7408-465b-a420-d83292f401cb None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:16.891772 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8c2ac-77cb-4adc-868c-d42df7683f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:16.892424 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c2ac-77cb-4adc-868c-d42df7683f80 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.892705 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c2ac-77cb-4adc-868c-d42df7683f80 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.892980 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c2ac-77cb-4adc-868c-d42df7683f80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.932853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:16.962480 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8c2ac-77cb-4adc-868c-d42df7683f80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:16.963975 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8c2ac-77cb-4adc-868c-d42df7683f80 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:17.064914 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 559/1128] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:26:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:17.070873 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eac560-6c28-4827-a7cc-4086049292ed None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:17.171166 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eac560-6c28-4827-a7cc-4086049292ed None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:17.205872 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c581a8-3c0b-44a4-b279-ea4cd94f5159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:17.206760 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c581a8-3c0b-44a4-b279-ea4cd94f5159 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:17.207045 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c581a8-3c0b-44a4-b279-ea4cd94f5159 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:17.207355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c581a8-3c0b-44a4-b279-ea4cd94f5159 None admin] PATH_INFO: `/v3/projects/9f5815f3832c491d9a440a243469002f` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:17.208716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c581a8-3c0b-44a4-b279-ea4cd94f5159 None admin] RBAC: Authorizing `identity:get_project(project_id=9f5815f3832c491d9a440a243469002f)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:17.210172 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c581a8-3c0b-44a4-b279-ea4cd94f5159 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:17.211935 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 570/1129] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:26:17 2022] GET /identity/v3/projects/9f5815f3832c491d9a440a243469002f => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:17.218240 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8c2ac-77cb-4adc-868c-d42df7683f80 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:17.288411 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:17.318351 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8c2ac-77cb-4adc-868c-d42df7683f80 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:17.353292 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac05f0-848a-4dfa-ad0e-b950f1fe89a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:17.353973 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac05f0-848a-4dfa-ad0e-b950f1fe89a1 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:17.354207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac05f0-848a-4dfa-ad0e-b950f1fe89a1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:17.354480 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac05f0-848a-4dfa-ad0e-b950f1fe89a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:17.355343 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac05f0-848a-4dfa-ad0e-b950f1fe89a1 None admin] RBAC: Adding query filter params (role.id=920e2cadf3044abda66c715e1c89f4e3, scope.project.id=9f5815f3832c491d9a440a243469002f, user.id=cabbd86fa06d4e678d3cff6a208ac5cc) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:17.355661 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac05f0-848a-4dfa-ad0e-b950f1fe89a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:17.357091 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac05f0-848a-4dfa-ad0e-b950f1fe89a1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:17.363538 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 560/1130] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:26:17 2022] GET /identity/v3/role_assignments?user.id=cabbd86fa06d4e678d3cff6a208ac5cc&scope.project.id=9f5815f3832c491d9a440a243469002f&role.id=920e2cadf3044abda66c715e1c89f4e3 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:19.645460 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770985-afba-4919-bc9d-4655d1091335 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:19.646032 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770985-afba-4919-bc9d-4655d1091335 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:19.646384 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770985-afba-4919-bc9d-4655d1091335 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:19.648822 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 571/1131] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:19.654375 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260603a3-7693-4434-a985-7373a37525e8 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:19.654878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260603a3-7693-4434-a985-7373a37525e8 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:19.654987 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260603a3-7693-4434-a985-7373a37525e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:19.672801 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-260603a3-7693-4434-a985-7373a37525e8 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:19.674003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-260603a3-7693-4434-a985-7373a37525e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:19.743074 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 561/1132] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:19.766996 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5770985-afba-4919-bc9d-4655d1091335 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:19.770925 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:19.890048 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5770985-afba-4919-bc9d-4655d1091335 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:19.924271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3760b-5de5-4d53-ba6c-f6afc73204be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:19.924979 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3760b-5de5-4d53-ba6c-f6afc73204be None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:19.925258 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3760b-5de5-4d53-ba6c-f6afc73204be None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:19.925529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3760b-5de5-4d53-ba6c-f6afc73204be None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:19.926989 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3760b-5de5-4d53-ba6c-f6afc73204be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:19.928425 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3760b-5de5-4d53-ba6c-f6afc73204be None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:19.930041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 572/1133] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:26:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:19.935987 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260603a3-7693-4434-a985-7373a37525e8 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:20.005808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:20.042628 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260603a3-7693-4434-a985-7373a37525e8 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:20.080094 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9caee0-fe3a-4ee4-a665-869edc568777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:20.080763 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9caee0-fe3a-4ee4-a665-869edc568777 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:20.081047 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9caee0-fe3a-4ee4-a665-869edc568777 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:20.081324 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9caee0-fe3a-4ee4-a665-869edc568777 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:20.082048 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9caee0-fe3a-4ee4-a665-869edc568777 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:20.083536 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9caee0-fe3a-4ee4-a665-869edc568777 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:20.170157 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 562/1134] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:26:19 2022] POST /identity/v3/projects => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:22.466778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4ef10-8f1f-4b57-bc95-dbf0eb4ba767 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:22.467485 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4ef10-8f1f-4b57-bc95-dbf0eb4ba767 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:22.467485 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4ef10-8f1f-4b57-bc95-dbf0eb4ba767 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:22.469277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 573/1135] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:22.474635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43e542-f843-43c8-a742-3c765159aae0 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:22.475101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43e542-f843-43c8-a742-3c765159aae0 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:22.475211 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43e542-f843-43c8-a742-3c765159aae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:22.492309 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-df43e542-f843-43c8-a742-3c765159aae0 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:22.493526 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-df43e542-f843-43c8-a742-3c765159aae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:22.561284 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 563/1136] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:22.587015 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4ef10-8f1f-4b57-bc95-dbf0eb4ba767 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:22.658388 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:22.689134 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4ef10-8f1f-4b57-bc95-dbf0eb4ba767 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:22.723261 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329912d9-b3ec-47d5-8761-d0b02ecd6cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:22.723979 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329912d9-b3ec-47d5-8761-d0b02ecd6cfe None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:22.724263 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329912d9-b3ec-47d5-8761-d0b02ecd6cfe None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:22.724545 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329912d9-b3ec-47d5-8761-d0b02ecd6cfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:22.725749 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329912d9-b3ec-47d5-8761-d0b02ecd6cfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:22.727233 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329912d9-b3ec-47d5-8761-d0b02ecd6cfe None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:22.728879 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 574/1137] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:26:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:22.734862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43e542-f843-43c8-a742-3c765159aae0 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:22.783574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:22.835117 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43e542-f843-43c8-a742-3c765159aae0 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:22.868951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c90e3-d273-4719-8c7d-27d96b697ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:22.869628 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c90e3-d273-4719-8c7d-27d96b697ba1 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:22.869917 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c90e3-d273-4719-8c7d-27d96b697ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:22.870198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c90e3-d273-4719-8c7d-27d96b697ba1 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:22.870943 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c90e3-d273-4719-8c7d-27d96b697ba1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:22.872389 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c90e3-d273-4719-8c7d-27d96b697ba1 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:22.954839 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 564/1138] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:26:22 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:25.260347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07832803-b28b-4e75-81ae-5358aa0adf45 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.260918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07832803-b28b-4e75-81ae-5358aa0adf45 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.260918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07832803-b28b-4e75-81ae-5358aa0adf45 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.262320 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 575/1139] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:26:25.268300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c0947-dcdf-40e4-aff6-0ffdb0bedba6 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.268762 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c0947-dcdf-40e4-aff6-0ffdb0bedba6 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.268879 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c0947-dcdf-40e4-aff6-0ffdb0bedba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.286318 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-1d7c0947-dcdf-40e4-aff6-0ffdb0bedba6 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:25.287587 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-1d7c0947-dcdf-40e4-aff6-0ffdb0bedba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:25.354369 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 565/1140] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:25.377373 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07832803-b28b-4e75-81ae-5358aa0adf45 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:25.483188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07832803-b28b-4e75-81ae-5358aa0adf45 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:25.523521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a7448-5c59-420b-8743-0a254d981a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:25.524235 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a7448-5c59-420b-8743-0a254d981a3a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.524513 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a7448-5c59-420b-8743-0a254d981a3a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.524782 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a7448-5c59-420b-8743-0a254d981a3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.533226 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:25.536157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a7448-5c59-420b-8743-0a254d981a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-637a7448-5c59-420b-8743-0a254d981a3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:25.543711 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:25.549330 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:25.550914 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 576/1141] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:26:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:25.553256 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c0947-dcdf-40e4-aff6-0ffdb0bedba6 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:25.587772 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:25.653637 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c0947-dcdf-40e4-aff6-0ffdb0bedba6 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:25.686549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164aaf-9cfd-4c29-a83e-05142fa32672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:25.687835 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164aaf-9cfd-4c29-a83e-05142fa32672 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.688119 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164aaf-9cfd-4c29-a83e-05142fa32672 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.688394 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164aaf-9cfd-4c29-a83e-05142fa32672 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.689139 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164aaf-9cfd-4c29-a83e-05142fa32672 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:25.689447 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164aaf-9cfd-4c29-a83e-05142fa32672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:25.690843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164aaf-9cfd-4c29-a83e-05142fa32672 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:25.698905 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 566/1142] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:26:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:25.705331 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a7448-5c59-420b-8743-0a254d981a3a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:25.806796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a7448-5c59-420b-8743-0a254d981a3a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:25.842372 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c695a-ffee-4710-b28c-0ae3bc23dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:25.843280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c695a-ffee-4710-b28c-0ae3bc23dec6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.843565 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c695a-ffee-4710-b28c-0ae3bc23dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.843844 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c695a-ffee-4710-b28c-0ae3bc23dec6 None admin] PATH_INFO: `/v3/users/6454e9bd71154c8b94794cd05887d256` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.857169 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c695a-ffee-4710-b28c-0ae3bc23dec6 None admin] RBAC: Authorizing `identity:get_user(user_id=6454e9bd71154c8b94794cd05887d256)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:25.858671 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c695a-ffee-4710-b28c-0ae3bc23dec6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:25.860360 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 577/1143] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:25 2022] GET /identity/v3/users/6454e9bd71154c8b94794cd05887d256 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:25.866172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164aaf-9cfd-4c29-a83e-05142fa32672 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:25.961936 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:25.967708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164aaf-9cfd-4c29-a83e-05142fa32672 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:26.002186 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713130fa-4625-401f-883e-b10a0ece82b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:26.002868 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713130fa-4625-401f-883e-b10a0ece82b0 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:26.003157 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713130fa-4625-401f-883e-b10a0ece82b0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:26.003437 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713130fa-4625-401f-883e-b10a0ece82b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:26.073313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713130fa-4625-401f-883e-b10a0ece82b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:26.074721 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713130fa-4625-401f-883e-b10a0ece82b0 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:26.174985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:26.181490 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 567/1144] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:26:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:26.188030 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c695a-ffee-4710-b28c-0ae3bc23dec6 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:26.246499 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:26.288001 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c695a-ffee-4710-b28c-0ae3bc23dec6 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:26.321840 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3629b3b-3d1f-4558-ad90-14fec0e36da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:26.322708 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3629b3b-3d1f-4558-ad90-14fec0e36da3 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:26.322992 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3629b3b-3d1f-4558-ad90-14fec0e36da3 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:26.323268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3629b3b-3d1f-4558-ad90-14fec0e36da3 None admin] PATH_INFO: `/v3/projects/7e8b48c4a529415e9d42df5618b7f1cc` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:26.324606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3629b3b-3d1f-4558-ad90-14fec0e36da3 None admin] RBAC: Authorizing `identity:get_project(project_id=7e8b48c4a529415e9d42df5618b7f1cc)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:26.326014 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3629b3b-3d1f-4558-ad90-14fec0e36da3 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:26.327799 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 578/1145] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:26:26 2022] GET /identity/v3/projects/7e8b48c4a529415e9d42df5618b7f1cc => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:26.333914 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713130fa-4625-401f-883e-b10a0ece82b0 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:26.434682 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713130fa-4625-401f-883e-b10a0ece82b0 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:26.470686 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4a559-f0ef-42a9-a1c5-e4c892a9c275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:26.471344 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4a559-f0ef-42a9-a1c5-e4c892a9c275 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:26.471630 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4a559-f0ef-42a9-a1c5-e4c892a9c275 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:26.471907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4a559-f0ef-42a9-a1c5-e4c892a9c275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:26.472747 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4a559-f0ef-42a9-a1c5-e4c892a9c275 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=7e8b48c4a529415e9d42df5618b7f1cc, user.id=6454e9bd71154c8b94794cd05887d256) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:26.473059 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4a559-f0ef-42a9-a1c5-e4c892a9c275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:26.474487 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4a559-f0ef-42a9-a1c5-e4c892a9c275 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:26.480096 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 568/1146] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:26:26 2022] GET /identity/v3/role_assignments?user.id=6454e9bd71154c8b94794cd05887d256&scope.project.id=7e8b48c4a529415e9d42df5618b7f1cc&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:28.712344 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5cf39-7821-4a5a-9ffd-b3115b8f5fa3 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.712918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5cf39-7821-4a5a-9ffd-b3115b8f5fa3 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.712918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5cf39-7821-4a5a-9ffd-b3115b8f5fa3 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.714322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 579/1147] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:28.719973 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02e49d-ae46-4313-9eb0-e86d4542ad93 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.720418 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02e49d-ae46-4313-9eb0-e86d4542ad93 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.720527 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02e49d-ae46-4313-9eb0-e86d4542ad93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.737540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-df02e49d-ae46-4313-9eb0-e86d4542ad93 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:28.738792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-df02e49d-ae46-4313-9eb0-e86d4542ad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:28.793101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:28.804791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 569/1148] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:28.826774 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5cf39-7821-4a5a-9ffd-b3115b8f5fa3 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:28.930327 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5cf39-7821-4a5a-9ffd-b3115b8f5fa3 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:28.956305 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:28.968379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e297cc-b312-494b-81ce-eac37b659930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:28.968379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e297cc-b312-494b-81ce-eac37b659930 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.968379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e297cc-b312-494b-81ce-eac37b659930 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.968379 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e297cc-b312-494b-81ce-eac37b659930 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.976503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e297cc-b312-494b-81ce-eac37b659930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-48e297cc-b312-494b-81ce-eac37b659930 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:28.984932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:28.986150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:28.987308 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:28.988350 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 580/1149] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:28.995569 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02e49d-ae46-4313-9eb0-e86d4542ad93 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:29.111170 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02e49d-ae46-4313-9eb0-e86d4542ad93 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:29.144693 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445ae3b-9433-4d8f-98e5-9c2e9b7bc862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:29.145358 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445ae3b-9433-4d8f-98e5-9c2e9b7bc862 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:29.145641 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445ae3b-9433-4d8f-98e5-9c2e9b7bc862 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:29.145919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445ae3b-9433-4d8f-98e5-9c2e9b7bc862 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:29.146694 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445ae3b-9433-4d8f-98e5-9c2e9b7bc862 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:29.147005 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445ae3b-9433-4d8f-98e5-9c2e9b7bc862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:29.148374 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445ae3b-9433-4d8f-98e5-9c2e9b7bc862 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:29.157236 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 570/1150] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:29.163174 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e297cc-b312-494b-81ce-eac37b659930 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:29.261836 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e297cc-b312-494b-81ce-eac37b659930 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:29.295404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7be609-65d7-463e-b6e5-a895f069ac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:29.296304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be609-65d7-463e-b6e5-a895f069ac52 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:29.296584 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be609-65d7-463e-b6e5-a895f069ac52 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:29.296858 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be609-65d7-463e-b6e5-a895f069ac52 None admin] PATH_INFO: `/v3/users/6454e9bd71154c8b94794cd05887d256` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:29.298061 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7be609-65d7-463e-b6e5-a895f069ac52 None admin] RBAC: Authorizing `identity:get_user(user_id=6454e9bd71154c8b94794cd05887d256)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:29.299529 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7be609-65d7-463e-b6e5-a895f069ac52 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:29.301430 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 581/1151] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:29 2022] GET /identity/v3/users/6454e9bd71154c8b94794cd05887d256 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:29.307109 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445ae3b-9433-4d8f-98e5-9c2e9b7bc862 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:29.363722 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:29.417786 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445ae3b-9433-4d8f-98e5-9c2e9b7bc862 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:29.452078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b1e85-466c-4cab-976b-899abcc382b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:29.453550 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b1e85-466c-4cab-976b-899abcc382b5 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:29.453837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b1e85-466c-4cab-976b-899abcc382b5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:29.454145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b1e85-466c-4cab-976b-899abcc382b5 None admin] PATH_INFO: `/v3/projects/7e8b48c4a529415e9d42df5618b7f1cc` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:29.455415 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b1e85-466c-4cab-976b-899abcc382b5 None admin] RBAC: Authorizing `identity:get_project(project_id=7e8b48c4a529415e9d42df5618b7f1cc)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:29.456877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b1e85-466c-4cab-976b-899abcc382b5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:29.458626 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 571/1152] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:26:29 2022] GET /identity/v3/projects/7e8b48c4a529415e9d42df5618b7f1cc => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:29.464569 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7be609-65d7-463e-b6e5-a895f069ac52 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:29.520333 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:29.566154 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7be609-65d7-463e-b6e5-a895f069ac52 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:29.599616 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb78e8-196e-4f14-8e8e-9ad924e14b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:29.600505 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb78e8-196e-4f14-8e8e-9ad924e14b8e None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:29.600792 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb78e8-196e-4f14-8e8e-9ad924e14b8e None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:29.601074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb78e8-196e-4f14-8e8e-9ad924e14b8e None admin] PATH_INFO: `/v3/projects/7e8b48c4a529415e9d42df5618b7f1cc/users/6454e9bd71154c8b94794cd05887d256/roles/59689ee7c4f5409692318371dac5cbc7` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:29.603096 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb78e8-196e-4f14-8e8e-9ad924e14b8e None admin] RBAC: Authorizing `identity:create_grant(project_id=7e8b48c4a529415e9d42df5618b7f1cc, user_id=6454e9bd71154c8b94794cd05887d256, role_id=59689ee7c4f5409692318371dac5cbc7)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:29.604541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb78e8-196e-4f14-8e8e-9ad924e14b8e None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:29.691823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 582/1153] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:26:29 2022] PUT /identity/v3/projects/7e8b48c4a529415e9d42df5618b7f1cc/users/6454e9bd71154c8b94794cd05887d256/roles/59689ee7c4f5409692318371dac5cbc7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:26:31.894221 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ca08b-ac94-4058-b519-4f8149d980be None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:31.894806 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ca08b-ac94-4058-b519-4f8149d980be None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:31.894806 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ca08b-ac94-4058-b519-4f8149d980be None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:31.896191 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 572/1154] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:31.901680 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfedde7-52b6-45a5-95f1-9ff55e2c1d2f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:31.902145 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfedde7-52b6-45a5-95f1-9ff55e2c1d2f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:31.902255 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfedde7-52b6-45a5-95f1-9ff55e2c1d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:31.919845 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-6bfedde7-52b6-45a5-95f1-9ff55e2c1d2f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:31.921786 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-6bfedde7-52b6-45a5-95f1-9ff55e2c1d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:31.990898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 583/1155] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:32.020887 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ca08b-ac94-4058-b519-4f8149d980be None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:32.125260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ca08b-ac94-4058-b519-4f8149d980be None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:32.145458 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:32.159721 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9d67e-25c9-44f7-bc73-df0f39643d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:32.160517 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9d67e-25c9-44f7-bc73-df0f39643d6b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:32.160799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9d67e-25c9-44f7-bc73-df0f39643d6b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:32.161075 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9d67e-25c9-44f7-bc73-df0f39643d6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:32.171874 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9d67e-25c9-44f7-bc73-df0f39643d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-bbe9d67e-25c9-44f7-bc73-df0f39643d6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:32.180251 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:32.182084 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:26:32.184020 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 573/1156] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:26:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:32.192361 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfedde7-52b6-45a5-95f1-9ff55e2c1d2f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:32.238905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:32.292952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfedde7-52b6-45a5-95f1-9ff55e2c1d2f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:32.328848 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dc00a-86bd-49cb-8d45-b7fa1cb91fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:32.329518 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dc00a-86bd-49cb-8d45-b7fa1cb91fbf None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:32.329834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dc00a-86bd-49cb-8d45-b7fa1cb91fbf None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:32.330115 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dc00a-86bd-49cb-8d45-b7fa1cb91fbf None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:32.330905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dc00a-86bd-49cb-8d45-b7fa1cb91fbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:32.331207 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dc00a-86bd-49cb-8d45-b7fa1cb91fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:32.332605 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dc00a-86bd-49cb-8d45-b7fa1cb91fbf None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:32.341984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 584/1157] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:26:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:32.348252 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9d67e-25c9-44f7-bc73-df0f39643d6b None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:32.465973 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9d67e-25c9-44f7-bc73-df0f39643d6b None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:32.501712 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a834f-b823-42ec-adbc-aaf7c531991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:32.502591 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a834f-b823-42ec-adbc-aaf7c531991b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:32.502907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a834f-b823-42ec-adbc-aaf7c531991b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:32.503187 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a834f-b823-42ec-adbc-aaf7c531991b None admin] PATH_INFO: `/v3/users/6454e9bd71154c8b94794cd05887d256` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:32.504489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a834f-b823-42ec-adbc-aaf7c531991b None admin] RBAC: Authorizing `identity:get_user(user_id=6454e9bd71154c8b94794cd05887d256)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:32.505951 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a834f-b823-42ec-adbc-aaf7c531991b None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:32.507629 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 574/1158] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:32 2022] GET /identity/v3/users/6454e9bd71154c8b94794cd05887d256 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:32.513424 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dc00a-86bd-49cb-8d45-b7fa1cb91fbf None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:32.621475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dc00a-86bd-49cb-8d45-b7fa1cb91fbf None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:32.629473 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:32.656239 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f960cd9-d550-4d68-8395-7d2c2d5806ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:32.656981 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f960cd9-d550-4d68-8395-7d2c2d5806ea None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:32.657268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f960cd9-d550-4d68-8395-7d2c2d5806ea None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:32.657559 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f960cd9-d550-4d68-8395-7d2c2d5806ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:32.728467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f960cd9-d550-4d68-8395-7d2c2d5806ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:32.729853 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f960cd9-d550-4d68-8395-7d2c2d5806ea None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:32.829607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 585/1159] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:26:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:32.835612 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a834f-b823-42ec-adbc-aaf7c531991b None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:32.884189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:32.933517 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a834f-b823-42ec-adbc-aaf7c531991b None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:32.967262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643286f2-0c7f-40ae-9679-527e52e8eff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:32.968145 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643286f2-0c7f-40ae-9679-527e52e8eff5 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:32.968430 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643286f2-0c7f-40ae-9679-527e52e8eff5 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:32.968706 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643286f2-0c7f-40ae-9679-527e52e8eff5 None admin] PATH_INFO: `/v3/projects/7e8b48c4a529415e9d42df5618b7f1cc` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:32.969887 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643286f2-0c7f-40ae-9679-527e52e8eff5 None admin] RBAC: Authorizing `identity:get_project(project_id=7e8b48c4a529415e9d42df5618b7f1cc)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:32.971371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643286f2-0c7f-40ae-9679-527e52e8eff5 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:32.973065 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 575/1160] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:26:32 2022] GET /identity/v3/projects/7e8b48c4a529415e9d42df5618b7f1cc => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:32.979340 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f960cd9-d550-4d68-8395-7d2c2d5806ea None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:32.987839 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:33.076874 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f960cd9-d550-4d68-8395-7d2c2d5806ea None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:33.110573 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083af8e4-59d5-40c8-a7d0-25c602102476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:33.111243 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083af8e4-59d5-40c8-a7d0-25c602102476 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:33.111523 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083af8e4-59d5-40c8-a7d0-25c602102476 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:33.111798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083af8e4-59d5-40c8-a7d0-25c602102476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:33.112625 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083af8e4-59d5-40c8-a7d0-25c602102476 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=7e8b48c4a529415e9d42df5618b7f1cc, user.id=6454e9bd71154c8b94794cd05887d256) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:33.112936 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083af8e4-59d5-40c8-a7d0-25c602102476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:33.114367 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083af8e4-59d5-40c8-a7d0-25c602102476 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:33.120328 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 586/1161] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:26:32 2022] GET /identity/v3/role_assignments?user.id=6454e9bd71154c8b94794cd05887d256&scope.project.id=7e8b48c4a529415e9d42df5618b7f1cc&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:35.362077 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d20dc5-4bdb-44ac-8075-68089923b767 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:35.362838 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d20dc5-4bdb-44ac-8075-68089923b767 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:35.362838 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d20dc5-4bdb-44ac-8075-68089923b767 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:35.364042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 576/1162] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:35.369302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a1b98-69b5-408e-89cf-d7209a50bd9e None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:35.369681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a1b98-69b5-408e-89cf-d7209a50bd9e None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:35.369845 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a1b98-69b5-408e-89cf-d7209a50bd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:35.386377 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-414a1b98-69b5-408e-89cf-d7209a50bd9e None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:35.387595 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-414a1b98-69b5-408e-89cf-d7209a50bd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:35.453157 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:35.457881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 587/1163] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:35.481219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d20dc5-4bdb-44ac-8075-68089923b767 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:35.586337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d20dc5-4bdb-44ac-8075-68089923b767 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:35.603362 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:35.621298 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef09c3-97a0-400d-922a-80f648411fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:35.621890 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef09c3-97a0-400d-922a-80f648411fed None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:35.622177 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef09c3-97a0-400d-922a-80f648411fed None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:35.622457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef09c3-97a0-400d-922a-80f648411fed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:35.689749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef09c3-97a0-400d-922a-80f648411fed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:35.691236 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef09c3-97a0-400d-922a-80f648411fed None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:35.788477 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 577/1164] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:26:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:35.794525 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a1b98-69b5-408e-89cf-d7209a50bd9e None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:35.893847 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a1b98-69b5-408e-89cf-d7209a50bd9e None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:35.927707 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ffa64-c8c5-47f5-815b-af72163b41e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:35.928502 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ffa64-c8c5-47f5-815b-af72163b41e6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:35.928782 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ffa64-c8c5-47f5-815b-af72163b41e6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:35.929056 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ffa64-c8c5-47f5-815b-af72163b41e6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:35.935727 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ffa64-c8c5-47f5-815b-af72163b41e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:35.937217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ffa64-c8c5-47f5-815b-af72163b41e6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-017ffa64-c8c5-47f5-815b-af72163b41e6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:35.951217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:35.953071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:35.954186 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 588/1165] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:26:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:35.959054 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef09c3-97a0-400d-922a-80f648411fed None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:35.977256 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:36.064331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef09c3-97a0-400d-922a-80f648411fed None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:36.099068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21207546-7028-4a28-88e6-c6eb5e51e233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:36.099738 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21207546-7028-4a28-88e6-c6eb5e51e233 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:36.100025 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21207546-7028-4a28-88e6-c6eb5e51e233 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:36.100303 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21207546-7028-4a28-88e6-c6eb5e51e233 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:36.101031 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21207546-7028-4a28-88e6-c6eb5e51e233 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:36.101340 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21207546-7028-4a28-88e6-c6eb5e51e233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:36.102763 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21207546-7028-4a28-88e6-c6eb5e51e233 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:36.111268 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 578/1166] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:26:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:38.326630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce1431-7304-4b2e-97b9-e46e548a0bb5 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:38.327219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce1431-7304-4b2e-97b9-e46e548a0bb5 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:38.327219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce1431-7304-4b2e-97b9-e46e548a0bb5 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:38.328636 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 589/1167] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:38.334056 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b9d5f-0b6f-4811-9c05-598a8fe05c81 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:38.334494 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b9d5f-0b6f-4811-9c05-598a8fe05c81 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:38.334636 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b9d5f-0b6f-4811-9c05-598a8fe05c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:38.351823 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-059b9d5f-0b6f-4811-9c05-598a8fe05c81 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:38.353003 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-059b9d5f-0b6f-4811-9c05-598a8fe05c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:38.417881 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 579/1168] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:38.441794 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce1431-7304-4b2e-97b9-e46e548a0bb5 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:38.503458 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:38.544795 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce1431-7304-4b2e-97b9-e46e548a0bb5 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:38.577999 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b9b14-690e-4109-a0cc-3eeab3b44860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:38.578590 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b9b14-690e-4109-a0cc-3eeab3b44860 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:38.578903 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b9b14-690e-4109-a0cc-3eeab3b44860 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:38.579177 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b9b14-690e-4109-a0cc-3eeab3b44860 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:38.579933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b9b14-690e-4109-a0cc-3eeab3b44860 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:38.581305 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b9b14-690e-4109-a0cc-3eeab3b44860 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:38.654571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 590/1169] 10.222.0.89 () {60 vars in 1138 bytes} [Thu May 19 20:26:38 2022] POST /identity/v3/domains => generated 267 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:40.918899 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7c310-3dca-4a78-8e39-b738627d497c None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:40.919466 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7c310-3dca-4a78-8e39-b738627d497c None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:40.919466 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7c310-3dca-4a78-8e39-b738627d497c None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:40.921333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 580/1170] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:40.926876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d3be-5f49-4a38-8f9b-69726e73977d None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:40.927280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d3be-5f49-4a38-8f9b-69726e73977d None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:40.927442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d3be-5f49-4a38-8f9b-69726e73977d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:40.944812 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-9244d3be-5f49-4a38-8f9b-69726e73977d None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:40.945997 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-9244d3be-5f49-4a38-8f9b-69726e73977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:41.012627 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 591/1171] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:41.035853 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7c310-3dca-4a78-8e39-b738627d497c None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:41.049450 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:41.139406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7c310-3dca-4a78-8e39-b738627d497c None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:41.172425 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf8def-c8bf-4618-adac-9522420b91b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:41.173282 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf8def-c8bf-4618-adac-9522420b91b6 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:41.173564 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf8def-c8bf-4618-adac-9522420b91b6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:41.173837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf8def-c8bf-4618-adac-9522420b91b6 None admin] PATH_INFO: `/v3/domains/fd50810ccf5044aeb64f142fd085e1d3` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:41.184407 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf8def-c8bf-4618-adac-9522420b91b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fd50810ccf5044aeb64f142fd085e1d3)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:41.185839 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf8def-c8bf-4618-adac-9522420b91b6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:41.188068 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 581/1172] 10.222.0.89 () {56 vars in 1183 bytes} [Thu May 19 20:26:41 2022] GET /identity/v3/domains/fd50810ccf5044aeb64f142fd085e1d3 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:41.194041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d3be-5f49-4a38-8f9b-69726e73977d None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:41.243020 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:41.293930 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d3be-5f49-4a38-8f9b-69726e73977d None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:41.326978 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94836fab-5496-4384-b69f-46a3d332cc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:41.327570 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94836fab-5496-4384-b69f-46a3d332cc3f None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:41.327849 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94836fab-5496-4384-b69f-46a3d332cc3f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:41.328121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94836fab-5496-4384-b69f-46a3d332cc3f None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:41.328826 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94836fab-5496-4384-b69f-46a3d332cc3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:41.330302 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94836fab-5496-4384-b69f-46a3d332cc3f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:41.478265 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 592/1173] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:26:41 2022] POST /identity/v3/projects => generated 361 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:43.786356 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a1ccf-344a-4776-8d52-c87b217b74ea None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:43.787053 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a1ccf-344a-4776-8d52-c87b217b74ea None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:43.787053 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a1ccf-344a-4776-8d52-c87b217b74ea None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:43.788331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 582/1174] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:43.793744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22860ae4-6743-4dd8-a245-1709be1fcc36 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:43.794177 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22860ae4-6743-4dd8-a245-1709be1fcc36 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:43.794287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22860ae4-6743-4dd8-a245-1709be1fcc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:43.811210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-22860ae4-6743-4dd8-a245-1709be1fcc36 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:43.812913 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-22860ae4-6743-4dd8-a245-1709be1fcc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:43.879838 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 593/1175] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:43.905182 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a1ccf-344a-4776-8d52-c87b217b74ea None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:43.975740 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:44.006124 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a1ccf-344a-4776-8d52-c87b217b74ea None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:44.040534 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba24341-10e6-400a-a03c-de905bee60d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:44.041331 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba24341-10e6-400a-a03c-de905bee60d8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:44.041612 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba24341-10e6-400a-a03c-de905bee60d8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:44.041888 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba24341-10e6-400a-a03c-de905bee60d8 None admin] PATH_INFO: `/v3/domains/fd50810ccf5044aeb64f142fd085e1d3` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:44.043096 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba24341-10e6-400a-a03c-de905bee60d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fd50810ccf5044aeb64f142fd085e1d3)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:44.044525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba24341-10e6-400a-a03c-de905bee60d8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:44.046150 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 583/1176] 10.222.0.89 () {56 vars in 1183 bytes} [Thu May 19 20:26:43 2022] GET /identity/v3/domains/fd50810ccf5044aeb64f142fd085e1d3 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:44.052148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22860ae4-6743-4dd8-a245-1709be1fcc36 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:44.082337 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:44.150629 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22860ae4-6743-4dd8-a245-1709be1fcc36 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:44.184164 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad503827-344e-4485-97ec-2b0ba0a6617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:44.184828 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad503827-344e-4485-97ec-2b0ba0a6617f None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:44.185111 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad503827-344e-4485-97ec-2b0ba0a6617f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:44.185389 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad503827-344e-4485-97ec-2b0ba0a6617f None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:44.186110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad503827-344e-4485-97ec-2b0ba0a6617f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:44.188228 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad503827-344e-4485-97ec-2b0ba0a6617f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:44.270388 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 594/1177] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:26:44 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:46.518685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f413-6761-4926-8798-0ed882c98e5f None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:46.519273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f413-6761-4926-8798-0ed882c98e5f None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:46.519273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f413-6761-4926-8798-0ed882c98e5f None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:46.520995 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 584/1178] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:46.526676 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673ee48-a37c-4827-a9d8-219400d4b2d3 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:46.527120 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673ee48-a37c-4827-a9d8-219400d4b2d3 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:46.527226 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673ee48-a37c-4827-a9d8-219400d4b2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:46.545445 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-a673ee48-a37c-4827-a9d8-219400d4b2d3 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:46.547249 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-a673ee48-a37c-4827-a9d8-219400d4b2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:46.615137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 595/1179] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:46.638778 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7f413-6761-4926-8798-0ed882c98e5f None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:46.752113 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7f413-6761-4926-8798-0ed882c98e5f None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:46.794695 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62206836-13c2-4781-bd6c-7a2b9b1ae12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:46.795450 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62206836-13c2-4781-bd6c-7a2b9b1ae12b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:46.795732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62206836-13c2-4781-bd6c-7a2b9b1ae12b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:46.796007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62206836-13c2-4781-bd6c-7a2b9b1ae12b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:46.804257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:46.808048 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62206836-13c2-4781-bd6c-7a2b9b1ae12b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-62206836-13c2-4781-bd6c-7a2b9b1ae12b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:46.816244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:46.823672 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:26:46.824926 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 585/1180] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:46.825968 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673ee48-a37c-4827-a9d8-219400d4b2d3 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:46.842443 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:46.928487 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673ee48-a37c-4827-a9d8-219400d4b2d3 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:46.966038 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732269bf-75dd-4c26-ad85-ca990f4c843a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:46.966750 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732269bf-75dd-4c26-ad85-ca990f4c843a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:46.967036 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732269bf-75dd-4c26-ad85-ca990f4c843a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:46.967314 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732269bf-75dd-4c26-ad85-ca990f4c843a None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:46.968066 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732269bf-75dd-4c26-ad85-ca990f4c843a None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:46.968972 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732269bf-75dd-4c26-ad85-ca990f4c843a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:46.970359 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732269bf-75dd-4c26-ad85-ca990f4c843a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:46.978679 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 596/1181] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:46.984870 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62206836-13c2-4781-bd6c-7a2b9b1ae12b None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:47.091708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62206836-13c2-4781-bd6c-7a2b9b1ae12b None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:47.126469 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d932f9-bc1b-4bf9-82c8-6910919a808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:47.127370 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d932f9-bc1b-4bf9-82c8-6910919a808e None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:47.127658 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d932f9-bc1b-4bf9-82c8-6910919a808e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:47.127928 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d932f9-bc1b-4bf9-82c8-6910919a808e None admin] PATH_INFO: `/v3/users/15eedad325c24ad1a266cb2367dab9cd` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:47.142191 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d932f9-bc1b-4bf9-82c8-6910919a808e None admin] RBAC: Authorizing `identity:get_user(user_id=15eedad325c24ad1a266cb2367dab9cd)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:47.143724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d932f9-bc1b-4bf9-82c8-6910919a808e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:47.145379 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 586/1182] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:46 2022] GET /identity/v3/users/15eedad325c24ad1a266cb2367dab9cd => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:47.151342 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732269bf-75dd-4c26-ad85-ca990f4c843a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:47.232550 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:47.252053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732269bf-75dd-4c26-ad85-ca990f4c843a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:47.284625 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec2997-fe49-48db-b215-3c6c7a334cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:47.285271 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec2997-fe49-48db-b215-3c6c7a334cda None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:47.285559 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec2997-fe49-48db-b215-3c6c7a334cda None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:47.285837 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec2997-fe49-48db-b215-3c6c7a334cda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:47.352674 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec2997-fe49-48db-b215-3c6c7a334cda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:47.354052 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec2997-fe49-48db-b215-3c6c7a334cda None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:47.432526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:47.453509 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 597/1183] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:26:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:47.459573 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d932f9-bc1b-4bf9-82c8-6910919a808e None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:47.517304 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:47.560014 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d932f9-bc1b-4bf9-82c8-6910919a808e None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:47.594931 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738e4d-4e97-4db4-8d4a-78fdf1e3f797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:47.595795 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738e4d-4e97-4db4-8d4a-78fdf1e3f797 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:47.596078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738e4d-4e97-4db4-8d4a-78fdf1e3f797 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:47.596354 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738e4d-4e97-4db4-8d4a-78fdf1e3f797 None admin] PATH_INFO: `/v3/projects/5602c9a2b690493aa2417124bd6bc35f` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:47.597546 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f738e4d-4e97-4db4-8d4a-78fdf1e3f797 None admin] RBAC: Authorizing `identity:get_project(project_id=5602c9a2b690493aa2417124bd6bc35f)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:47.598998 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f738e4d-4e97-4db4-8d4a-78fdf1e3f797 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:47.600751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 587/1184] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:26:47 2022] GET /identity/v3/projects/5602c9a2b690493aa2417124bd6bc35f => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:47.606940 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec2997-fe49-48db-b215-3c6c7a334cda None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:47.724590 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec2997-fe49-48db-b215-3c6c7a334cda None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:47.759475 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b80aa-9658-457a-ab0d-958580d17217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:47.760128 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b80aa-9658-457a-ab0d-958580d17217 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:47.760410 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b80aa-9658-457a-ab0d-958580d17217 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:47.760683 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b80aa-9658-457a-ab0d-958580d17217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:47.761508 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b80aa-9658-457a-ab0d-958580d17217 None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=5602c9a2b690493aa2417124bd6bc35f, user.id=15eedad325c24ad1a266cb2367dab9cd) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:47.761819 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b80aa-9658-457a-ab0d-958580d17217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:47.763290 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b80aa-9658-457a-ab0d-958580d17217 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:47.768804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 598/1185] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:26:47 2022] GET /identity/v3/role_assignments?user.id=15eedad325c24ad1a266cb2367dab9cd&scope.project.id=5602c9a2b690493aa2417124bd6bc35f&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:49.977833 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd275b-811b-451d-8121-5999046cfc58 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:49.978393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd275b-811b-451d-8121-5999046cfc58 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:49.978393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd275b-811b-451d-8121-5999046cfc58 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:49.979857 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 588/1186] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:49.985952 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2162fc-68fd-4499-a444-01875b27cf7b None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:49.986374 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2162fc-68fd-4499-a444-01875b27cf7b None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:49.986505 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2162fc-68fd-4499-a444-01875b27cf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:50.003634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-8c2162fc-68fd-4499-a444-01875b27cf7b None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:50.004877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-8c2162fc-68fd-4499-a444-01875b27cf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:50.044324 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:50.071260 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 599/1187] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:50.094201 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd275b-811b-451d-8121-5999046cfc58 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:50.196794 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd275b-811b-451d-8121-5999046cfc58 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:50.219710 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:50.229937 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd520bb-86ac-4fd5-8d79-5ad497e7123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:50.236767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd520bb-86ac-4fd5-8d79-5ad497e7123f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:50.236767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd520bb-86ac-4fd5-8d79-5ad497e7123f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:50.236767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd520bb-86ac-4fd5-8d79-5ad497e7123f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:50.241766 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd520bb-86ac-4fd5-8d79-5ad497e7123f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-1cd520bb-86ac-4fd5-8d79-5ad497e7123f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:50.250078 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:50.251300 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:26:50.252239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 589/1188] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:26:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:50.257385 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2162fc-68fd-4499-a444-01875b27cf7b None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:50.355879 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2162fc-68fd-4499-a444-01875b27cf7b None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:50.389315 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73d40e-f568-4e79-b73c-07579f9cae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:50.390575 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73d40e-f568-4e79-b73c-07579f9cae23 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:50.390893 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73d40e-f568-4e79-b73c-07579f9cae23 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:50.391170 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73d40e-f568-4e79-b73c-07579f9cae23 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:50.391921 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73d40e-f568-4e79-b73c-07579f9cae23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:50.392232 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73d40e-f568-4e79-b73c-07579f9cae23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:50.393631 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73d40e-f568-4e79-b73c-07579f9cae23 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:50.402124 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 600/1189] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:26:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:50.408783 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd520bb-86ac-4fd5-8d79-5ad497e7123f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:50.507237 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd520bb-86ac-4fd5-8d79-5ad497e7123f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:50.539704 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48227bf-62d5-4ba9-a962-60961f3082c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:50.540571 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48227bf-62d5-4ba9-a962-60961f3082c4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:50.540851 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48227bf-62d5-4ba9-a962-60961f3082c4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:50.541123 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48227bf-62d5-4ba9-a962-60961f3082c4 None admin] PATH_INFO: `/v3/users/15eedad325c24ad1a266cb2367dab9cd` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:50.542303 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48227bf-62d5-4ba9-a962-60961f3082c4 None admin] RBAC: Authorizing `identity:get_user(user_id=15eedad325c24ad1a266cb2367dab9cd)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:50.543792 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48227bf-62d5-4ba9-a962-60961f3082c4 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:50.545411 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 590/1190] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:50 2022] GET /identity/v3/users/15eedad325c24ad1a266cb2367dab9cd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:50.552318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73d40e-f568-4e79-b73c-07579f9cae23 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:50.587178 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:50.651877 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73d40e-f568-4e79-b73c-07579f9cae23 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:50.685230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4aab50-f970-44f1-80ab-59e0b8b598eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:50.686092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aab50-f970-44f1-80ab-59e0b8b598eb None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:50.686376 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aab50-f970-44f1-80ab-59e0b8b598eb None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:50.686675 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aab50-f970-44f1-80ab-59e0b8b598eb None admin] PATH_INFO: `/v3/projects/5602c9a2b690493aa2417124bd6bc35f` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:50.687905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4aab50-f970-44f1-80ab-59e0b8b598eb None admin] RBAC: Authorizing `identity:get_project(project_id=5602c9a2b690493aa2417124bd6bc35f)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:50.689351 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4aab50-f970-44f1-80ab-59e0b8b598eb None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:50.691107 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 601/1191] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:26:50 2022] GET /identity/v3/projects/5602c9a2b690493aa2417124bd6bc35f => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:50.697156 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48227bf-62d5-4ba9-a962-60961f3082c4 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:50.753169 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:50.800274 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48227bf-62d5-4ba9-a962-60961f3082c4 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:50.834501 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cca57-7fc9-45d4-8015-a7edba54d2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:50.835414 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cca57-7fc9-45d4-8015-a7edba54d2b6 None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:50.835692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cca57-7fc9-45d4-8015-a7edba54d2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:50.835964 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cca57-7fc9-45d4-8015-a7edba54d2b6 None admin] PATH_INFO: `/v3/projects/5602c9a2b690493aa2417124bd6bc35f/users/15eedad325c24ad1a266cb2367dab9cd/roles/59689ee7c4f5409692318371dac5cbc7` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:50.837913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cca57-7fc9-45d4-8015-a7edba54d2b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5602c9a2b690493aa2417124bd6bc35f, user_id=15eedad325c24ad1a266cb2367dab9cd, role_id=59689ee7c4f5409692318371dac5cbc7)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:50.839364 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cca57-7fc9-45d4-8015-a7edba54d2b6 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:50.921411 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 591/1192] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:26:50 2022] PUT /identity/v3/projects/5602c9a2b690493aa2417124bd6bc35f/users/15eedad325c24ad1a266cb2367dab9cd/roles/59689ee7c4f5409692318371dac5cbc7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:26:53.136655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18cb87-6506-4a91-8ef5-b241ea76b70b None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:53.137214 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18cb87-6506-4a91-8ef5-b241ea76b70b None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:53.137214 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18cb87-6506-4a91-8ef5-b241ea76b70b None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:53.138647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 602/1193] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:53.144510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70f1fd-3a44-4398-bc1c-908dbdc1a0f1 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:53.144911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70f1fd-3a44-4398-bc1c-908dbdc1a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:53.145076 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70f1fd-3a44-4398-bc1c-908dbdc1a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:53.162564 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-3c70f1fd-3a44-4398-bc1c-908dbdc1a0f1 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:53.163810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-3c70f1fd-3a44-4398-bc1c-908dbdc1a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:53.229994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 592/1194] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:26:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:53.254020 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18cb87-6506-4a91-8ef5-b241ea76b70b None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:53.354066 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18cb87-6506-4a91-8ef5-b241ea76b70b None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:53.356399 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:53.387900 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f775e-42b2-47e9-b8b6-d2e4b4a393c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:53.388630 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f775e-42b2-47e9-b8b6-d2e4b4a393c9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:53.389200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f775e-42b2-47e9-b8b6-d2e4b4a393c9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:53.389477 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f775e-42b2-47e9-b8b6-d2e4b4a393c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:53.399498 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f775e-42b2-47e9-b8b6-d2e4b4a393c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-0b1f775e-42b2-47e9-b8b6-d2e4b4a393c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:53.407621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:53.408825 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:26:53.409961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 603/1195] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:26:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:53.414822 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70f1fd-3a44-4398-bc1c-908dbdc1a0f1 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:53.457965 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:53.514803 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70f1fd-3a44-4398-bc1c-908dbdc1a0f1 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:53.549923 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82486399-3bca-4bc6-b8c6-5351af00355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:53.550865 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486399-3bca-4bc6-b8c6-5351af00355d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:53.551151 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486399-3bca-4bc6-b8c6-5351af00355d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:53.551426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486399-3bca-4bc6-b8c6-5351af00355d None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:53.552164 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82486399-3bca-4bc6-b8c6-5351af00355d None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:53.552465 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82486399-3bca-4bc6-b8c6-5351af00355d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:53.553813 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82486399-3bca-4bc6-b8c6-5351af00355d None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:53.561856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 593/1196] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:26:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:53.567546 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f775e-42b2-47e9-b8b6-d2e4b4a393c9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:53.666792 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f775e-42b2-47e9-b8b6-d2e4b4a393c9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:53.700455 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda61fe-f7b9-4d72-b1bb-982eb606aa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:53.701312 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda61fe-f7b9-4d72-b1bb-982eb606aa93 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:53.701589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda61fe-f7b9-4d72-b1bb-982eb606aa93 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:53.701858 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda61fe-f7b9-4d72-b1bb-982eb606aa93 None admin] PATH_INFO: `/v3/users/15eedad325c24ad1a266cb2367dab9cd` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:53.703656 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda61fe-f7b9-4d72-b1bb-982eb606aa93 None admin] RBAC: Authorizing `identity:get_user(user_id=15eedad325c24ad1a266cb2367dab9cd)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:53.705172 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda61fe-f7b9-4d72-b1bb-982eb606aa93 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:53.706933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 604/1197] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:26:53 2022] GET /identity/v3/users/15eedad325c24ad1a266cb2367dab9cd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:53.713007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82486399-3bca-4bc6-b8c6-5351af00355d None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:53.812483 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82486399-3bca-4bc6-b8c6-5351af00355d None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:53.814808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:53.845195 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f3725-1ace-41ee-9083-5ed1efddf1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:53.845839 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3725-1ace-41ee-9083-5ed1efddf1ef None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:53.846171 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3725-1ace-41ee-9083-5ed1efddf1ef None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:53.846457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3725-1ace-41ee-9083-5ed1efddf1ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:53.912278 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3725-1ace-41ee-9083-5ed1efddf1ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:53.913726 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3725-1ace-41ee-9083-5ed1efddf1ef None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:54.014108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 594/1198] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:26:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:54.019998 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda61fe-f7b9-4d72-b1bb-982eb606aa93 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:54.052233 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:54.125272 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda61fe-f7b9-4d72-b1bb-982eb606aa93 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:54.159277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497814-1dfc-4151-990d-33c329125342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:54.160127 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497814-1dfc-4151-990d-33c329125342 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:54.160408 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497814-1dfc-4151-990d-33c329125342 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:54.160682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497814-1dfc-4151-990d-33c329125342 None admin] PATH_INFO: `/v3/projects/5602c9a2b690493aa2417124bd6bc35f` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:54.161883 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f497814-1dfc-4151-990d-33c329125342 None admin] RBAC: Authorizing `identity:get_project(project_id=5602c9a2b690493aa2417124bd6bc35f)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:54.163399 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f497814-1dfc-4151-990d-33c329125342 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:54.165111 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 605/1199] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:26:54 2022] GET /identity/v3/projects/5602c9a2b690493aa2417124bd6bc35f => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:54.171244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f3725-1ace-41ee-9083-5ed1efddf1ef None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:54.175703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:54.270326 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f3725-1ace-41ee-9083-5ed1efddf1ef None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:54.303132 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916db086-bdc9-4272-81b2-8417dff7e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:54.303787 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916db086-bdc9-4272-81b2-8417dff7e13b None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:54.304069 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916db086-bdc9-4272-81b2-8417dff7e13b None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:54.304345 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916db086-bdc9-4272-81b2-8417dff7e13b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:54.305173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916db086-bdc9-4272-81b2-8417dff7e13b None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=5602c9a2b690493aa2417124bd6bc35f, user.id=15eedad325c24ad1a266cb2367dab9cd) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:54.305483 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916db086-bdc9-4272-81b2-8417dff7e13b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:54.306924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916db086-bdc9-4272-81b2-8417dff7e13b None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:54.313200 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 595/1200] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:26:54 2022] GET /identity/v3/role_assignments?user.id=15eedad325c24ad1a266cb2367dab9cd&scope.project.id=5602c9a2b690493aa2417124bd6bc35f&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:04.154833 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=50 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:04.310080 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=66 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:14.118272 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca2a23-fd68-4145-9966-f6a579f584bb None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:14.119023 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca2a23-fd68-4145-9966-f6a579f584bb None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:14.119023 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca2a23-fd68-4145-9966-f6a579f584bb None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:14.120273 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 606/1201] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:28:14.126572 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ae85-c1cb-4e23-956a-eb6d23e5bc90 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:14.127406 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ae85-c1cb-4e23-956a-eb6d23e5bc90 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:14.127667 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ae85-c1cb-4e23-956a-eb6d23e5bc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:14.149948 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-c926ae85-c1cb-4e23-956a-eb6d23e5bc90 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:14.158029 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-c926ae85-c1cb-4e23-956a-eb6d23e5bc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:14.253564 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 596/1202] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:28:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:28:14.280501 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca2a23-fd68-4145-9966-f6a579f584bb None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:14.413797 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca2a23-fd68-4145-9966-f6a579f584bb None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:14.468301 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2aa4f-ac10-4c29-a57d-d1d1841f457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:14.469126 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2aa4f-ac10-4c29-a57d-d1d1841f457a None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:14.469418 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2aa4f-ac10-4c29-a57d-d1d1841f457a None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:14.469698 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2aa4f-ac10-4c29-a57d-d1d1841f457a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:14.483343 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2aa4f-ac10-4c29-a57d-d1d1841f457a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:14.484939 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2aa4f-ac10-4c29-a57d-d1d1841f457a None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-66e2aa4f-ac10-4c29-a57d-d1d1841f457a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:14.505747 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:14.507905 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:14.509420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:14.509420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:14.509420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:14.509420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:14.509420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 607/1203] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:14.515698 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926ae85-c1cb-4e23-956a-eb6d23e5bc90 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:14.673381 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926ae85-c1cb-4e23-956a-eb6d23e5bc90 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:14.709514 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:14.717575 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3b057-7354-4d82-a2a8-3093ec3288ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:14.718526 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3b057-7354-4d82-a2a8-3093ec3288ee None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:14.718959 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3b057-7354-4d82-a2a8-3093ec3288ee None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:14.719338 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3b057-7354-4d82-a2a8-3093ec3288ee None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:14.720275 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3b057-7354-4d82-a2a8-3093ec3288ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:14.720687 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3b057-7354-4d82-a2a8-3093ec3288ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:14.722486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3b057-7354-4d82-a2a8-3093ec3288ee None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:14.738118 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 597/1204] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:14.744976 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2aa4f-ac10-4c29-a57d-d1d1841f457a None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:14.830953 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:14.891040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2aa4f-ac10-4c29-a57d-d1d1841f457a None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:14.933280 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620533b-9e81-40a2-aa1e-8f40b9beabe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:14.933869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620533b-9e81-40a2-aa1e-8f40b9beabe6 None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:14.934241 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620533b-9e81-40a2-aa1e-8f40b9beabe6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:14.935126 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620533b-9e81-40a2-aa1e-8f40b9beabe6 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:14.935851 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620533b-9e81-40a2-aa1e-8f40b9beabe6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:14.937301 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620533b-9e81-40a2-aa1e-8f40b9beabe6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:15.035486 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 608/1205] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:28:14 2022] POST /identity/v3/users => generated 251 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:28:17.459339 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bf20-7927-4916-82ed-273669fa83cb None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:17.460187 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bf20-7927-4916-82ed-273669fa83cb None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:17.460187 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bf20-7927-4916-82ed-273669fa83cb None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:17.461649 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 598/1206] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:17.469251 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535600-5807-4e02-be45-2dd55e19fb86 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:17.470022 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535600-5807-4e02-be45-2dd55e19fb86 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:17.470022 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535600-5807-4e02-be45-2dd55e19fb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:17.491443 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-6a535600-5807-4e02-be45-2dd55e19fb86 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:17.492673 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-6a535600-5807-4e02-be45-2dd55e19fb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:17.566262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 609/1207] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:28:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:17.591501 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0bf20-7927-4916-82ed-273669fa83cb None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:17.718198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0bf20-7927-4916-82ed-273669fa83cb None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:17.760260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bee263-7732-4032-9307-6b7d7da680fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:17.761188 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bee263-7732-4032-9307-6b7d7da680fb None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:17.761551 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bee263-7732-4032-9307-6b7d7da680fb None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:17.761928 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bee263-7732-4032-9307-6b7d7da680fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:17.776693 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bee263-7732-4032-9307-6b7d7da680fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-55bee263-7732-4032-9307-6b7d7da680fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:17.787202 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:17.788958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:17.790732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 599/1208] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:28:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:17.800714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a535600-5807-4e02-be45-2dd55e19fb86 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:17.856769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:17.927843 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a535600-5807-4e02-be45-2dd55e19fb86 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:17.974310 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680e754-5d7a-4b6d-bcd9-2cd7fe3d2883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:17.975069 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680e754-5d7a-4b6d-bcd9-2cd7fe3d2883 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:17.975432 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680e754-5d7a-4b6d-bcd9-2cd7fe3d2883 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:17.975769 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680e754-5d7a-4b6d-bcd9-2cd7fe3d2883 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:17.976607 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680e754-5d7a-4b6d-bcd9-2cd7fe3d2883 None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:17.976977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680e754-5d7a-4b6d-bcd9-2cd7fe3d2883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:17.978545 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680e754-5d7a-4b6d-bcd9-2cd7fe3d2883 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:17.987789 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 610/1209] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:28:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:17.994291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bee263-7732-4032-9307-6b7d7da680fb None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:18.059914 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:18.145594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bee263-7732-4032-9307-6b7d7da680fb None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:18.193896 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d489346-0ae3-4125-90b3-f4c72c347877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:18.194751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d489346-0ae3-4125-90b3-f4c72c347877 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:18.195040 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d489346-0ae3-4125-90b3-f4c72c347877 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:18.195320 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d489346-0ae3-4125-90b3-f4c72c347877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:18.208412 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d489346-0ae3-4125-90b3-f4c72c347877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:18.210291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d489346-0ae3-4125-90b3-f4c72c347877 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-1d489346-0ae3-4125-90b3-f4c72c347877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:18.231215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:18.232864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:18.233862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:18.233862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:18.233862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:18.233862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:18.233862 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 600/1210] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:18.241980 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680e754-5d7a-4b6d-bcd9-2cd7fe3d2883 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:18.355362 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:18.359957 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680e754-5d7a-4b6d-bcd9-2cd7fe3d2883 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:18.409535 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e21be3-fdea-4565-b96e-82be21394490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:18.410433 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e21be3-fdea-4565-b96e-82be21394490 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:18.410859 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e21be3-fdea-4565-b96e-82be21394490 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:18.411246 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e21be3-fdea-4565-b96e-82be21394490 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:18.412262 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e21be3-fdea-4565-b96e-82be21394490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:18.412699 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e21be3-fdea-4565-b96e-82be21394490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:18.414666 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e21be3-fdea-4565-b96e-82be21394490 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:18.430195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 611/1211] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:18.437156 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d489346-0ae3-4125-90b3-f4c72c347877 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:18.558105 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d489346-0ae3-4125-90b3-f4c72c347877 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:18.560877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:18.601841 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5d033-d04d-41e1-be79-585352aacf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:18.602736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d033-d04d-41e1-be79-585352aacf59 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:18.603026 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d033-d04d-41e1-be79-585352aacf59 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:18.603371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d033-d04d-41e1-be79-585352aacf59 None admin] PATH_INFO: `/v3/users/placement` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:18.613257 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5d033-d04d-41e1-be79-585352aacf59 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:18.614814 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5d033-d04d-41e1-be79-585352aacf59 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-4cd5d033-d04d-41e1-be79-585352aacf59 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:18.633063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:18.635108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:18.637185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:18.637185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:18.637185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:18.637185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:18.637185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:18.637185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:18.637185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:18.637185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:18.637185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:18.637185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:18.637185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 601/1212] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:18.641468 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e21be3-fdea-4565-b96e-82be21394490 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:18.796422 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e21be3-fdea-4565-b96e-82be21394490 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:18.838452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4ef64-af5b-465f-8224-aeb717ace986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:18.839088 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ef64-af5b-465f-8224-aeb717ace986 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:18.839377 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ef64-af5b-465f-8224-aeb717ace986 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:18.839655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ef64-af5b-465f-8224-aeb717ace986 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:18.841059 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4ef64-af5b-465f-8224-aeb717ace986 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:18.841378 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4ef64-af5b-465f-8224-aeb717ace986 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:18.842898 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4ef64-af5b-465f-8224-aeb717ace986 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:18.863476 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 612/1213] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:28:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:18.873900 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5d033-d04d-41e1-be79-585352aacf59 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:19.050884 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5d033-d04d-41e1-be79-585352aacf59 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:19.116935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35d893-50b3-4361-8aa4-c5d2726b1e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:19.118083 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35d893-50b3-4361-8aa4-c5d2726b1e66 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:19.118599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35d893-50b3-4361-8aa4-c5d2726b1e66 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:19.119151 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35d893-50b3-4361-8aa4-c5d2726b1e66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:19.175985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:19.253977 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35d893-50b3-4361-8aa4-c5d2726b1e66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:19.256867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35d893-50b3-4361-8aa4-c5d2726b1e66 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:19.440851 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 602/1214] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:28:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:28:19.447718 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4ef64-af5b-465f-8224-aeb717ace986 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:19.484518 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:19.590842 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4ef64-af5b-465f-8224-aeb717ace986 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:19.648457 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f7b1-f40d-4f96-90bd-e91609e472b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:19.649964 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f7b1-f40d-4f96-90bd-e91609e472b5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:19.650442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f7b1-f40d-4f96-90bd-e91609e472b5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:19.651032 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f7b1-f40d-4f96-90bd-e91609e472b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:19.672636 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75f7b1-f40d-4f96-90bd-e91609e472b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:19.675634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75f7b1-f40d-4f96-90bd-e91609e472b5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-af75f7b1-f40d-4f96-90bd-e91609e472b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:19.710579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:19.712581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:19.714591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:19.714591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:19.714591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:19.714591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:19.714591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 613/1215] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:19.720554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35d893-50b3-4361-8aa4-c5d2726b1e66 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:19.807393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:19.857967 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35d893-50b3-4361-8aa4-c5d2726b1e66 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:19.902542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6634b5-fbd5-4edf-a082-c14706b17aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:19.903464 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6634b5-fbd5-4edf-a082-c14706b17aaf None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:19.903851 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6634b5-fbd5-4edf-a082-c14706b17aaf None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:19.904577 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6634b5-fbd5-4edf-a082-c14706b17aaf None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:19.905407 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6634b5-fbd5-4edf-a082-c14706b17aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:19.905816 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6634b5-fbd5-4edf-a082-c14706b17aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:19.907401 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6634b5-fbd5-4edf-a082-c14706b17aaf None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:19.923747 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 603/1216] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:19.929943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f7b1-f40d-4f96-90bd-e91609e472b5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:20.033924 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:20.071565 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f7b1-f40d-4f96-90bd-e91609e472b5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:20.118940 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41c574-b993-4f44-98d8-764cf2133cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:20.119725 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c574-b993-4f44-98d8-764cf2133cfb None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:20.120007 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c574-b993-4f44-98d8-764cf2133cfb None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:20.120281 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c574-b993-4f44-98d8-764cf2133cfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:20.128686 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41c574-b993-4f44-98d8-764cf2133cfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:20.130217 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41c574-b993-4f44-98d8-764cf2133cfb None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-6d41c574-b993-4f44-98d8-764cf2133cfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:20.146210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:20.148469 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:20.150653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:20.150653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:20.150653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:20.150653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:20.150653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:20.150653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:20.150653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:20.150653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:20.150653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 614/1217] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:20.157457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6634b5-fbd5-4edf-a082-c14706b17aaf None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:20.356334 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6634b5-fbd5-4edf-a082-c14706b17aaf None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:20.402715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:20.424380 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322d4bd-f417-4a1c-b553-940236387528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:20.425793 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322d4bd-f417-4a1c-b553-940236387528 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:20.426291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322d4bd-f417-4a1c-b553-940236387528 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:20.426832 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322d4bd-f417-4a1c-b553-940236387528 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:20.428399 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322d4bd-f417-4a1c-b553-940236387528 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:20.428957 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322d4bd-f417-4a1c-b553-940236387528 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:20.432451 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322d4bd-f417-4a1c-b553-940236387528 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:20.455067 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 604/1218] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:28:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:20.463220 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41c574-b993-4f44-98d8-764cf2133cfb None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:20.590925 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41c574-b993-4f44-98d8-764cf2133cfb None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:20.625627 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:20.632583 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bd1a4-864f-431a-a1e1-b986e985e806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:20.638592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bd1a4-864f-431a-a1e1-b986e985e806 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:20.638592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bd1a4-864f-431a-a1e1-b986e985e806 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:20.638592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bd1a4-864f-431a-a1e1-b986e985e806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:20.638592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bd1a4-864f-431a-a1e1-b986e985e806 None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=b4fbe085f9764389b3f51d477943565d) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:20.638592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bd1a4-864f-431a-a1e1-b986e985e806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:20.639114 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bd1a4-864f-431a-a1e1-b986e985e806 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:20.646664 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 615/1219] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:28:20 2022] GET /identity/v3/role_assignments?user.id=b4fbe085f9764389b3f51d477943565d&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:23.060717 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590325-6b48-4ff9-b584-84c3e8de04ea None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:23.061547 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590325-6b48-4ff9-b584-84c3e8de04ea None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:23.061547 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590325-6b48-4ff9-b584-84c3e8de04ea None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:23.062673 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 605/1220] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:23.070437 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb1600-26bc-48e6-81a6-ceb4f08664d1 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:23.071164 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb1600-26bc-48e6-81a6-ceb4f08664d1 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:23.071502 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb1600-26bc-48e6-81a6-ceb4f08664d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:23.096970 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-23bb1600-26bc-48e6-81a6-ceb4f08664d1 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:23.098347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-23bb1600-26bc-48e6-81a6-ceb4f08664d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:23.188013 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 616/1221] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:28:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:23.211254 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44590325-6b48-4ff9-b584-84c3e8de04ea None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:23.347759 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44590325-6b48-4ff9-b584-84c3e8de04ea None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:23.411651 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c79d87-7bfc-49b8-b550-32f5148c6a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:23.413008 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c79d87-7bfc-49b8-b550-32f5148c6a6a None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:23.413492 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c79d87-7bfc-49b8-b550-32f5148c6a6a None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:23.413979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c79d87-7bfc-49b8-b550-32f5148c6a6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:23.432813 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c79d87-7bfc-49b8-b550-32f5148c6a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-28c79d87-7bfc-49b8-b550-32f5148c6a6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:23.448585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:23.450099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:23.451219 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:23.452582 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 606/1222] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:23.458357 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb1600-26bc-48e6-81a6-ceb4f08664d1 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:23.584716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb1600-26bc-48e6-81a6-ceb4f08664d1 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:23.615417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:23.628446 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33425f9-1965-4a48-9bd6-f21336cccfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:23.633945 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33425f9-1965-4a48-9bd6-f21336cccfb1 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:23.633945 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33425f9-1965-4a48-9bd6-f21336cccfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:23.633945 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33425f9-1965-4a48-9bd6-f21336cccfb1 None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:23.633945 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33425f9-1965-4a48-9bd6-f21336cccfb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:23.633945 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33425f9-1965-4a48-9bd6-f21336cccfb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:23.633945 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33425f9-1965-4a48-9bd6-f21336cccfb1 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:23.644097 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 617/1223] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:23.651060 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c79d87-7bfc-49b8-b550-32f5148c6a6a None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:23.733932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:23.807726 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c79d87-7bfc-49b8-b550-32f5148c6a6a None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:23.843391 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5e085-9abc-4a5e-a588-30fe8912ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:23.844207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e085-9abc-4a5e-a588-30fe8912ae31 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:23.844494 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e085-9abc-4a5e-a588-30fe8912ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:23.844774 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e085-9abc-4a5e-a588-30fe8912ae31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:23.855861 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5e085-9abc-4a5e-a588-30fe8912ae31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:23.857318 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5e085-9abc-4a5e-a588-30fe8912ae31 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-ead5e085-9abc-4a5e-a588-30fe8912ae31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:23.878709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:23.879947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:23.881505 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:23.881505 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:23.881505 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:23.881505 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:23.881505 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 607/1224] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:23.885998 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33425f9-1965-4a48-9bd6-f21336cccfb1 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:24.035604 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33425f9-1965-4a48-9bd6-f21336cccfb1 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:24.078820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201b0bc-455f-416e-ae32-c6fe70c4c361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:24.079592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201b0bc-455f-416e-ae32-c6fe70c4c361 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:24.079897 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201b0bc-455f-416e-ae32-c6fe70c4c361 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:24.080222 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201b0bc-455f-416e-ae32-c6fe70c4c361 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:24.081138 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201b0bc-455f-416e-ae32-c6fe70c4c361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:24.081523 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201b0bc-455f-416e-ae32-c6fe70c4c361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:24.083086 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201b0bc-455f-416e-ae32-c6fe70c4c361 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:24.097496 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 618/1225] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:24.104241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5e085-9abc-4a5e-a588-30fe8912ae31 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:24.214456 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:24.220517 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5e085-9abc-4a5e-a588-30fe8912ae31 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:24.257478 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118817b9-0bb5-439c-b433-4fe4953093bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:24.258311 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118817b9-0bb5-439c-b433-4fe4953093bf None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:24.258599 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118817b9-0bb5-439c-b433-4fe4953093bf None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:24.259021 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118817b9-0bb5-439c-b433-4fe4953093bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:24.267857 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118817b9-0bb5-439c-b433-4fe4953093bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:24.276212 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118817b9-0bb5-439c-b433-4fe4953093bf None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-118817b9-0bb5-439c-b433-4fe4953093bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:24.285333 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:24.286736 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:24.288243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:24.288243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:24.288243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:24.288243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:24.288243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:24.288243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:24.288243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:24.288243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:24.288243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:24.288243 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:24.290810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 608/1226] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:24.292615 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201b0bc-455f-416e-ae32-c6fe70c4c361 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:24.352656 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:24.415400 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201b0bc-455f-416e-ae32-c6fe70c4c361 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:24.456588 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda29d38-6598-4af6-93c9-346ef3a28f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:24.461830 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29d38-6598-4af6-93c9-346ef3a28f5c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:24.461830 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29d38-6598-4af6-93c9-346ef3a28f5c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:24.461830 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29d38-6598-4af6-93c9-346ef3a28f5c None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:24.461830 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda29d38-6598-4af6-93c9-346ef3a28f5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:24.461830 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda29d38-6598-4af6-93c9-346ef3a28f5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:24.461830 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda29d38-6598-4af6-93c9-346ef3a28f5c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:24.483141 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 619/1227] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:28:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:24.490239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118817b9-0bb5-439c-b433-4fe4953093bf None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:24.637026 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118817b9-0bb5-439c-b433-4fe4953093bf None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:24.679217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c50b-9b82-4ee1-ad4a-cf667e76ef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:24.680415 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c50b-9b82-4ee1-ad4a-cf667e76ef54 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:24.680769 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c50b-9b82-4ee1-ad4a-cf667e76ef54 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:24.681091 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c50b-9b82-4ee1-ad4a-cf667e76ef54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:24.694129 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307c50b-9b82-4ee1-ad4a-cf667e76ef54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:24.695909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307c50b-9b82-4ee1-ad4a-cf667e76ef54 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-b307c50b-9b82-4ee1-ad4a-cf667e76ef54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:24.721273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:24.723488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:24.725625 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:24.725625 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:24.725625 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:24.725625 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:24.725625 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 609/1228] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:24.729731 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda29d38-6598-4af6-93c9-346ef3a28f5c None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:24.902169 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda29d38-6598-4af6-93c9-346ef3a28f5c None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:24.905474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:24.959177 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327279a1-9f73-47b7-b98f-56fd7af35a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:24.960327 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327279a1-9f73-47b7-b98f-56fd7af35a9e None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:24.960838 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327279a1-9f73-47b7-b98f-56fd7af35a9e None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:24.961350 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327279a1-9f73-47b7-b98f-56fd7af35a9e None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:24.962778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327279a1-9f73-47b7-b98f-56fd7af35a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:24.963411 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327279a1-9f73-47b7-b98f-56fd7af35a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:24.966634 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327279a1-9f73-47b7-b98f-56fd7af35a9e None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:24.989884 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 620/1229] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:24.996346 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c50b-9b82-4ee1-ad4a-cf667e76ef54 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:25.006469 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:25.129245 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c50b-9b82-4ee1-ad4a-cf667e76ef54 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:25.176808 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a4463-ca86-4e82-a67d-45b874dab9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:25.177660 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a4463-ca86-4e82-a67d-45b874dab9a4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:25.177942 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a4463-ca86-4e82-a67d-45b874dab9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:25.178220 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a4463-ca86-4e82-a67d-45b874dab9a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:25.187510 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a4463-ca86-4e82-a67d-45b874dab9a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:25.189027 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a4463-ca86-4e82-a67d-45b874dab9a4 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-f62a4463-ca86-4e82-a67d-45b874dab9a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:25.205255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:25.207390 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:25.209189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:25.209189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:25.209189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:25.209189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:25.209189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:25.209189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:25.209189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:25.209189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:25.209189 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 610/1230] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:25.213283 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327279a1-9f73-47b7-b98f-56fd7af35a9e None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:25.346110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327279a1-9f73-47b7-b98f-56fd7af35a9e None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:25.410915 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d554db2-1004-4e75-96b0-84694eeb98aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:25.411987 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d554db2-1004-4e75-96b0-84694eeb98aa None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:25.412562 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d554db2-1004-4e75-96b0-84694eeb98aa None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:25.413128 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d554db2-1004-4e75-96b0-84694eeb98aa None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:25.414796 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d554db2-1004-4e75-96b0-84694eeb98aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:25.415367 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d554db2-1004-4e75-96b0-84694eeb98aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:25.418765 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d554db2-1004-4e75-96b0-84694eeb98aa None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:25.437054 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 621/1231] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:28:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:25.443935 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a4463-ca86-4e82-a67d-45b874dab9a4 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:25.530871 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:25.578732 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a4463-ca86-4e82-a67d-45b874dab9a4 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:25.621049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b3b1a-b3b6-4849-a151-d3fa49a1e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:25.622128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3b1a-b3b6-4849-a151-d3fa49a1e74e None admin] REQUEST_METHOD: `PUT` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:25.622481 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3b1a-b3b6-4849-a151-d3fa49a1e74e None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:25.622880 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3b1a-b3b6-4849-a151-d3fa49a1e74e None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/b4fbe085f9764389b3f51d477943565d/roles/c6d6983e0eaf48da8812725f576ddfb2` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:25.639991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3b1a-b3b6-4849-a151-d3fa49a1e74e None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=b4fbe085f9764389b3f51d477943565d, role_id=c6d6983e0eaf48da8812725f576ddfb2)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:25.641472 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3b1a-b3b6-4849-a151-d3fa49a1e74e None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:25.720540 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 611/1232] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:28:25 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/b4fbe085f9764389b3f51d477943565d/roles/c6d6983e0eaf48da8812725f576ddfb2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:28:28.097584 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da86e5b-f2e3-4b9f-bca2-ed0f14452c22 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:28.098219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da86e5b-f2e3-4b9f-bca2-ed0f14452c22 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:28.098219 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da86e5b-f2e3-4b9f-bca2-ed0f14452c22 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:28.099477 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 622/1233] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:28:28.105264 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d6d88-f33c-4c6a-b5e5-f0adb6aaa8db None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:28.105932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d6d88-f33c-4c6a-b5e5-f0adb6aaa8db None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:28.105932 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d6d88-f33c-4c6a-b5e5-f0adb6aaa8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:28.132724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-fa4d6d88-f33c-4c6a-b5e5-f0adb6aaa8db None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:28.134882 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-fa4d6d88-f33c-4c6a-b5e5-f0adb6aaa8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:28.233448 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 612/1234] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:28:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:28.276729 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da86e5b-f2e3-4b9f-bca2-ed0f14452c22 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:28.304913 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:28.392113 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da86e5b-f2e3-4b9f-bca2-ed0f14452c22 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:28.431656 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c861584-a3e0-49da-9491-1905051ccdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:28.432467 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861584-a3e0-49da-9491-1905051ccdaf None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:28.432746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861584-a3e0-49da-9491-1905051ccdaf None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:28.433016 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861584-a3e0-49da-9491-1905051ccdaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:28.445501 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c861584-a3e0-49da-9491-1905051ccdaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-2c861584-a3e0-49da-9491-1905051ccdaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:28.453802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:28.455532 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:28.456533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 623/1235] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:28.465721 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d6d88-f33c-4c6a-b5e5-f0adb6aaa8db None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:28.520200 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:28.578115 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d6d88-f33c-4c6a-b5e5-f0adb6aaa8db None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:28.614760 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34d656-9669-45c1-a6b1-8d91551c8dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:28.615447 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34d656-9669-45c1-a6b1-8d91551c8dec None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:28.616317 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34d656-9669-45c1-a6b1-8d91551c8dec None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:28.616593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34d656-9669-45c1-a6b1-8d91551c8dec None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:28.617799 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34d656-9669-45c1-a6b1-8d91551c8dec None admin] RBAC: Adding query filter params (name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:28.618174 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34d656-9669-45c1-a6b1-8d91551c8dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:28.619609 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34d656-9669-45c1-a6b1-8d91551c8dec None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:28.632379 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 613/1236] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:28.641685 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c861584-a3e0-49da-9491-1905051ccdaf None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:28.736568 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:28.754659 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c861584-a3e0-49da-9491-1905051ccdaf None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:28.797927 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dae13-2250-4c6e-9d5b-b5b677ac96a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:28.799023 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dae13-2250-4c6e-9d5b-b5b677ac96a9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:28.799660 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dae13-2250-4c6e-9d5b-b5b677ac96a9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:28.800079 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dae13-2250-4c6e-9d5b-b5b677ac96a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:28.813527 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dae13-2250-4c6e-9d5b-b5b677ac96a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:28.815351 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dae13-2250-4c6e-9d5b-b5b677ac96a9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-0d0dae13-2250-4c6e-9d5b-b5b677ac96a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:28.834402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:28.840652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:28.842526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:28.842526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:28.842526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:28.842526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:28.842526 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 624/1237] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:28.843718 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34d656-9669-45c1-a6b1-8d91551c8dec None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:28.957511 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34d656-9669-45c1-a6b1-8d91551c8dec None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:28.968015 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:28.993863 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b53173-02b7-41a4-9328-2653bfb58806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:28.994651 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b53173-02b7-41a4-9328-2653bfb58806 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:28.995033 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b53173-02b7-41a4-9328-2653bfb58806 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:28.995429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b53173-02b7-41a4-9328-2653bfb58806 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:28.996276 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b53173-02b7-41a4-9328-2653bfb58806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:28.996707 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b53173-02b7-41a4-9328-2653bfb58806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:28.998213 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b53173-02b7-41a4-9328-2653bfb58806 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:29.011230 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 614/1238] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:29.017963 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dae13-2250-4c6e-9d5b-b5b677ac96a9 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:29.134382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dae13-2250-4c6e-9d5b-b5b677ac96a9 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:29.171141 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6107e-29f4-4ef2-9753-bfa83505e95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:29.171944 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6107e-29f4-4ef2-9753-bfa83505e95b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:29.172222 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6107e-29f4-4ef2-9753-bfa83505e95b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:29.172494 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6107e-29f4-4ef2-9753-bfa83505e95b None admin] PATH_INFO: `/v3/users/placement` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:29.175926 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:29.181329 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6107e-29f4-4ef2-9753-bfa83505e95b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:29.182820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6107e-29f4-4ef2-9753-bfa83505e95b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-80b6107e-29f4-4ef2-9753-bfa83505e95b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:29.198137 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:29.200074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:29.201230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:29.201230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:29.201230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:29.201230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:29.201230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:29.201230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:29.201230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:29.201230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:29.201230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:29.201230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:29.201230 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 625/1239] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:29.207058 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b53173-02b7-41a4-9328-2653bfb58806 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:29.344374 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b53173-02b7-41a4-9328-2653bfb58806 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:29.386161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd706c8-716b-4bc4-8c18-5fffd17f8ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:29.387036 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd706c8-716b-4bc4-8c18-5fffd17f8ca4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:29.387380 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd706c8-716b-4bc4-8c18-5fffd17f8ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:29.387755 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd706c8-716b-4bc4-8c18-5fffd17f8ca4 None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:29.388692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd706c8-716b-4bc4-8c18-5fffd17f8ca4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:29.389102 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd706c8-716b-4bc4-8c18-5fffd17f8ca4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:29.390803 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd706c8-716b-4bc4-8c18-5fffd17f8ca4 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:29.413211 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 615/1240] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:28:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:29.420546 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6107e-29f4-4ef2-9753-bfa83505e95b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:29.547163 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6107e-29f4-4ef2-9753-bfa83505e95b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:29.585127 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfff42e-4644-4467-b199-960ffc2ab428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:29.585815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfff42e-4644-4467-b199-960ffc2ab428 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:29.586102 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfff42e-4644-4467-b199-960ffc2ab428 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:29.586382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfff42e-4644-4467-b199-960ffc2ab428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:29.664696 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:29.673077 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfff42e-4644-4467-b199-960ffc2ab428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:29.675127 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfff42e-4644-4467-b199-960ffc2ab428 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:29.807807 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 626/1241] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:28:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:28:29.815276 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd706c8-716b-4bc4-8c18-5fffd17f8ca4 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:29.848087 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:29.924829 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd706c8-716b-4bc4-8c18-5fffd17f8ca4 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:29.960958 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c823f-d314-4505-90e5-7fc93c8b9639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:29.961831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c823f-d314-4505-90e5-7fc93c8b9639 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:29.962172 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c823f-d314-4505-90e5-7fc93c8b9639 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:29.962495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c823f-d314-4505-90e5-7fc93c8b9639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:29.973691 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c823f-d314-4505-90e5-7fc93c8b9639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:29.975197 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c823f-d314-4505-90e5-7fc93c8b9639 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-d74c823f-d314-4505-90e5-7fc93c8b9639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:29.993696 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:30.002974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:30.004210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:30.004210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:30.004210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:30.004210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:30.004210 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 616/1242] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:30.004525 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfff42e-4644-4467-b199-960ffc2ab428 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:30.107629 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:30.115074 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfff42e-4644-4467-b199-960ffc2ab428 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:30.155699 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a450f6-f938-42b4-9dff-5546ca979ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:30.156418 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a450f6-f938-42b4-9dff-5546ca979ab8 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:30.156647 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a450f6-f938-42b4-9dff-5546ca979ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:30.156982 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a450f6-f938-42b4-9dff-5546ca979ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:30.157717 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a450f6-f938-42b4-9dff-5546ca979ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:30.158022 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a450f6-f938-42b4-9dff-5546ca979ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:30.159462 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a450f6-f938-42b4-9dff-5546ca979ab8 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:30.172975 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 627/1243] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:30.179843 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c823f-d314-4505-90e5-7fc93c8b9639 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:30.264128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:30.288761 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c823f-d314-4505-90e5-7fc93c8b9639 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:30.326887 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471ee9c-78b9-45bf-b78f-95cf740ea567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:30.327710 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471ee9c-78b9-45bf-b78f-95cf740ea567 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:30.328001 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471ee9c-78b9-45bf-b78f-95cf740ea567 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:30.328282 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471ee9c-78b9-45bf-b78f-95cf740ea567 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:30.336122 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471ee9c-78b9-45bf-b78f-95cf740ea567 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:30.338404 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471ee9c-78b9-45bf-b78f-95cf740ea567 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-1471ee9c-78b9-45bf-b78f-95cf740ea567 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:30.354010 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:30.355313 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:30.356921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:30.356921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:30.356921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:30.356921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:30.356921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:30.356921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:30.356921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:30.356921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:30.356921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 617/1244] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:28:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:30.365968 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a450f6-f938-42b4-9dff-5546ca979ab8 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:30.504068 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a450f6-f938-42b4-9dff-5546ca979ab8 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:30.542654 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33ab75-df40-4178-a4d1-d1695113debf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:30.543347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33ab75-df40-4178-a4d1-d1695113debf None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:30.543625 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33ab75-df40-4178-a4d1-d1695113debf None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:30.543895 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33ab75-df40-4178-a4d1-d1695113debf None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:30.544687 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33ab75-df40-4178-a4d1-d1695113debf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:30.545000 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33ab75-df40-4178-a4d1-d1695113debf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:30.546545 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33ab75-df40-4178-a4d1-d1695113debf None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:30.559947 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 628/1245] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:28:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:30.566522 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471ee9c-78b9-45bf-b78f-95cf740ea567 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:30.682990 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471ee9c-78b9-45bf-b78f-95cf740ea567 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:30.724740 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44e59-1055-4905-88f1-0811eec47bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:30.725436 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44e59-1055-4905-88f1-0811eec47bfd None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:30.725726 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44e59-1055-4905-88f1-0811eec47bfd None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:30.726017 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44e59-1055-4905-88f1-0811eec47bfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:30.726928 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a44e59-1055-4905-88f1-0811eec47bfd None admin] RBAC: Adding query filter params (role.id=c6d6983e0eaf48da8812725f576ddfb2, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=b4fbe085f9764389b3f51d477943565d) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:30.727249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a44e59-1055-4905-88f1-0811eec47bfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:30.728742 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a44e59-1055-4905-88f1-0811eec47bfd None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:30.735901 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 618/1246] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:28:30 2022] GET /identity/v3/role_assignments?user.id=b4fbe085f9764389b3f51d477943565d&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=c6d6983e0eaf48da8812725f576ddfb2 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:33.201185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c6f3-99d0-4a98-a642-9de94c99cadf None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:33.201850 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c6f3-99d0-4a98-a642-9de94c99cadf None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:33.201850 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c6f3-99d0-4a98-a642-9de94c99cadf None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:33.203466 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 629/1247] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:33.209563 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4ec3e-6b09-4145-8090-4676701c31ac None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:33.210149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4ec3e-6b09-4145-8090-4676701c31ac None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:33.210149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4ec3e-6b09-4145-8090-4676701c31ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:33.215462 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:33.228310 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-75c4ec3e-6b09-4145-8090-4676701c31ac None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:33.229574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-75c4ec3e-6b09-4145-8090-4676701c31ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:33.307751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 619/1248] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:28:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:33.333167 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8c6f3-99d0-4a98-a642-9de94c99cadf None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:33.353967 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:33.461465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8c6f3-99d0-4a98-a642-9de94c99cadf None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:33.524823 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35ce3a-386d-4a0e-aa9c-34bada952e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:33.525725 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35ce3a-386d-4a0e-aa9c-34bada952e43 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:33.526049 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35ce3a-386d-4a0e-aa9c-34bada952e43 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:33.526362 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35ce3a-386d-4a0e-aa9c-34bada952e43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:33.538571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35ce3a-386d-4a0e-aa9c-34bada952e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-df35ce3a-386d-4a0e-aa9c-34bada952e43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:33.547275 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:33.552277 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:33.554534 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 630/1249] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:33.556594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4ec3e-6b09-4145-8090-4676701c31ac None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:33.669795 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4ec3e-6b09-4145-8090-4676701c31ac None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:33.706879 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:33.712722 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591a2df-a641-4788-82ec-e8e3a4d48659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:33.713386 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591a2df-a641-4788-82ec-e8e3a4d48659 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:33.713708 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591a2df-a641-4788-82ec-e8e3a4d48659 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:33.714024 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591a2df-a641-4788-82ec-e8e3a4d48659 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:33.715391 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591a2df-a641-4788-82ec-e8e3a4d48659 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:33.715738 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591a2df-a641-4788-82ec-e8e3a4d48659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:33.717215 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591a2df-a641-4788-82ec-e8e3a4d48659 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:33.726879 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 620/1250] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:33.733535 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35ce3a-386d-4a0e-aa9c-34bada952e43 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:33.825210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:33.850075 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35ce3a-386d-4a0e-aa9c-34bada952e43 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:33.885597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52521c-c7ef-4a7e-84b6-d8e60217e050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:33.886400 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52521c-c7ef-4a7e-84b6-d8e60217e050 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:33.886713 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52521c-c7ef-4a7e-84b6-d8e60217e050 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:33.886993 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52521c-c7ef-4a7e-84b6-d8e60217e050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:33.898909 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52521c-c7ef-4a7e-84b6-d8e60217e050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:33.900655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52521c-c7ef-4a7e-84b6-d8e60217e050 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-3f52521c-c7ef-4a7e-84b6-d8e60217e050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:33.920133 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:33.922041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:33.924041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:33.924041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:33.924041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:33.924041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:33.924041 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 631/1251] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:33.930041 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591a2df-a641-4788-82ec-e8e3a4d48659 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:34.047015 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591a2df-a641-4788-82ec-e8e3a4d48659 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:34.087322 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ca269-d591-46dd-a2b5-c52f162d7a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:34.088019 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca269-d591-46dd-a2b5-c52f162d7a41 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:34.088310 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca269-d591-46dd-a2b5-c52f162d7a41 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:34.088594 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca269-d591-46dd-a2b5-c52f162d7a41 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:34.089355 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ca269-d591-46dd-a2b5-c52f162d7a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:34.090207 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ca269-d591-46dd-a2b5-c52f162d7a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:34.091655 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ca269-d591-46dd-a2b5-c52f162d7a41 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:34.106593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 621/1252] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:34.113365 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52521c-c7ef-4a7e-84b6-d8e60217e050 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:34.267578 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52521c-c7ef-4a7e-84b6-d8e60217e050 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:34.300649 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:34.308497 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddc20d-90fb-45eb-b5a5-479632021fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:34.309321 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc20d-90fb-45eb-b5a5-479632021fc5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:34.309606 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc20d-90fb-45eb-b5a5-479632021fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:34.309885 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc20d-90fb-45eb-b5a5-479632021fc5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:34.318395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddc20d-90fb-45eb-b5a5-479632021fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:34.319937 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddc20d-90fb-45eb-b5a5-479632021fc5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-75ddc20d-90fb-45eb-b5a5-479632021fc5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:34.336156 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:34.338216 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:34.340759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:34.340759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:34.340759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:34.340759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:34.340759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:34.340759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:34.340759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:34.340759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:34.340759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:34.340759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:34.340759 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 632/1253] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:34.347060 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ca269-d591-46dd-a2b5-c52f162d7a41 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:34.426574 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:34.476650 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ca269-d591-46dd-a2b5-c52f162d7a41 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:34.517782 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931c9c-34d3-49c4-ace0-1a94575dadbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:34.518767 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931c9c-34d3-49c4-ace0-1a94575dadbf None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:34.519185 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931c9c-34d3-49c4-ace0-1a94575dadbf None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:34.519616 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931c9c-34d3-49c4-ace0-1a94575dadbf None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:34.520716 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2931c9c-34d3-49c4-ace0-1a94575dadbf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:34.521138 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2931c9c-34d3-49c4-ace0-1a94575dadbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:34.522841 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2931c9c-34d3-49c4-ace0-1a94575dadbf None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:34.542950 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 622/1254] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:28:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:34.549188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddc20d-90fb-45eb-b5a5-479632021fc5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:34.670073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddc20d-90fb-45eb-b5a5-479632021fc5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:34.713276 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca1ca-8e3b-4f83-aad5-c6798c15d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:34.714004 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca1ca-8e3b-4f83-aad5-c6798c15d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:34.714335 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca1ca-8e3b-4f83-aad5-c6798c15d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:34.714754 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca1ca-8e3b-4f83-aad5-c6798c15d3f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:34.779023 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:34.793742 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ca1ca-8e3b-4f83-aad5-c6798c15d3f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:34.795394 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ca1ca-8e3b-4f83-aad5-c6798c15d3f6 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:34.910567 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 633/1255] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:28:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:28:34.916914 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931c9c-34d3-49c4-ace0-1a94575dadbf None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:35.030291 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931c9c-34d3-49c4-ace0-1a94575dadbf None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:35.050363 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:35.074627 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec0014-95c4-475f-8e52-56b24b952ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:35.075645 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec0014-95c4-475f-8e52-56b24b952ea9 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:35.075974 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec0014-95c4-475f-8e52-56b24b952ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:35.076302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec0014-95c4-475f-8e52-56b24b952ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:35.087695 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec0014-95c4-475f-8e52-56b24b952ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:35.089173 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec0014-95c4-475f-8e52-56b24b952ea9 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-d3ec0014-95c4-475f-8e52-56b24b952ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:35.108866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:35.110872 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:35.112445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:35.112445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:35.112445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:35.112445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:35.112445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 623/1256] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:35.119850 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca1ca-8e3b-4f83-aad5-c6798c15d3f6 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:35.244259 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:35.258086 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca1ca-8e3b-4f83-aad5-c6798c15d3f6 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:35.302063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcf8ff-3789-4f58-bba2-7a2bcd6085f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:35.302821 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcf8ff-3789-4f58-bba2-7a2bcd6085f7 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:35.302966 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcf8ff-3789-4f58-bba2-7a2bcd6085f7 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:35.303243 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcf8ff-3789-4f58-bba2-7a2bcd6085f7 None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:35.304054 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcf8ff-3789-4f58-bba2-7a2bcd6085f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:35.304375 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcf8ff-3789-4f58-bba2-7a2bcd6085f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:35.305857 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcf8ff-3789-4f58-bba2-7a2bcd6085f7 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:35.319714 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 634/1257] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:35.326525 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec0014-95c4-475f-8e52-56b24b952ea9 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:35.478678 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec0014-95c4-475f-8e52-56b24b952ea9 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:35.519794 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09d53f-fd13-4389-b0be-29dedf153d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:35.520985 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09d53f-fd13-4389-b0be-29dedf153d47 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:35.521399 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09d53f-fd13-4389-b0be-29dedf153d47 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:35.521781 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09d53f-fd13-4389-b0be-29dedf153d47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:35.530194 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09d53f-fd13-4389-b0be-29dedf153d47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:35.531726 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09d53f-fd13-4389-b0be-29dedf153d47 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-4a09d53f-fd13-4389-b0be-29dedf153d47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:35.546919 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:35.552866 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:35.554007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:35.554007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:35.554007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:35.554007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:35.554007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:35.554007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:35.554007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:35.554007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:35.554007 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 624/1258] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:35.556016 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcf8ff-3789-4f58-bba2-7a2bcd6085f7 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:35.699842 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcf8ff-3789-4f58-bba2-7a2bcd6085f7 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:35.738213 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5db1e-113d-4c6b-8d85-0024027c4fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:35.739002 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5db1e-113d-4c6b-8d85-0024027c4fd9 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:35.739359 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5db1e-113d-4c6b-8d85-0024027c4fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:35.739672 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5db1e-113d-4c6b-8d85-0024027c4fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:35.740540 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5db1e-113d-4c6b-8d85-0024027c4fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:35.740897 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5db1e-113d-4c6b-8d85-0024027c4fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:35.742417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5db1e-113d-4c6b-8d85-0024027c4fd9 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:35.758053 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 635/1259] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:28:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:35.764934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09d53f-fd13-4389-b0be-29dedf153d47 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:35.796879 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:35.898892 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09d53f-fd13-4389-b0be-29dedf153d47 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:35.951972 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d123a-1c0d-4f6c-ab68-a4b7077f83ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:35.953204 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d123a-1c0d-4f6c-ab68-a4b7077f83ec None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:35.953716 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d123a-1c0d-4f6c-ab68-a4b7077f83ec None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:35.954192 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d123a-1c0d-4f6c-ab68-a4b7077f83ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:35.956111 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d123a-1c0d-4f6c-ab68-a4b7077f83ec None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=b4fbe085f9764389b3f51d477943565d) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:35.956691 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d123a-1c0d-4f6c-ab68-a4b7077f83ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:35.959477 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d123a-1c0d-4f6c-ab68-a4b7077f83ec None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:35.970740 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 625/1260] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:28:35 2022] GET /identity/v3/role_assignments?user.id=b4fbe085f9764389b3f51d477943565d&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:38.343778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ece0-8484-47ec-bf6c-86a32ca01609 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:38.344489 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ece0-8484-47ec-bf6c-86a32ca01609 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:38.344489 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ece0-8484-47ec-bf6c-86a32ca01609 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:38.345879 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 636/1261] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:28:38.354585 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b83b1d-7641-4324-b1fb-c490d88d3950 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:38.358339 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b83b1d-7641-4324-b1fb-c490d88d3950 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:38.358339 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b83b1d-7641-4324-b1fb-c490d88d3950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:38.373589 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-27b83b1d-7641-4324-b1fb-c490d88d3950 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:38.374953 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-27b83b1d-7641-4324-b1fb-c490d88d3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:38.457753 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 626/1262] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:28:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:38.481865 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648ece0-8484-47ec-bf6c-86a32ca01609 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:38.495512 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:38.612482 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648ece0-8484-47ec-bf6c-86a32ca01609 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:38.656347 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523808cc-4ddd-47f2-8a98-0d246bd2e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:38.657242 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523808cc-4ddd-47f2-8a98-0d246bd2e359 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:38.657576 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523808cc-4ddd-47f2-8a98-0d246bd2e359 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:38.657903 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523808cc-4ddd-47f2-8a98-0d246bd2e359 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:38.672128 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523808cc-4ddd-47f2-8a98-0d246bd2e359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-523808cc-4ddd-47f2-8a98-0d246bd2e359 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:38.680657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:38.688285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:38.690580 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 637/1263] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:38.694837 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b83b1d-7641-4324-b1fb-c490d88d3950 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:38.714120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:38.815738 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b83b1d-7641-4324-b1fb-c490d88d3950 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:38.856776 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0383f30-c52f-49a6-b4cb-acfd3da45ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:38.857485 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0383f30-c52f-49a6-b4cb-acfd3da45ad4 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:38.857774 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0383f30-c52f-49a6-b4cb-acfd3da45ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:38.858054 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0383f30-c52f-49a6-b4cb-acfd3da45ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:38.858880 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0383f30-c52f-49a6-b4cb-acfd3da45ad4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:38.859198 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0383f30-c52f-49a6-b4cb-acfd3da45ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:38.860617 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0383f30-c52f-49a6-b4cb-acfd3da45ad4 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:38.870483 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 627/1264] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:38.877267 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523808cc-4ddd-47f2-8a98-0d246bd2e359 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:38.953870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:38.995690 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523808cc-4ddd-47f2-8a98-0d246bd2e359 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:39.034126 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87469d55-2932-4c9d-a23d-c5306df0945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:39.034958 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87469d55-2932-4c9d-a23d-c5306df0945f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:39.035244 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87469d55-2932-4c9d-a23d-c5306df0945f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:39.035524 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87469d55-2932-4c9d-a23d-c5306df0945f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:39.048592 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87469d55-2932-4c9d-a23d-c5306df0945f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:39.050368 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87469d55-2932-4c9d-a23d-c5306df0945f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-87469d55-2932-4c9d-a23d-c5306df0945f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:39.069541 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:39.071417 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:39.072804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:39.072804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:39.072804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:39.072804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:39.072804 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 638/1265] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:39.080458 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0383f30-c52f-49a6-b4cb-acfd3da45ad4 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:39.216412 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:39.239614 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0383f30-c52f-49a6-b4cb-acfd3da45ad4 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:39.281262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f164d00-4ec5-4965-a93a-cc470c40fd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:39.281966 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f164d00-4ec5-4965-a93a-cc470c40fd15 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:39.282255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f164d00-4ec5-4965-a93a-cc470c40fd15 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:39.282666 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f164d00-4ec5-4965-a93a-cc470c40fd15 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:39.283351 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f164d00-4ec5-4965-a93a-cc470c40fd15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:39.283669 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f164d00-4ec5-4965-a93a-cc470c40fd15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:39.285090 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f164d00-4ec5-4965-a93a-cc470c40fd15 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:39.307925 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 628/1266] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:39.313974 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87469d55-2932-4c9d-a23d-c5306df0945f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:39.439604 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87469d55-2932-4c9d-a23d-c5306df0945f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:39.463353 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:39.481459 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16406c3-eb41-49e7-9dbc-d5fb62f9d6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:39.482199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16406c3-eb41-49e7-9dbc-d5fb62f9d6de None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:39.482483 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16406c3-eb41-49e7-9dbc-d5fb62f9d6de None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:39.482803 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16406c3-eb41-49e7-9dbc-d5fb62f9d6de None admin] PATH_INFO: `/v3/users/placement` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:39.491958 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16406c3-eb41-49e7-9dbc-d5fb62f9d6de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:39.493585 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16406c3-eb41-49e7-9dbc-d5fb62f9d6de None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-f16406c3-eb41-49e7-9dbc-d5fb62f9d6de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:39.510279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:39.512778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:39.514787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:39.514787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:39.514787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:39.514787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:39.514787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:39.514787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:39.514787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:39.514787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:39.514787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:39.514787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:39.514787 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 639/1267] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:39.520018 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f164d00-4ec5-4965-a93a-cc470c40fd15 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:39.640092 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f164d00-4ec5-4965-a93a-cc470c40fd15 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:39.679748 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4afaf9-7238-49e9-b78e-e90379dc778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:39.683869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4afaf9-7238-49e9-b78e-e90379dc778f None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:39.683869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4afaf9-7238-49e9-b78e-e90379dc778f None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:39.683869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4afaf9-7238-49e9-b78e-e90379dc778f None admin] PATH_INFO: `/v3/users` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:39.683869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4afaf9-7238-49e9-b78e-e90379dc778f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:39.683869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4afaf9-7238-49e9-b78e-e90379dc778f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:39.684545 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4afaf9-7238-49e9-b78e-e90379dc778f None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:39.695022 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:39.705486 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 629/1268] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:28:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:39.711627 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16406c3-eb41-49e7-9dbc-d5fb62f9d6de None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:39.848260 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16406c3-eb41-49e7-9dbc-d5fb62f9d6de None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:39.908579 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79736a-d2d8-4e36-b697-abddf90288e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:39.909587 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79736a-d2d8-4e36-b697-abddf90288e5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:39.909971 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79736a-d2d8-4e36-b697-abddf90288e5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:39.910377 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79736a-d2d8-4e36-b697-abddf90288e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:39.922521 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79736a-d2d8-4e36-b697-abddf90288e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:39.924054 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79736a-d2d8-4e36-b697-abddf90288e5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-3c79736a-d2d8-4e36-b697-abddf90288e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:39.943188 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:39.945108 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:39.946363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:39.946363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:39.946363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:39.946363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:39.946363 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 640/1269] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:39.951784 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4afaf9-7238-49e9-b78e-e90379dc778f None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:40.136445 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4afaf9-7238-49e9-b78e-e90379dc778f None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:40.180051 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61f423-4ff2-41ed-b8c2-7985212776c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:40.180735 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f423-4ff2-41ed-b8c2-7985212776c0 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:40.181022 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f423-4ff2-41ed-b8c2-7985212776c0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:40.181302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f423-4ff2-41ed-b8c2-7985212776c0 None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:40.182048 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61f423-4ff2-41ed-b8c2-7985212776c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:40.182358 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61f423-4ff2-41ed-b8c2-7985212776c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:40.184348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61f423-4ff2-41ed-b8c2-7985212776c0 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:40.198310 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 630/1270] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:40.204892 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79736a-d2d8-4e36-b697-abddf90288e5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:40.243567 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:40.324779 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79736a-d2d8-4e36-b697-abddf90288e5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:40.368359 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45efef6-fb6e-4c08-9152-71a2a762f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:40.369181 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45efef6-fb6e-4c08-9152-71a2a762f2c5 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:40.369465 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45efef6-fb6e-4c08-9152-71a2a762f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:40.369743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45efef6-fb6e-4c08-9152-71a2a762f2c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:40.377861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45efef6-fb6e-4c08-9152-71a2a762f2c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:40.379404 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45efef6-fb6e-4c08-9152-71a2a762f2c5 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-f45efef6-fb6e-4c08-9152-71a2a762f2c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:40.395391 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:40.397199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:40.399187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:40.399187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:40.399187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:40.399187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:40.399187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:40.399187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:40.399187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:40.399187 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:40.401500 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 641/1271] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:40.403615 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61f423-4ff2-41ed-b8c2-7985212776c0 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:40.488612 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:40.532495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61f423-4ff2-41ed-b8c2-7985212776c0 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:40.568488 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f294dc7-e709-469c-8d4f-1e076bb12164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:40.569166 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294dc7-e709-469c-8d4f-1e076bb12164 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:40.569457 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294dc7-e709-469c-8d4f-1e076bb12164 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:40.569738 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294dc7-e709-469c-8d4f-1e076bb12164 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:40.570545 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f294dc7-e709-469c-8d4f-1e076bb12164 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:40.570893 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f294dc7-e709-469c-8d4f-1e076bb12164 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:40.572347 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f294dc7-e709-469c-8d4f-1e076bb12164 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:40.585997 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 631/1272] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:40.593004 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45efef6-fb6e-4c08-9152-71a2a762f2c5 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:40.699566 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:40.709065 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45efef6-fb6e-4c08-9152-71a2a762f2c5 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:40.746478 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c450d9-fae3-46cc-9929-5e6bd9b41a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:40.751976 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c450d9-fae3-46cc-9929-5e6bd9b41a84 None admin] REQUEST_METHOD: `PUT` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:40.751976 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c450d9-fae3-46cc-9929-5e6bd9b41a84 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:40.751976 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c450d9-fae3-46cc-9929-5e6bd9b41a84 None admin] PATH_INFO: `/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/b4fbe085f9764389b3f51d477943565d/roles/59689ee7c4f5409692318371dac5cbc7` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:40.751976 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c450d9-fae3-46cc-9929-5e6bd9b41a84 None admin] RBAC: Authorizing `identity:create_grant(project_id=a28cc07edfbc439fa4f326f4100dbcd5, user_id=b4fbe085f9764389b3f51d477943565d, role_id=59689ee7c4f5409692318371dac5cbc7)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:40.751976 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c450d9-fae3-46cc-9929-5e6bd9b41a84 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:40.862999 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 642/1273] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:28:40 2022] PUT /identity/v3/projects/a28cc07edfbc439fa4f326f4100dbcd5/users/b4fbe085f9764389b3f51d477943565d/roles/59689ee7c4f5409692318371dac5cbc7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:28:43.184235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608980c5-5620-4d27-bd00-4ba0866c24ab None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:43.184894 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608980c5-5620-4d27-bd00-4ba0866c24ab None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:43.184894 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608980c5-5620-4d27-bd00-4ba0866c24ab None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:43.186319 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 632/1274] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:28:43.196211 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13efa-d060-4611-b23a-4b4636ea62dd None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:43.203977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13efa-d060-4611-b23a-4b4636ea62dd None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:43.203977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13efa-d060-4611-b23a-4b4636ea62dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:43.225884 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-4cd13efa-d060-4611-b23a-4b4636ea62dd None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:43.228190 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-4cd13efa-d060-4611-b23a-4b4636ea62dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:43.338111 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 643/1275] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:28:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:43.362428 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608980c5-5620-4d27-bd00-4ba0866c24ab None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:43.479537 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608980c5-5620-4d27-bd00-4ba0866c24ab None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:43.500100 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:43.518802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391675c-9521-4af2-818a-74ec519ac35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:43.519709 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391675c-9521-4af2-818a-74ec519ac35d None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:43.520002 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391675c-9521-4af2-818a-74ec519ac35d None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:43.520287 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391675c-9521-4af2-818a-74ec519ac35d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:43.532681 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391675c-9521-4af2-818a-74ec519ac35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-7391675c-9521-4af2-818a-74ec519ac35d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:43.546289 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:43.548429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:43.550509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 633/1276] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:43.556155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd13efa-d060-4611-b23a-4b4636ea62dd None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:43.650178 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:43.670764 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd13efa-d060-4611-b23a-4b4636ea62dd None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:43.708221 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00890b4-5819-4a64-888a-e1cb4bef86ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:43.708907 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00890b4-5819-4a64-888a-e1cb4bef86ee None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:43.709191 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00890b4-5819-4a64-888a-e1cb4bef86ee None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:43.709464 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00890b4-5819-4a64-888a-e1cb4bef86ee None admin] PATH_INFO: `/v3/roles` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:43.710225 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00890b4-5819-4a64-888a-e1cb4bef86ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:43.710533 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00890b4-5819-4a64-888a-e1cb4bef86ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:43.711970 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00890b4-5819-4a64-888a-e1cb4bef86ee None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:43.722311 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 644/1277] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:43.728372 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391675c-9521-4af2-818a-74ec519ac35d None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:43.842429 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391675c-9521-4af2-818a-74ec519ac35d None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:43.897337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5c19-fcb9-4d23-89d2-e3dd582716fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:43.898499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5c19-fcb9-4d23-89d2-e3dd582716fd None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:43.898973 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5c19-fcb9-4d23-89d2-e3dd582716fd None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:43.899366 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5c19-fcb9-4d23-89d2-e3dd582716fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:43.919028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5c19-fcb9-4d23-89d2-e3dd582716fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:43.920729 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5c19-fcb9-4d23-89d2-e3dd582716fd None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-f8ae5c19-fcb9-4d23-89d2-e3dd582716fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:43.943836 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:43.946042 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:43.948918 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:43.948918 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:43.948918 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:43.948918 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:43.948918 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 634/1278] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:43.954013 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00890b4-5819-4a64-888a-e1cb4bef86ee None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:44.072625 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00890b4-5819-4a64-888a-e1cb4bef86ee None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:44.114383 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342f5bb-0e80-4074-8a07-039ec5cc532f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:44.115110 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342f5bb-0e80-4074-8a07-039ec5cc532f None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:44.115396 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342f5bb-0e80-4074-8a07-039ec5cc532f None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:44.115677 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342f5bb-0e80-4074-8a07-039ec5cc532f None admin] PATH_INFO: `/v3/domains` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:44.116601 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342f5bb-0e80-4074-8a07-039ec5cc532f None admin] RBAC: Adding query filter params (name=Default) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:44.116981 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342f5bb-0e80-4074-8a07-039ec5cc532f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:44.118432 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342f5bb-0e80-4074-8a07-039ec5cc532f None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:44.132995 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 645/1279] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:44.140746 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5c19-fcb9-4d23-89d2-e3dd582716fd None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:44.175026 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:44.258426 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5c19-fcb9-4d23-89d2-e3dd582716fd None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:44.304663 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bb294-9418-4967-b964-a446e70aa929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:44.305505 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb294-9418-4967-b964-a446e70aa929 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:44.305783 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb294-9418-4967-b964-a446e70aa929 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:44.306055 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb294-9418-4967-b964-a446e70aa929 None admin] PATH_INFO: `/v3/users/placement` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:44.314986 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bb294-9418-4967-b964-a446e70aa929 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:44.316508 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bb294-9418-4967-b964-a446e70aa929 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-177bb294-9418-4967-b964-a446e70aa929 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:44.334028 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:44.336004 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:44.337877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:44.337877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:44.337877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:44.337877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:44.337877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:44.337877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:44.337877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:44.337877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:44.337877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:44.337877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:44.337877 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 635/1280] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:44.342312 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342f5bb-0e80-4074-8a07-039ec5cc532f None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:44.346792 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:44.503371 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342f5bb-0e80-4074-8a07-039ec5cc532f None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:44.545891 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6303c-10a1-48bb-8f74-07e1685994a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:44.546743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6303c-10a1-48bb-8f74-07e1685994a0 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:44.547147 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6303c-10a1-48bb-8f74-07e1685994a0 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:44.547531 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6303c-10a1-48bb-8f74-07e1685994a0 None admin] PATH_INFO: `/v3/users` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:44.548538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6303c-10a1-48bb-8f74-07e1685994a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:44.548993 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6303c-10a1-48bb-8f74-07e1685994a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:44.550991 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6303c-10a1-48bb-8f74-07e1685994a0 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:44.571587 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 646/1281] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:28:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:44.578430 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bb294-9418-4967-b964-a446e70aa929 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:44.708623 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:44.723054 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bb294-9418-4967-b964-a446e70aa929 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:44.781481 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c1d00-b638-442b-a0d6-df6e4c166717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:44.782654 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c1d00-b638-442b-a0d6-df6e4c166717 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:44.783151 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c1d00-b638-442b-a0d6-df6e4c166717 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:44.783658 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c1d00-b638-442b-a0d6-df6e4c166717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:44.863825 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c1d00-b638-442b-a0d6-df6e4c166717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:44.865320 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c1d00-b638-442b-a0d6-df6e4c166717 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:44.970938 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:44.982648 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 636/1282] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:28:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:28:44.989190 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6303c-10a1-48bb-8f74-07e1685994a0 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:45.059866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:45.102503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6303c-10a1-48bb-8f74-07e1685994a0 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:45.140557 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869407-7fe7-4d46-9d10-35d287f90e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:45.141369 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869407-7fe7-4d46-9d10-35d287f90e1b None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:45.141659 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869407-7fe7-4d46-9d10-35d287f90e1b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:45.141918 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869407-7fe7-4d46-9d10-35d287f90e1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:45.154442 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c869407-7fe7-4d46-9d10-35d287f90e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:45.156038 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c869407-7fe7-4d46-9d10-35d287f90e1b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-5c869407-7fe7-4d46-9d10-35d287f90e1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:45.176427 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:45.178946 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:45.180073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:45.180073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:45.180073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:45.180073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:45.180073 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 647/1283] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:45.183621 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c1d00-b638-442b-a0d6-df6e4c166717 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:45.301749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c1d00-b638-442b-a0d6-df6e4c166717 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:45.340112 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194df5d-0b23-4282-9073-4a610cfa10ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:45.340820 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194df5d-0b23-4282-9073-4a610cfa10ae None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:45.341101 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194df5d-0b23-4282-9073-4a610cfa10ae None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:45.341377 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194df5d-0b23-4282-9073-4a610cfa10ae None admin] PATH_INFO: `/v3/domains` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:45.342149 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194df5d-0b23-4282-9073-4a610cfa10ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:45.342460 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194df5d-0b23-4282-9073-4a610cfa10ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:45.344012 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194df5d-0b23-4282-9073-4a610cfa10ae None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:45.358630 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 637/1284] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:45.365263 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869407-7fe7-4d46-9d10-35d287f90e1b None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:45.509650 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869407-7fe7-4d46-9d10-35d287f90e1b None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:45.537034 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:45.572470 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba0af9-716a-411b-8349-d252d16853d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:45.574340 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba0af9-716a-411b-8349-d252d16853d2 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:45.574876 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba0af9-716a-411b-8349-d252d16853d2 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:45.575375 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba0af9-716a-411b-8349-d252d16853d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:45.588435 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba0af9-716a-411b-8349-d252d16853d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:45.598052 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba0af9-716a-411b-8349-d252d16853d2 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application [None req-49ba0af9-716a-411b-8349-d252d16853d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:45.625768 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application with Lock( May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:45.627195 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:45.628270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:45.628270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:45.628270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:45.628270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:45.628270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:45.628270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:45.628270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:45.628270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: ERROR keystone.server.flask.application May 19 20:28:45.628270 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 648/1285] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:45.635044 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194df5d-0b23-4282-9073-4a610cfa10ae None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:45.702405 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:45.789479 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194df5d-0b23-4282-9073-4a610cfa10ae None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:45.851602 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456a82f-9df3-4053-969d-38d22b717807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:45.852634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456a82f-9df3-4053-969d-38d22b717807 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:45.853150 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456a82f-9df3-4053-969d-38d22b717807 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:45.853654 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456a82f-9df3-4053-969d-38d22b717807 None admin] PATH_INFO: `/v3/projects` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:45.855337 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456a82f-9df3-4053-969d-38d22b717807 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:45.855897 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456a82f-9df3-4053-969d-38d22b717807 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:45.858638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456a82f-9df3-4053-969d-38d22b717807 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:45.911740 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 638/1286] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:45.918941 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba0af9-716a-411b-8349-d252d16853d2 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:46.041726 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba0af9-716a-411b-8349-d252d16853d2 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:46.081730 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cca40-1ab7-4291-a8e6-8bfbb8f086ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:46.082402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cca40-1ab7-4291-a8e6-8bfbb8f086ee None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:46.082707 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cca40-1ab7-4291-a8e6-8bfbb8f086ee None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:46.082984 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cca40-1ab7-4291-a8e6-8bfbb8f086ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:46.083831 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cca40-1ab7-4291-a8e6-8bfbb8f086ee None admin] RBAC: Adding query filter params (role.id=59689ee7c4f5409692318371dac5cbc7, scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5, user.id=b4fbe085f9764389b3f51d477943565d) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:46.084145 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cca40-1ab7-4291-a8e6-8bfbb8f086ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:46.085617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cca40-1ab7-4291-a8e6-8bfbb8f086ee None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:46.092723 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 649/1287] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:28:45 2022] GET /identity/v3/role_assignments?user.id=b4fbe085f9764389b3f51d477943565d&scope.project.id=a28cc07edfbc439fa4f326f4100dbcd5&role.id=59689ee7c4f5409692318371dac5cbc7 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:48.447446 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e837245-660b-4ed7-a587-5516ffa55e7d None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:48.448731 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e837245-660b-4ed7-a587-5516ffa55e7d None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:48.448731 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e837245-660b-4ed7-a587-5516ffa55e7d None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:48.450110 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 639/1288] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:48.455956 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7984850-0d39-49cf-b858-fecda2ac1ee0 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:48.456517 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7984850-0d39-49cf-b858-fecda2ac1ee0 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:48.456517 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7984850-0d39-49cf-b858-fecda2ac1ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:48.475509 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-f7984850-0d39-49cf-b858-fecda2ac1ee0 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:48.476744 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-f7984850-0d39-49cf-b858-fecda2ac1ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:48.510869 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:48.555268 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 650/1289] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:28:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:48.578519 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e837245-660b-4ed7-a587-5516ffa55e7d None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:48.717454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e837245-660b-4ed7-a587-5516ffa55e7d None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:48.730921 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:48.755728 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6d3dd-365d-42be-858b-248125390db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:48.756548 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6d3dd-365d-42be-858b-248125390db0 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:48.756829 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6d3dd-365d-42be-858b-248125390db0 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:48.757104 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6d3dd-365d-42be-858b-248125390db0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:48.757775 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6d3dd-365d-42be-858b-248125390db0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:48.759209 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6d3dd-365d-42be-858b-248125390db0 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-7ea6d3dd-365d-42be-858b-248125390db0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:48.771915 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:48.773442 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:48.774692 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 640/1290] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:28:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:48.780484 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7984850-0d39-49cf-b858-fecda2ac1ee0 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:48.918953 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7984850-0d39-49cf-b858-fecda2ac1ee0 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:48.957183 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535ac27-b829-4cc9-9bf2-3c47974a7a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:48.957856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535ac27-b829-4cc9-9bf2-3c47974a7a8c None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:48.958139 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535ac27-b829-4cc9-9bf2-3c47974a7a8c None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:48.958416 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535ac27-b829-4cc9-9bf2-3c47974a7a8c None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:48.959172 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535ac27-b829-4cc9-9bf2-3c47974a7a8c None admin] RBAC: Adding query filter params (name=placement) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:48.959477 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535ac27-b829-4cc9-9bf2-3c47974a7a8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:48.961096 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535ac27-b829-4cc9-9bf2-3c47974a7a8c None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:48.972194 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 651/1291] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:28:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:48.978839 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6d3dd-365d-42be-858b-248125390db0 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:49.101651 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6d3dd-365d-42be-858b-248125390db0 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:49.140804 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d3a1e-ca90-4951-936e-af66955a77d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:49.141484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d3a1e-ca90-4951-936e-af66955a77d8 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:49.141765 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d3a1e-ca90-4951-936e-af66955a77d8 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:49.142040 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d3a1e-ca90-4951-936e-af66955a77d8 None admin] PATH_INFO: `/v3/services` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:49.142791 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d3a1e-ca90-4951-936e-af66955a77d8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:49.143099 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d3a1e-ca90-4951-936e-af66955a77d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:49.144476 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d3a1e-ca90-4951-936e-af66955a77d8 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:49.149509 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 641/1292] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:28:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:51.488056 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdbdee-6428-45f0-a8e8-a460c3eb4815 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:51.488730 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdbdee-6428-45f0-a8e8-a460c3eb4815 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:51.488730 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdbdee-6428-45f0-a8e8-a460c3eb4815 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:51.490303 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 652/1293] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:28:51.496956 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc047-6fab-4ee1-a4c1-78002f035b77 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:51.497554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc047-6fab-4ee1-a4c1-78002f035b77 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:51.497554 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc047-6fab-4ee1-a4c1-78002f035b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:51.517610 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-eb0bc047-6fab-4ee1-a4c1-78002f035b77 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:51.518994 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-eb0bc047-6fab-4ee1-a4c1-78002f035b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:51.554831 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:51.603869 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 642/1294] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:28:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:51.626936 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdbdee-6428-45f0-a8e8-a460c3eb4815 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:51.663797 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:51.776663 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdbdee-6428-45f0-a8e8-a460c3eb4815 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:51.818719 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55e1ba-ad67-4a45-80d3-db146c7f521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:51.819403 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55e1ba-ad67-4a45-80d3-db146c7f521b None admin] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:51.819689 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55e1ba-ad67-4a45-80d3-db146c7f521b None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:51.819968 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55e1ba-ad67-4a45-80d3-db146c7f521b None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:51.820708 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55e1ba-ad67-4a45-80d3-db146c7f521b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:51.822109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55e1ba-ad67-4a45-80d3-db146c7f521b None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:51.891614 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 653/1295] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:28:51 2022] POST /identity/v3/services => generated 246 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:28:54.300561 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cad9f-2c10-4dac-9872-37aba8f944f5 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:54.301193 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cad9f-2c10-4dac-9872-37aba8f944f5 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:54.301193 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cad9f-2c10-4dac-9872-37aba8f944f5 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:54.302560 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 643/1296] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:28:54.308698 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf461e1-06cf-4ede-95c3-2d3ed9111335 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:54.309301 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf461e1-06cf-4ede-95c3-2d3ed9111335 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:54.309301 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf461e1-06cf-4ede-95c3-2d3ed9111335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:54.327942 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-bdf461e1-06cf-4ede-95c3-2d3ed9111335 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:54.329185 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-bdf461e1-06cf-4ede-95c3-2d3ed9111335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:54.414115 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 654/1297] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:28:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:54.438235 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cad9f-2c10-4dac-9872-37aba8f944f5 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:54.564168 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cad9f-2c10-4dac-9872-37aba8f944f5 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:54.615038 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbe044-99f1-4dc1-a799-bc0433ee814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:54.615884 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbe044-99f1-4dc1-a799-bc0433ee814c None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:54.616171 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbe044-99f1-4dc1-a799-bc0433ee814c None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:54.616452 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbe044-99f1-4dc1-a799-bc0433ee814c None admin] PATH_INFO: `/v3/services/placement` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:54.617140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbe044-99f1-4dc1-a799-bc0433ee814c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:54.618530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbe044-99f1-4dc1-a799-bc0433ee814c None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-abbbe044-99f1-4dc1-a799-bc0433ee814c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:54.630979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:54.632898 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:54.634294 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 644/1298] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:28:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:54.642231 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf461e1-06cf-4ede-95c3-2d3ed9111335 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:54.662871 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:54.751125 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf461e1-06cf-4ede-95c3-2d3ed9111335 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:54.791564 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78d03f-b20c-4d1a-ad09-2581b7097a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:54.792329 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d03f-b20c-4d1a-ad09-2581b7097a88 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:54.792659 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d03f-b20c-4d1a-ad09-2581b7097a88 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:54.792979 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d03f-b20c-4d1a-ad09-2581b7097a88 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:54.793749 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78d03f-b20c-4d1a-ad09-2581b7097a88 None admin] RBAC: Adding query filter params (name=placement) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:54.794106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78d03f-b20c-4d1a-ad09-2581b7097a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:54.795778 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78d03f-b20c-4d1a-ad09-2581b7097a88 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:54.802597 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 655/1299] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:28:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:54.812399 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbe044-99f1-4dc1-a799-bc0433ee814c None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:54.848530 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:54.930595 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbe044-99f1-4dc1-a799-bc0433ee814c None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:54.970781 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800713d-aa2b-46dc-b1ef-b68140ff1774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:54.971495 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800713d-aa2b-46dc-b1ef-b68140ff1774 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:54.971780 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800713d-aa2b-46dc-b1ef-b68140ff1774 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:54.972062 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800713d-aa2b-46dc-b1ef-b68140ff1774 None admin] PATH_INFO: `/v3/endpoints` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:54.972878 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800713d-aa2b-46dc-b1ef-b68140ff1774 None admin] RBAC: Adding query filter params (interface=public, service_id=d460df3b7d1e47c6a4a05ea85994f2d5, region_id=RegionOne) {{(pid=220180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:54.973192 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800713d-aa2b-46dc-b1ef-b68140ff1774 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:54.974640 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800713d-aa2b-46dc-b1ef-b68140ff1774 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:54.980271 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 645/1300] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:28:54 2022] GET /identity/v3/endpoints?service_id=d460df3b7d1e47c6a4a05ea85994f2d5&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:54.986291 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78d03f-b20c-4d1a-ad09-2581b7097a88 None admin] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:55.079584 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:55.098348 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78d03f-b20c-4d1a-ad09-2581b7097a88 None admin] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:55.141888 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546611e-a51d-4e67-9828-46e56543672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:55.142781 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546611e-a51d-4e67-9828-46e56543672d None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:55.145637 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546611e-a51d-4e67-9828-46e56543672d None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:55.145637 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546611e-a51d-4e67-9828-46e56543672d None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:55.145637 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546611e-a51d-4e67-9828-46e56543672d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:55.145637 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546611e-a51d-4e67-9828-46e56543672d None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:55.153582 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 656/1301] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:28:54 2022] GET /identity/v3/services => generated 2191 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:28:57.438633 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4a1d-ab4f-44de-9d4e-38fb79ed8800 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:57.439214 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4a1d-ab4f-44de-9d4e-38fb79ed8800 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:57.439214 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4a1d-ab4f-44de-9d4e-38fb79ed8800 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:57.440567 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 646/1302] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:57.445998 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c466-6346-4289-9d1e-2199ba7f784f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:57.446462 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c466-6346-4289-9d1e-2199ba7f784f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:57.446578 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c466-6346-4289-9d1e-2199ba7f784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:57.464961 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-c869c466-6346-4289-9d1e-2199ba7f784f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:57.466241 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-c869c466-6346-4289-9d1e-2199ba7f784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:57.539377 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 657/1303] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:28:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:57.564032 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b4a1d-ab4f-44de-9d4e-38fb79ed8800 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:57.665415 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:57.673260 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b4a1d-ab4f-44de-9d4e-38fb79ed8800 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:57.709691 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99996e17-637e-4c5e-928e-a44c42258337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:57.710412 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99996e17-637e-4c5e-928e-a44c42258337 None admin] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:57.710724 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99996e17-637e-4c5e-928e-a44c42258337 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:57.711000 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99996e17-637e-4c5e-928e-a44c42258337 None admin] PATH_INFO: `/v3/services/placement` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:57.711659 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99996e17-637e-4c5e-928e-a44c42258337 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:57.713041 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99996e17-637e-4c5e-928e-a44c42258337 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application [None req-99996e17-637e-4c5e-928e-a44c42258337 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:57.725715 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:57.727867 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application with Lock( May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: ERROR keystone.server.flask.application May 19 20:28:57.730217 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 647/1304] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:28:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:57.734079 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869c466-6346-4289-9d1e-2199ba7f784f None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:57.819079 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:57.842779 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869c466-6346-4289-9d1e-2199ba7f784f None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:57.878235 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f6cd7-14c0-4827-9407-bb063f78d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:57.878943 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f6cd7-14c0-4827-9407-bb063f78d2a1 None admin] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:57.879218 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f6cd7-14c0-4827-9407-bb063f78d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:57.879491 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f6cd7-14c0-4827-9407-bb063f78d2a1 None admin] PATH_INFO: `/v3/services` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:57.880234 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f6cd7-14c0-4827-9407-bb063f78d2a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=220179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:57.880540 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f6cd7-14c0-4827-9407-bb063f78d2a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:57.881932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f6cd7-14c0-4827-9407-bb063f78d2a1 None admin] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:57.888025 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 658/1305] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:28:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:57.893991 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99996e17-637e-4c5e-928e-a44c42258337 None admin] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:58.002906 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99996e17-637e-4c5e-928e-a44c42258337 None admin] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:58.037893 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4404-cc74-49a6-a2e7-0ed72fdf4162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b88d2c828540b1a63ceadb9cee8a00', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:58.038568 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4404-cc74-49a6-a2e7-0ed72fdf4162 None admin] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:58.043273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4404-cc74-49a6-a2e7-0ed72fdf4162 None admin] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:58.043273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4404-cc74-49a6-a2e7-0ed72fdf4162 None admin] PATH_INFO: `/v3/endpoints` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:58.043273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4404-cc74-49a6-a2e7-0ed72fdf4162 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:58.043273 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4404-cc74-49a6-a2e7-0ed72fdf4162 None admin] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:58.119135 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 648/1306] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:28:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:29:07.916069 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=30 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:29:08.113934 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:12.827352 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ccde2-a4fb-4dab-9b85-010c0123f31f None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:12.827954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ccde2-a4fb-4dab-9b85-010c0123f31f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:12.827954 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ccde2-a4fb-4dab-9b85-010c0123f31f None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:12.829452 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 659/1307] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:12.834797 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb94b7-68cf-44c2-8085-0d17b62b63f4 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:12.835282 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb94b7-68cf-44c2-8085-0d17b62b63f4 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:12.835393 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb94b7-68cf-44c2-8085-0d17b62b63f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:12.930321 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-d2fb94b7-68cf-44c2-8085-0d17b62b63f4 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:12.931873 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-d2fb94b7-68cf-44c2-8085-0d17b62b63f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:13.108180 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 649/1308] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:13.185673 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf269f8-9dd8-4a6d-9874-62790fd772b4 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:13.186155 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf269f8-9dd8-4a6d-9874-62790fd772b4 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:13.186505 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf269f8-9dd8-4a6d-9874-62790fd772b4 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:13.188147 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 660/1309] 10.222.0.89 () {54 vars in 964 bytes} [Thu May 19 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:13.194584 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafa9e7-f4c4-4fb5-bfbe-05ab5c37c59f None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:13.194907 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafa9e7-f4c4-4fb5-bfbe-05ab5c37c59f None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:13.195216 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafa9e7-f4c4-4fb5-bfbe-05ab5c37c59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:13.359549 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-bdafa9e7-f4c4-4fb5-bfbe-05ab5c37c59f None None] MFA Rules not processed for user `8ac8cf78ff434568b20062de3ccf65ed`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:13.363128 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-bdafa9e7-f4c4-4fb5-bfbe-05ab5c37c59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:13.435302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:13.553780 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 650/1310] 10.222.0.89 () {58 vars in 1061 bytes} [Thu May 19 20:36:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:13.554589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf269f8-9dd8-4a6d-9874-62790fd772b4 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:13.556549 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-edf269f8-9dd8-4a6d-9874-62790fd772b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:13.703345 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf269f8-9dd8-4a6d-9874-62790fd772b4 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:13.792032 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a95f50-c357-4454-9e56-c52b22609ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:13.793063 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95f50-c357-4454-9e56-c52b22609ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:13.794235 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95f50-c357-4454-9e56-c52b22609ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:13.795109 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95f50-c357-4454-9e56-c52b22609ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:13.797192 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-20a95f50-c357-4454-9e56-c52b22609ff4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:13.860591 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:13.924000 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a95f50-c357-4454-9e56-c52b22609ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:13.925894 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a95f50-c357-4454-9e56-c52b22609ff4 service neutron] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:13.949690 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 661/1311] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 20:36:16.677734 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd4d48-1538-435f-9213-e4bbbc251947 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:16.678241 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd4d48-1538-435f-9213-e4bbbc251947 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:16.678336 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd4d48-1538-435f-9213-e4bbbc251947 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:16.684050 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 651/1312] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:16.685439 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773b96-ad17-433e-ad20-e438db73fff4 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:16.685870 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773b96-ad17-433e-ad20-e438db73fff4 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:16.685997 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773b96-ad17-433e-ad20-e438db73fff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:16.773795 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-15773b96-ad17-433e-ad20-e438db73fff4 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:16.775274 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-15773b96-ad17-433e-ad20-e438db73fff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:16.967117 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 662/1313] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:17.006356 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd4d48-1538-435f-9213-e4bbbc251947 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:17.008355 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-78bd4d48-1538-435f-9213-e4bbbc251947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:17.153584 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd4d48-1538-435f-9213-e4bbbc251947 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:17.252583 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:17.256116 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22015b74-c324-49c7-8b5a-bf766a748644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:17.256802 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22015b74-c324-49c7-8b5a-bf766a748644 service neutron] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:17.257088 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22015b74-c324-49c7-8b5a-bf766a748644 service neutron] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:17.257367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22015b74-c324-49c7-8b5a-bf766a748644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:17.259135 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-22015b74-c324-49c7-8b5a-bf766a748644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:17.388405 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22015b74-c324-49c7-8b5a-bf766a748644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:17.389983 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22015b74-c324-49c7-8b5a-bf766a748644 service neutron] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:17.412114 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 652/1314] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:36:20.332286 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65b32e-0031-4a67-a08f-31b42c5b8390 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:20.332286 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65b32e-0031-4a67-a08f-31b42c5b8390 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:20.332286 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65b32e-0031-4a67-a08f-31b42c5b8390 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:20.333194 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 663/1315] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:20.338620 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7e2fe-faf5-434d-83fd-0fb8a0c0bc3d None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:20.339065 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7e2fe-faf5-434d-83fd-0fb8a0c0bc3d None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:20.339190 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7e2fe-faf5-434d-83fd-0fb8a0c0bc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:20.404063 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-83f7e2fe-faf5-434d-83fd-0fb8a0c0bc3d None None] MFA Rules not processed for user `d05cd1394b114e79a86eca456272c6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:20.405307 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-83f7e2fe-faf5-434d-83fd-0fb8a0c0bc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:20.458790 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:20.504367 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 653/1316] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:20.543906 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65b32e-0031-4a67-a08f-31b42c5b8390 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:20.545730 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-6e65b32e-0031-4a67-a08f-31b42c5b8390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:20.555684 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:20.649576 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65b32e-0031-4a67-a08f-31b42c5b8390 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:20.722571 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21894a51-2423-4e7e-9401-7925ff8f8e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:20.723250 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894a51-2423-4e7e-9401-7925ff8f8e7b service neutron] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:20.723538 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894a51-2423-4e7e-9401-7925ff8f8e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:20.723815 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894a51-2423-4e7e-9401-7925ff8f8e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:20.725476 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-21894a51-2423-4e7e-9401-7925ff8f8e7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:20.787019 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:20.835203 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21894a51-2423-4e7e-9401-7925ff8f8e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:20.836646 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21894a51-2423-4e7e-9401-7925ff8f8e7b service neutron] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:20.854915 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 664/1317] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:36:23.979697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442fa5c-ac31-4b9c-832d-8938c38b5221 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:23.980284 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442fa5c-ac31-4b9c-832d-8938c38b5221 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:23.980397 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442fa5c-ac31-4b9c-832d-8938c38b5221 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:23.982303 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 654/1318] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:23.987761 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dc698-4ff3-4f81-8e2e-f7dc598e512e None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:23.988199 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dc698-4ff3-4f81-8e2e-f7dc598e512e None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:23.988355 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dc698-4ff3-4f81-8e2e-f7dc598e512e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:24.053845 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-6f7dc698-4ff3-4f81-8e2e-f7dc598e512e None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:24.055092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-6f7dc698-4ff3-4f81-8e2e-f7dc598e512e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:24.151921 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 665/1319] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:36:24.190880 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442fa5c-ac31-4b9c-832d-8938c38b5221 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:24.192448 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-9442fa5c-ac31-4b9c-832d-8938c38b5221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:24.298759 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442fa5c-ac31-4b9c-832d-8938c38b5221 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:24.372856 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40a1ca-b70e-4291-a4fc-43872eb7f18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:24.373638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40a1ca-b70e-4291-a4fc-43872eb7f18f service neutron] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:24.373927 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40a1ca-b70e-4291-a4fc-43872eb7f18f service neutron] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:24.374214 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40a1ca-b70e-4291-a4fc-43872eb7f18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:24.375930 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-ec40a1ca-b70e-4291-a4fc-43872eb7f18f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:24.383619 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:24.488605 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40a1ca-b70e-4291-a4fc-43872eb7f18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:24.490058 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40a1ca-b70e-4291-a4fc-43872eb7f18f service neutron] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:24.508848 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 655/1320] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:36:27.907746 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d88530-3a32-4881-81de-ac9deb069a60 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:27.908285 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d88530-3a32-4881-81de-ac9deb069a60 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:27.908382 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d88530-3a32-4881-81de-ac9deb069a60 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:27.909726 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 666/1321] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:27.915259 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54c71-77ea-4a00-9047-1d1ae91cc8d9 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:27.915774 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54c71-77ea-4a00-9047-1d1ae91cc8d9 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:27.915952 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54c71-77ea-4a00-9047-1d1ae91cc8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:27.983446 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-74f54c71-77ea-4a00-9047-1d1ae91cc8d9 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:27.984670 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-74f54c71-77ea-4a00-9047-1d1ae91cc8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:28.045484 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:28.085656 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 656/1322] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:28.122636 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d88530-3a32-4881-81de-ac9deb069a60 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:28.124207 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-e3d88530-3a32-4881-81de-ac9deb069a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:28.143899 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:28.235279 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d88530-3a32-4881-81de-ac9deb069a60 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:28.310974 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad32f19-05a1-46a4-bf63-afbf5c1bdc1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:28.311641 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad32f19-05a1-46a4-bf63-afbf5c1bdc1a service neutron] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:28.311932 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad32f19-05a1-46a4-bf63-afbf5c1bdc1a service neutron] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:28.312212 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad32f19-05a1-46a4-bf63-afbf5c1bdc1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:28.313901 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-0ad32f19-05a1-46a4-bf63-afbf5c1bdc1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:28.387942 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:28.427617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad32f19-05a1-46a4-bf63-afbf5c1bdc1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:28.429318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad32f19-05a1-46a4-bf63-afbf5c1bdc1a service neutron] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:28.447940 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 667/1323] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:36:30.766812 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8547f-24ae-477c-a635-323273381ece None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:30.767383 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8547f-24ae-477c-a635-323273381ece None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:30.767383 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8547f-24ae-477c-a635-323273381ece None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:30.768787 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 657/1324] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:30.774304 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d680d69-bbb0-4ce3-b061-40fa5311dca5 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:30.774881 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d680d69-bbb0-4ce3-b061-40fa5311dca5 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:30.774977 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d680d69-bbb0-4ce3-b061-40fa5311dca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:30.841872 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-8d680d69-bbb0-4ce3-b061-40fa5311dca5 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:30.843105 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-8d680d69-bbb0-4ce3-b061-40fa5311dca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:30.943576 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 668/1325] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:30.978947 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8547f-24ae-477c-a635-323273381ece None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:30.981081 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-7af8547f-24ae-477c-a635-323273381ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:31.087022 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8547f-24ae-477c-a635-323273381ece None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:31.161205 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c50c0-e139-45aa-bdff-bada4a31f3b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:31.161864 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c50c0-e139-45aa-bdff-bada4a31f3b1 service neutron] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:31.162144 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c50c0-e139-45aa-bdff-bada4a31f3b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:31.162416 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c50c0-e139-45aa-bdff-bada4a31f3b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:31.164178 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-9e5c50c0-e139-45aa-bdff-bada4a31f3b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:31.181795 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:31.276635 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c50c0-e139-45aa-bdff-bada4a31f3b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:31.278774 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c50c0-e139-45aa-bdff-bada4a31f3b1 service neutron] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:31.297039 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 658/1326] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:36:33.607258 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321367e-b52c-4d6a-a481-3c1f8ba997d0 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:33.607693 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321367e-b52c-4d6a-a481-3c1f8ba997d0 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:33.607798 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321367e-b52c-4d6a-a481-3c1f8ba997d0 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:33.609191 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 669/1327] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:33.614751 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cacf2-ecfd-42eb-922a-db63b61a4b67 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:33.615176 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cacf2-ecfd-42eb-922a-db63b61a4b67 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:33.615424 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cacf2-ecfd-42eb-922a-db63b61a4b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:33.682596 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-f72cacf2-ecfd-42eb-922a-db63b61a4b67 None None] MFA Rules not processed for user `d05cd1394b114e79a86eca456272c6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:33.683897 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-f72cacf2-ecfd-42eb-922a-db63b61a4b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:33.752370 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:33.798469 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 659/1328] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:33.845179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237d0c0-480f-4ac4-aefe-367d6d889d53 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:33.845464 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237d0c0-480f-4ac4-aefe-367d6d889d53 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:33.845743 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237d0c0-480f-4ac4-aefe-367d6d889d53 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:33.847179 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 670/1329] 10.222.0.89 () {54 vars in 964 bytes} [Thu May 19 20:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:33.853120 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5aca9-b32f-478b-bd14-446fa3f943f2 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:33.853356 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5aca9-b32f-478b-bd14-446fa3f943f2 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:33.853639 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5aca9-b32f-478b-bd14-446fa3f943f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:33.928323 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-2dc5aca9-b32f-478b-bd14-446fa3f943f2 None None] MFA Rules not processed for user `8ac8cf78ff434568b20062de3ccf65ed`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:33.929535 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-2dc5aca9-b32f-478b-bd14-446fa3f943f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:34.006909 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 660/1330] 10.222.0.89 () {58 vars in 1061 bytes} [Thu May 19 20:36:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:34.016128 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237d0c0-480f-4ac4-aefe-367d6d889d53 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:34.017657 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-1237d0c0-480f-4ac4-aefe-367d6d889d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:34.052315 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:34.131228 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237d0c0-480f-4ac4-aefe-367d6d889d53 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:34.206514 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5128c81-8488-46b6-86cd-860e58560050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:34.207192 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5128c81-8488-46b6-86cd-860e58560050 service neutron] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:34.207478 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5128c81-8488-46b6-86cd-860e58560050 service neutron] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:34.207757 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5128c81-8488-46b6-86cd-860e58560050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:34.209430 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-c5128c81-8488-46b6-86cd-860e58560050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:34.287820 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:34.321154 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5128c81-8488-46b6-86cd-860e58560050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:34.322621 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5128c81-8488-46b6-86cd-860e58560050 service neutron] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:34.341194 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 671/1331] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 20:36:37.386683 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b9521-b349-428d-98f7-208d6b163ca8 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:37.387228 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b9521-b349-428d-98f7-208d6b163ca8 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:37.387354 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b9521-b349-428d-98f7-208d6b163ca8 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:37.388638 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 661/1332] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:37.394046 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6984705-44fe-4549-8288-b60f244981fb None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:37.394440 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6984705-44fe-4549-8288-b60f244981fb None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:37.394636 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6984705-44fe-4549-8288-b60f244981fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:37.461396 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-c6984705-44fe-4549-8288-b60f244981fb None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:37.462641 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-c6984705-44fe-4549-8288-b60f244981fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:37.561127 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 672/1333] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:37.596871 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b9521-b349-428d-98f7-208d6b163ca8 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:37.598460 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-474b9521-b349-428d-98f7-208d6b163ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:37.679954 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:37.715226 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b9521-b349-428d-98f7-208d6b163ca8 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:37.788316 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7fb09-0c27-4165-89cd-f2e49ed7b92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:37.788979 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7fb09-0c27-4165-89cd-f2e49ed7b92a service neutron] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:37.789262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7fb09-0c27-4165-89cd-f2e49ed7b92a service neutron] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:37.789538 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7fb09-0c27-4165-89cd-f2e49ed7b92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:37.791246 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-93a7fb09-0c27-4165-89cd-f2e49ed7b92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:37.913615 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7fb09-0c27-4165-89cd-f2e49ed7b92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:37.915122 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7fb09-0c27-4165-89cd-f2e49ed7b92a service neutron] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:37.926026 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:37.938244 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 662/1334] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:36:40.225485 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ac38-097e-4379-ac22-0a40d6b38279 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:40.226037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ac38-097e-4379-ac22-0a40d6b38279 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:40.226037 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ac38-097e-4379-ac22-0a40d6b38279 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:40.227485 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 673/1335] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:40.232749 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cad60d-d702-45b6-994c-ed3230f24a6f None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:40.233200 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cad60d-d702-45b6-994c-ed3230f24a6f None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:40.233302 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cad60d-d702-45b6-994c-ed3230f24a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:40.300026 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-89cad60d-d702-45b6-994c-ed3230f24a6f None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:40.301262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-89cad60d-d702-45b6-994c-ed3230f24a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:40.399248 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 663/1336] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:40.440430 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935ac38-097e-4379-ac22-0a40d6b38279 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:40.442003 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-f935ac38-097e-4379-ac22-0a40d6b38279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:40.484474 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:40.549209 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935ac38-097e-4379-ac22-0a40d6b38279 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:40.622748 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce558003-59ea-49e6-b2e4-2ba9908451e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:40.623395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce558003-59ea-49e6-b2e4-2ba9908451e9 service neutron] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:40.623682 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce558003-59ea-49e6-b2e4-2ba9908451e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:40.623957 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce558003-59ea-49e6-b2e4-2ba9908451e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:40.625617 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-ce558003-59ea-49e6-b2e4-2ba9908451e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:40.710197 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:40.736387 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce558003-59ea-49e6-b2e4-2ba9908451e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:40.737762 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce558003-59ea-49e6-b2e4-2ba9908451e9 service neutron] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:40.757022 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 674/1337] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:36:43.583596 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334a1dc-0037-4e1c-9071-b8f3d8e5dfbd None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:43.584306 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334a1dc-0037-4e1c-9071-b8f3d8e5dfbd None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:43.584306 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334a1dc-0037-4e1c-9071-b8f3d8e5dfbd None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:43.585544 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 664/1338] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:43.591196 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473863bd-baa7-43b5-bcee-71b1bb5cbe20 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:43.591681 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473863bd-baa7-43b5-bcee-71b1bb5cbe20 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:43.591797 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473863bd-baa7-43b5-bcee-71b1bb5cbe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:43.663223 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-473863bd-baa7-43b5-bcee-71b1bb5cbe20 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:43.664911 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-473863bd-baa7-43b5-bcee-71b1bb5cbe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:43.777106 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 675/1339] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:43.813320 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334a1dc-0037-4e1c-9071-b8f3d8e5dfbd None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:43.815489 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-5334a1dc-0037-4e1c-9071-b8f3d8e5dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:43.896423 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=100 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:36:43.910811 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334a1dc-0037-4e1c-9071-b8f3d8e5dfbd None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:43.914371 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb8cfe-2983-4ed4-bd8d-62b8ae835b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:43.915049 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb8cfe-2983-4ed4-bd8d-62b8ae835b6f service neutron] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:43.915332 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb8cfe-2983-4ed4-bd8d-62b8ae835b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:43.915608 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb8cfe-2983-4ed4-bd8d-62b8ae835b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:43.925350 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb8cfe-2983-4ed4-bd8d-62b8ae835b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:43.927107 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb8cfe-2983-4ed4-bd8d-62b8ae835b6f service neutron] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:43.937199 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 665/1340] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:36:48.752546 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99f6f5-88d8-4194-abf9-c13d83d2067a None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:48.753129 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99f6f5-88d8-4194-abf9-c13d83d2067a None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:48.753129 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99f6f5-88d8-4194-abf9-c13d83d2067a None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:48.754479 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 676/1341] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:48.760218 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e192b-0189-4ecf-b1a9-b50b1918a5db None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:48.760653 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e192b-0189-4ecf-b1a9-b50b1918a5db None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:48.760788 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e192b-0189-4ecf-b1a9-b50b1918a5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:48.792175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-fb1e192b-0189-4ecf-b1a9-b50b1918a5db None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:48.793430 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-fb1e192b-0189-4ecf-b1a9-b50b1918a5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:48.873780 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 666/1342] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:48.912652 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99f6f5-88d8-4194-abf9-c13d83d2067a None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:48.923531 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99f6f5-88d8-4194-abf9-c13d83d2067a None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:48.926999 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab5a39-9c81-44d0-b75a-3d129d24ad37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:48.927691 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5a39-9c81-44d0-b75a-3d129d24ad37 service neutron] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:48.927970 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5a39-9c81-44d0-b75a-3d129d24ad37 service neutron] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:48.928242 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5a39-9c81-44d0-b75a-3d129d24ad37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:48.938421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab5a39-9c81-44d0-b75a-3d129d24ad37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:48.939912 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab5a39-9c81-44d0-b75a-3d129d24ad37 service neutron] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:48.950789 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 677/1343] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:36:52.217737 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c954c69-3054-49b1-ae53-1fcd2a227f26 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:52.218312 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c954c69-3054-49b1-ae53-1fcd2a227f26 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:52.218312 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c954c69-3054-49b1-ae53-1fcd2a227f26 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:52.219716 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 667/1344] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:52.224933 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd08d0-b7a6-4c72-836b-654071aca5bb None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:52.225395 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd08d0-b7a6-4c72-836b-654071aca5bb None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:52.225495 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd08d0-b7a6-4c72-836b-654071aca5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:52.243284 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-0cdd08d0-b7a6-4c72-836b-654071aca5bb None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:52.244499 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-0cdd08d0-b7a6-4c72-836b-654071aca5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:52.252515 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 678/1345] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:52.290076 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c954c69-3054-49b1-ae53-1fcd2a227f26 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:52.301497 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c954c69-3054-49b1-ae53-1fcd2a227f26 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:52.305177 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdc050-93ff-4f6e-9ece-eec7746278ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:52.305825 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdc050-93ff-4f6e-9ece-eec7746278ad service neutron] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:52.306109 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdc050-93ff-4f6e-9ece-eec7746278ad service neutron] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:52.306384 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdc050-93ff-4f6e-9ece-eec7746278ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:52.315697 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdc050-93ff-4f6e-9ece-eec7746278ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:52.317140 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdc050-93ff-4f6e-9ece-eec7746278ad service neutron] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:52.327454 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 668/1346] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:36:56.815067 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f57ca-2217-44cb-af13-8017f0c1c38e None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:56.815739 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f57ca-2217-44cb-af13-8017f0c1c38e None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:56.815739 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f57ca-2217-44cb-af13-8017f0c1c38e None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:56.817087 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 679/1347] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:36:56.823038 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0865d24-277f-460a-9eb9-b100b74e8e8a None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:56.823611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0865d24-277f-460a-9eb9-b100b74e8e8a None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:56.823611 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0865d24-277f-460a-9eb9-b100b74e8e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:56.843929 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-b0865d24-277f-460a-9eb9-b100b74e8e8a None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:36:56.845161 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-b0865d24-277f-460a-9eb9-b100b74e8e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:36:56.853634 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 669/1348] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:36:56.893154 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f57ca-2217-44cb-af13-8017f0c1c38e None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:36:56.906313 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f57ca-2217-44cb-af13-8017f0c1c38e None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:36:56.910421 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea299c-f190-4f95-a9c6-6fff70f921f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac8cf78ff434568b20062de3ccf65ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:36:56.910726 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea299c-f190-4f95-a9c6-6fff70f921f8 service neutron] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:36:56.911017 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea299c-f190-4f95-a9c6-6fff70f921f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:36:56.911296 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea299c-f190-4f95-a9c6-6fff70f921f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:36:56.922866 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea299c-f190-4f95-a9c6-6fff70f921f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:36:56.925148 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea299c-f190-4f95-a9c6-6fff70f921f8 service neutron] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:36:56.946861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 680/1349] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:37:02.669780 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5da1-0a48-4f66-a4b7-dd803aa91a38 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:02.670258 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5da1-0a48-4f66-a4b7-dd803aa91a38 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:02.670345 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5da1-0a48-4f66-a4b7-dd803aa91a38 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:02.673453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 670/1350] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 20:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:37:02.678318 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d786b-a67e-440e-83a2-87f9359b058a None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:02.679737 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d786b-a67e-440e-83a2-87f9359b058a None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:02.680200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d786b-a67e-440e-83a2-87f9359b058a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:02.696699 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:37:02.757550 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-e77d786b-a67e-440e-83a2-87f9359b058a None None] MFA Rules not processed for user `b4fbe085f9764389b3f51d477943565d`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:37:02.759200 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-e77d786b-a67e-440e-83a2-87f9359b058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:37:02.843561 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 681/1351] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 20:37:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:37:06.836810 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=57 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:37:07.309625 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78958b9-4c72-43be-8098-e4714c0a95b6 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:07.310175 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78958b9-4c72-43be-8098-e4714c0a95b6 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:07.310453 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78958b9-4c72-43be-8098-e4714c0a95b6 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:07.312075 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 671/1352] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 20:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:37:07.317287 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ae1ef-59cb-492e-bdfd-65e99d3b1ad6 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:07.318170 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ae1ef-59cb-492e-bdfd-65e99d3b1ad6 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:07.318818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ae1ef-59cb-492e-bdfd-65e99d3b1ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:07.338423 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-f35ae1ef-59cb-492e-bdfd-65e99d3b1ad6 None None] MFA Rules not processed for user `b4fbe085f9764389b3f51d477943565d`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:37:07.340258 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-f35ae1ef-59cb-492e-bdfd-65e99d3b1ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:37:07.349367 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 682/1353] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:37:08.835685 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d464409-4823-41ac-aca8-bfcf2d664d43 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:08.836249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d464409-4823-41ac-aca8-bfcf2d664d43 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:08.836249 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d464409-4823-41ac-aca8-bfcf2d664d43 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:08.837588 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 672/1354] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 20:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:37:08.843220 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efcb04-1442-43da-9808-33e989f5b59f None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:08.843655 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efcb04-1442-43da-9808-33e989f5b59f None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:08.843834 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efcb04-1442-43da-9808-33e989f5b59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:08.863071 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-96efcb04-1442-43da-9808-33e989f5b59f None None] MFA Rules not processed for user `b4fbe085f9764389b3f51d477943565d`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:37:08.864256 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-96efcb04-1442-43da-9808-33e989f5b59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:37:08.872978 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 683/1355] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:37:13.057275 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9a185-b559-444e-adab-ab24d8bb2658 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:13.058272 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9a185-b559-444e-adab-ab24d8bb2658 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:13.058855 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9a185-b559-444e-adab-ab24d8bb2658 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:13.064961 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 673/1356] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:37:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:37:13.066501 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938faf-6c81-4d7f-97c7-b79f93d3a6d3 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:13.067402 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938faf-6c81-4d7f-97c7-b79f93d3a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:13.067980 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938faf-6c81-4d7f-97c7-b79f93d3a6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:13.090097 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-f4938faf-6c81-4d7f-97c7-b79f93d3a6d3 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:37:13.092209 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-f4938faf-6c81-4d7f-97c7-b79f93d3a6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:37:13.101488 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 684/1357] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:37:13.160542 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c882e-4a43-4375-99bc-2b5caea6caae None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:13.160913 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c882e-4a43-4375-99bc-2b5caea6caae None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:13.161262 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c882e-4a43-4375-99bc-2b5caea6caae None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:13.162745 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 674/1358] 10.222.0.89 () {54 vars in 961 bytes} [Thu May 19 20:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:37:13.168622 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247fa77-ea04-4197-b5ee-c28c06b69dae None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:13.168919 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247fa77-ea04-4197-b5ee-c28c06b69dae None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:13.169203 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247fa77-ea04-4197-b5ee-c28c06b69dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:13.225420 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-a247fa77-ea04-4197-b5ee-c28c06b69dae None None] MFA Rules not processed for user `382eda270f1545718847c9687bd62846`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:37:13.226758 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-a247fa77-ea04-4197-b5ee-c28c06b69dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:37:13.294499 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=100 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:37:13.318264 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 685/1359] 10.222.0.89 () {58 vars in 1058 bytes} [Thu May 19 20:37:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:37:13.327327 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c882e-4a43-4375-99bc-2b5caea6caae None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:37:13.343415 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c882e-4a43-4375-99bc-2b5caea6caae None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:37:13.349171 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90feaf87-96fa-48d4-be53-c28da0682dc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382eda270f1545718847c9687bd62846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:37:13.349893 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feaf87-96fa-48d4-be53-c28da0682dc9 service nova] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:13.350197 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feaf87-96fa-48d4-be53-c28da0682dc9 service nova] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:13.350632 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feaf87-96fa-48d4-be53-c28da0682dc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:13.362714 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90feaf87-96fa-48d4-be53-c28da0682dc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:37:13.364458 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90feaf87-96fa-48d4-be53-c28da0682dc9 service nova] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:37:13.376103 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 675/1360] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:37:15.897210 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37d8b-a15f-4f36-80c5-0bc67dac1559 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:15.897706 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37d8b-a15f-4f36-80c5-0bc67dac1559 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:15.898190 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37d8b-a15f-4f36-80c5-0bc67dac1559 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:15.899220 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 686/1361] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:37:15.904753 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac35ce-084c-4c20-a9f8-65527f3536a0 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:15.905234 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac35ce-084c-4c20-a9f8-65527f3536a0 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:15.905330 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac35ce-084c-4c20-a9f8-65527f3536a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:15.924703 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-cfac35ce-084c-4c20-a9f8-65527f3536a0 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:37:15.925910 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-cfac35ce-084c-4c20-a9f8-65527f3536a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:37:15.935400 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 676/1362] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:37:15.984716 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd37d8b-a15f-4f36-80c5-0bc67dac1559 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:37:16.000058 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd37d8b-a15f-4f36-80c5-0bc67dac1559 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:37:16.005553 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067777db-fe09-49ed-863f-c187a282e664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382eda270f1545718847c9687bd62846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:37:16.006556 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067777db-fe09-49ed-863f-c187a282e664 service nova] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:16.006556 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067777db-fe09-49ed-863f-c187a282e664 service nova] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:16.006789 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067777db-fe09-49ed-863f-c187a282e664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:16.015856 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067777db-fe09-49ed-863f-c187a282e664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:37:16.017581 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067777db-fe09-49ed-863f-c187a282e664 service nova] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:37:16.028653 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 687/1363] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:37:18.717089 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae939f-222c-4bc5-a0a9-c978a03d5d4a None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:18.717698 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae939f-222c-4bc5-a0a9-c978a03d5d4a None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:18.717698 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae939f-222c-4bc5-a0a9-c978a03d5d4a None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:18.719052 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 677/1364] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:37:18.724545 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d2d41-aab2-4ec6-9c1b-9153bbb42a6d None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:18.725022 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d2d41-aab2-4ec6-9c1b-9153bbb42a6d None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:18.725121 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d2d41-aab2-4ec6-9c1b-9153bbb42a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:18.743861 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-249d2d41-aab2-4ec6-9c1b-9153bbb42a6d None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:37:18.745065 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-249d2d41-aab2-4ec6-9c1b-9153bbb42a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:37:18.753941 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 688/1365] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:37:18.800699 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b92fab-ae87-4a6b-a508-8f8791b54bb0 None None] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:18.801255 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b92fab-ae87-4a6b-a508-8f8791b54bb0 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:18.802392 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b92fab-ae87-4a6b-a508-8f8791b54bb0 None None] PATH_INFO: `/` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:18.804061 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 678/1366] 10.222.0.89 () {54 vars in 961 bytes} [Thu May 19 20:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:37:18.811409 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7816f7a-905d-4a71-88a3-178242ffc826 None None] REQUEST_METHOD: `POST` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:18.811694 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7816f7a-905d-4a71-88a3-178242ffc826 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:18.828830 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7816f7a-905d-4a71-88a3-178242ffc826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:18.830889 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.auth.core [None req-c7816f7a-905d-4a71-88a3-178242ffc826 None None] MFA Rules not processed for user `382eda270f1545718847c9687bd62846`. Rule list: `[]` (Enabled: `True`). {{(pid=220179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:37:18.832092 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.fernet_utils [None req-c7816f7a-905d-4a71-88a3-178242ffc826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:37:18.841669 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 689/1367] 10.222.0.89 () {58 vars in 1058 bytes} [Thu May 19 20:37:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:37:18.849348 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b92fab-ae87-4a6b-a508-8f8791b54bb0 None None] Authenticating user token {{(pid=220180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:37:18.867315 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b92fab-ae87-4a6b-a508-8f8791b54bb0 None None] Validating token access rules against request {{(pid=220180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:37:18.874118 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c5381-b7ad-4638-99c6-86d9586d372a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382eda270f1545718847c9687bd62846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:37:18.874924 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c5381-b7ad-4638-99c6-86d9586d372a service nova] REQUEST_METHOD: `GET` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:18.875506 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c5381-b7ad-4638-99c6-86d9586d372a service nova] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:18.876079 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c5381-b7ad-4638-99c6-86d9586d372a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:18.887388 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c5381-b7ad-4638-99c6-86d9586d372a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:37:18.889330 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c5381-b7ad-4638-99c6-86d9586d372a service nova] RBAC: Authorization granted {{(pid=220180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:37:18.903911 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 679/1368] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:37:19.635040 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c5d9-cff5-48ae-9d20-27501d7358a0 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:19.635322 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c5d9-cff5-48ae-9d20-27501d7358a0 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:19.635589 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c5d9-cff5-48ae-9d20-27501d7358a0 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:19.637184 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 690/1369] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:37:19.642546 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d17c8-429f-41cd-9ea7-045cc6428d62 None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:19.643108 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d17c8-429f-41cd-9ea7-045cc6428d62 None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:19.643391 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d17c8-429f-41cd-9ea7-045cc6428d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:19.661239 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-fa2d17c8-429f-41cd-9ea7-045cc6428d62 None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:37:19.662480 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-fa2d17c8-429f-41cd-9ea7-045cc6428d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:37:19.671523 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 680/1370] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:37:21.504802 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25f7e1-7a6c-426d-a436-ab2659de14f5 None None] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:21.506931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25f7e1-7a6c-426d-a436-ab2659de14f5 None None] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:21.506931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25f7e1-7a6c-426d-a436-ab2659de14f5 None None] PATH_INFO: `/` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:21.506931 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 691/1371] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:37:21.512593 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8531b6-6bca-4ecc-81b9-9b83db7f229a None None] REQUEST_METHOD: `POST` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:21.513089 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8531b6-6bca-4ecc-81b9-9b83db7f229a None None] SCRIPT_NAME: `/identity` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:21.513296 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8531b6-6bca-4ecc-81b9-9b83db7f229a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=220180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:21.533308 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.auth.core [None req-da8531b6-6bca-4ecc-81b9-9b83db7f229a None None] MFA Rules not processed for user `f0b88d2c828540b1a63ceadb9cee8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=220180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:37:21.534527 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG keystone.common.fernet_utils [None req-da8531b6-6bca-4ecc-81b9-9b83db7f229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=220180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:37:21.545499 dv-cinder-841302-4-smb devstack@keystone.service[220180]: [pid: 220180|app: 0|req: 681/1372] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:37:21.591928 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25f7e1-7a6c-426d-a436-ab2659de14f5 None None] Authenticating user token {{(pid=220179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:37:21.607846 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25f7e1-7a6c-426d-a436-ab2659de14f5 None None] Validating token access rules against request {{(pid=220179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:37:21.613559 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d444e8-12cb-4caa-bf8b-7d3d46a04d98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382eda270f1545718847c9687bd62846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a28cc07edfbc439fa4f326f4100dbcd5', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=220179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:37:21.614215 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d444e8-12cb-4caa-bf8b-7d3d46a04d98 service nova] REQUEST_METHOD: `GET` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:37:21.614503 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d444e8-12cb-4caa-bf8b-7d3d46a04d98 service nova] SCRIPT_NAME: `/identity` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:37:21.614864 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d444e8-12cb-4caa-bf8b-7d3d46a04d98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=220179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:37:21.624164 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d444e8-12cb-4caa-bf8b-7d3d46a04d98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:37:21.625818 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d444e8-12cb-4caa-bf8b-7d3d46a04d98 service nova] RBAC: Authorization granted {{(pid=220179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:37:21.637150 dv-cinder-841302-4-smb devstack@keystone.service[220179]: [pid: 220179|app: 0|req: 692/1373] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:37:31.526686 dv-cinder-841302-4-smb devstack@keystone.service[220180]: DEBUG dbcounter [-] [220180] Writing DB stats keystone:SELECT=21 {{(pid=220180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:37:31.631632 dv-cinder-841302-4-smb devstack@keystone.service[220179]: DEBUG dbcounter [-] [220179] Writing DB stats keystone:SELECT=23 {{(pid=220179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:37:43.147270 dv-cinder-841302-4-smb systemd[1]: Stopping Devstack devstack@keystone.service... May 19 20:37:43.147761 dv-cinder-841302-4-smb devstack@keystone.service[220168]: Thu May 19 20:37:43 2022 - graceful shutdown triggered... May 19 20:37:43.148248 dv-cinder-841302-4-smb devstack@keystone.service[220179]: Gracefully killing worker 1 (pid: 220179)... May 19 20:37:43.148668 dv-cinder-841302-4-smb devstack@keystone.service[220180]: Gracefully killing worker 2 (pid: 220180)... May 19 20:37:44.148914 dv-cinder-841302-4-smb devstack@keystone.service[220168]: worker 1 buried after 1 seconds May 19 20:37:44.148914 dv-cinder-841302-4-smb devstack@keystone.service[220168]: worker 2 buried after 1 seconds May 19 20:37:44.148914 dv-cinder-841302-4-smb devstack@keystone.service[220168]: goodbye to uWSGI. May 19 20:37:44.150477 dv-cinder-841302-4-smb systemd[1]: devstack@keystone.service: Succeeded. May 19 20:37:44.151054 dv-cinder-841302-4-smb systemd[1]: Stopped Devstack devstack@keystone.service. May 19 20:44:33.424908 dv-cinder-841302-4-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 20:44:33.432229 dv-cinder-841302-4-smb devstack@keystone.service[284547]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 20:44:33.434479 dv-cinder-841302-4-smb devstack@keystone.service[284547]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 20:44:33 2022] *** May 19 20:44:33.434479 dv-cinder-841302-4-smb devstack@keystone.service[284547]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 20:44:33.434479 dv-cinder-841302-4-smb devstack@keystone.service[284547]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 20:44:33.434479 dv-cinder-841302-4-smb devstack@keystone.service[284547]: nodename: dv-cinder-841302-4-smb May 19 20:44:33.434479 dv-cinder-841302-4-smb devstack@keystone.service[284547]: machine: x86_64 May 19 20:44:33.434479 dv-cinder-841302-4-smb devstack@keystone.service[284547]: clock source: unix May 19 20:44:33.434479 dv-cinder-841302-4-smb devstack@keystone.service[284547]: pcre jit disabled May 19 20:44:33.434479 dv-cinder-841302-4-smb devstack@keystone.service[284547]: detected number of CPU cores: 4 May 19 20:44:33.434479 dv-cinder-841302-4-smb devstack@keystone.service[284547]: current working directory: / May 19 20:44:33.434479 dv-cinder-841302-4-smb devstack@keystone.service[284547]: detected binary path: /usr/bin/uwsgi-core May 19 20:44:33.437050 dv-cinder-841302-4-smb devstack@keystone.service[284547]: your processes number limit is 47680 May 19 20:44:33.437050 dv-cinder-841302-4-smb devstack@keystone.service[284547]: your memory page size is 4096 bytes May 19 20:44:33.437050 dv-cinder-841302-4-smb devstack@keystone.service[284547]: detected max file descriptor number: 2048 May 19 20:44:33.437050 dv-cinder-841302-4-smb devstack@keystone.service[284547]: lock engine: pthread robust mutexes May 19 20:44:33.437050 dv-cinder-841302-4-smb devstack@keystone.service[284547]: thunder lock: enabled May 19 20:44:33.437050 dv-cinder-841302-4-smb devstack@keystone.service[284547]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 20:44:33.437050 dv-cinder-841302-4-smb devstack@keystone.service[284547]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 20:44:33.482115 dv-cinder-841302-4-smb devstack@keystone.service[284547]: Python main interpreter initialized at 0x55f60c1689c0 May 19 20:44:33.482115 dv-cinder-841302-4-smb devstack@keystone.service[284547]: python threads support enabled May 19 20:44:33.482115 dv-cinder-841302-4-smb devstack@keystone.service[284547]: your server socket listen backlog is limited to 100 connections May 19 20:44:33.482115 dv-cinder-841302-4-smb devstack@keystone.service[284547]: your mercy for graceful operations on workers is 90 seconds May 19 20:44:33.482549 dv-cinder-841302-4-smb devstack@keystone.service[284547]: mapped 403077 bytes (393 KB) for 2 cores May 19 20:44:33.482549 dv-cinder-841302-4-smb devstack@keystone.service[284547]: *** Operational MODE: preforking *** May 19 20:44:33.482826 dv-cinder-841302-4-smb devstack@keystone.service[284547]: *** uWSGI is running in multiple interpreter mode *** May 19 20:44:33.482826 dv-cinder-841302-4-smb devstack@keystone.service[284547]: spawned uWSGI master process (pid: 284547) May 19 20:44:33.483033 dv-cinder-841302-4-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 20:44:33.486639 dv-cinder-841302-4-smb devstack@keystone.service[284547]: spawned uWSGI worker 1 (pid: 284560, cores: 1) May 19 20:44:33.486639 dv-cinder-841302-4-smb devstack@keystone.service[284547]: spawned uWSGI worker 2 (pid: 284561, cores: 1) May 19 20:44:33.486639 dv-cinder-841302-4-smb devstack@keystone.service[284547]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 20:44:39.229554 dv-cinder-841302-4-smb devstack@keystone.service[284561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:44:39.229554 dv-cinder-841302-4-smb devstack@keystone.service[284561]: from cryptography.utils import int_from_bytes May 19 20:44:39.230520 dv-cinder-841302-4-smb devstack@keystone.service[284561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:44:39.230520 dv-cinder-841302-4-smb devstack@keystone.service[284561]: from cryptography.utils import int_from_bytes May 19 20:44:39.280588 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 20:44:39.280813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 20:44:39.280959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] command line args: [] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 20:44:39.281233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 20:44:39.281412 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ================================================================================ {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 20:44:39.281654 dv-cinder-841302-4-smb devstack@keystone.service[284560]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:44:39.281654 dv-cinder-841302-4-smb devstack@keystone.service[284560]: from cryptography.utils import int_from_bytes May 19 20:44:39.282243 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] admin_token = **** {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.282243 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] config_dir = [] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.282435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:44:39.282435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: from cryptography.utils import int_from_bytes May 19 20:44:39.282624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.282624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] config_source = [] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.282624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] debug = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.282624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.283176 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.283176 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] insecure_debug = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.283431 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.283660 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.283896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] list_limit = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.284077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] log_config_append = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.284242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.284423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] log_dir = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.284602 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] log_file = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.284846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.285106 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.285357 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.285594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.285773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.285951 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.286201 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.286451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.286714 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.286955 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.287194 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.287431 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.287683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.287935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] notification_format = cadf {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.288217 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.288718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.288902 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] publish_errors = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.289137 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.289371 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.289553 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.289788 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.290025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.290266 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] standard_threads = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.290503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] strict_password_check = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.290775 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.290953 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] use_eventlog = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.291131 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] use_journal = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.291308 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] use_json = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.291484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] use_stderr = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.291661 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] use_syslog = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.291897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] watch_log_file = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.292158 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.292403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.292669 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.292920 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.293174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.293461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.293670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.293913 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.294165 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.294418 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.294702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.294947 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.295229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.295473 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.295726 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.295981 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.296223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.296484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.296744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.296996 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.297238 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.297500 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.297767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.298026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.298280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.298517 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.298776 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.299013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.299252 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.299507 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.299761 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.299997 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.300231 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.300486 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.300738 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.300980 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.301234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.301468 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.301709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.301947 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.302182 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.302416 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.302678 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.302922 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.303168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.303425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.303662 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.303906 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.304141 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.304382 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.304623 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.304878 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.305115 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.305358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.305600 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.305841 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.306081 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.306323 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.306559 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.306838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.307080 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.307325 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.307562 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.307828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.308071 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.308307 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.308815 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.309056 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.309330 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.309573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.309828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.310077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.310318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.310557 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.311352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.311606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.enabled = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.311849 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.312090 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.312337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.312581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.312825 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.313064 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.313303 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.313542 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.313806 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.314049 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.314292 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.314533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.314802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.315043 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.315282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.315521 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.315756 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.315990 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.316223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.316462 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.316696 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.316940 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.317181 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.317435 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.317676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.318051 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.318317 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.318563 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.318831 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] auth.external = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.319068 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] auth.mapped = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.319373 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.319613 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.319850 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] auth.password = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.320086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] auth.token = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.320332 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.320576 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] catalog.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.320829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.321067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.321331 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.321574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.321808 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.322052 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] credential.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.322304 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] credential.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.322558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.322838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.323081 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.323330 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.323572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.323843 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.324104 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.324345 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.324605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.324897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.325150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.325419 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.325666 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.325928 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.326169 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] federation.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.326992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.327249 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] federation.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.327503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.327738 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.327990 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.328230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.328489 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.328731 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.328989 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.329229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.329481 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.329721 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.329866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 20:44:39.330017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.330153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 20:44:39.330287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] command line args: [] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 20:44:39.330419 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.330419 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.330721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 20:44:39.330721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ================================================================================ {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 20:44:39.330995 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.331136 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] admin_token = **** {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.331277 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.331418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] config_dir = [] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.331559 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.331706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.331841 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.331981 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] config_source = [] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.331981 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] debug = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.332239 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.332386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.332565 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.332718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.332865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.333000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] insecure_debug = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.333141 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.333286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.333421 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.333576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.333725 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.333866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] list_limit = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.334019 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.334175 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] log_config_append = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.334175 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.334451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.334586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] log_dir = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.334753 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.334889 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] log_file = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.335036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.335178 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.335178 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.335444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.335586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.335729 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.335865 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.336007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.336148 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.336296 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.336431 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.336578 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.336719 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.336861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.336995 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.337135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.337277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.337423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.337571 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.337704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.337845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.337986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.338127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.338273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.338408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.338557 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.338719 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] notification_format = cadf {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.338871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.339013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.339160 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.339160 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.339438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.339579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.339734 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] publish_errors = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.339880 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.340022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.340022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.340273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.340413 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.340557 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.password = **** {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.340692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.340824 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.340965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.341099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.341247 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] standard_threads = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.341394 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.341536 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] strict_password_check = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.341677 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.341818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.341958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.342100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] use_eventlog = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.342247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.342382 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] use_journal = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.342382 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] use_json = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.342669 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.342817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] use_stderr = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.342951 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.343099 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] use_syslog = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.343240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.343381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] watch_log_file = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:44:39.343521 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.343672 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.343813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.343966 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.344102 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.344250 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.344384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.344517 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.344660 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.344805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.344951 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.345086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.345228 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.345381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.345522 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.345666 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.345806 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.345940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.346080 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.346221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.346362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.346505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.346687 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.346837 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.346977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.347131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.347280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.347421 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.347569 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.347718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.347868 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.348003 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.348137 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.348278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.348426 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.348567 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.348709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.348849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.348983 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.349132 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.349275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.349417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.349558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.349716 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.349857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.349999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.350180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.350331 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.350467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.350616 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.350753 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.350887 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.351037 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.351179 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.351320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.351456 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.351595 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.351730 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.351884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.352026 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.352175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.352329 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.352471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.352612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.352755 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] policy.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.352895 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.353053 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.353195 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.353337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.353483 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.353700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.353843 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.353983 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] receipt.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.354127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.354262 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.354403 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.354596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.354786 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.354927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.355062 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.355195 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.355328 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.355478 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.355620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.355620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.355880 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] resource.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.356021 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.356161 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.356318 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.356458 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] resource.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.356599 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.356734 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.356880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.357020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.357168 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.357351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.357487 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.357626 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] revoke.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.357769 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.357916 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.358057 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.358212 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.358353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.358487 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] role.cache_time = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.358643 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.358792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] role.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.358928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.359069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] role.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.359210 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.359350 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] role.list_limit = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.359491 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.359634 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.359768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.359909 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.360050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.360200 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.360342 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.360485 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.360626 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.360775 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.360919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.361059 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.361209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.361361 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.361510 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.361645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.361791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.361926 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.362065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.362200 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.362333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.362333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.362665 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.362802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.362946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.363125 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.363268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.363410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.363559 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.363702 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.363837 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.363991 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.364135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.364270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.364416 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.364571 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.364710 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.364852 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.365013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.365168 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.enabled = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.365312 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.365447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.365447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.365700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.365841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.365982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.366130 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.366265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.366405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.366540 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.366687 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.366822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.366968 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.367103 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.367244 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.367384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.367525 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.367668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.367802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.367940 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.368080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.368215 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.368354 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.368496 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.368636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.368780 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] token.cache_time = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.368914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.369061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] token.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.369210 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.369357 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.369490 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.369622 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] token.provider = fernet {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.369754 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.369892 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.370025 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.370171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.370305 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.370452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.370592 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.370745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.370878 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.371023 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.371164 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.371304 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.371445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.371579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] trust.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.371718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.371860 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.372007 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.372140 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.372279 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.372413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.372562 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.372709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.372989 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.373131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] auth.external = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.373809 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.373953 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] auth.mapped = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.374099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.374240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.374381 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.374516 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.374680 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.connection = **** {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.374827 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] auth.password = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.374970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.375110 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] auth.token = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.375243 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.375383 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.375529 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.375671 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] catalog.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.375803 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.375943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.376082 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.376222 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.376366 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.376500 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.376640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.376779 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.376918 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.377066 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.377208 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.377348 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] credential.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.377487 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.377627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] credential.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.377767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.377915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.378058 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.378198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.378337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.378477 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.378637 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.378823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.378975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.379111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.379251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.379392 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.379526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.379756 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.379893 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.380027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.380167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=284561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 20:44:39.380309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.380309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.380309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.380309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.380309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.380309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.380309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] federation.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.380309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.380309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] federation.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.381438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.381438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.381438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.381438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.381438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.381438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.381438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.381438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.381438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.382710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.382710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.382710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.382710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.382710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.382710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.382710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.382710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.382710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.383875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.383875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.383875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.383875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.383875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.383875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.383875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.383875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.383875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.385015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.385015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.385015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.385015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.385015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.385015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.385015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.385015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.385015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.386188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.386188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.386188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.386188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.386188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.386188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.386188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.386188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.386188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.387368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.password = **** {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.387368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.387368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.387368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.387368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.387368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.387368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.387368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.387368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.388518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.388518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.388518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.388518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.388518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.388518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.388518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.388518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.388518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.390228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.390228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.390228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.390228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.390228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.390228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.390228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.390228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.390228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.391424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.391424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.391424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.391424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.391424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.391424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.391424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.391424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.392456 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.392456 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.392456 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.392456 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.392456 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.393086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.393086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.393351 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] policy.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.393499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.393623 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.393852 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.394090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] receipt.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.394327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.394575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.394842 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.395073 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.395310 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.395552 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] resource.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.395803 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.396051 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] resource.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.396305 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.396554 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.396805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.397042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] revoke.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.397290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.397528 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.397770 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] role.cache_time = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.398008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] role.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.398262 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] role.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.398494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] role.list_limit = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.398768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.399018 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.399268 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.399517 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.399764 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.400026 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.400275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.400526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.400759 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.401009 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.401200 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.401350 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.401491 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.401637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.401773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.401916 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.402126 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.402365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.402635 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.402891 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.403141 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.403391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.403627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.403882 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.404134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.404373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.405131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.405364 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.405596 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.405849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.406104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.406351 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.406600 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.406870 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.407104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] token.cache_time = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.407343 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] token.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.407581 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.407830 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] token.provider = fernet {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.408069 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.408332 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.408581 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.408819 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.409064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.409310 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.409559 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] trust.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.409796 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.410035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.410271 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.410518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.410791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.411023 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.411160 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.411297 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.411551 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.411814 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.connection = **** {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.412103 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.412312 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.412559 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.412805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.413042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.413280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.413516 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.413753 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.413999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.414237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.414482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.414743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.414996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.415234 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.415481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.415714 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.415957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.416195 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:44:39.416366 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=284560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 20:44:39.441234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.441508 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.448275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.448507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.448720 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.459826 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.479226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.479458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.495999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.517125 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.548196 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.548373 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.554417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.554673 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.614346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.614541 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.614682 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.614805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.614899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.615023 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.615187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.615324 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.615409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.615516 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.615600 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.615792 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.638425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.638683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.639453 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.639553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.639684 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.639791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.639888 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.639985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.640110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.640221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.640315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.640402 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.640543 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.640779 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.651725 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.652303 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.665137 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.665368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.665590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.665810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.666027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.666242 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.666457 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=284560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.666707 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.666946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.667175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.667400 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.667621 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.667840 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.668059 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=284561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:44:39.684040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.684245 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:44:39.684355 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.684569 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:44:39.684676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.684772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:44:39.684906 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.685009 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.685099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:44:39.685254 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.685360 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.685508 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.685607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.685787 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.685903 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.686128 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.698570 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.698890 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.699228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.699508 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.702485 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.702982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.703413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.703881 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.708745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.712034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.712327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.712589 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.712981 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.713269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.713530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.713799 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.714070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.714339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.714629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.714801 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.714911 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.718698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.718982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.719265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.719662 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.719950 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.720213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.720484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.720758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.721029 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.721303 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.721571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.741756 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.743404 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.743682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.748044 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.748936 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.749212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.749487 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.749692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.749975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.755287 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.755568 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.755847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.756755 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.757038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.761624 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.761907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.762186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.762464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.762776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.763054 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.763163 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.763325 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.763422 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.763591 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.768557 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.768843 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.769123 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.769404 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.769676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.769949 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.770218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.770485 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.783273 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.783544 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.788056 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.789666 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.789945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.791674 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.791968 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.794484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.796940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.798155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.798498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.800519 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.803458 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.804247 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.804544 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.804827 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.805105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.805379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.805655 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.807071 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.811690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.811991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.812275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.812555 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.812841 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.813117 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.825350 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.825732 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.825999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.826275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.832658 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.833028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.833298 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.833570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.834721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.836425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.836699 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.839763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.840042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.840328 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.840613 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.840888 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.841545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.843909 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.844186 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.847273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.847552 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.847842 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.848128 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.848409 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.854779 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.855060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.855403 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.855635 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.855910 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.856179 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.856457 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.862396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.862704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.862987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.863267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.863548 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.863825 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.864106 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.875199 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.878525 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.881867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.882288 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.883491 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.885135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.885418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.885581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.885695 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.888963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.890641 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.892290 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.892575 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.892856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.893135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.894779 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.897992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.898278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.898556 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.898852 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.900351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.901980 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.905776 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.906067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.906352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.906645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.908579 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.908860 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.909136 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.916042 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.916393 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.916722 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.917999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=284560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.918296 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.918576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.918879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.919157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.919427 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.919717 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.919986 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.920826 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.921098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.921383 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.921644 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.921914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.922179 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=284560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.925497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=284561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:44:39.925792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.926082 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.926361 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.926659 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.926959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.927236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.927507 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.927786 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.928069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.928349 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.928621 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.928896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.929158 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=284561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:44:39.961742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f60c1689c0 pid: 284560 (default app) May 19 20:44:39.965499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34f515-75a9-4382-ac61-ef4aa2e462c4 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:39.965812 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34f515-75a9-4382-ac61-ef4aa2e462c4 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:39.966094 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34f515-75a9-4382-ac61-ef4aa2e462c4 None None] PATH_INFO: `/v3` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:39.969378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f60c1689c0 pid: 284561 (default app) May 19 20:44:39.971154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 1/1] 10.222.0.89 () {50 vars in 791 bytes} [Thu May 19 20:44:39 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:44:48.954699 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6528682-3388-4bc9-b4eb-e7a54bcde211 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:48.955325 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6528682-3388-4bc9-b4eb-e7a54bcde211 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:48.955325 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6528682-3388-4bc9-b4eb-e7a54bcde211 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:48.959821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 1/2] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:44:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:44:48.965178 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b623671-7eb7-4208-861f-c751e41d0dbf None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:48.965640 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b623671-7eb7-4208-861f-c751e41d0dbf None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:48.965744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b623671-7eb7-4208-861f-c751e41d0dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:49.033813 dv-cinder-841302-4-smb devstack@keystone.service[284560]: INFO dbcounter [None req-5b623671-7eb7-4208-861f-c751e41d0dbf None None] Registered counter for database keystone May 19 20:44:49.056042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG oslo_db.sqlalchemy.engines [None req-5b623671-7eb7-4208-861f-c751e41d0dbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=284560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 20:44:49.062865 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writer thread running {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 20:44:49.250589 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG passlib.handlers.bcrypt [None req-5b623671-7eb7-4208-861f-c751e41d0dbf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=284560) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 20:44:49.250589 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG passlib.handlers.bcrypt [None req-5b623671-7eb7-4208-861f-c751e41d0dbf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=284560) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 20:44:49.299536 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-5b623671-7eb7-4208-861f-c751e41d0dbf None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:44:49.301168 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-5b623671-7eb7-4208-861f-c751e41d0dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:44:49.429154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 2/3] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:44:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 20:44:49.452740 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6528682-3388-4bc9-b4eb-e7a54bcde211 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:49.523589 dv-cinder-841302-4-smb devstack@keystone.service[284561]: INFO dbcounter [None req-c6528682-3388-4bc9-b4eb-e7a54bcde211 None None] Registered counter for database keystone May 19 20:44:49.543464 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG oslo_db.sqlalchemy.engines [None req-c6528682-3388-4bc9-b4eb-e7a54bcde211 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=284561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 20:44:49.550307 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writer thread running {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 20:44:49.673558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6528682-3388-4bc9-b4eb-e7a54bcde211 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:49.677975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41891569-7237-491d-876a-1804d20d5ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cd97939f145462186b2c89bb3a6460f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:49.678667 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891569-7237-491d-876a-1804d20d5ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:49.678959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891569-7237-491d-876a-1804d20d5ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:49.679238 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891569-7237-491d-876a-1804d20d5ea0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:49.687958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41891569-7237-491d-876a-1804d20d5ea0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:49.741201 dv-cinder-841302-4-smb devstack@keystone.service[284561]: WARNING keystone.common.rbac_enforcer.enforcer [None req-41891569-7237-491d-876a-1804d20d5ea0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 20:44:49.741540 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41891569-7237-491d-876a-1804d20d5ea0 admin admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:49.751934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 2/4] 10.222.0.89 () {58 vars in 1324 bytes} [Thu May 19 20:44:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 20:44:49.757946 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b623671-7eb7-4208-861f-c751e41d0dbf None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:49.773151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b623671-7eb7-4208-861f-c751e41d0dbf None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:49.777687 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b752cdb-697d-4668-892f-a605c21aecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cd97939f145462186b2c89bb3a6460f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:49.778810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b752cdb-697d-4668-892f-a605c21aecee admin admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:49.779131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b752cdb-697d-4668-892f-a605c21aecee admin admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:49.779415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b752cdb-697d-4668-892f-a605c21aecee admin admin] PATH_INFO: `/v3/projects/0cd97939f145462186b2c89bb3a6460f` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:49.780943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b752cdb-697d-4668-892f-a605c21aecee admin admin] RBAC: Authorizing `identity:get_project(project_id=0cd97939f145462186b2c89bb3a6460f)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:49.834946 dv-cinder-841302-4-smb devstack@keystone.service[284560]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8b752cdb-697d-4668-892f-a605c21aecee admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 20:44:49.835299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b752cdb-697d-4668-892f-a605c21aecee admin admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:49.840051 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 3/5] 10.222.0.89 () {56 vars in 1207 bytes} [Thu May 19 20:44:49 2022] GET /identity/v3/projects/0cd97939f145462186b2c89bb3a6460f => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:44:52.079410 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74263ed2-bbe1-4210-a0e1-aac04397fde0 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:52.080006 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74263ed2-bbe1-4210-a0e1-aac04397fde0 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:52.080006 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74263ed2-bbe1-4210-a0e1-aac04397fde0 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:52.084174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 3/6] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:44:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:44:52.089821 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee50f99-48ed-45d0-bb51-a3d29323eb4c None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:52.090269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee50f99-48ed-45d0-bb51-a3d29323eb4c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:52.090377 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee50f99-48ed-45d0-bb51-a3d29323eb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:52.110349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-eee50f99-48ed-45d0-bb51-a3d29323eb4c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:44:52.111937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-eee50f99-48ed-45d0-bb51-a3d29323eb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:44:52.119935 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 4/7] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:44:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 20:44:52.141768 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74263ed2-bbe1-4210-a0e1-aac04397fde0 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:52.154025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74263ed2-bbe1-4210-a0e1-aac04397fde0 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:52.158912 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c8c06-7510-4c05-814f-b8c538fe50b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cd97939f145462186b2c89bb3a6460f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:52.159560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c8c06-7510-4c05-814f-b8c538fe50b5 admin admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:52.159848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c8c06-7510-4c05-814f-b8c538fe50b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:52.160131 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c8c06-7510-4c05-814f-b8c538fe50b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:52.168250 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c8c06-7510-4c05-814f-b8c538fe50b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:52.170659 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c8c06-7510-4c05-814f-b8c538fe50b5 admin admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:52.179657 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 4/8] 10.222.0.89 () {58 vars in 1324 bytes} [Thu May 19 20:44:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 20:44:52.185446 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee50f99-48ed-45d0-bb51-a3d29323eb4c None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:52.194662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee50f99-48ed-45d0-bb51-a3d29323eb4c None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:52.199897 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4af08-85b5-4c71-bbbe-f18479ecf74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cd97939f145462186b2c89bb3a6460f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:52.200776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4af08-85b5-4c71-bbbe-f18479ecf74c admin admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:52.201563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4af08-85b5-4c71-bbbe-f18479ecf74c admin admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:52.201851 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4af08-85b5-4c71-bbbe-f18479ecf74c admin admin] PATH_INFO: `/v3/users/7348bece61b448488b3b2cc1f96ba25d` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:52.203311 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4af08-85b5-4c71-bbbe-f18479ecf74c admin admin] RBAC: Authorizing `identity:get_user(user_id=7348bece61b448488b3b2cc1f96ba25d)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:52.205158 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4af08-85b5-4c71-bbbe-f18479ecf74c admin admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:52.206785 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 5/9] 10.222.0.89 () {56 vars in 1198 bytes} [Thu May 19 20:44:52 2022] GET /identity/v3/users/7348bece61b448488b3b2cc1f96ba25d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:44:54.525035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261e54-3d93-4cea-941f-59bfaba7a281 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:54.525612 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261e54-3d93-4cea-941f-59bfaba7a281 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:54.525612 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261e54-3d93-4cea-941f-59bfaba7a281 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:54.526981 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 5/10] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:44:54.532169 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e20b32-83f6-4fed-b169-d0b0e08bd035 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:54.532626 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e20b32-83f6-4fed-b169-d0b0e08bd035 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:54.532735 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e20b32-83f6-4fed-b169-d0b0e08bd035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:54.549799 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2b29-5c44-4a89-a316-4b571577307e None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:54.550030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-e8e20b32-83f6-4fed-b169-d0b0e08bd035 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:44:54.550143 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2b29-5c44-4a89-a316-4b571577307e None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:54.550352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2b29-5c44-4a89-a316-4b571577307e None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:54.551218 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-e8e20b32-83f6-4fed-b169-d0b0e08bd035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:44:54.551740 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 6/11] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:44:54.556892 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec473a-280c-448e-afb7-3bafb6727bde None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:54.557182 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec473a-280c-448e-afb7-3bafb6727bde None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:54.557463 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec473a-280c-448e-afb7-3bafb6727bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:54.597836 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG passlib.handlers.bcrypt [None req-47ec473a-280c-448e-afb7-3bafb6727bde None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=284561) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 20:44:54.598253 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG passlib.handlers.bcrypt [None req-47ec473a-280c-448e-afb7-3bafb6727bde None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=284561) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 20:44:54.632377 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 6/12] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:44:54.645212 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-47ec473a-280c-448e-afb7-3bafb6727bde None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:44:54.646884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-47ec473a-280c-448e-afb7-3bafb6727bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:44:54.655115 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e20b32-83f6-4fed-b169-d0b0e08bd035 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:54.679507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:54.750839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 7/13] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:44:54.761884 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e20b32-83f6-4fed-b169-d0b0e08bd035 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:54.772733 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec473a-280c-448e-afb7-3bafb6727bde None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:54.799000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795274f-8295-45f2-a99d-a86b81e1be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:54.799819 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795274f-8295-45f2-a99d-a86b81e1be08 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:54.800113 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795274f-8295-45f2-a99d-a86b81e1be08 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:54.800400 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795274f-8295-45f2-a99d-a86b81e1be08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:54.814639 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795274f-8295-45f2-a99d-a86b81e1be08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-1795274f-8295-45f2-a99d-a86b81e1be08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:44:54.826300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:44:54.827817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:44:54.828915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 7/14] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:44:54.833983 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795274f-8295-45f2-a99d-a86b81e1be08 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:54.991939 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec473a-280c-448e-afb7-3bafb6727bde None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:54.994273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:55.029919 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c35d08-23d2-46d6-9cec-e6b2d713d111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:55.030905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:55.031035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c35d08-23d2-46d6-9cec-e6b2d713d111 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:55.031146 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c35d08-23d2-46d6-9cec-e6b2d713d111 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:55.031419 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c35d08-23d2-46d6-9cec-e6b2d713d111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:55.050454 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795274f-8295-45f2-a99d-a86b81e1be08 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:55.095480 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e199c2-c8cb-4678-960d-b30abd1b8c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:55.096158 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e199c2-c8cb-4678-960d-b30abd1b8c50 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:55.096449 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e199c2-c8cb-4678-960d-b30abd1b8c50 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:55.096939 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e199c2-c8cb-4678-960d-b30abd1b8c50 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:55.097707 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e199c2-c8cb-4678-960d-b30abd1b8c50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:44:55.098022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e199c2-c8cb-4678-960d-b30abd1b8c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:55.099564 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e199c2-c8cb-4678-960d-b30abd1b8c50 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:55.105522 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c35d08-23d2-46d6-9cec-e6b2d713d111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:55.107089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c35d08-23d2-46d6-9cec-e6b2d713d111 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:55.112396 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 8/15] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:44:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:44:55.118099 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e199c2-c8cb-4678-960d-b30abd1b8c50 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:55.209986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 8/16] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:44:55.215710 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c35d08-23d2-46d6-9cec-e6b2d713d111 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:55.219315 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:55.223852 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e199c2-c8cb-4678-960d-b30abd1b8c50 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:55.258156 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bda06-e9a2-453c-9421-74dfa7e5a5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:55.259069 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bda06-e9a2-453c-9421-74dfa7e5a5e4 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:55.259355 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bda06-e9a2-453c-9421-74dfa7e5a5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:55.259640 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bda06-e9a2-453c-9421-74dfa7e5a5e4 None admin] PATH_INFO: `/v3/users/7348bece61b448488b3b2cc1f96ba25d` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:55.260873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bda06-e9a2-453c-9421-74dfa7e5a5e4 None admin] RBAC: Authorizing `identity:get_user(user_id=7348bece61b448488b3b2cc1f96ba25d)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:55.262342 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bda06-e9a2-453c-9421-74dfa7e5a5e4 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:55.264050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 9/17] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:44:55 2022] GET /identity/v3/users/7348bece61b448488b3b2cc1f96ba25d => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:44:55.269335 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bda06-e9a2-453c-9421-74dfa7e5a5e4 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:55.284090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:55.319286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c35d08-23d2-46d6-9cec-e6b2d713d111 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:55.352217 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c802-b9bc-4ce9-86ac-51612cc72963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:55.353013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c802-b9bc-4ce9-86ac-51612cc72963 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:55.353296 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c802-b9bc-4ce9-86ac-51612cc72963 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:55.353572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c802-b9bc-4ce9-86ac-51612cc72963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:55.370064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bda06-e9a2-453c-9421-74dfa7e5a5e4 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:55.373871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8c802-b9bc-4ce9-86ac-51612cc72963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:55.375389 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8c802-b9bc-4ce9-86ac-51612cc72963 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-e2d8c802-b9bc-4ce9-86ac-51612cc72963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:44:55.396094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:44:55.397257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:44:55.398297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:44:55.398297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:44:55.398297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:44:55.398297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:44:55.398297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 9/18] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:44:55.403139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c802-b9bc-4ce9-86ac-51612cc72963 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:55.413570 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cff16b-4cbe-4de4-8561-55fde27c9184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:55.414388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cff16b-4cbe-4de4-8561-55fde27c9184 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:55.414693 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cff16b-4cbe-4de4-8561-55fde27c9184 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:55.414971 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cff16b-4cbe-4de4-8561-55fde27c9184 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:55.416201 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cff16b-4cbe-4de4-8561-55fde27c9184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:55.417650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cff16b-4cbe-4de4-8561-55fde27c9184 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:55.419283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 10/19] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:44:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:44:55.425658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cff16b-4cbe-4de4-8561-55fde27c9184 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:55.469284 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:55.511195 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:55.517160 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c802-b9bc-4ce9-86ac-51612cc72963 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:55.530109 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cff16b-4cbe-4de4-8561-55fde27c9184 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:55.552728 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4c8ac-e588-433a-800a-28c9f41046b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:55.553486 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4c8ac-e588-433a-800a-28c9f41046b8 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:55.553683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4c8ac-e588-433a-800a-28c9f41046b8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:55.553965 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4c8ac-e588-433a-800a-28c9f41046b8 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:55.554742 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4c8ac-e588-433a-800a-28c9f41046b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:44:55.555061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4c8ac-e588-433a-800a-28c9f41046b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:55.556459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4c8ac-e588-433a-800a-28c9f41046b8 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:55.565841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338365eb-6327-4d30-8845-f4eed33a880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:55.566512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338365eb-6327-4d30-8845-f4eed33a880f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:55.566846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338365eb-6327-4d30-8845-f4eed33a880f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:55.567129 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338365eb-6327-4d30-8845-f4eed33a880f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:55.567974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338365eb-6327-4d30-8845-f4eed33a880f None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.domain.id=default, user.id=7348bece61b448488b3b2cc1f96ba25d) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:44:55.568291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338365eb-6327-4d30-8845-f4eed33a880f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:55.569784 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338365eb-6327-4d30-8845-f4eed33a880f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:55.574790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 10/20] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:44:55.576919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 11/21] 10.222.0.89 () {56 vars in 1322 bytes} [Thu May 19 20:44:55 2022] GET /identity/v3/role_assignments?user.id=7348bece61b448488b3b2cc1f96ba25d&scope.domain.id=default&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:44:58.144661 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478e45b-c1a9-46b8-9384-8b0c843ab3b9 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:58.145701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478e45b-c1a9-46b8-9384-8b0c843ab3b9 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:58.146213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478e45b-c1a9-46b8-9384-8b0c843ab3b9 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:58.147863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 11/22] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:44:58.153495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bc21-db29-4926-81d0-3c6c7fcd6339 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:58.154395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bc21-db29-4926-81d0-3c6c7fcd6339 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:58.154944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bc21-db29-4926-81d0-3c6c7fcd6339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:58.179699 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-a8f1bc21-db29-4926-81d0-3c6c7fcd6339 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:44:58.181320 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-a8f1bc21-db29-4926-81d0-3c6c7fcd6339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:44:58.253644 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf046-6b29-4f45-8b94-3b5492ff28d2 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:58.254329 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf046-6b29-4f45-8b94-3b5492ff28d2 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:58.254883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf046-6b29-4f45-8b94-3b5492ff28d2 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:58.256494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 12/23] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:44:58.261865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96d91-54d8-4f50-840c-fbb27dae6f9c None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:58.262452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96d91-54d8-4f50-840c-fbb27dae6f9c None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:58.262987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96d91-54d8-4f50-840c-fbb27dae6f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:58.272612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 12/24] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:44:58.296204 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-5ab96d91-54d8-4f50-840c-fbb27dae6f9c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:44:58.297771 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-5ab96d91-54d8-4f50-840c-fbb27dae6f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:44:58.313530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1bc21-db29-4926-81d0-3c6c7fcd6339 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:58.445155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 13/25] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:44:58.480770 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab96d91-54d8-4f50-840c-fbb27dae6f9c None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:58.493497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:58.535965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1bc21-db29-4926-81d0-3c6c7fcd6339 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:58.597926 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695c927-c693-40fd-8b23-cdd96dba92e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:58.598729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695c927-c693-40fd-8b23-cdd96dba92e2 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:58.599031 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695c927-c693-40fd-8b23-cdd96dba92e2 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:58.599313 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695c927-c693-40fd-8b23-cdd96dba92e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:58.611772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:58.615763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695c927-c693-40fd-8b23-cdd96dba92e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:58.624119 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695c927-c693-40fd-8b23-cdd96dba92e2 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-3695c927-c693-40fd-8b23-cdd96dba92e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:44:58.654563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:44:58.655772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:44:58.656793 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:44:58.656793 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:44:58.656793 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:44:58.656793 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:44:58.656793 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 13/26] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:44:58.664360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695c927-c693-40fd-8b23-cdd96dba92e2 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:58.777471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab96d91-54d8-4f50-840c-fbb27dae6f9c None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:58.806832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695c927-c693-40fd-8b23-cdd96dba92e2 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:58.840381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:58.870281 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ac5bd-fb28-4115-a43a-a587cbef6c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:58.870281 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ac5bd-fb28-4115-a43a-a587cbef6c81 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:58.870281 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ac5bd-fb28-4115-a43a-a587cbef6c81 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:58.870281 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ac5bd-fb28-4115-a43a-a587cbef6c81 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:58.870783 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ac5bd-fb28-4115-a43a-a587cbef6c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:44:58.870783 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ac5bd-fb28-4115-a43a-a587cbef6c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:58.870783 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ac5bd-fb28-4115-a43a-a587cbef6c81 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:58.879869 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed26503-9d10-4167-ba27-10dc4d87e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:58.880746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed26503-9d10-4167-ba27-10dc4d87e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:58.881037 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed26503-9d10-4167-ba27-10dc4d87e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:58.881315 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed26503-9d10-4167-ba27-10dc4d87e3e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:58.912420 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed26503-9d10-4167-ba27-10dc4d87e3e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:44:58.924558 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 14/27] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-5ed26503-9d10-4167-ba27-10dc4d87e3e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:44:58.928827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:44:58.929900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:44:58.930883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:44:58.931632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ac5bd-fb28-4115-a43a-a587cbef6c81 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:58.939315 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 14/28] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:44:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:44:58.949004 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed26503-9d10-4167-ba27-10dc4d87e3e6 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:59.144851 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ac5bd-fb28-4115-a43a-a587cbef6c81 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:59.204574 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ce3b6-3b98-4bc6-bf4c-9d3b5cd28716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:59.205248 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ce3b6-3b98-4bc6-bf4c-9d3b5cd28716 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:59.205545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ce3b6-3b98-4bc6-bf4c-9d3b5cd28716 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:59.205666 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed26503-9d10-4167-ba27-10dc4d87e3e6 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:59.206035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ce3b6-3b98-4bc6-bf4c-9d3b5cd28716 None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:59.206550 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ce3b6-3b98-4bc6-bf4c-9d3b5cd28716 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:59.208108 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ce3b6-3b98-4bc6-bf4c-9d3b5cd28716 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:59.213780 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:59.247299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef7324-1c25-49bb-b393-2914b2a17e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:59.248013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef7324-1c25-49bb-b393-2914b2a17e1f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:59.248307 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef7324-1c25-49bb-b393-2914b2a17e1f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:59.248631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef7324-1c25-49bb-b393-2914b2a17e1f None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:59.249478 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef7324-1c25-49bb-b393-2914b2a17e1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:44:59.249792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef7324-1c25-49bb-b393-2914b2a17e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:59.251316 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef7324-1c25-49bb-b393-2914b2a17e1f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:59.266490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 15/29] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:44:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:44:59.267669 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f482e2d-bcf2-4dcf-b9bb-e2ec8db12de9 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:59.267961 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f482e2d-bcf2-4dcf-b9bb-e2ec8db12de9 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:59.268246 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f482e2d-bcf2-4dcf-b9bb-e2ec8db12de9 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:59.269684 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 16/30] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:44:59.276569 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c101b-ef18-4546-b7f0-a5498ad1f754 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:59.276874 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c101b-ef18-4546-b7f0-a5498ad1f754 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:59.277160 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c101b-ef18-4546-b7f0-a5498ad1f754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:59.295937 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-ac0c101b-ef18-4546-b7f0-a5498ad1f754 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:44:59.301939 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-ac0c101b-ef18-4546-b7f0-a5498ad1f754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:44:59.372287 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 17/31] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:44:59.373900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c101b-ef18-4546-b7f0-a5498ad1f754 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:59.480492 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:59.484797 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c101b-ef18-4546-b7f0-a5498ad1f754 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:59.521520 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07840f-2c7d-49f1-b6de-b9824cc3ea5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:59.522444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07840f-2c7d-49f1-b6de-b9824cc3ea5c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:59.522772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07840f-2c7d-49f1-b6de-b9824cc3ea5c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:59.523054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07840f-2c7d-49f1-b6de-b9824cc3ea5c None admin] PATH_INFO: `/v3/users/7348bece61b448488b3b2cc1f96ba25d` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:59.524637 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07840f-2c7d-49f1-b6de-b9824cc3ea5c None admin] RBAC: Authorizing `identity:get_user(user_id=7348bece61b448488b3b2cc1f96ba25d)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:59.526105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07840f-2c7d-49f1-b6de-b9824cc3ea5c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:59.527969 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 18/32] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:44:59 2022] GET /identity/v3/users/7348bece61b448488b3b2cc1f96ba25d => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:44:59.529025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f6d83-76d4-4808-96e2-71300f102b43 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:59.529313 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f6d83-76d4-4808-96e2-71300f102b43 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:59.529789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f6d83-76d4-4808-96e2-71300f102b43 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:59.531206 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 19/33] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:44:59.538214 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 15/34] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:44:58 2022] POST /identity/v3/projects => generated 301 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:44:59.538214 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ce3b6-3b98-4bc6-bf4c-9d3b5cd28716 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:59.543223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4520a-7cdf-4625-94e7-b215faeed2a7 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:59.543568 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4520a-7cdf-4625-94e7-b215faeed2a7 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:59.543808 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4520a-7cdf-4625-94e7-b215faeed2a7 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:59.546861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 20/35] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:44:59 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:44:59.546861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4520a-7cdf-4625-94e7-b215faeed2a7 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:59.589306 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:59.665088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ce3b6-3b98-4bc6-bf4c-9d3b5cd28716 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:59.700478 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4520a-7cdf-4625-94e7-b215faeed2a7 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:44:59.715821 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7c85-d48a-4305-817f-2bd0822c6236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:59.716562 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7c85-d48a-4305-817f-2bd0822c6236 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:59.716854 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7c85-d48a-4305-817f-2bd0822c6236 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:59.717134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7c85-d48a-4305-817f-2bd0822c6236 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:59.718227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7c85-d48a-4305-817f-2bd0822c6236 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:59.720725 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7c85-d48a-4305-817f-2bd0822c6236 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:59.747357 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa4ffb-d81e-469b-9bc4-a2b3273cd70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:44:59.749271 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4ffb-d81e-469b-9bc4-a2b3273cd70d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:59.749818 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4ffb-d81e-469b-9bc4-a2b3273cd70d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:59.750202 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4ffb-d81e-469b-9bc4-a2b3273cd70d None admin] PATH_INFO: `/v3/domains/default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:59.751768 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa4ffb-d81e-469b-9bc4-a2b3273cd70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:44:59.753288 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa4ffb-d81e-469b-9bc4-a2b3273cd70d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:44:59.755145 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 21/36] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:44:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:44:59.756645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84216a3f-c968-4988-a4d4-67272b736c7c None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:59.756936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84216a3f-c968-4988-a4d4-67272b736c7c None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:59.757214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84216a3f-c968-4988-a4d4-67272b736c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:59.780517 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-84216a3f-c968-4988-a4d4-67272b736c7c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:44:59.781753 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-84216a3f-c968-4988-a4d4-67272b736c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:44:59.812225 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:44:59.827090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 16/37] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:44:59 2022] POST /identity/v3/roles => generated 219 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:44:59.829835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d2b9b-cd7a-4d6e-8afa-bdef270dd81c None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:44:59.830140 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d2b9b-cd7a-4d6e-8afa-bdef270dd81c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:44:59.830428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d2b9b-cd7a-4d6e-8afa-bdef270dd81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:44:59.861459 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-e62d2b9b-cd7a-4d6e-8afa-bdef270dd81c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:44:59.864325 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-e62d2b9b-cd7a-4d6e-8afa-bdef270dd81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:44:59.871800 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 22/38] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:44:59.873457 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84216a3f-c968-4988-a4d4-67272b736c7c None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:59.978813 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 17/39] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:44:59.980794 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d2b9b-cd7a-4d6e-8afa-bdef270dd81c None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:44:59.996264 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84216a3f-c968-4988-a4d4-67272b736c7c None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:00.014552 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:00.041758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca7d27-c67c-464d-8129-26fa2b7c5e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:00.041758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7d27-c67c-464d-8129-26fa2b7c5e88 None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:00.041758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7d27-c67c-464d-8129-26fa2b7c5e88 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:00.041758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7d27-c67c-464d-8129-26fa2b7c5e88 None admin] PATH_INFO: `/v3/domains/default/users/7348bece61b448488b3b2cc1f96ba25d/roles/480e35452fc547e0a2917bdd5b782f7d` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:00.043061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca7d27-c67c-464d-8129-26fa2b7c5e88 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7348bece61b448488b3b2cc1f96ba25d, role_id=480e35452fc547e0a2917bdd5b782f7d)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:00.044553 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca7d27-c67c-464d-8129-26fa2b7c5e88 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:00.103485 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d2b9b-cd7a-4d6e-8afa-bdef270dd81c None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:00.137656 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769e9f6-46c0-42ba-997d-6cc2b6fd8e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:00.138364 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769e9f6-46c0-42ba-997d-6cc2b6fd8e2f None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:00.139228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769e9f6-46c0-42ba-997d-6cc2b6fd8e2f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:00.139514 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769e9f6-46c0-42ba-997d-6cc2b6fd8e2f None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:00.140284 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769e9f6-46c0-42ba-997d-6cc2b6fd8e2f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:00.141688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769e9f6-46c0-42ba-997d-6cc2b6fd8e2f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:00.215529 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 18/40] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:44:59 2022] POST /identity/v3/roles => generated 223 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:45:00.217368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36248-5e57-454e-9d8f-7d1389896887 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:00.217662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36248-5e57-454e-9d8f-7d1389896887 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:00.217945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36248-5e57-454e-9d8f-7d1389896887 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:00.219417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 19/41] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:00.219967 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a36248-5e57-454e-9d8f-7d1389896887 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:00.234839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 23/42] 10.222.0.89 () {58 vars in 1361 bytes} [Thu May 19 20:44:59 2022] PUT /identity/v3/domains/default/users/7348bece61b448488b3b2cc1f96ba25d/roles/480e35452fc547e0a2917bdd5b782f7d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:00.237839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81684c6-a5ae-4f57-a7f9-3e3147c40142 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:00.239014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81684c6-a5ae-4f57-a7f9-3e3147c40142 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:00.239360 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81684c6-a5ae-4f57-a7f9-3e3147c40142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:00.272465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-c81684c6-a5ae-4f57-a7f9-3e3147c40142 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:00.274862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-c81684c6-a5ae-4f57-a7f9-3e3147c40142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:00.307288 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:00.365582 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:00.374687 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 24/43] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:00.394083 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a36248-5e57-454e-9d8f-7d1389896887 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:00.403067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81684c6-a5ae-4f57-a7f9-3e3147c40142 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:00.447607 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f96811-d9c3-41b5-848e-d3bfd20b3517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:00.448297 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f96811-d9c3-41b5-848e-d3bfd20b3517 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:00.448597 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f96811-d9c3-41b5-848e-d3bfd20b3517 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:00.448879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f96811-d9c3-41b5-848e-d3bfd20b3517 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:00.449620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f96811-d9c3-41b5-848e-d3bfd20b3517 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:00.451633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f96811-d9c3-41b5-848e-d3bfd20b3517 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:00.528326 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 20/44] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:45:00 2022] POST /identity/v3/roles => generated 225 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:45:00.567453 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81684c6-a5ae-4f57-a7f9-3e3147c40142 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:00.631680 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba25ca4-4904-4ceb-8431-24e702b316a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:00.633035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba25ca4-4904-4ceb-8431-24e702b316a5 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:00.633803 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba25ca4-4904-4ceb-8431-24e702b316a5 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:00.634005 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba25ca4-4904-4ceb-8431-24e702b316a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:00.636163 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba25ca4-4904-4ceb-8431-24e702b316a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:00.639769 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba25ca4-4904-4ceb-8431-24e702b316a5 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:00.648809 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 25/45] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:00.659630 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f96811-d9c3-41b5-848e-d3bfd20b3517 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:00.770766 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f96811-d9c3-41b5-848e-d3bfd20b3517 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:00.808618 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54624c67-10ec-45a2-aa2b-2e0b98f359a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:00.809468 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54624c67-10ec-45a2-aa2b-2e0b98f359a7 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:00.809759 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54624c67-10ec-45a2-aa2b-2e0b98f359a7 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:00.810042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54624c67-10ec-45a2-aa2b-2e0b98f359a7 None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:00.811355 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54624c67-10ec-45a2-aa2b-2e0b98f359a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:00.812835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54624c67-10ec-45a2-aa2b-2e0b98f359a7 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:00.886207 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:00.892087 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 21/46] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:45:00 2022] POST /identity/v3/projects => generated 312 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:45:02.527399 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eca16b-9bf0-44f4-8314-a07bd426b8c0 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:02.527992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eca16b-9bf0-44f4-8314-a07bd426b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:02.527992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eca16b-9bf0-44f4-8314-a07bd426b8c0 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:02.529925 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 26/47] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:02.535639 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156e534-41b6-4cee-9904-aa773d2a0a46 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:02.536112 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156e534-41b6-4cee-9904-aa773d2a0a46 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:02.536327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156e534-41b6-4cee-9904-aa773d2a0a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:02.553643 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-4156e534-41b6-4cee-9904-aa773d2a0a46 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:02.554864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-4156e534-41b6-4cee-9904-aa773d2a0a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:02.621645 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 22/48] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:02.644078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eca16b-9bf0-44f4-8314-a07bd426b8c0 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:02.670807 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:02.748725 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eca16b-9bf0-44f4-8314-a07bd426b8c0 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:02.783461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f5049-0afb-4e5b-b55c-1c88ab9d864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:02.784180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5049-0afb-4e5b-b55c-1c88ab9d864d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:02.784469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5049-0afb-4e5b-b55c-1c88ab9d864d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:02.784746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5049-0afb-4e5b-b55c-1c88ab9d864d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:02.795037 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f5049-0afb-4e5b-b55c-1c88ab9d864d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-f53f5049-0afb-4e5b-b55c-1c88ab9d864d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:02.802651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:02.803884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:02.805077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 27/49] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:02.812277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156e534-41b6-4cee-9904-aa773d2a0a46 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:02.912695 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156e534-41b6-4cee-9904-aa773d2a0a46 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:02.942198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:02.948348 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1bf6-b595-4ca9-9ff2-ec121868a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:02.949059 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1bf6-b595-4ca9-9ff2-ec121868a778 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:02.949349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1bf6-b595-4ca9-9ff2-ec121868a778 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:02.949639 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1bf6-b595-4ca9-9ff2-ec121868a778 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:02.950431 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1bf6-b595-4ca9-9ff2-ec121868a778 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:02.951306 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1bf6-b595-4ca9-9ff2-ec121868a778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:02.954632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1bf6-b595-4ca9-9ff2-ec121868a778 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:02.962854 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 23/50] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:02.969335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f5049-0afb-4e5b-b55c-1c88ab9d864d None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:03.053744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:03.072345 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f5049-0afb-4e5b-b55c-1c88ab9d864d None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:03.107198 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b2f25-c3ea-4bfe-9644-0397bc72288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:03.108079 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2f25-c3ea-4bfe-9644-0397bc72288d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:03.108367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2f25-c3ea-4bfe-9644-0397bc72288d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:03.108646 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2f25-c3ea-4bfe-9644-0397bc72288d None admin] PATH_INFO: `/v3/users/7348bece61b448488b3b2cc1f96ba25d` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:03.109850 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b2f25-c3ea-4bfe-9644-0397bc72288d None admin] RBAC: Authorizing `identity:get_user(user_id=7348bece61b448488b3b2cc1f96ba25d)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:03.111354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b2f25-c3ea-4bfe-9644-0397bc72288d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:03.113182 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 28/51] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:02 2022] GET /identity/v3/users/7348bece61b448488b3b2cc1f96ba25d => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:03.118504 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1bf6-b595-4ca9-9ff2-ec121868a778 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:03.136214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76689ac8-27dd-4350-b00f-b56f770757da None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:03.136511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76689ac8-27dd-4350-b00f-b56f770757da None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:03.136799 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76689ac8-27dd-4350-b00f-b56f770757da None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:03.138182 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 29/52] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:45:03.143746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4255b1-de2f-406c-a478-b36cb263a244 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:03.144035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4255b1-de2f-406c-a478-b36cb263a244 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:03.144314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4255b1-de2f-406c-a478-b36cb263a244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:03.160893 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-4d4255b1-de2f-406c-a478-b36cb263a244 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:03.162101 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-4d4255b1-de2f-406c-a478-b36cb263a244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:03.223648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1bf6-b595-4ca9-9ff2-ec121868a778 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:03.230305 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 30/53] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:03.253407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4255b1-de2f-406c-a478-b36cb263a244 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:03.257087 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094b110-b9b2-4120-a274-b44bbdc76e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:03.257887 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094b110-b9b2-4120-a274-b44bbdc76e5d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:03.258171 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094b110-b9b2-4120-a274-b44bbdc76e5d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:03.258445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094b110-b9b2-4120-a274-b44bbdc76e5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:03.259803 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094b110-b9b2-4120-a274-b44bbdc76e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:03.261246 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094b110-b9b2-4120-a274-b44bbdc76e5d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:03.262903 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 24/54] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:03.269090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094b110-b9b2-4120-a274-b44bbdc76e5d None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:03.329417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:03.335554 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:03.354322 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4255b1-de2f-406c-a478-b36cb263a244 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:03.370374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094b110-b9b2-4120-a274-b44bbdc76e5d None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:03.389178 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9092f-7b47-44dc-8bcc-b9becdafed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:03.389984 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9092f-7b47-44dc-8bcc-b9becdafed8a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:03.390273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9092f-7b47-44dc-8bcc-b9becdafed8a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:03.390554 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9092f-7b47-44dc-8bcc-b9becdafed8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:03.391796 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9092f-7b47-44dc-8bcc-b9becdafed8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:03.393315 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9092f-7b47-44dc-8bcc-b9becdafed8a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:03.394994 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 31/55] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:03.400573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9092f-7b47-44dc-8bcc-b9becdafed8a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:03.406020 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dda8a7-d307-4313-8b6f-fac00820cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:03.406719 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dda8a7-d307-4313-8b6f-fac00820cc95 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:03.407012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dda8a7-d307-4313-8b6f-fac00820cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:03.407294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dda8a7-d307-4313-8b6f-fac00820cc95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:03.408220 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dda8a7-d307-4313-8b6f-fac00820cc95 None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.domain.id=default, user.id=7348bece61b448488b3b2cc1f96ba25d) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:03.408465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dda8a7-d307-4313-8b6f-fac00820cc95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:03.409944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dda8a7-d307-4313-8b6f-fac00820cc95 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:03.416060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 25/56] 10.222.0.89 () {56 vars in 1322 bytes} [Thu May 19 20:45:03 2022] GET /identity/v3/role_assignments?user.id=7348bece61b448488b3b2cc1f96ba25d&scope.domain.id=default&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:03.511931 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9092f-7b47-44dc-8bcc-b9becdafed8a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:03.549609 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d95b89-5e97-4753-a484-fbe6e4cd03fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:03.550364 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d95b89-5e97-4753-a484-fbe6e4cd03fb None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:03.550752 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d95b89-5e97-4753-a484-fbe6e4cd03fb None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:03.551222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d95b89-5e97-4753-a484-fbe6e4cd03fb None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:03.551823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d95b89-5e97-4753-a484-fbe6e4cd03fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:03.553341 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d95b89-5e97-4753-a484-fbe6e4cd03fb None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:03.629221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:03.635380 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 32/57] 10.222.0.89 () {60 vars in 1140 bytes} [Thu May 19 20:45:03 2022] POST /identity/v3/projects => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:45:05.937597 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f64d-655a-497e-8b67-5dba9666b174 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:05.938196 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f64d-655a-497e-8b67-5dba9666b174 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:05.938196 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f64d-655a-497e-8b67-5dba9666b174 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:05.939728 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 26/58] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:05.946829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1fb93-134e-47b4-b78e-f84842ed9109 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:05.947356 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1fb93-134e-47b4-b78e-f84842ed9109 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:05.947481 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1fb93-134e-47b4-b78e-f84842ed9109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:05.967910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-40c1fb93-134e-47b4-b78e-f84842ed9109 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:05.969144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-40c1fb93-134e-47b4-b78e-f84842ed9109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:06.038572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 33/59] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:06.063357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2f64d-655a-497e-8b67-5dba9666b174 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:06.164640 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2f64d-655a-497e-8b67-5dba9666b174 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:06.188714 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:06.199080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2f7d0-8edc-4e9d-ba2f-2ce1ddc72e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:06.199945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2f7d0-8edc-4e9d-ba2f-2ce1ddc72e20 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:06.200232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2f7d0-8edc-4e9d-ba2f-2ce1ddc72e20 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:06.200514 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2f7d0-8edc-4e9d-ba2f-2ce1ddc72e20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:06.202284 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2f7d0-8edc-4e9d-ba2f-2ce1ddc72e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:06.203781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2f7d0-8edc-4e9d-ba2f-2ce1ddc72e20 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:06.205417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 27/60] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:06.211062 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1fb93-134e-47b4-b78e-f84842ed9109 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:06.309460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1fb93-134e-47b4-b78e-f84842ed9109 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:06.338470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:06.344025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf062f-b813-444f-882b-e783ac3c0c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:06.348378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf062f-b813-444f-882b-e783ac3c0c3a None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:06.348378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf062f-b813-444f-882b-e783ac3c0c3a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:06.348378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf062f-b813-444f-882b-e783ac3c0c3a None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:06.348378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf062f-b813-444f-882b-e783ac3c0c3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:06.348378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf062f-b813-444f-882b-e783ac3c0c3a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:06.432806 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 34/61] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:45:06 2022] POST /identity/v3/users => generated 275 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:45:09.880333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4af88-a7ee-4928-a22d-d7fb7f086831 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:09.880333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4af88-a7ee-4928-a22d-d7fb7f086831 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:09.880333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4af88-a7ee-4928-a22d-d7fb7f086831 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:09.880333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 28/62] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:09.886968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0548c-55d9-42d1-a195-41749f0b1023 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:09.887903 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0548c-55d9-42d1-a195-41749f0b1023 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:09.888993 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0548c-55d9-42d1-a195-41749f0b1023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:09.916589 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-bae0548c-55d9-42d1-a195-41749f0b1023 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:09.918232 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-bae0548c-55d9-42d1-a195-41749f0b1023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:10.025491 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 35/63] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:10.068119 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4af88-a7ee-4928-a22d-d7fb7f086831 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:10.136598 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935295aa-c1c2-419c-9cce-9488719d35fc None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.137256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935295aa-c1c2-419c-9cce-9488719d35fc None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.137759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935295aa-c1c2-419c-9cce-9488719d35fc None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.140009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 36/64] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:10.152405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb38c-ead1-48bf-8ead-cedb59cea9a3 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.153093 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb38c-ead1-48bf-8ead-cedb59cea9a3 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.153591 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb38c-ead1-48bf-8ead-cedb59cea9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.206587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-66fcb38c-ead1-48bf-8ead-cedb59cea9a3 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:10.208259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-66fcb38c-ead1-48bf-8ead-cedb59cea9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:10.210440 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4af88-a7ee-4928-a22d-d7fb7f086831 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:10.249530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe0681-ea7d-418b-b521-0e6f168c1156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:10.254847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe0681-ea7d-418b-b521-0e6f168c1156 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.254847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe0681-ea7d-418b-b521-0e6f168c1156 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.254847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe0681-ea7d-418b-b521-0e6f168c1156 None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.263994 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe0681-ea7d-418b-b521-0e6f168c1156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-42fe0681-ea7d-418b-b521-0e6f168c1156 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:10.272437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:10.273847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:10.275079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:10.277823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 29/65] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:10.279513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99691-40d9-41a4-986e-36ff544f821a None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.279963 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99691-40d9-41a4-986e-36ff544f821a None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.280432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99691-40d9-41a4-986e-36ff544f821a None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.281977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 30/66] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:10.283327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99691-40d9-41a4-986e-36ff544f821a None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:10.297652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 37/67] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 20:45:10.312382 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caa827-7abc-42e8-bac9-7441d29c201f None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.312835 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caa827-7abc-42e8-bac9-7441d29c201f None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.313224 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caa827-7abc-42e8-bac9-7441d29c201f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.342848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-14caa827-7abc-42e8-bac9-7441d29c201f None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:10.344204 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-14caa827-7abc-42e8-bac9-7441d29c201f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:10.348734 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:10.402433 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99691-40d9-41a4-986e-36ff544f821a None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:10.405013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:10.427321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 38/68] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:10.431979 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14caa827-7abc-42e8-bac9-7441d29c201f None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:10.442482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ac3ad-7f6d-401c-847a-49123e515623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:10.443681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ac3ad-7f6d-401c-847a-49123e515623 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.444250 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ac3ad-7f6d-401c-847a-49123e515623 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.444728 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ac3ad-7f6d-401c-847a-49123e515623 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.445696 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ac3ad-7f6d-401c-847a-49123e515623 None admin] RBAC: Adding query filter params (name=member) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:10.446214 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ac3ad-7f6d-401c-847a-49123e515623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:10.447872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ac3ad-7f6d-401c-847a-49123e515623 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:10.464425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 31/69] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:10.470100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ac3ad-7f6d-401c-847a-49123e515623 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:10.593816 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14caa827-7abc-42e8-bac9-7441d29c201f None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:10.598144 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ac3ad-7f6d-401c-847a-49123e515623 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:10.616058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:10.634135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b227ec-8cbc-4e48-8107-7e64e44ea083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:10.634975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b227ec-8cbc-4e48-8107-7e64e44ea083 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.635328 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b227ec-8cbc-4e48-8107-7e64e44ea083 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.635539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b227ec-8cbc-4e48-8107-7e64e44ea083 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.638737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa57a7-ac8e-40c8-820d-9a50276e9517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:10.639633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa57a7-ac8e-40c8-820d-9a50276e9517 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.639922 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa57a7-ac8e-40c8-820d-9a50276e9517 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.640203 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa57a7-ac8e-40c8-820d-9a50276e9517 None admin] PATH_INFO: `/v3/users/3ed428cb56e14e89a5927b411a660345` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.648608 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b227ec-8cbc-4e48-8107-7e64e44ea083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:10.656591 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa57a7-ac8e-40c8-820d-9a50276e9517 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed428cb56e14e89a5927b411a660345)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-28b227ec-8cbc-4e48-8107-7e64e44ea083 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:10.657751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:10.658792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:10.665048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:10.665777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa57a7-ac8e-40c8-820d-9a50276e9517 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:10.665868 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 39/70] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:45:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:10.665944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 32/71] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:10 2022] GET /identity/v3/users/3ed428cb56e14e89a5927b411a660345 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:10.665944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70370f1a-15b2-481d-9e31-935e2f9f5923 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.665944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70370f1a-15b2-481d-9e31-935e2f9f5923 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.665944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70370f1a-15b2-481d-9e31-935e2f9f5923 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.665944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 33/72] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:10.665944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70370f1a-15b2-481d-9e31-935e2f9f5923 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:10.666377 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b227ec-8cbc-4e48-8107-7e64e44ea083 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:10.711585 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:10.786658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70370f1a-15b2-481d-9e31-935e2f9f5923 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:10.808702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b227ec-8cbc-4e48-8107-7e64e44ea083 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:10.828806 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1aa0d-d05b-4dcf-adfe-2baef7be8a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:10.829826 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1aa0d-d05b-4dcf-adfe-2baef7be8a5e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.830300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1aa0d-d05b-4dcf-adfe-2baef7be8a5e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.830631 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1aa0d-d05b-4dcf-adfe-2baef7be8a5e None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.831754 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1aa0d-d05b-4dcf-adfe-2baef7be8a5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:10.832242 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1aa0d-d05b-4dcf-adfe-2baef7be8a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:10.834316 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1aa0d-d05b-4dcf-adfe-2baef7be8a5e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:10.845721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 34/73] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:10.848831 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239dfaa-9d91-4e86-aa94-62e361328b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:10.849651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239dfaa-9d91-4e86-aa94-62e361328b7e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.849937 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239dfaa-9d91-4e86-aa94-62e361328b7e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.850442 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239dfaa-9d91-4e86-aa94-62e361328b7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.851242 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1aa0d-d05b-4dcf-adfe-2baef7be8a5e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:10.862725 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239dfaa-9d91-4e86-aa94-62e361328b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-b239dfaa-9d91-4e86-aa94-62e361328b7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:10.871061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:10.872155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 40/74] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:45:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:10.873702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d364ea-412d-45da-a62f-1fe50dc888a3 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.874714 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d364ea-412d-45da-a62f-1fe50dc888a3 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.874714 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d364ea-412d-45da-a62f-1fe50dc888a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.888341 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:10.891265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-c7d364ea-412d-45da-a62f-1fe50dc888a3 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:10.892493 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-c7d364ea-412d-45da-a62f-1fe50dc888a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:10.963382 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1aa0d-d05b-4dcf-adfe-2baef7be8a5e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:10.971986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 41/75] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:10.973331 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c9fa-e3d2-493c-b8c0-bb0fe12b802a None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:10.973627 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c9fa-e3d2-493c-b8c0-bb0fe12b802a None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:10.973909 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c9fa-e3d2-493c-b8c0-bb0fe12b802a None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:10.975365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 42/76] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:10.975920 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c9fa-e3d2-493c-b8c0-bb0fe12b802a None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:11.009187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:11.016192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80527d1c-3963-47d8-b54e-38726de055f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:11.016864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80527d1c-3963-47d8-b54e-38726de055f1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:11.017157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80527d1c-3963-47d8-b54e-38726de055f1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:11.017501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80527d1c-3963-47d8-b54e-38726de055f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:11.107060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c9fa-e3d2-493c-b8c0-bb0fe12b802a None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:11.121332 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80527d1c-3963-47d8-b54e-38726de055f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:11.121332 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80527d1c-3963-47d8-b54e-38726de055f1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:11.151640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151bf87-2081-4cb7-af46-485598b3f94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:11.152526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151bf87-2081-4cb7-af46-485598b3f94e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:11.152809 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151bf87-2081-4cb7-af46-485598b3f94e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:11.153073 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151bf87-2081-4cb7-af46-485598b3f94e None admin] PATH_INFO: `/v3/users/7348bece61b448488b3b2cc1f96ba25d` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:11.154903 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151bf87-2081-4cb7-af46-485598b3f94e None admin] RBAC: Authorizing `identity:get_user(user_id=7348bece61b448488b3b2cc1f96ba25d)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:11.156357 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151bf87-2081-4cb7-af46-485598b3f94e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:11.162765 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 43/77] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:10 2022] GET /identity/v3/users/7348bece61b448488b3b2cc1f96ba25d => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:11.162765 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151bf87-2081-4cb7-af46-485598b3f94e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:11.165865 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:11.241350 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 35/78] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:11.241350 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a473c-a8d3-4fca-b9ab-bb21448fbf7b None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:11.241350 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a473c-a8d3-4fca-b9ab-bb21448fbf7b None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:11.241707 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a473c-a8d3-4fca-b9ab-bb21448fbf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:11.260408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-e09a473c-a8d3-4fca-b9ab-bb21448fbf7b None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:11.262050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-e09a473c-a8d3-4fca-b9ab-bb21448fbf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:11.266375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:11.273772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151bf87-2081-4cb7-af46-485598b3f94e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:11.314144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dc414-0185-4e0b-9c99-cffc1f968c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:11.314862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc414-0185-4e0b-9c99-cffc1f968c42 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:11.315149 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc414-0185-4e0b-9c99-cffc1f968c42 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:11.315456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc414-0185-4e0b-9c99-cffc1f968c42 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:11.316279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dc414-0185-4e0b-9c99-cffc1f968c42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:11.316594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dc414-0185-4e0b-9c99-cffc1f968c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:11.318130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dc414-0185-4e0b-9c99-cffc1f968c42 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:11.327650 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 44/79] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:45:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:11.328816 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dc414-0185-4e0b-9c99-cffc1f968c42 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:11.343071 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 36/80] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:11.344027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a473c-a8d3-4fca-b9ab-bb21448fbf7b None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:11.412654 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:11.443461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dc414-0185-4e0b-9c99-cffc1f968c42 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:11.455808 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a473c-a8d3-4fca-b9ab-bb21448fbf7b None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:11.479328 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1c14f-35a9-42d2-85dc-c657197c59f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:11.480127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c14f-35a9-42d2-85dc-c657197c59f9 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:11.480499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c14f-35a9-42d2-85dc-c657197c59f9 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:11.480779 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c14f-35a9-42d2-85dc-c657197c59f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:11.492633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7dd0-5409-47c3-ad61-5a180b4f4713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:11.493213 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7dd0-5409-47c3-ad61-5a180b4f4713 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:11.493378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1c14f-35a9-42d2-85dc-c657197c59f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:11.493494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7dd0-5409-47c3-ad61-5a180b4f4713 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:11.493770 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7dd0-5409-47c3-ad61-5a180b4f4713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-b2b1c14f-35a9-42d2-85dc-c657197c59f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:11.502174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:11.503448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 45/81] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:11.505002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1c14f-35a9-42d2-85dc-c657197c59f9 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:11.526151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:11.576436 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b7dd0-5409-47c3-ad61-5a180b4f4713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:11.577938 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b7dd0-5409-47c3-ad61-5a180b4f4713 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:11.618169 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1c14f-35a9-42d2-85dc-c657197c59f9 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:11.646083 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:11.658484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70efc3-1e52-4f8e-ae13-fa04224053d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:11.660439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70efc3-1e52-4f8e-ae13-fa04224053d4 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:11.660439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70efc3-1e52-4f8e-ae13-fa04224053d4 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:11.660439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70efc3-1e52-4f8e-ae13-fa04224053d4 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:11.660733 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70efc3-1e52-4f8e-ae13-fa04224053d4 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:11.662090 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70efc3-1e52-4f8e-ae13-fa04224053d4 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:11.663937 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 46/82] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:11 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:11.664731 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70efc3-1e52-4f8e-ae13-fa04224053d4 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:11.691713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 37/83] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:11.693021 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7dd0-5409-47c3-ad61-5a180b4f4713 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:11.757708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:11.775866 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70efc3-1e52-4f8e-ae13-fa04224053d4 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:11.801114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7dd0-5409-47c3-ad61-5a180b4f4713 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:11.815208 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda35ed-6eab-43f8-aa63-89cc2ec72288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:11.816101 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda35ed-6eab-43f8-aa63-89cc2ec72288 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:11.816380 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda35ed-6eab-43f8-aa63-89cc2ec72288 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:11.816654 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda35ed-6eab-43f8-aa63-89cc2ec72288 None admin] PATH_INFO: `/v3/users/3ed428cb56e14e89a5927b411a660345` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:11.817926 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda35ed-6eab-43f8-aa63-89cc2ec72288 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed428cb56e14e89a5927b411a660345)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:11.819441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda35ed-6eab-43f8-aa63-89cc2ec72288 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:11.821293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 47/84] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:11 2022] GET /identity/v3/users/3ed428cb56e14e89a5927b411a660345 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:11.822225 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda35ed-6eab-43f8-aa63-89cc2ec72288 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:11.841357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d750d33-2513-452b-a978-0f422eb31782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:11.842160 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d750d33-2513-452b-a978-0f422eb31782 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:11.842438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d750d33-2513-452b-a978-0f422eb31782 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:11.842752 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d750d33-2513-452b-a978-0f422eb31782 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:11.843954 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d750d33-2513-452b-a978-0f422eb31782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:11.845420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d750d33-2513-452b-a978-0f422eb31782 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:11.847259 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 38/85] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:11.848366 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d750d33-2513-452b-a978-0f422eb31782 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:11.883427 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:11.934843 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda35ed-6eab-43f8-aa63-89cc2ec72288 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:11.955986 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d750d33-2513-452b-a978-0f422eb31782 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:11.969097 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff62314-bedc-48c1-b875-5151e863e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:11.969779 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff62314-bedc-48c1-b875-5151e863e042 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:11.970069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff62314-bedc-48c1-b875-5151e863e042 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:11.970359 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff62314-bedc-48c1-b875-5151e863e042 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:11.971226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff62314-bedc-48c1-b875-5151e863e042 None admin] RBAC: Adding query filter params (name=member) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:11.971542 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff62314-bedc-48c1-b875-5151e863e042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:11.972982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff62314-bedc-48c1-b875-5151e863e042 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:11.981326 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 48/86] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:11.982676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff62314-bedc-48c1-b875-5151e863e042 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:11.995082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a24065-a444-44f1-ab8e-f3caba87acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:11.995753 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24065-a444-44f1-ab8e-f3caba87acae None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:11.996042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24065-a444-44f1-ab8e-f3caba87acae None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:11.996329 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24065-a444-44f1-ab8e-f3caba87acae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:11.997175 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a24065-a444-44f1-ab8e-f3caba87acae None admin] RBAC: Adding query filter params (role.id=b6aef1054c2f43a693e82eb19749d60b, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386, user.id=3ed428cb56e14e89a5927b411a660345) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:11.997524 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a24065-a444-44f1-ab8e-f3caba87acae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:11.999380 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:11.999632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a24065-a444-44f1-ab8e-f3caba87acae None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:12.005438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 39/87] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:11 2022] GET /identity/v3/role_assignments?user.id=3ed428cb56e14e89a5927b411a660345&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:12.006066 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a24065-a444-44f1-ab8e-f3caba87acae None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:12.124303 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff62314-bedc-48c1-b875-5151e863e042 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:12.125025 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:12.132911 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a24065-a444-44f1-ab8e-f3caba87acae None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:12.163462 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587c543-2b22-41b8-8d1c-3ada88258cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:12.164350 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587c543-2b22-41b8-8d1c-3ada88258cc5 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:12.164637 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587c543-2b22-41b8-8d1c-3ada88258cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:12.164917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587c543-2b22-41b8-8d1c-3ada88258cc5 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:12.166218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587c543-2b22-41b8-8d1c-3ada88258cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:12.167768 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587c543-2b22-41b8-8d1c-3ada88258cc5 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:12.170334 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 49/88] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:11 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:12.172799 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8b3ab-93ed-441f-b43d-840fa1bafb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:12.173804 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8b3ab-93ed-441f-b43d-840fa1bafb33 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:12.174386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8b3ab-93ed-441f-b43d-840fa1bafb33 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:12.174920 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8b3ab-93ed-441f-b43d-840fa1bafb33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:12.180596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587c543-2b22-41b8-8d1c-3ada88258cc5 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:12.259054 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8b3ab-93ed-441f-b43d-840fa1bafb33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:12.260535 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8b3ab-93ed-441f-b43d-840fa1bafb33 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:12.273173 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:12.292758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587c543-2b22-41b8-8d1c-3ada88258cc5 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:12.333150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ccaf-1646-4da6-8ebb-160ad109af8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:12.333745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ccaf-1646-4da6-8ebb-160ad109af8c None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:12.334035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ccaf-1646-4da6-8ebb-160ad109af8c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:12.334319 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ccaf-1646-4da6-8ebb-160ad109af8c None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:12.335091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733ccaf-1646-4da6-8ebb-160ad109af8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:12.336891 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733ccaf-1646-4da6-8ebb-160ad109af8c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:12.362865 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:12.369247 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 40/89] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:12.370482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8b3ab-93ed-441f-b43d-840fa1bafb33 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:12.458640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 50/90] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:45:12 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:45:12.458640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ccaf-1646-4da6-8ebb-160ad109af8c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:12.484996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8b3ab-93ed-441f-b43d-840fa1bafb33 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:12.531961 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ff769-f8c3-4c88-aa18-4e2750599ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:12.532920 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ff769-f8c3-4c88-aa18-4e2750599ac0 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:12.533211 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ff769-f8c3-4c88-aa18-4e2750599ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:12.533497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ff769-f8c3-4c88-aa18-4e2750599ac0 None admin] PATH_INFO: `/v3/users/3ed428cb56e14e89a5927b411a660345` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:12.535221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ff769-f8c3-4c88-aa18-4e2750599ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed428cb56e14e89a5927b411a660345)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:12.536965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ff769-f8c3-4c88-aa18-4e2750599ac0 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:12.538993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 41/91] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:12 2022] GET /identity/v3/users/3ed428cb56e14e89a5927b411a660345 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:12.539803 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ff769-f8c3-4c88-aa18-4e2750599ac0 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:12.617059 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:12.624887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ccaf-1646-4da6-8ebb-160ad109af8c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:12.671802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c84e1-4911-43f8-8bdb-56eab57aa8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:12.672422 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c84e1-4911-43f8-8bdb-56eab57aa8e6 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:12.672721 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c84e1-4911-43f8-8bdb-56eab57aa8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:12.673007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c84e1-4911-43f8-8bdb-56eab57aa8e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:12.674859 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c84e1-4911-43f8-8bdb-56eab57aa8e6 None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386, user.id=7348bece61b448488b3b2cc1f96ba25d) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:12.674859 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c84e1-4911-43f8-8bdb-56eab57aa8e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:12.675083 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ff769-f8c3-4c88-aa18-4e2750599ac0 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:12.675762 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c84e1-4911-43f8-8bdb-56eab57aa8e6 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:12.686874 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 51/92] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:12 2022] GET /identity/v3/role_assignments?user.id=7348bece61b448488b3b2cc1f96ba25d&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:12.689915 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c84e1-4911-43f8-8bdb-56eab57aa8e6 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:12.694462 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:12.728492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35d7c-9199-49b7-a338-234da9f7e6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:12.728883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35d7c-9199-49b7-a338-234da9f7e6a8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:12.729272 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35d7c-9199-49b7-a338-234da9f7e6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:12.729557 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35d7c-9199-49b7-a338-234da9f7e6a8 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:12.730940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c35d7c-9199-49b7-a338-234da9f7e6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:12.733331 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c35d7c-9199-49b7-a338-234da9f7e6a8 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:12.737490 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 42/93] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:12 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:12.742716 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35d7c-9199-49b7-a338-234da9f7e6a8 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:12.849721 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c84e1-4911-43f8-8bdb-56eab57aa8e6 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:12.890404 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ddd46-08e2-4aff-8b8b-b1234505d236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:12.891028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ddd46-08e2-4aff-8b8b-b1234505d236 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:12.891315 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ddd46-08e2-4aff-8b8b-b1234505d236 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:12.891596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ddd46-08e2-4aff-8b8b-b1234505d236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:12.898159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35d7c-9199-49b7-a338-234da9f7e6a8 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:12.933632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:12.940648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2aa20-e6a4-4835-b9ac-9acd37a24ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:12.945163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2aa20-e6a4-4835-b9ac-9acd37a24ade None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:12.945163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2aa20-e6a4-4835-b9ac-9acd37a24ade None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:12.945163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2aa20-e6a4-4835-b9ac-9acd37a24ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:12.945163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2aa20-e6a4-4835-b9ac-9acd37a24ade None admin] RBAC: Adding query filter params (role.id=715071b6b1244a559110be37cc8410ab, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386, user.id=3ed428cb56e14e89a5927b411a660345) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:12.945163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2aa20-e6a4-4835-b9ac-9acd37a24ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:12.945775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2aa20-e6a4-4835-b9ac-9acd37a24ade None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:12.953050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 43/94] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:12 2022] GET /identity/v3/role_assignments?user.id=3ed428cb56e14e89a5927b411a660345&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=715071b6b1244a559110be37cc8410ab => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:12.977760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ddd46-08e2-4aff-8b8b-b1234505d236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:12.979310 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ddd46-08e2-4aff-8b8b-b1234505d236 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:12.982033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:13.117043 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 52/95] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:13.122991 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2aa20-e6a4-4835-b9ac-9acd37a24ade None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:13.251957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2aa20-e6a4-4835-b9ac-9acd37a24ade None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:13.292664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577af076-ade8-4b42-bf3e-6a07562485f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:13.293551 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577af076-ade8-4b42-bf3e-6a07562485f6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:13.293891 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577af076-ade8-4b42-bf3e-6a07562485f6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:13.294174 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577af076-ade8-4b42-bf3e-6a07562485f6 None admin] PATH_INFO: `/v3/projects/9a542347dd33478fa691b3f9464c57ae` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:13.296095 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577af076-ade8-4b42-bf3e-6a07562485f6 None admin] RBAC: Authorizing `identity:get_project(project_id=9a542347dd33478fa691b3f9464c57ae)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:13.297573 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577af076-ade8-4b42-bf3e-6a07562485f6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:13.299731 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 44/96] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:13 2022] GET /identity/v3/projects/9a542347dd33478fa691b3f9464c57ae => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:13.305524 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ddd46-08e2-4aff-8b8b-b1234505d236 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:13.431009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ddd46-08e2-4aff-8b8b-b1234505d236 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:13.432671 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:13.481189 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63677d37-f381-4c90-9e04-8b19301b9787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:13.482462 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63677d37-f381-4c90-9e04-8b19301b9787 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:13.482778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63677d37-f381-4c90-9e04-8b19301b9787 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:13.483057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63677d37-f381-4c90-9e04-8b19301b9787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:13.483932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63677d37-f381-4c90-9e04-8b19301b9787 None admin] RBAC: Adding query filter params (role.id=b6aef1054c2f43a693e82eb19749d60b, scope.project.id=9a542347dd33478fa691b3f9464c57ae, user.id=3ed428cb56e14e89a5927b411a660345) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:13.484259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63677d37-f381-4c90-9e04-8b19301b9787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:13.485821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63677d37-f381-4c90-9e04-8b19301b9787 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:13.495204 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 53/97] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:13 2022] GET /identity/v3/role_assignments?user.id=3ed428cb56e14e89a5927b411a660345&scope.project.id=9a542347dd33478fa691b3f9464c57ae&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:14.652451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc2d56-aea9-428f-9491-001be41550cc None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:14.653036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc2d56-aea9-428f-9491-001be41550cc None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:14.653133 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc2d56-aea9-428f-9491-001be41550cc None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:14.654738 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 45/98] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:14.660283 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950e5eb-d400-40b3-afc5-ec903998be4f None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:14.660726 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950e5eb-d400-40b3-afc5-ec903998be4f None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:14.660830 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950e5eb-d400-40b3-afc5-ec903998be4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:14.682871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-3950e5eb-d400-40b3-afc5-ec903998be4f None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:14.684353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-3950e5eb-d400-40b3-afc5-ec903998be4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:14.760402 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 54/99] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:14.782652 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc2d56-aea9-428f-9491-001be41550cc None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:14.864296 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:14.907351 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc2d56-aea9-428f-9491-001be41550cc None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:14.944570 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a821e3-8186-41c5-a5fe-5963680c1735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:14.945445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a821e3-8186-41c5-a5fe-5963680c1735 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:14.945734 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a821e3-8186-41c5-a5fe-5963680c1735 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:14.946013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a821e3-8186-41c5-a5fe-5963680c1735 None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:14.957469 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a821e3-8186-41c5-a5fe-5963680c1735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-15a821e3-8186-41c5-a5fe-5963680c1735 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:14.965497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:14.966736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:14.968117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 46/100] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:14.973338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950e5eb-d400-40b3-afc5-ec903998be4f None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:15.101762 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:15.108204 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950e5eb-d400-40b3-afc5-ec903998be4f None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:15.156978 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8592b0-8de6-45a9-9ac0-88bdc549691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:15.157721 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8592b0-8de6-45a9-9ac0-88bdc549691c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:15.157937 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8592b0-8de6-45a9-9ac0-88bdc549691c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:15.158221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8592b0-8de6-45a9-9ac0-88bdc549691c None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:15.159022 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8592b0-8de6-45a9-9ac0-88bdc549691c None admin] RBAC: Adding query filter params (name=member) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:15.159336 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8592b0-8de6-45a9-9ac0-88bdc549691c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:15.160718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8592b0-8de6-45a9-9ac0-88bdc549691c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:15.174271 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 55/101] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:15.179767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a821e3-8186-41c5-a5fe-5963680c1735 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:15.358177 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a821e3-8186-41c5-a5fe-5963680c1735 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:15.387525 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:15.404909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fad032-d54b-46d4-9408-c09ddc3e5a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:15.405804 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fad032-d54b-46d4-9408-c09ddc3e5a74 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:15.406089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fad032-d54b-46d4-9408-c09ddc3e5a74 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:15.406368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fad032-d54b-46d4-9408-c09ddc3e5a74 None admin] PATH_INFO: `/v3/users/3ed428cb56e14e89a5927b411a660345` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:15.407653 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fad032-d54b-46d4-9408-c09ddc3e5a74 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed428cb56e14e89a5927b411a660345)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:15.409271 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fad032-d54b-46d4-9408-c09ddc3e5a74 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:15.411217 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 47/102] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:15 2022] GET /identity/v3/users/3ed428cb56e14e89a5927b411a660345 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:15.416563 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8592b0-8de6-45a9-9ac0-88bdc549691c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:15.561039 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8592b0-8de6-45a9-9ac0-88bdc549691c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:15.598144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5b5c1-3b4c-4ddb-913f-556d34e97128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:15.599070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b5c1-3b4c-4ddb-913f-556d34e97128 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:15.599360 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b5c1-3b4c-4ddb-913f-556d34e97128 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:15.599644 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b5c1-3b4c-4ddb-913f-556d34e97128 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:15.600883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5b5c1-3b4c-4ddb-913f-556d34e97128 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:15.602343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5b5c1-3b4c-4ddb-913f-556d34e97128 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:15.604467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 56/103] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:15 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:15.619695 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fad032-d54b-46d4-9408-c09ddc3e5a74 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:15.769662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fad032-d54b-46d4-9408-c09ddc3e5a74 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:15.821548 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df7aa7-a3de-47a2-a1b4-86139ff9cc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:15.822964 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7aa7-a3de-47a2-a1b4-86139ff9cc18 None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:15.823475 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7aa7-a3de-47a2-a1b4-86139ff9cc18 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:15.823977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7aa7-a3de-47a2-a1b4-86139ff9cc18 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/users/3ed428cb56e14e89a5927b411a660345/roles/b6aef1054c2f43a693e82eb19749d60b` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:15.832066 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df7aa7-a3de-47a2-a1b4-86139ff9cc18 None admin] RBAC: Authorizing `identity:create_grant(project_id=41f0c6987ff94c9cb442a42b28d9f386, user_id=3ed428cb56e14e89a5927b411a660345, role_id=b6aef1054c2f43a693e82eb19749d60b)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:15.833840 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df7aa7-a3de-47a2-a1b4-86139ff9cc18 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:15.920058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 48/104] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:45:15 2022] PUT /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/users/3ed428cb56e14e89a5927b411a660345/roles/b6aef1054c2f43a693e82eb19749d60b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:16.273960 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbd101-c7ba-40d0-980b-6f7fdf9b867d None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:16.274520 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbd101-c7ba-40d0-980b-6f7fdf9b867d None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:16.274520 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbd101-c7ba-40d0-980b-6f7fdf9b867d None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:16.275965 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 57/105] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:16.281568 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd15dc-d834-4f3c-b99b-c182d91abba9 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:16.288917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd15dc-d834-4f3c-b99b-c182d91abba9 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:16.288917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd15dc-d834-4f3c-b99b-c182d91abba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:16.307270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-27dd15dc-d834-4f3c-b99b-c182d91abba9 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:16.308484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-27dd15dc-d834-4f3c-b99b-c182d91abba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:16.313490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce763c-1835-4b23-9356-58326ec76b9b None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:16.314142 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce763c-1835-4b23-9356-58326ec76b9b None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:16.314701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce763c-1835-4b23-9356-58326ec76b9b None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:16.316670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 58/106] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:16.323262 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac95202-f4db-40a2-9331-e200803c5ec7 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:16.323856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac95202-f4db-40a2-9331-e200803c5ec7 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:16.324389 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac95202-f4db-40a2-9331-e200803c5ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:16.342881 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-dac95202-f4db-40a2-9331-e200803c5ec7 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:16.344512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-dac95202-f4db-40a2-9331-e200803c5ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:16.368793 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:16.380671 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:16.417254 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 49/107] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:16.424154 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 59/108] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:16.449356 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd15dc-d834-4f3c-b99b-c182d91abba9 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:16.460748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac95202-f4db-40a2-9331-e200803c5ec7 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:16.659149 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac95202-f4db-40a2-9331-e200803c5ec7 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:16.703399 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b7813-c974-4226-ad34-575b0610833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:16.703670 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd15dc-d834-4f3c-b99b-c182d91abba9 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:16.704650 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b7813-c974-4226-ad34-575b0610833c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:16.705105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b7813-c974-4226-ad34-575b0610833c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:16.705748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b7813-c974-4226-ad34-575b0610833c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:16.720150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b7813-c974-4226-ad34-575b0610833c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-145b7813-c974-4226-ad34-575b0610833c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:16.730017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:16.731384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:16.733127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:16.735887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 60/109] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:45:16.742567 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b7813-c974-4226-ad34-575b0610833c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:16.773450 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:16.795582 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e456959-0d62-4c21-ae4d-bbcd41c37db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:16.796407 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456959-0d62-4c21-ae4d-bbcd41c37db9 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:16.796693 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456959-0d62-4c21-ae4d-bbcd41c37db9 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:16.796982 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456959-0d62-4c21-ae4d-bbcd41c37db9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:16.798290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e456959-0d62-4c21-ae4d-bbcd41c37db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:16.799790 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e456959-0d62-4c21-ae4d-bbcd41c37db9 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:16.801778 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 50/110] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:16.820062 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e456959-0d62-4c21-ae4d-bbcd41c37db9 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:16.867609 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b7813-c974-4226-ad34-575b0610833c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:16.926938 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:16.932521 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a168d38-4492-4158-a429-1c9731131e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:16.937316 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a168d38-4492-4158-a429-1c9731131e4a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:16.937316 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a168d38-4492-4158-a429-1c9731131e4a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:16.937316 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a168d38-4492-4158-a429-1c9731131e4a None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:16.937316 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a168d38-4492-4158-a429-1c9731131e4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:16.937316 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a168d38-4492-4158-a429-1c9731131e4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:16.937316 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a168d38-4492-4158-a429-1c9731131e4a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:16.947435 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 61/111] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:16.949093 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef320f4b-d880-418d-afac-3ce34729f5ef None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:16.949395 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef320f4b-d880-418d-afac-3ce34729f5ef None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:16.949679 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef320f4b-d880-418d-afac-3ce34729f5ef None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:16.951493 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 62/112] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:16.952795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5dc3e-b229-4082-9234-12fb594a08e0 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:16.953274 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5dc3e-b229-4082-9234-12fb594a08e0 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:16.953562 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5dc3e-b229-4082-9234-12fb594a08e0 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:16.958729 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 63/113] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:16.958729 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61933d8-d818-46bb-884e-dea9e8f6753b None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:16.958729 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61933d8-d818-46bb-884e-dea9e8f6753b None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:16.958729 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61933d8-d818-46bb-884e-dea9e8f6753b None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:16.960467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 64/114] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:16.961383 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b85ff-56e5-4c51-a1e6-0edf0e7f693f None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:16.961725 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b85ff-56e5-4c51-a1e6-0edf0e7f693f None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:16.962007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b85ff-56e5-4c51-a1e6-0edf0e7f693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:16.984170 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-8a3b85ff-56e5-4c51-a1e6-0edf0e7f693f None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:16.985473 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-8a3b85ff-56e5-4c51-a1e6-0edf0e7f693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:16.986577 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e456959-0d62-4c21-ae4d-bbcd41c37db9 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:17.026259 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0210bb4-a813-4dfd-a400-0b1ac72123b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:17.026967 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210bb4-a813-4dfd-a400-0b1ac72123b9 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:17.027255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210bb4-a813-4dfd-a400-0b1ac72123b9 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:17.027534 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210bb4-a813-4dfd-a400-0b1ac72123b9 None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:17.028257 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0210bb4-a813-4dfd-a400-0b1ac72123b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:17.030946 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0210bb4-a813-4dfd-a400-0b1ac72123b9 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:17.063430 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 65/115] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:17.064291 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b85ff-56e5-4c51-a1e6-0edf0e7f693f None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:17.083920 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:17.114721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 51/116] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:45:16 2022] POST /identity/v3/projects => generated 302 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:45:17.116449 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c4dd-0e0e-4dec-a395-fbfbe59c0f4c None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:17.117114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c4dd-0e0e-4dec-a395-fbfbe59c0f4c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:17.117470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c4dd-0e0e-4dec-a395-fbfbe59c0f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:17.137111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-7ca1c4dd-0e0e-4dec-a395-fbfbe59c0f4c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:17.139141 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-7ca1c4dd-0e0e-4dec-a395-fbfbe59c0f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:17.205768 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b85ff-56e5-4c51-a1e6-0edf0e7f693f None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:17.232856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 52/117] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:17.234570 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f53c2a-6683-4709-91b0-9b32e264d14f None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:17.235109 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f53c2a-6683-4709-91b0-9b32e264d14f None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:17.235573 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f53c2a-6683-4709-91b0-9b32e264d14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:17.264357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-b4f53c2a-6683-4709-91b0-9b32e264d14f None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:17.265795 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-b4f53c2a-6683-4709-91b0-9b32e264d14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:17.267582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f6d4d-5daa-421b-b461-a1e985a22c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:17.268873 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f6d4d-5daa-421b-b461-a1e985a22c97 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:17.269360 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f6d4d-5daa-421b-b461-a1e985a22c97 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:17.269849 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f6d4d-5daa-421b-b461-a1e985a22c97 None admin] PATH_INFO: `/v3/users/7348bece61b448488b3b2cc1f96ba25d` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:17.271557 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f6d4d-5daa-421b-b461-a1e985a22c97 None admin] RBAC: Authorizing `identity:get_user(user_id=7348bece61b448488b3b2cc1f96ba25d)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:17.273878 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f6d4d-5daa-421b-b461-a1e985a22c97 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:17.276002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 66/118] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:17 2022] GET /identity/v3/users/7348bece61b448488b3b2cc1f96ba25d => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:17.277653 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f6d4d-5daa-421b-b461-a1e985a22c97 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:17.297888 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:17.345388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 53/119] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:17.350936 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f53c2a-6683-4709-91b0-9b32e264d14f None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:17.388946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:17.417620 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f6d4d-5daa-421b-b461-a1e985a22c97 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:17.462872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178a57d-42bd-4213-ba98-98cd6c25c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:17.464080 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178a57d-42bd-4213-ba98-98cd6c25c127 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:17.464590 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178a57d-42bd-4213-ba98-98cd6c25c127 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:17.465208 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178a57d-42bd-4213-ba98-98cd6c25c127 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:17.475863 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f53c2a-6683-4709-91b0-9b32e264d14f None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:17.480029 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178a57d-42bd-4213-ba98-98cd6c25c127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-4178a57d-42bd-4213-ba98-98cd6c25c127 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:17.488772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:17.489970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:17.491273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:17.493856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 67/120] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:17.494947 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178a57d-42bd-4213-ba98-98cd6c25c127 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:17.512740 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b145e5-7c1d-4e2a-afe2-1b1a4d58e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:17.513591 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b145e5-7c1d-4e2a-afe2-1b1a4d58e5ac None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:17.513880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b145e5-7c1d-4e2a-afe2-1b1a4d58e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:17.514162 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b145e5-7c1d-4e2a-afe2-1b1a4d58e5ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:17.526653 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b145e5-7c1d-4e2a-afe2-1b1a4d58e5ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-63b145e5-7c1d-4e2a-afe2-1b1a4d58e5ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:17.535388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:17.536452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:17.537465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 54/121] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:17.538260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b145e5-7c1d-4e2a-afe2-1b1a4d58e5ac None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:17.570112 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:17.636121 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178a57d-42bd-4213-ba98-98cd6c25c127 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:17.652550 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b145e5-7c1d-4e2a-afe2-1b1a4d58e5ac None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:17.676573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa878c-fa26-488e-8c9f-3d7660a208c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:17.677953 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa878c-fa26-488e-8c9f-3d7660a208c0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:17.678515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa878c-fa26-488e-8c9f-3d7660a208c0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:17.679022 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa878c-fa26-488e-8c9f-3d7660a208c0 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:17.680558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa878c-fa26-488e-8c9f-3d7660a208c0 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:17.682346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa878c-fa26-488e-8c9f-3d7660a208c0 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:17.685192 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 68/122] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:17 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:17.686346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa878c-fa26-488e-8c9f-3d7660a208c0 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:17.689595 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac529e9d-aab4-4d6f-bc28-f2f64d78ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:17.690424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac529e9d-aab4-4d6f-bc28-f2f64d78ed9c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:17.690743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac529e9d-aab4-4d6f-bc28-f2f64d78ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:17.691028 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac529e9d-aab4-4d6f-bc28-f2f64d78ed9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:17.692069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:17.705075 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac529e9d-aab4-4d6f-bc28-f2f64d78ed9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-ac529e9d-aab4-4d6f-bc28-f2f64d78ed9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:17.713943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:17.715050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 55/123] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:45:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:17.715999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac529e9d-aab4-4d6f-bc28-f2f64d78ed9c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:17.804967 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa878c-fa26-488e-8c9f-3d7660a208c0 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:17.831025 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:17.835287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac529e9d-aab4-4d6f-bc28-f2f64d78ed9c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:17.848763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de5b6a-e55b-4328-899f-6a509f6a1fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:17.849932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de5b6a-e55b-4328-899f-6a509f6a1fdc None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:17.850327 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de5b6a-e55b-4328-899f-6a509f6a1fdc None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:17.850751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de5b6a-e55b-4328-899f-6a509f6a1fdc None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:17.851895 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de5b6a-e55b-4328-899f-6a509f6a1fdc None admin] RBAC: Adding query filter params (name=reader) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:17.852359 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de5b6a-e55b-4328-899f-6a509f6a1fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:17.854573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de5b6a-e55b-4328-899f-6a509f6a1fdc None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:17.866784 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 69/124] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:17.867862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de5b6a-e55b-4328-899f-6a509f6a1fdc None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:17.874731 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2f4c-32bf-473b-a4db-4bb4039bc6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:17.875676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2f4c-32bf-473b-a4db-4bb4039bc6d9 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:17.876126 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2f4c-32bf-473b-a4db-4bb4039bc6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:17.876569 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2f4c-32bf-473b-a4db-4bb4039bc6d9 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:17.877525 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c2f4c-32bf-473b-a4db-4bb4039bc6d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:17.878200 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c2f4c-32bf-473b-a4db-4bb4039bc6d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:17.879957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c2f4c-32bf-473b-a4db-4bb4039bc6d9 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:17.890132 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 56/125] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:17.891422 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2f4c-32bf-473b-a4db-4bb4039bc6d9 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:17.956350 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:17.993996 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de5b6a-e55b-4328-899f-6a509f6a1fdc None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:18.003854 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2f4c-32bf-473b-a4db-4bb4039bc6d9 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:18.032366 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd698d-7e51-4c90-a925-16b1c223e76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:18.033477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd698d-7e51-4c90-a925-16b1c223e76e None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:18.033872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd698d-7e51-4c90-a925-16b1c223e76e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:18.034286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd698d-7e51-4c90-a925-16b1c223e76e None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/users/7348bece61b448488b3b2cc1f96ba25d/roles/480e35452fc547e0a2917bdd5b782f7d` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:18.036701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd698d-7e51-4c90-a925-16b1c223e76e None admin] RBAC: Authorizing `identity:create_grant(project_id=41f0c6987ff94c9cb442a42b28d9f386, user_id=7348bece61b448488b3b2cc1f96ba25d, role_id=480e35452fc547e0a2917bdd5b782f7d)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:18.038341 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd698d-7e51-4c90-a925-16b1c223e76e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:18.044710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd575b5-b02c-4017-9749-165b42c2279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:18.045680 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd575b5-b02c-4017-9749-165b42c2279d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:18.045969 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd575b5-b02c-4017-9749-165b42c2279d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:18.046247 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd575b5-b02c-4017-9749-165b42c2279d None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:18.049183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd575b5-b02c-4017-9749-165b42c2279d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:18.049183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd575b5-b02c-4017-9749-165b42c2279d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:18.049183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd575b5-b02c-4017-9749-165b42c2279d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:18.062635 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 57/126] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:45:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:18.062635 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd575b5-b02c-4017-9749-165b42c2279d None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:18.069540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:18.128857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 70/127] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:45:17 2022] PUT /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/users/7348bece61b448488b3b2cc1f96ba25d/roles/480e35452fc547e0a2917bdd5b782f7d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:18.130135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd698d-7e51-4c90-a925-16b1c223e76e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:18.170766 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd575b5-b02c-4017-9749-165b42c2279d None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:18.211631 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf30d7c-dd77-4f8a-b0b0-61258a1788e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:18.212951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf30d7c-dd77-4f8a-b0b0-61258a1788e7 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:18.213467 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf30d7c-dd77-4f8a-b0b0-61258a1788e7 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:18.213978 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf30d7c-dd77-4f8a-b0b0-61258a1788e7 None admin] PATH_INFO: `/v3/users/0115c93aedec4927ac7fba856583ae0c` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:18.229308 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf30d7c-dd77-4f8a-b0b0-61258a1788e7 None admin] RBAC: Authorizing `identity:get_user(user_id=0115c93aedec4927ac7fba856583ae0c)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:18.231153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf30d7c-dd77-4f8a-b0b0-61258a1788e7 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:18.233216 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 58/128] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:18 2022] GET /identity/v3/users/0115c93aedec4927ac7fba856583ae0c => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:18.234322 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf30d7c-dd77-4f8a-b0b0-61258a1788e7 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:18.274144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd698d-7e51-4c90-a925-16b1c223e76e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:18.306987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:18.318996 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd246a-2198-465f-8bad-64c8d1bd38e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:18.320516 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd246a-2198-465f-8bad-64c8d1bd38e4 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:18.320818 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd246a-2198-465f-8bad-64c8d1bd38e4 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:18.321103 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd246a-2198-465f-8bad-64c8d1bd38e4 None admin] PATH_INFO: `/v3/users/3ed428cb56e14e89a5927b411a660345` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:18.322423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd246a-2198-465f-8bad-64c8d1bd38e4 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed428cb56e14e89a5927b411a660345)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:18.324083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd246a-2198-465f-8bad-64c8d1bd38e4 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:18.326505 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 71/129] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:18 2022] GET /identity/v3/users/3ed428cb56e14e89a5927b411a660345 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:18.327388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd246a-2198-465f-8bad-64c8d1bd38e4 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:18.406859 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:18.457375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd246a-2198-465f-8bad-64c8d1bd38e4 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:18.481095 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf30d7c-dd77-4f8a-b0b0-61258a1788e7 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:18.501176 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f8b13-db4e-43d7-9746-ef95c39cbee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:18.501861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f8b13-db4e-43d7-9746-ef95c39cbee3 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:18.502272 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f8b13-db4e-43d7-9746-ef95c39cbee3 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:18.502634 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f8b13-db4e-43d7-9746-ef95c39cbee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:18.531850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c39af-67b0-48b6-bfec-058d70220d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:18.532933 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c39af-67b0-48b6-bfec-058d70220d1e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:18.533666 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c39af-67b0-48b6-bfec-058d70220d1e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:18.533957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c39af-67b0-48b6-bfec-058d70220d1e None admin] PATH_INFO: `/v3/users/3ed428cb56e14e89a5927b411a660345` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:18.535860 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c39af-67b0-48b6-bfec-058d70220d1e None admin] RBAC: Authorizing `identity:get_user(user_id=3ed428cb56e14e89a5927b411a660345)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:18.538100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c39af-67b0-48b6-bfec-058d70220d1e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:18.541023 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 59/130] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:18 2022] GET /identity/v3/users/3ed428cb56e14e89a5927b411a660345 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:18.541637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c39af-67b0-48b6-bfec-058d70220d1e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:18.610271 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:18.631707 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f8b13-db4e-43d7-9746-ef95c39cbee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:18.633217 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f8b13-db4e-43d7-9746-ef95c39cbee3 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:18.688487 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c39af-67b0-48b6-bfec-058d70220d1e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:18.737076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:18.744654 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a33b3-594e-4e36-8442-cad20dd57ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:18.749270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a33b3-594e-4e36-8442-cad20dd57ade None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:18.749270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a33b3-594e-4e36-8442-cad20dd57ade None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:18.749270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a33b3-594e-4e36-8442-cad20dd57ade None admin] PATH_INFO: `/v3/projects/9a542347dd33478fa691b3f9464c57ae` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:18.749270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a33b3-594e-4e36-8442-cad20dd57ade None admin] RBAC: Authorizing `identity:get_project(project_id=9a542347dd33478fa691b3f9464c57ae)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:18.750754 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a33b3-594e-4e36-8442-cad20dd57ade None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:18.753572 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 60/131] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:18 2022] GET /identity/v3/projects/9a542347dd33478fa691b3f9464c57ae => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:18.754261 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a33b3-594e-4e36-8442-cad20dd57ade None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:18.798417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 72/132] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:18.799540 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af44a4-c8c5-4d51-980d-1146adb8087b None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:18.799885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af44a4-c8c5-4d51-980d-1146adb8087b None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:18.800110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af44a4-c8c5-4d51-980d-1146adb8087b None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:18.801507 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 73/133] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:18.802929 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af44a4-c8c5-4d51-980d-1146adb8087b None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:18.870421 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a33b3-594e-4e36-8442-cad20dd57ade None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:18.908539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a983-9168-4f45-bb8d-1a43e4c3552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:18.910009 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a983-9168-4f45-bb8d-1a43e4c3552d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:18.910684 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a983-9168-4f45-bb8d-1a43e4c3552d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:18.911205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a983-9168-4f45-bb8d-1a43e4c3552d None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:18.912668 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185a983-9168-4f45-bb8d-1a43e4c3552d None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:18.914584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185a983-9168-4f45-bb8d-1a43e4c3552d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:18.922091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 61/134] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:18 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:18.923549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:18.924661 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2aa4-dc50-4b97-90f6-415d21d4f644 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:18.925250 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2aa4-dc50-4b97-90f6-415d21d4f644 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:18.925748 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2aa4-dc50-4b97-90f6-415d21d4f644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:18.931301 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af44a4-c8c5-4d51-980d-1146adb8087b None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:18.944427 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-b04f2aa4-dc50-4b97-90f6-415d21d4f644 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:18.946072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-b04f2aa4-dc50-4b97-90f6-415d21d4f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:18.970251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e18fc-9a21-4e89-be30-34fd39ca6463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:18.971198 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e18fc-9a21-4e89-be30-34fd39ca6463 None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:18.971483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e18fc-9a21-4e89-be30-34fd39ca6463 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:18.971761 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e18fc-9a21-4e89-be30-34fd39ca6463 None admin] PATH_INFO: `/v3/projects/9a542347dd33478fa691b3f9464c57ae/users/3ed428cb56e14e89a5927b411a660345/roles/b6aef1054c2f43a693e82eb19749d60b` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:18.973932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e18fc-9a21-4e89-be30-34fd39ca6463 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a542347dd33478fa691b3f9464c57ae, user_id=3ed428cb56e14e89a5927b411a660345, role_id=b6aef1054c2f43a693e82eb19749d60b)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:18.975411 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e18fc-9a21-4e89-be30-34fd39ca6463 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:19.021106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:19.027319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 62/135] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:19.028155 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f2aa4-dc50-4b97-90f6-415d21d4f644 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:19.062012 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 74/136] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:45:18 2022] PUT /identity/v3/projects/9a542347dd33478fa691b3f9464c57ae/users/3ed428cb56e14e89a5927b411a660345/roles/b6aef1054c2f43a693e82eb19749d60b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:19.063130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e18fc-9a21-4e89-be30-34fd39ca6463 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:19.198385 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e18fc-9a21-4e89-be30-34fd39ca6463 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:19.224417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f2aa4-dc50-4b97-90f6-415d21d4f644 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:19.243610 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f4075-55ae-4f17-b617-74a89261bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:19.244537 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f4075-55ae-4f17-b617-74a89261bfc9 None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:19.249267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f4075-55ae-4f17-b617-74a89261bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:19.249267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f4075-55ae-4f17-b617-74a89261bfc9 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/users/3ed428cb56e14e89a5927b411a660345/roles/715071b6b1244a559110be37cc8410ab` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:19.249267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f4075-55ae-4f17-b617-74a89261bfc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=41f0c6987ff94c9cb442a42b28d9f386, user_id=3ed428cb56e14e89a5927b411a660345, role_id=715071b6b1244a559110be37cc8410ab)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:19.250419 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f4075-55ae-4f17-b617-74a89261bfc9 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:19.286648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ed012-c98a-47a6-a18d-430d499e816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:19.287608 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed012-c98a-47a6-a18d-430d499e816e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:19.287900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed012-c98a-47a6-a18d-430d499e816e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:19.288184 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed012-c98a-47a6-a18d-430d499e816e None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:19.289519 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ed012-c98a-47a6-a18d-430d499e816e None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:19.291066 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ed012-c98a-47a6-a18d-430d499e816e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:19.293153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 63/137] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:19 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:19.293952 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ed012-c98a-47a6-a18d-430d499e816e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:19.344457 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 75/138] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:45:19 2022] PUT /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/users/3ed428cb56e14e89a5927b411a660345/roles/715071b6b1244a559110be37cc8410ab => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:19.345333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f4075-55ae-4f17-b617-74a89261bfc9 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:19.382441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:19.408603 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:19.458505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ed012-c98a-47a6-a18d-430d499e816e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:19.520121 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdadf51-df7c-4458-9ac4-8195d1115c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:19.520980 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdadf51-df7c-4458-9ac4-8195d1115c29 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:19.521272 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdadf51-df7c-4458-9ac4-8195d1115c29 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:19.521612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdadf51-df7c-4458-9ac4-8195d1115c29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:19.538867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdadf51-df7c-4458-9ac4-8195d1115c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-5bdadf51-df7c-4458-9ac4-8195d1115c29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:19.548138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:19.549336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:19.550292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 64/139] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:19.555889 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdadf51-df7c-4458-9ac4-8195d1115c29 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:19.634559 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f4075-55ae-4f17-b617-74a89261bfc9 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:19.708054 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdadf51-df7c-4458-9ac4-8195d1115c29 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:19.720905 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81f1fc-b58b-44c4-ad47-9ee4cd1fc6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:19.721592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81f1fc-b58b-44c4-ad47-9ee4cd1fc6e3 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:19.721880 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81f1fc-b58b-44c4-ad47-9ee4cd1fc6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:19.722163 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81f1fc-b58b-44c4-ad47-9ee4cd1fc6e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:19.723058 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81f1fc-b58b-44c4-ad47-9ee4cd1fc6e3 None admin] RBAC: Adding query filter params (role.id=429fffc185ca46c6a104c64d4325c366, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386, user.id=0115c93aedec4927ac7fba856583ae0c) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:19.723377 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81f1fc-b58b-44c4-ad47-9ee4cd1fc6e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:19.724860 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81f1fc-b58b-44c4-ad47-9ee4cd1fc6e3 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:19.740605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 76/140] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:19 2022] GET /identity/v3/role_assignments?user.id=0115c93aedec4927ac7fba856583ae0c&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=429fffc185ca46c6a104c64d4325c366 => generated 259 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:19.744094 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2c4ff-a0c8-45ee-bc38-7788c5db86c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:19.744791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2c4ff-a0c8-45ee-bc38-7788c5db86c6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:19.745077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2c4ff-a0c8-45ee-bc38-7788c5db86c6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:19.745359 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2c4ff-a0c8-45ee-bc38-7788c5db86c6 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:19.746123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2c4ff-a0c8-45ee-bc38-7788c5db86c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:19.746433 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2c4ff-a0c8-45ee-bc38-7788c5db86c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:19.748491 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2c4ff-a0c8-45ee-bc38-7788c5db86c6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:19.750336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:19.759249 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 65/141] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:19.767765 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81f1fc-b58b-44c4-ad47-9ee4cd1fc6e3 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:19.890928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da335d-8157-4001-ad81-8a7110722228 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:19.891531 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da335d-8157-4001-ad81-8a7110722228 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:19.891531 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da335d-8157-4001-ad81-8a7110722228 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:19.892817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 66/142] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:45:19.901759 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30847ffb-39ca-4535-952c-e9b92c480d29 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:19.902094 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30847ffb-39ca-4535-952c-e9b92c480d29 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:19.902358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30847ffb-39ca-4535-952c-e9b92c480d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:19.912507 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:19.932216 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-30847ffb-39ca-4535-952c-e9b92c480d29 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:19.933721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-30847ffb-39ca-4535-952c-e9b92c480d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:19.953907 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81f1fc-b58b-44c4-ad47-9ee4cd1fc6e3 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:20.007093 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9d756-de47-45e6-8588-a6592a2e5ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:20.007985 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9d756-de47-45e6-8588-a6592a2e5ad3 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:20.008281 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9d756-de47-45e6-8588-a6592a2e5ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:20.008548 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9d756-de47-45e6-8588-a6592a2e5ad3 None admin] PATH_INFO: `/v3/users/3ed428cb56e14e89a5927b411a660345` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:20.009795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9d756-de47-45e6-8588-a6592a2e5ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed428cb56e14e89a5927b411a660345)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:20.011606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9d756-de47-45e6-8588-a6592a2e5ad3 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:20.013814 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 77/143] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:19 2022] GET /identity/v3/users/3ed428cb56e14e89a5927b411a660345 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:20.020046 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9d756-de47-45e6-8588-a6592a2e5ad3 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:20.061598 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 67/144] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:20.090559 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30847ffb-39ca-4535-952c-e9b92c480d29 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:20.127769 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9d756-de47-45e6-8588-a6592a2e5ad3 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:20.176402 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0708f7f-2121-4123-8a29-737637d88d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:20.176992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708f7f-2121-4123-8a29-737637d88d6d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:20.177281 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708f7f-2121-4123-8a29-737637d88d6d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:20.177564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0708f7f-2121-4123-8a29-737637d88d6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:20.195705 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:20.241450 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30847ffb-39ca-4535-952c-e9b92c480d29 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:20.250636 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0708f7f-2121-4123-8a29-737637d88d6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:20.252255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0708f7f-2121-4123-8a29-737637d88d6d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:20.271010 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:20.307998 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b223c0-c99c-43a6-9eb3-841c3be104b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:20.309623 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b223c0-c99c-43a6-9eb3-841c3be104b9 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:20.310758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b223c0-c99c-43a6-9eb3-841c3be104b9 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:20.311271 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b223c0-c99c-43a6-9eb3-841c3be104b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:20.316855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b223c0-c99c-43a6-9eb3-841c3be104b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:20.318709 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b223c0-c99c-43a6-9eb3-841c3be104b9 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:20.321061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 68/145] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:20.326944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b223c0-c99c-43a6-9eb3-841c3be104b9 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:20.372337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 78/146] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:45:20.378988 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0708f7f-2121-4123-8a29-737637d88d6d None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:20.439128 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:20.503752 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0708f7f-2121-4123-8a29-737637d88d6d None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:20.531411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b223c0-c99c-43a6-9eb3-841c3be104b9 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:20.546715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f6c4d-3c35-4f5c-a91f-eb5af2b09f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:20.547458 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6c4d-3c35-4f5c-a91f-eb5af2b09f0f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:20.547748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6c4d-3c35-4f5c-a91f-eb5af2b09f0f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:20.548030 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6c4d-3c35-4f5c-a91f-eb5af2b09f0f None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:20.549280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f6c4d-3c35-4f5c-a91f-eb5af2b09f0f None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:20.551761 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f6c4d-3c35-4f5c-a91f-eb5af2b09f0f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:20.554352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 79/147] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:20 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:20.560098 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f6c4d-3c35-4f5c-a91f-eb5af2b09f0f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:20.596429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825e913-1869-4a7f-88c7-ae3b53fe5888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:20.597597 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825e913-1869-4a7f-88c7-ae3b53fe5888 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:20.598095 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825e913-1869-4a7f-88c7-ae3b53fe5888 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:20.598594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825e913-1869-4a7f-88c7-ae3b53fe5888 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:20.599586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825e913-1869-4a7f-88c7-ae3b53fe5888 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:20.601432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825e913-1869-4a7f-88c7-ae3b53fe5888 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:20.673368 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f6c4d-3c35-4f5c-a91f-eb5af2b09f0f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:20.689881 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:20.713952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdda072-a4fa-460b-bc60-68bd13b5783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:20.714653 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda072-a4fa-460b-bc60-68bd13b5783a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:20.714949 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda072-a4fa-460b-bc60-68bd13b5783a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:20.715229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda072-a4fa-460b-bc60-68bd13b5783a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:20.716639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdda072-a4fa-460b-bc60-68bd13b5783a None admin] RBAC: Adding query filter params (role.id=b6aef1054c2f43a693e82eb19749d60b, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386, user.id=3ed428cb56e14e89a5927b411a660345) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:20.716961 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdda072-a4fa-460b-bc60-68bd13b5783a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:20.718541 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdda072-a4fa-460b-bc60-68bd13b5783a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:20.725984 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 80/148] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:20 2022] GET /identity/v3/role_assignments?user.id=3ed428cb56e14e89a5927b411a660345&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:20.735321 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 69/149] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:45:20 2022] POST /identity/v3/users => generated 283 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:45:21.343538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e4005-8f41-4ad7-aa72-61b8fc9bc44f None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:21.344249 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e4005-8f41-4ad7-aa72-61b8fc9bc44f None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:21.344773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e4005-8f41-4ad7-aa72-61b8fc9bc44f None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:21.346920 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 81/150] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:21.352690 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90f78-bfa8-4f2d-9681-966d89f5486e None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:21.353226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90f78-bfa8-4f2d-9681-966d89f5486e None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:21.353226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90f78-bfa8-4f2d-9681-966d89f5486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:21.373908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-e8b90f78-bfa8-4f2d-9681-966d89f5486e None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:21.375155 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-e8b90f78-bfa8-4f2d-9681-966d89f5486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:21.416552 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:21.455654 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 70/151] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:21.482176 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e4005-8f41-4ad7-aa72-61b8fc9bc44f None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:21.604344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e4005-8f41-4ad7-aa72-61b8fc9bc44f None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:21.645336 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968e754-b841-4e82-bdc0-71fe31348a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:21.646145 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968e754-b841-4e82-bdc0-71fe31348a29 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:21.646427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968e754-b841-4e82-bdc0-71fe31348a29 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:21.646736 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968e754-b841-4e82-bdc0-71fe31348a29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:21.660025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968e754-b841-4e82-bdc0-71fe31348a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-7968e754-b841-4e82-bdc0-71fe31348a29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:21.667952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:21.669024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:21.670991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 82/152] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:45:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:21.675919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b90f78-bfa8-4f2d-9681-966d89f5486e None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:21.791219 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b90f78-bfa8-4f2d-9681-966d89f5486e None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:21.833216 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0249554-cbdd-4ad8-8fdf-e930088ea164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:21.833902 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0249554-cbdd-4ad8-8fdf-e930088ea164 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:21.834189 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0249554-cbdd-4ad8-8fdf-e930088ea164 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:21.834467 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0249554-cbdd-4ad8-8fdf-e930088ea164 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:21.835269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0249554-cbdd-4ad8-8fdf-e930088ea164 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:21.835584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0249554-cbdd-4ad8-8fdf-e930088ea164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:21.836996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0249554-cbdd-4ad8-8fdf-e930088ea164 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:21.849363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 71/153] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:21.855337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968e754-b841-4e82-bdc0-71fe31348a29 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:21.907543 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:21.979817 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968e754-b841-4e82-bdc0-71fe31348a29 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:22.016393 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7842e-92ed-4603-9094-3c9a58274595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:22.017289 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7842e-92ed-4603-9094-3c9a58274595 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:22.017574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7842e-92ed-4603-9094-3c9a58274595 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:22.017853 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7842e-92ed-4603-9094-3c9a58274595 None admin] PATH_INFO: `/v3/users/7348bece61b448488b3b2cc1f96ba25d` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:22.019148 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7842e-92ed-4603-9094-3c9a58274595 None admin] RBAC: Authorizing `identity:get_user(user_id=7348bece61b448488b3b2cc1f96ba25d)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:22.020640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7842e-92ed-4603-9094-3c9a58274595 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:22.022762 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 83/154] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:21 2022] GET /identity/v3/users/7348bece61b448488b3b2cc1f96ba25d => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:22.030164 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0249554-cbdd-4ad8-8fdf-e930088ea164 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:22.086179 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:22.179041 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0249554-cbdd-4ad8-8fdf-e930088ea164 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:22.227775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195a6a3-20d3-4006-8c42-8bf3ea9d3991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:22.228477 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195a6a3-20d3-4006-8c42-8bf3ea9d3991 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:22.228766 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195a6a3-20d3-4006-8c42-8bf3ea9d3991 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:22.229046 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195a6a3-20d3-4006-8c42-8bf3ea9d3991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:22.329304 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195a6a3-20d3-4006-8c42-8bf3ea9d3991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:22.330869 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195a6a3-20d3-4006-8c42-8bf3ea9d3991 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:22.380259 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:22.473234 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 72/155] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:22.479126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7842e-92ed-4603-9094-3c9a58274595 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:22.480244 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec9f6e-c5fb-43d0-b7ad-a590d63d7c68 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:22.480516 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec9f6e-c5fb-43d0-b7ad-a590d63d7c68 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:22.480851 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec9f6e-c5fb-43d0-b7ad-a590d63d7c68 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:22.482439 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 73/156] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:22.488347 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6f82c-5a56-482b-92b9-f2957d6fa149 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:22.488637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6f82c-5a56-482b-92b9-f2957d6fa149 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:22.488917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6f82c-5a56-482b-92b9-f2957d6fa149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:22.518224 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-82c6f82c-5a56-482b-92b9-f2957d6fa149 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:22.519510 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-82c6f82c-5a56-482b-92b9-f2957d6fa149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:22.612309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7842e-92ed-4603-9094-3c9a58274595 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:22.620757 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:22.653708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441bd77-5c9e-49ca-8663-27a4b09136e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:22.654539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 74/157] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:22.654996 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bd77-5c9e-49ca-8663-27a4b09136e6 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:22.655290 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bd77-5c9e-49ca-8663-27a4b09136e6 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:22.655573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bd77-5c9e-49ca-8663-27a4b09136e6 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:22.656938 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441bd77-5c9e-49ca-8663-27a4b09136e6 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:22.657201 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3ca9f-d13b-4e7a-a889-aa1203914674 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:22.657684 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3ca9f-d13b-4e7a-a889-aa1203914674 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:22.658150 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3ca9f-d13b-4e7a-a889-aa1203914674 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:22.658403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441bd77-5c9e-49ca-8663-27a4b09136e6 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:22.660223 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 75/158] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:22.664795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 84/159] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:22 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:22.666165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fb1f1-8f4b-421c-9b9f-3ed794c8abcc None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:22.666517 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441bd77-5c9e-49ca-8663-27a4b09136e6 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:22.666965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fb1f1-8f4b-421c-9b9f-3ed794c8abcc None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:22.667466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fb1f1-8f4b-421c-9b9f-3ed794c8abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:22.689841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-592fb1f1-8f4b-421c-9b9f-3ed794c8abcc None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:22.691793 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-592fb1f1-8f4b-421c-9b9f-3ed794c8abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:22.801728 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441bd77-5c9e-49ca-8663-27a4b09136e6 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:22.802868 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:22.820690 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 76/160] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:22.821360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fb1f1-8f4b-421c-9b9f-3ed794c8abcc None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:22.845504 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdeef0-df5a-4c53-b9ac-b2a7c3ac836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:22.846673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdeef0-df5a-4c53-b9ac-b2a7c3ac836e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:22.847188 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdeef0-df5a-4c53-b9ac-b2a7c3ac836e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:22.847771 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdeef0-df5a-4c53-b9ac-b2a7c3ac836e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:22.848856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdeef0-df5a-4c53-b9ac-b2a7c3ac836e None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386, user.id=7348bece61b448488b3b2cc1f96ba25d) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:22.849406 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdeef0-df5a-4c53-b9ac-b2a7c3ac836e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:22.851331 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdeef0-df5a-4c53-b9ac-b2a7c3ac836e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:22.859477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 85/161] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:22 2022] GET /identity/v3/role_assignments?user.id=7348bece61b448488b3b2cc1f96ba25d&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:22.864634 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdeef0-df5a-4c53-b9ac-b2a7c3ac836e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:22.917836 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:22.994214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdeef0-df5a-4c53-b9ac-b2a7c3ac836e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:23.065474 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b11814-cc5c-4951-b75e-8c2727c983ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:23.066453 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11814-cc5c-4951-b75e-8c2727c983ef None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:23.066866 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11814-cc5c-4951-b75e-8c2727c983ef None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:23.067293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11814-cc5c-4951-b75e-8c2727c983ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:23.107903 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b11814-cc5c-4951-b75e-8c2727c983ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-e6b11814-cc5c-4951-b75e-8c2727c983ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:23.116479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:23.117821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:23.119014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 86/162] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:45:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:45:23.127694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b11814-cc5c-4951-b75e-8c2727c983ef None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:23.132391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fb1f1-8f4b-421c-9b9f-3ed794c8abcc None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:23.220747 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dc99e-a0b5-4ab1-8fe5-3247c7c5f12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:23.221587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dc99e-a0b5-4ab1-8fe5-3247c7c5f12e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:23.221874 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dc99e-a0b5-4ab1-8fe5-3247c7c5f12e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:23.222222 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dc99e-a0b5-4ab1-8fe5-3247c7c5f12e None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:23.237194 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dc99e-a0b5-4ab1-8fe5-3247c7c5f12e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-f52dc99e-a0b5-4ab1-8fe5-3247c7c5f12e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:23.246263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:23.249909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 77/163] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:23.250886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148b5dd-1f78-4757-967d-dc372ec210ed None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:23.251839 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148b5dd-1f78-4757-967d-dc372ec210ed None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:23.251839 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148b5dd-1f78-4757-967d-dc372ec210ed None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:23.252646 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 78/164] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:23.258333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148b5dd-1f78-4757-967d-dc372ec210ed None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:23.333377 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:23.376773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:23.382699 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b11814-cc5c-4951-b75e-8c2727c983ef None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:23.389581 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148b5dd-1f78-4757-967d-dc372ec210ed None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:23.428465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66327d32-de7a-4032-a9e4-19aa6c20d95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:23.429161 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327d32-de7a-4032-a9e4-19aa6c20d95a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:23.429452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327d32-de7a-4032-a9e4-19aa6c20d95a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:23.429737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327d32-de7a-4032-a9e4-19aa6c20d95a None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:23.430509 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66327d32-de7a-4032-a9e4-19aa6c20d95a None admin] RBAC: Adding query filter params (name=member) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:23.430866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66327d32-de7a-4032-a9e4-19aa6c20d95a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:23.432486 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66327d32-de7a-4032-a9e4-19aa6c20d95a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:23.442806 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 79/165] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:23.444125 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa3f9-bb57-4cd3-b76e-f22a809b5b4e None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:23.444416 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa3f9-bb57-4cd3-b76e-f22a809b5b4e None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:23.444698 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa3f9-bb57-4cd3-b76e-f22a809b5b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:23.464230 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-b14fa3f9-bb57-4cd3-b76e-f22a809b5b4e None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:23.465586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-b14fa3f9-bb57-4cd3-b76e-f22a809b5b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:23.490211 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ad5ed-7faa-4fa7-b4d3-ad95b56f4f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:23.491014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ad5ed-7faa-4fa7-b4d3-ad95b56f4f0e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:23.491307 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ad5ed-7faa-4fa7-b4d3-ad95b56f4f0e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:23.491585 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ad5ed-7faa-4fa7-b4d3-ad95b56f4f0e None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:23.492375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ad5ed-7faa-4fa7-b4d3-ad95b56f4f0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:23.492773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ad5ed-7faa-4fa7-b4d3-ad95b56f4f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:23.494232 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ad5ed-7faa-4fa7-b4d3-ad95b56f4f0e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:23.520728 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 87/166] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:45:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:23.521653 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ad5ed-7faa-4fa7-b4d3-ad95b56f4f0e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:23.551427 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 80/167] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:23.552464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa3f9-bb57-4cd3-b76e-f22a809b5b4e None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:23.610233 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:23.686782 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa3f9-bb57-4cd3-b76e-f22a809b5b4e None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:23.741036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ad5ed-7faa-4fa7-b4d3-ad95b56f4f0e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:23.753303 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce52c0-cb95-4226-8b00-f3ff7b373650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:23.754201 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce52c0-cb95-4226-8b00-f3ff7b373650 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:23.754484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce52c0-cb95-4226-8b00-f3ff7b373650 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:23.754788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce52c0-cb95-4226-8b00-f3ff7b373650 None admin] PATH_INFO: `/v3/users/3ed428cb56e14e89a5927b411a660345` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:23.757927 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce52c0-cb95-4226-8b00-f3ff7b373650 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed428cb56e14e89a5927b411a660345)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:23.759443 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce52c0-cb95-4226-8b00-f3ff7b373650 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:23.761131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 81/168] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:23 2022] GET /identity/v3/users/3ed428cb56e14e89a5927b411a660345 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:23.764517 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce52c0-cb95-4226-8b00-f3ff7b373650 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:23.815357 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2402748-aa35-42ed-830e-609028a36b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:23.816242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2402748-aa35-42ed-830e-609028a36b3c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:23.816525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2402748-aa35-42ed-830e-609028a36b3c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:23.816797 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2402748-aa35-42ed-830e-609028a36b3c None admin] PATH_INFO: `/v3/users/3ed428cb56e14e89a5927b411a660345` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:23.818715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2402748-aa35-42ed-830e-609028a36b3c None admin] RBAC: Authorizing `identity:get_user(user_id=3ed428cb56e14e89a5927b411a660345)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:23.820185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2402748-aa35-42ed-830e-609028a36b3c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:23.821869 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 88/169] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:23 2022] GET /identity/v3/users/3ed428cb56e14e89a5927b411a660345 => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:23.826446 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2402748-aa35-42ed-830e-609028a36b3c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:23.890993 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:23.960515 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce52c0-cb95-4226-8b00-f3ff7b373650 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:23.965723 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2402748-aa35-42ed-830e-609028a36b3c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:23.992714 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:24.002463 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021dc8-17b7-49a8-8fd7-5266084f97be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:24.003227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021dc8-17b7-49a8-8fd7-5266084f97be None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:24.003510 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021dc8-17b7-49a8-8fd7-5266084f97be None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:24.004145 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021dc8-17b7-49a8-8fd7-5266084f97be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:24.041832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1787e-f124-4ad3-8169-e9edcfa80f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:24.041832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1787e-f124-4ad3-8169-e9edcfa80f77 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:24.041832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1787e-f124-4ad3-8169-e9edcfa80f77 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:24.042219 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1787e-f124-4ad3-8169-e9edcfa80f77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:24.071813 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1787e-f124-4ad3-8169-e9edcfa80f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-6ac1787e-f124-4ad3-8169-e9edcfa80f77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:24.080405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:24.081527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:24.082473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:24.083261 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0021dc8-17b7-49a8-8fd7-5266084f97be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:24.083852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0021dc8-17b7-49a8-8fd7-5266084f97be None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:24.091118 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 82/170] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:24.092077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1787e-f124-4ad3-8169-e9edcfa80f77 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:24.135017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:24.197198 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 89/171] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:24.198420 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021dc8-17b7-49a8-8fd7-5266084f97be None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:24.329729 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021dc8-17b7-49a8-8fd7-5266084f97be None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:24.349464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1787e-f124-4ad3-8169-e9edcfa80f77 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:24.382999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:24.399233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67418ff8-8865-40ef-a590-4a2317667d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:24.400024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67418ff8-8865-40ef-a590-4a2317667d3f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:24.400211 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67418ff8-8865-40ef-a590-4a2317667d3f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:24.400450 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67418ff8-8865-40ef-a590-4a2317667d3f None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:24.401216 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67418ff8-8865-40ef-a590-4a2317667d3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:24.401522 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67418ff8-8865-40ef-a590-4a2317667d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:24.402930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67418ff8-8865-40ef-a590-4a2317667d3f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:24.421966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 90/172] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:24.422897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67418ff8-8865-40ef-a590-4a2317667d3f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:24.423904 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746333d6-8eee-4cc3-88be-775cf47efe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:24.424697 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746333d6-8eee-4cc3-88be-775cf47efe8a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:24.425021 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746333d6-8eee-4cc3-88be-775cf47efe8a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:24.425296 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746333d6-8eee-4cc3-88be-775cf47efe8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:24.526073 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:24.579389 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746333d6-8eee-4cc3-88be-775cf47efe8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:24.584346 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746333d6-8eee-4cc3-88be-775cf47efe8a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:24.593093 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67418ff8-8865-40ef-a590-4a2317667d3f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:24.652420 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b675556-7290-4edc-a5c0-703f450473af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:24.653311 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675556-7290-4edc-a5c0-703f450473af None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:24.654174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675556-7290-4edc-a5c0-703f450473af None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:24.654454 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675556-7290-4edc-a5c0-703f450473af None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:24.655714 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b675556-7290-4edc-a5c0-703f450473af None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:24.657191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b675556-7290-4edc-a5c0-703f450473af None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:24.659017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 91/173] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:24 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:24.659796 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b675556-7290-4edc-a5c0-703f450473af None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:24.734660 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 83/174] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:24.735562 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746333d6-8eee-4cc3-88be-775cf47efe8a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:24.735932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:24.795684 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b675556-7290-4edc-a5c0-703f450473af None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:24.816968 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:24.842342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989dc68-21f3-4959-9dde-e078657fa523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:24.843324 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989dc68-21f3-4959-9dde-e078657fa523 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:24.843608 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989dc68-21f3-4959-9dde-e078657fa523 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:24.843886 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989dc68-21f3-4959-9dde-e078657fa523 None admin] PATH_INFO: `/v3/users/0115c93aedec4927ac7fba856583ae0c` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:24.845299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989dc68-21f3-4959-9dde-e078657fa523 None admin] RBAC: Authorizing `identity:get_user(user_id=0115c93aedec4927ac7fba856583ae0c)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:24.846807 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989dc68-21f3-4959-9dde-e078657fa523 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:24.848814 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 92/175] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:24 2022] GET /identity/v3/users/0115c93aedec4927ac7fba856583ae0c => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:24.849896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989dc68-21f3-4959-9dde-e078657fa523 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:24.854131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746333d6-8eee-4cc3-88be-775cf47efe8a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:24.907739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667d89c-8515-4dbf-ad7f-a33cf1e93f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:24.908983 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667d89c-8515-4dbf-ad7f-a33cf1e93f4b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:24.909513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667d89c-8515-4dbf-ad7f-a33cf1e93f4b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:24.910212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667d89c-8515-4dbf-ad7f-a33cf1e93f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:24.911769 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667d89c-8515-4dbf-ad7f-a33cf1e93f4b None admin] RBAC: Adding query filter params (role.id=715071b6b1244a559110be37cc8410ab, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386, user.id=3ed428cb56e14e89a5927b411a660345) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:24.912530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667d89c-8515-4dbf-ad7f-a33cf1e93f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:24.914845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667d89c-8515-4dbf-ad7f-a33cf1e93f4b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:24.925079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 84/176] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:24 2022] GET /identity/v3/role_assignments?user.id=3ed428cb56e14e89a5927b411a660345&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=715071b6b1244a559110be37cc8410ab => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:24.927458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cecd6d-4904-4e20-9501-5626f58ccae5 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:24.928006 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cecd6d-4904-4e20-9501-5626f58ccae5 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:24.928524 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cecd6d-4904-4e20-9501-5626f58ccae5 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:24.930151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 85/177] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:24.931359 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cecd6d-4904-4e20-9501-5626f58ccae5 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:25.053386 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989dc68-21f3-4959-9dde-e078657fa523 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:25.102438 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:25.114914 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8550a-8ec2-4a63-be10-ba5b4f9d76ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:25.115941 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8550a-8ec2-4a63-be10-ba5b4f9d76ca None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.127011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8550a-8ec2-4a63-be10-ba5b4f9d76ca None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.127011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8550a-8ec2-4a63-be10-ba5b4f9d76ca None admin] PATH_INFO: `/v3/projects/9a542347dd33478fa691b3f9464c57ae` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.127011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8550a-8ec2-4a63-be10-ba5b4f9d76ca None admin] RBAC: Authorizing `identity:get_project(project_id=9a542347dd33478fa691b3f9464c57ae)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:25.127011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8550a-8ec2-4a63-be10-ba5b4f9d76ca None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:25.127011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 93/178] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:24 2022] GET /identity/v3/projects/9a542347dd33478fa691b3f9464c57ae => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:25.127011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49a0dd-2e20-4d33-af01-3558f81add79 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.127504 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49a0dd-2e20-4d33-af01-3558f81add79 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.127504 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49a0dd-2e20-4d33-af01-3558f81add79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.136976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cecd6d-4904-4e20-9501-5626f58ccae5 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:25.147561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-5f49a0dd-2e20-4d33-af01-3558f81add79 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:25.149159 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-5f49a0dd-2e20-4d33-af01-3558f81add79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:25.178246 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c58f94-ad06-4387-864f-5505230673f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:25.179183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c58f94-ad06-4387-864f-5505230673f5 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.179468 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c58f94-ad06-4387-864f-5505230673f5 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.179969 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c58f94-ad06-4387-864f-5505230673f5 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.180954 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c58f94-ad06-4387-864f-5505230673f5 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:25.182407 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c58f94-ad06-4387-864f-5505230673f5 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:25.184653 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 86/179] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:24 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:25.186371 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682eaa0-c335-499d-82fa-f17f8adf7b59 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.186580 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682eaa0-c335-499d-82fa-f17f8adf7b59 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.186860 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682eaa0-c335-499d-82fa-f17f8adf7b59 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.188583 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 87/180] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:25.189100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682eaa0-c335-499d-82fa-f17f8adf7b59 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:25.200779 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:25.246774 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 94/181] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:25.249768 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49a0dd-2e20-4d33-af01-3558f81add79 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:25.319990 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682eaa0-c335-499d-82fa-f17f8adf7b59 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:25.363153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c168b4-9b55-44cd-b312-3564c1387e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:25.363660 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c168b4-9b55-44cd-b312-3564c1387e49 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.363919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c168b4-9b55-44cd-b312-3564c1387e49 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.364192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c168b4-9b55-44cd-b312-3564c1387e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.365024 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c168b4-9b55-44cd-b312-3564c1387e49 None admin] RBAC: Adding query filter params (role.id=b6aef1054c2f43a693e82eb19749d60b, scope.project.id=9a542347dd33478fa691b3f9464c57ae, user.id=3ed428cb56e14e89a5927b411a660345) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:25.365803 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c168b4-9b55-44cd-b312-3564c1387e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:25.367255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c168b4-9b55-44cd-b312-3564c1387e49 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:25.380670 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 88/182] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:25 2022] GET /identity/v3/role_assignments?user.id=3ed428cb56e14e89a5927b411a660345&scope.project.id=9a542347dd33478fa691b3f9464c57ae&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:25.380670 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27fa94-89d9-4e92-a1ca-2c6d1a5c3997 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.380670 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27fa94-89d9-4e92-a1ca-2c6d1a5c3997 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.380670 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27fa94-89d9-4e92-a1ca-2c6d1a5c3997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.389203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49a0dd-2e20-4d33-af01-3558f81add79 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:25.395004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-4d27fa94-89d9-4e92-a1ca-2c6d1a5c3997 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:25.396621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-4d27fa94-89d9-4e92-a1ca-2c6d1a5c3997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:25.418544 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:25.439250 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6b237-a42d-4def-8676-42fe46c7a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:25.440694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6b237-a42d-4def-8676-42fe46c7a123 None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.440995 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6b237-a42d-4def-8676-42fe46c7a123 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.441333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6b237-a42d-4def-8676-42fe46c7a123 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/users/0115c93aedec4927ac7fba856583ae0c/roles/429fffc185ca46c6a104c64d4325c366` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.443944 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6b237-a42d-4def-8676-42fe46c7a123 None admin] RBAC: Authorizing `identity:create_grant(project_id=41f0c6987ff94c9cb442a42b28d9f386, user_id=0115c93aedec4927ac7fba856583ae0c, role_id=429fffc185ca46c6a104c64d4325c366)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:25.446751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6b237-a42d-4def-8676-42fe46c7a123 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:25.482115 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:25.487784 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 89/183] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:25.488886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27fa94-89d9-4e92-a1ca-2c6d1a5c3997 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:25.523917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 95/184] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:45:25 2022] PUT /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/users/0115c93aedec4927ac7fba856583ae0c/roles/429fffc185ca46c6a104c64d4325c366 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:25.524791 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6b237-a42d-4def-8676-42fe46c7a123 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:25.675225 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6b237-a42d-4def-8676-42fe46c7a123 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:25.682159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27fa94-89d9-4e92-a1ca-2c6d1a5c3997 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:25.724023 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d966b3-d42e-4e10-8205-4c56bf38ae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:25.725360 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d966b3-d42e-4e10-8205-4c56bf38ae23 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.725895 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d966b3-d42e-4e10-8205-4c56bf38ae23 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.726401 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d966b3-d42e-4e10-8205-4c56bf38ae23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.727944 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d966b3-d42e-4e10-8205-4c56bf38ae23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:25.728406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dcf9f-0f14-44b2-b94c-d685589bec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:25.729212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dcf9f-0f14-44b2-b94c-d685589bec8b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.729412 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d966b3-d42e-4e10-8205-4c56bf38ae23 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:25.729529 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dcf9f-0f14-44b2-b94c-d685589bec8b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.729749 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dcf9f-0f14-44b2-b94c-d685589bec8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.732392 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 96/185] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:25.737614 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdc83e-6d49-4cf2-b921-069737caeec6 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.737912 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdc83e-6d49-4cf2-b921-069737caeec6 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.738249 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdc83e-6d49-4cf2-b921-069737caeec6 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.739640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 97/186] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:25.740352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdc83e-6d49-4cf2-b921-069737caeec6 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:25.744692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dcf9f-0f14-44b2-b94c-d685589bec8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-ae6dcf9f-0f14-44b2-b94c-d685589bec8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:25.753357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:25.754739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:25.755908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 90/187] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:45:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:25.756916 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee592d-4aae-497a-b254-75fdd47e501c None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.756916 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee592d-4aae-497a-b254-75fdd47e501c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.756916 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee592d-4aae-497a-b254-75fdd47e501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.774887 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-c6ee592d-4aae-497a-b254-75fdd47e501c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:25.776075 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-c6ee592d-4aae-497a-b254-75fdd47e501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:25.815027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:25.839907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:25.853621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 91/188] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:25.854458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee592d-4aae-497a-b254-75fdd47e501c None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:25.867309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdc83e-6d49-4cf2-b921-069737caeec6 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:25.905613 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb074ef-1fd7-4f9a-9c35-e12af480d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:25.906297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb074ef-1fd7-4f9a-9c35-e12af480d4fa None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:25.906581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb074ef-1fd7-4f9a-9c35-e12af480d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:25.906890 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb074ef-1fd7-4f9a-9c35-e12af480d4fa None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:25.907761 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb074ef-1fd7-4f9a-9c35-e12af480d4fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:25.909217 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb074ef-1fd7-4f9a-9c35-e12af480d4fa None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:25.968121 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee592d-4aae-497a-b254-75fdd47e501c None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:26.001250 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed2aae-57f9-4781-a74b-082ce613178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:26.001919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed2aae-57f9-4781-a74b-082ce613178c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:26.002200 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed2aae-57f9-4781-a74b-082ce613178c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:26.002478 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed2aae-57f9-4781-a74b-082ce613178c None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:26.003329 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed2aae-57f9-4781-a74b-082ce613178c None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:26.003709 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed2aae-57f9-4781-a74b-082ce613178c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:26.005602 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed2aae-57f9-4781-a74b-082ce613178c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:26.022697 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 98/190] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:45:25 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:45:26.022951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 92/190] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:26.023110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb074ef-1fd7-4f9a-9c35-e12af480d4fa None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:26.031424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed2aae-57f9-4781-a74b-082ce613178c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:26.111699 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:26.148967 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb074ef-1fd7-4f9a-9c35-e12af480d4fa None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:26.160194 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:26.184923 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed2aae-57f9-4781-a74b-082ce613178c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:26.187846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e82ba-1fab-4b9c-b790-44787d3b466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:26.188814 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e82ba-1fab-4b9c-b790-44787d3b466c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:26.189174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e82ba-1fab-4b9c-b790-44787d3b466c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:26.189529 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e82ba-1fab-4b9c-b790-44787d3b466c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:26.204898 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e82ba-1fab-4b9c-b790-44787d3b466c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-6d6e82ba-1fab-4b9c-b790-44787d3b466c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:26.213566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:26.214930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:26.216695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:26.217701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 99/191] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:45:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:26.222845 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e82ba-1fab-4b9c-b790-44787d3b466c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:26.242511 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa478fe-7645-4bd0-8a16-1699a5dc8edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:26.244454 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa478fe-7645-4bd0-8a16-1699a5dc8edf None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:26.244454 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa478fe-7645-4bd0-8a16-1699a5dc8edf None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:26.244865 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa478fe-7645-4bd0-8a16-1699a5dc8edf None admin] PATH_INFO: `/v3/users/ed2e8460f2b2417b89425058958efd06` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:26.264766 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa478fe-7645-4bd0-8a16-1699a5dc8edf None admin] RBAC: Authorizing `identity:get_user(user_id=ed2e8460f2b2417b89425058958efd06)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:26.266284 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa478fe-7645-4bd0-8a16-1699a5dc8edf None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:26.274519 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 93/192] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:26 2022] GET /identity/v3/users/ed2e8460f2b2417b89425058958efd06 => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:26.274519 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa478fe-7645-4bd0-8a16-1699a5dc8edf None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:26.356046 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e82ba-1fab-4b9c-b790-44787d3b466c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:26.406159 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b7e75-5af5-4527-aa51-201c60a5e96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:26.407319 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7e75-5af5-4527-aa51-201c60a5e96c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:26.407833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7e75-5af5-4527-aa51-201c60a5e96c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:26.408312 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7e75-5af5-4527-aa51-201c60a5e96c None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:26.409404 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b7e75-5af5-4527-aa51-201c60a5e96c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:26.409984 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b7e75-5af5-4527-aa51-201c60a5e96c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:26.411788 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b7e75-5af5-4527-aa51-201c60a5e96c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:26.421925 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 100/193] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:45:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:26.426525 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa478fe-7645-4bd0-8a16-1699a5dc8edf None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:26.427687 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b7e75-5af5-4527-aa51-201c60a5e96c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:26.443380 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:26.472964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:26.476673 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64697f91-45d5-47a1-96ba-a33c3921d402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:26.476673 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697f91-45d5-47a1-96ba-a33c3921d402 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:26.476673 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697f91-45d5-47a1-96ba-a33c3921d402 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:26.476987 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697f91-45d5-47a1-96ba-a33c3921d402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:26.558332 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64697f91-45d5-47a1-96ba-a33c3921d402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:26.560745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64697f91-45d5-47a1-96ba-a33c3921d402 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:26.565676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b7e75-5af5-4527-aa51-201c60a5e96c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:26.614998 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97990c14-f461-41bb-bc10-1bc69434f8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:26.615888 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97990c14-f461-41bb-bc10-1bc69434f8e0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:26.616171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97990c14-f461-41bb-bc10-1bc69434f8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:26.616444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97990c14-f461-41bb-bc10-1bc69434f8e0 None admin] PATH_INFO: `/v3/users/ed2e8460f2b2417b89425058958efd06` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:26.619090 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97990c14-f461-41bb-bc10-1bc69434f8e0 None admin] RBAC: Authorizing `identity:get_user(user_id=ed2e8460f2b2417b89425058958efd06)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:26.620553 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97990c14-f461-41bb-bc10-1bc69434f8e0 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:26.627039 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 101/194] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:26 2022] GET /identity/v3/users/ed2e8460f2b2417b89425058958efd06 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:26.632809 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97990c14-f461-41bb-bc10-1bc69434f8e0 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:26.683858 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 94/195] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:26.693878 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64697f91-45d5-47a1-96ba-a33c3921d402 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:26.715052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:26.820600 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:26.826696 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97990c14-f461-41bb-bc10-1bc69434f8e0 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:26.850884 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64697f91-45d5-47a1-96ba-a33c3921d402 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:26.870353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c737d93-245c-4acc-a281-d1e9b1627aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:26.871841 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c737d93-245c-4acc-a281-d1e9b1627aaa None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:26.872408 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c737d93-245c-4acc-a281-d1e9b1627aaa None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:26.872900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c737d93-245c-4acc-a281-d1e9b1627aaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:26.929870 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d62c7-fdaa-4cb7-ab4e-bb35cee71e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:26.930793 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d62c7-fdaa-4cb7-ab4e-bb35cee71e5f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:26.931080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d62c7-fdaa-4cb7-ab4e-bb35cee71e5f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:26.931422 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d62c7-fdaa-4cb7-ab4e-bb35cee71e5f None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:26.932875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d62c7-fdaa-4cb7-ab4e-bb35cee71e5f None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:26.934651 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d62c7-fdaa-4cb7-ab4e-bb35cee71e5f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:26.936405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 95/196] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:26 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:26.946802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d62c7-fdaa-4cb7-ab4e-bb35cee71e5f None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:26.985629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c737d93-245c-4acc-a281-d1e9b1627aaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:26.987159 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c737d93-245c-4acc-a281-d1e9b1627aaa None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:27.089610 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:27.125915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d62c7-fdaa-4cb7-ab4e-bb35cee71e5f None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:27.177323 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:27.185596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 102/197] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:45:27.188144 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a847c-f430-45d3-a8d3-e259e7cf9987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:27.188829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a847c-f430-45d3-a8d3-e259e7cf9987 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:27.189852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c737d93-245c-4acc-a281-d1e9b1627aaa None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:27.192177 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a847c-f430-45d3-a8d3-e259e7cf9987 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:27.192463 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a847c-f430-45d3-a8d3-e259e7cf9987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:27.193330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a847c-f430-45d3-a8d3-e259e7cf9987 None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd, user.id=ed2e8460f2b2417b89425058958efd06) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:27.193653 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a847c-f430-45d3-a8d3-e259e7cf9987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:27.196033 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a847c-f430-45d3-a8d3-e259e7cf9987 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:27.210729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 96/198] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:26 2022] GET /identity/v3/role_assignments?user.id=ed2e8460f2b2417b89425058958efd06&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:27.386717 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c737d93-245c-4acc-a281-d1e9b1627aaa None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:27.435566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704e2d4-ccf7-486a-8b30-88f794045dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:27.436446 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e2d4-ccf7-486a-8b30-88f794045dab None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:27.436727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e2d4-ccf7-486a-8b30-88f794045dab None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:27.437071 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e2d4-ccf7-486a-8b30-88f794045dab None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:27.438359 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704e2d4-ccf7-486a-8b30-88f794045dab None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:27.439875 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704e2d4-ccf7-486a-8b30-88f794045dab None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:27.441649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 103/199] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:27 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:27.447570 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a847c-f430-45d3-a8d3-e259e7cf9987 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:27.572613 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a847c-f430-45d3-a8d3-e259e7cf9987 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:27.619025 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be2183-1b88-4601-ae22-16e271bab561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:27.619703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be2183-1b88-4601-ae22-16e271bab561 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:27.620052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be2183-1b88-4601-ae22-16e271bab561 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:27.620339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be2183-1b88-4601-ae22-16e271bab561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:27.621239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be2183-1b88-4601-ae22-16e271bab561 None admin] RBAC: Adding query filter params (role.id=715071b6b1244a559110be37cc8410ab, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd, user.id=ed2e8460f2b2417b89425058958efd06) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:27.621564 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be2183-1b88-4601-ae22-16e271bab561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:27.623167 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be2183-1b88-4601-ae22-16e271bab561 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:27.635413 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 97/200] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:27 2022] GET /identity/v3/role_assignments?user.id=ed2e8460f2b2417b89425058958efd06&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=715071b6b1244a559110be37cc8410ab => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:28.058125 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee8f7-8049-4839-8498-ac6859cdfa8e None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:28.058671 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee8f7-8049-4839-8498-ac6859cdfa8e None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:28.058780 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee8f7-8049-4839-8498-ac6859cdfa8e None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:28.060403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 104/201] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:28.065937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a263751-546d-40ad-860a-af43c78271ab None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:28.066239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a263751-546d-40ad-860a-af43c78271ab None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:28.066526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a263751-546d-40ad-860a-af43c78271ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:28.085115 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:28.093059 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-6a263751-546d-40ad-860a-af43c78271ab None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:28.094301 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-6a263751-546d-40ad-860a-af43c78271ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:28.200008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 98/202] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:28.235825 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ee8f7-8049-4839-8498-ac6859cdfa8e None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:28.316691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:28.372246 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ee8f7-8049-4839-8498-ac6859cdfa8e None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:28.416223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c097e21-35cd-4df7-a778-25fd2196f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:28.417096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097e21-35cd-4df7-a778-25fd2196f92a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:28.417381 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097e21-35cd-4df7-a778-25fd2196f92a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:28.417652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097e21-35cd-4df7-a778-25fd2196f92a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:28.431099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c097e21-35cd-4df7-a778-25fd2196f92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-3c097e21-35cd-4df7-a778-25fd2196f92a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:28.439367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:28.440467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:28.441449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 105/203] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:28.446422 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a263751-546d-40ad-860a-af43c78271ab None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:28.567801 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a263751-546d-40ad-860a-af43c78271ab None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:28.613655 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7bcd5-c858-4b24-b219-28dc2a068095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:28.614353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7bcd5-c858-4b24-b219-28dc2a068095 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:28.614598 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7bcd5-c858-4b24-b219-28dc2a068095 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:28.614897 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7bcd5-c858-4b24-b219-28dc2a068095 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:28.615655 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7bcd5-c858-4b24-b219-28dc2a068095 None admin] RBAC: Adding query filter params (name=reader) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:28.615961 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7bcd5-c858-4b24-b219-28dc2a068095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:28.617346 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7bcd5-c858-4b24-b219-28dc2a068095 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:28.622697 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:28.630012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 99/204] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:28.638894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c097e21-35cd-4df7-a778-25fd2196f92a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:28.776562 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c097e21-35cd-4df7-a778-25fd2196f92a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:28.806919 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:28.816627 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cfd5e-bae9-4a50-901d-e2053e0bc6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:28.817509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cfd5e-bae9-4a50-901d-e2053e0bc6b7 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:28.817916 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cfd5e-bae9-4a50-901d-e2053e0bc6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:28.818138 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cfd5e-bae9-4a50-901d-e2053e0bc6b7 None admin] PATH_INFO: `/v3/users/0115c93aedec4927ac7fba856583ae0c` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:28.819376 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cfd5e-bae9-4a50-901d-e2053e0bc6b7 None admin] RBAC: Authorizing `identity:get_user(user_id=0115c93aedec4927ac7fba856583ae0c)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:28.826666 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cfd5e-bae9-4a50-901d-e2053e0bc6b7 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:28.826666 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 106/205] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:28 2022] GET /identity/v3/users/0115c93aedec4927ac7fba856583ae0c => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:28.831777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7bcd5-c858-4b24-b219-28dc2a068095 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:28.949965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7bcd5-c858-4b24-b219-28dc2a068095 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:28.991445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23c59f-62ba-4c5b-b2d3-c35dbed44d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:28.992526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23c59f-62ba-4c5b-b2d3-c35dbed44d67 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:28.993039 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23c59f-62ba-4c5b-b2d3-c35dbed44d67 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:28.993531 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23c59f-62ba-4c5b-b2d3-c35dbed44d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:29.050264 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf06e7e-06fb-40f3-8e81-c50c77c1f3ea None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:29.050544 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf06e7e-06fb-40f3-8e81-c50c77c1f3ea None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:29.050865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf06e7e-06fb-40f3-8e81-c50c77c1f3ea None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:29.052515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 107/206] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:29.060947 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8aac-8e81-407c-8a75-59fdecaf670f None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:29.061579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8aac-8e81-407c-8a75-59fdecaf670f None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:29.061579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8aac-8e81-407c-8a75-59fdecaf670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:29.079710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:29.084356 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23c59f-62ba-4c5b-b2d3-c35dbed44d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:29.086133 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23c59f-62ba-4c5b-b2d3-c35dbed44d67 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:29.094815 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-780e8aac-8e81-407c-8a75-59fdecaf670f None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:29.101161 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-780e8aac-8e81-407c-8a75-59fdecaf670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:29.198121 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 100/207] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:29.204007 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23c59f-62ba-4c5b-b2d3-c35dbed44d67 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:29.261452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 108/208] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:29.300774 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e8aac-8e81-407c-8a75-59fdecaf670f None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:29.313018 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:29.318049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23c59f-62ba-4c5b-b2d3-c35dbed44d67 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:29.360518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9634f-ef10-4e87-acc5-2bea1d9985b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:29.361761 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9634f-ef10-4e87-acc5-2bea1d9985b3 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:29.362260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9634f-ef10-4e87-acc5-2bea1d9985b3 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:29.362834 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9634f-ef10-4e87-acc5-2bea1d9985b3 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:29.364457 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9634f-ef10-4e87-acc5-2bea1d9985b3 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:29.366178 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9634f-ef10-4e87-acc5-2bea1d9985b3 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:29.368598 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 101/209] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:29 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:29.374294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9634f-ef10-4e87-acc5-2bea1d9985b3 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:29.511422 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9634f-ef10-4e87-acc5-2bea1d9985b3 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:29.534784 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e8aac-8e81-407c-8a75-59fdecaf670f None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:29.556461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e38e0-ec63-4d6a-8416-68a4e34e7560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:29.557575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e38e0-ec63-4d6a-8416-68a4e34e7560 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:29.558101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e38e0-ec63-4d6a-8416-68a4e34e7560 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:29.558637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e38e0-ec63-4d6a-8416-68a4e34e7560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:29.560137 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e38e0-ec63-4d6a-8416-68a4e34e7560 None admin] RBAC: Adding query filter params (role.id=429fffc185ca46c6a104c64d4325c366, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386, user.id=0115c93aedec4927ac7fba856583ae0c) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:29.560767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e38e0-ec63-4d6a-8416-68a4e34e7560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:29.562428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e38e0-ec63-4d6a-8416-68a4e34e7560 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:29.567345 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:29.571147 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 102/210] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:29 2022] GET /identity/v3/role_assignments?user.id=0115c93aedec4927ac7fba856583ae0c&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=429fffc185ca46c6a104c64d4325c366 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:29.589933 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb23a73-f1dc-4f2a-acae-f988ce7e50bf None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:29.590598 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb23a73-f1dc-4f2a-acae-f988ce7e50bf None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:29.591894 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb23a73-f1dc-4f2a-acae-f988ce7e50bf None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:29.594036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 103/211] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:29.599687 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa3c24-e544-4828-b2f9-d6ebe7f6d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:29.600525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa3c24-e544-4828-b2f9-d6ebe7f6d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:29.600837 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0c5ae-be67-4f98-9a29-5ff711455f33 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:29.600975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa3c24-e544-4828-b2f9-d6ebe7f6d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:29.601211 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa3c24-e544-4828-b2f9-d6ebe7f6d3a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:29.601713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0c5ae-be67-4f98-9a29-5ff711455f33 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:29.602229 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0c5ae-be67-4f98-9a29-5ff711455f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:29.605031 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa3c24-e544-4828-b2f9-d6ebe7f6d3a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:29.609565 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa3c24-e544-4828-b2f9-d6ebe7f6d3a0 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:29.609565 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 109/212] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:29.614574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa3c24-e544-4828-b2f9-d6ebe7f6d3a0 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:29.641256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-f6f0c5ae-be67-4f98-9a29-5ff711455f33 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:29.644366 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-f6f0c5ae-be67-4f98-9a29-5ff711455f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:29.692270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:29.756957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 104/213] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:29.796780 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa3c24-e544-4828-b2f9-d6ebe7f6d3a0 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:29.810247 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0c5ae-be67-4f98-9a29-5ff711455f33 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:29.839938 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080a24b-0388-42b1-afa1-1297ef80d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:29.840638 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080a24b-0388-42b1-afa1-1297ef80d49c None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:29.841561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080a24b-0388-42b1-afa1-1297ef80d49c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:29.841846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080a24b-0388-42b1-afa1-1297ef80d49c None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:29.842596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080a24b-0388-42b1-afa1-1297ef80d49c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:29.844147 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080a24b-0388-42b1-afa1-1297ef80d49c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:29.954094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 110/214] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:45:29 2022] POST /identity/v3/users => generated 297 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:45:29.965320 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0c5ae-be67-4f98-9a29-5ff711455f33 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:30.021415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718f12d-9ded-457d-ab53-8242f7fa9c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:30.022777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718f12d-9ded-457d-ab53-8242f7fa9c3d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:30.023324 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718f12d-9ded-457d-ab53-8242f7fa9c3d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:30.023884 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718f12d-9ded-457d-ab53-8242f7fa9c3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:30.051743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718f12d-9ded-457d-ab53-8242f7fa9c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-2718f12d-9ded-457d-ab53-8242f7fa9c3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:30.063682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:30.065269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:30.066553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 105/215] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:45:30.074319 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080a24b-0388-42b1-afa1-1297ef80d49c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:30.131733 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:30.198379 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080a24b-0388-42b1-afa1-1297ef80d49c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:30.211442 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4725db7-ee18-40d4-9640-8e577e7e0c2d None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:30.211631 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4725db7-ee18-40d4-9640-8e577e7e0c2d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:30.211909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4725db7-ee18-40d4-9640-8e577e7e0c2d None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:30.213311 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 106/216] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:30.219716 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0563be-9b24-44a5-a0b1-45d3c0fad293 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:30.220015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0563be-9b24-44a5-a0b1-45d3c0fad293 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:30.220282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0563be-9b24-44a5-a0b1-45d3c0fad293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:30.237310 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901c976-0630-4317-9e22-c610d1ae47c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:30.237997 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901c976-0630-4317-9e22-c610d1ae47c8 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:30.238283 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901c976-0630-4317-9e22-c610d1ae47c8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:30.238560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901c976-0630-4317-9e22-c610d1ae47c8 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:30.239359 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901c976-0630-4317-9e22-c610d1ae47c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:30.239672 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901c976-0630-4317-9e22-c610d1ae47c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:30.240040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-1c0563be-9b24-44a5-a0b1-45d3c0fad293 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:30.241091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901c976-0630-4317-9e22-c610d1ae47c8 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:30.241270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-1c0563be-9b24-44a5-a0b1-45d3c0fad293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:30.252023 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 111/217] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:30.258815 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901c976-0630-4317-9e22-c610d1ae47c8 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:30.267804 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:30.406705 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 107/218] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:30.408152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200b914-db0d-43fd-86c2-620d19d24d6a None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:30.408452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200b914-db0d-43fd-86c2-620d19d24d6a None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:30.408736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200b914-db0d-43fd-86c2-620d19d24d6a None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:30.410072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 108/219] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:30.415897 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a2cb9-654a-42ad-a415-b2600219dda3 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:30.416186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a2cb9-654a-42ad-a415-b2600219dda3 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:30.416469 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a2cb9-654a-42ad-a415-b2600219dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:30.436381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-6d8a2cb9-654a-42ad-a415-b2600219dda3 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:30.437580 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-6d8a2cb9-654a-42ad-a415-b2600219dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:30.439462 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901c976-0630-4317-9e22-c610d1ae47c8 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:30.452720 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:30.477985 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999ceb2-29f6-4cc5-8aad-eba71f1d8ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:30.478941 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999ceb2-29f6-4cc5-8aad-eba71f1d8ff1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:30.479229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999ceb2-29f6-4cc5-8aad-eba71f1d8ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:30.479515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999ceb2-29f6-4cc5-8aad-eba71f1d8ff1 None admin] PATH_INFO: `/v3/users/d3046814eacc4adaa14d384cb53fabe0` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:30.500957 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999ceb2-29f6-4cc5-8aad-eba71f1d8ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=d3046814eacc4adaa14d384cb53fabe0)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:30.502530 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999ceb2-29f6-4cc5-8aad-eba71f1d8ff1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:30.504510 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 112/220] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:30 2022] GET /identity/v3/users/d3046814eacc4adaa14d384cb53fabe0 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:30.505412 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999ceb2-29f6-4cc5-8aad-eba71f1d8ff1 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:30.523547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 109/221] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:30.524878 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a2cb9-654a-42ad-a415-b2600219dda3 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:30.625205 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999ceb2-29f6-4cc5-8aad-eba71f1d8ff1 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:30.635813 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:30.661993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a2cb9-654a-42ad-a415-b2600219dda3 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:30.662653 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe5131-96e8-4385-bac5-0b3c8a833ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:30.663783 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe5131-96e8-4385-bac5-0b3c8a833ea4 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:30.664133 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe5131-96e8-4385-bac5-0b3c8a833ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:30.664532 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe5131-96e8-4385-bac5-0b3c8a833ea4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:30.678170 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe5131-96e8-4385-bac5-0b3c8a833ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-24fe5131-96e8-4385-bac5-0b3c8a833ea4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:30.687773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:30.688896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:30.690091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 113/222] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:45:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:30.692070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe5131-96e8-4385-bac5-0b3c8a833ea4 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:30.707316 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1dde6-81aa-49bc-a78d-9f420ab0a16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:30.708906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1dde6-81aa-49bc-a78d-9f420ab0a16f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:30.709193 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1dde6-81aa-49bc-a78d-9f420ab0a16f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:30.709466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1dde6-81aa-49bc-a78d-9f420ab0a16f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:30.738425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:30.789204 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1dde6-81aa-49bc-a78d-9f420ab0a16f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:30.790855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1dde6-81aa-49bc-a78d-9f420ab0a16f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:30.827198 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe5131-96e8-4385-bac5-0b3c8a833ea4 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:30.863167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf250-0113-4b12-b835-f02cdd6ed685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:30.864368 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf250-0113-4b12-b835-f02cdd6ed685 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:30.864875 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf250-0113-4b12-b835-f02cdd6ed685 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:30.865387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf250-0113-4b12-b835-f02cdd6ed685 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:30.877178 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bf250-0113-4b12-b835-f02cdd6ed685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:30.881271 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-e81bf250-0113-4b12-b835-f02cdd6ed685 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:30.885708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:30.886847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:30.887899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:30.890861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 114/223] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:45:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:30.892004 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf250-0113-4b12-b835-f02cdd6ed685 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:30.908265 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 110/224] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:30.913005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1dde6-81aa-49bc-a78d-9f420ab0a16f None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:30.997983 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:31.010771 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf250-0113-4b12-b835-f02cdd6ed685 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:31.022118 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1dde6-81aa-49bc-a78d-9f420ab0a16f None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:31.049383 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d565d-82e5-4492-ac1c-12306db377e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:31.050460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d565d-82e5-4492-ac1c-12306db377e5 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:31.051037 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d565d-82e5-4492-ac1c-12306db377e5 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:31.051534 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d565d-82e5-4492-ac1c-12306db377e5 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:31.052553 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d565d-82e5-4492-ac1c-12306db377e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:31.053087 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d565d-82e5-4492-ac1c-12306db377e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:31.054732 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d565d-82e5-4492-ac1c-12306db377e5 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:31.063339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef62d53-b048-4cfd-aae7-c929aba1020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:31.064241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62d53-b048-4cfd-aae7-c929aba1020a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:31.064706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62d53-b048-4cfd-aae7-c929aba1020a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:31.065130 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62d53-b048-4cfd-aae7-c929aba1020a None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:31.065505 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 115/225] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:45:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:31.066238 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef62d53-b048-4cfd-aae7-c929aba1020a None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:31.066677 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d565d-82e5-4492-ac1c-12306db377e5 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:31.066902 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef62d53-b048-4cfd-aae7-c929aba1020a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:31.068619 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef62d53-b048-4cfd-aae7-c929aba1020a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:31.078521 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 111/226] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:31.084385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef62d53-b048-4cfd-aae7-c929aba1020a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:31.132577 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:31.180388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d565d-82e5-4492-ac1c-12306db377e5 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:31.197463 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef62d53-b048-4cfd-aae7-c929aba1020a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:31.217261 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42fd07-d5bd-45b8-a158-4fa7d5cbe92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:31.218313 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42fd07-d5bd-45b8-a158-4fa7d5cbe92c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:31.218790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42fd07-d5bd-45b8-a158-4fa7d5cbe92c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:31.219177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42fd07-d5bd-45b8-a158-4fa7d5cbe92c None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:31.220509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42fd07-d5bd-45b8-a158-4fa7d5cbe92c None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:31.222137 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42fd07-d5bd-45b8-a158-4fa7d5cbe92c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:31.224177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 116/227] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:31 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:31.229653 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42fd07-d5bd-45b8-a158-4fa7d5cbe92c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:31.237064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e2187-8f51-44d5-bf5e-5a3539531889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:31.238158 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2187-8f51-44d5-bf5e-5a3539531889 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:31.238695 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2187-8f51-44d5-bf5e-5a3539531889 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:31.239184 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2187-8f51-44d5-bf5e-5a3539531889 None admin] PATH_INFO: `/v3/users/ed2e8460f2b2417b89425058958efd06` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:31.240623 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e2187-8f51-44d5-bf5e-5a3539531889 None admin] RBAC: Authorizing `identity:get_user(user_id=ed2e8460f2b2417b89425058958efd06)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:31.242324 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e2187-8f51-44d5-bf5e-5a3539531889 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:31.244566 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 112/228] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:31 2022] GET /identity/v3/users/ed2e8460f2b2417b89425058958efd06 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:31.245499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e2187-8f51-44d5-bf5e-5a3539531889 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:31.254705 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:31.339536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42fd07-d5bd-45b8-a158-4fa7d5cbe92c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:31.356776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e2187-8f51-44d5-bf5e-5a3539531889 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:31.368046 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:31.381504 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c99a3-9904-4166-9d68-32254c7561de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:31.383129 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c99a3-9904-4166-9d68-32254c7561de None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:31.383632 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c99a3-9904-4166-9d68-32254c7561de None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:31.384333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c99a3-9904-4166-9d68-32254c7561de None admin] PATH_INFO: `/v3/users/ed2e8460f2b2417b89425058958efd06` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:31.392193 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c99a3-9904-4166-9d68-32254c7561de None admin] RBAC: Authorizing `identity:get_user(user_id=ed2e8460f2b2417b89425058958efd06)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:31.392193 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c99a3-9904-4166-9d68-32254c7561de None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:31.392193 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 117/229] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:31 2022] GET /identity/v3/users/ed2e8460f2b2417b89425058958efd06 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:31.395344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c99a3-9904-4166-9d68-32254c7561de None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:31.399692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88ccb7-5c52-4102-92b2-f9db9aa56744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:31.401269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88ccb7-5c52-4102-92b2-f9db9aa56744 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:31.401559 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88ccb7-5c52-4102-92b2-f9db9aa56744 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:31.401844 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88ccb7-5c52-4102-92b2-f9db9aa56744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:31.402742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88ccb7-5c52-4102-92b2-f9db9aa56744 None admin] RBAC: Adding query filter params (role.id=b6aef1054c2f43a693e82eb19749d60b, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd, user.id=d3046814eacc4adaa14d384cb53fabe0) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:31.403065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88ccb7-5c52-4102-92b2-f9db9aa56744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:31.405213 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88ccb7-5c52-4102-92b2-f9db9aa56744 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:31.414804 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 113/230] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:31 2022] GET /identity/v3/role_assignments?user.id=d3046814eacc4adaa14d384cb53fabe0&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:31.415667 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88ccb7-5c52-4102-92b2-f9db9aa56744 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:31.587924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:31.614097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88ccb7-5c52-4102-92b2-f9db9aa56744 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:31.636643 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c99a3-9904-4166-9d68-32254c7561de None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:31.663086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774c2f-8d4a-41bb-814a-8d5075d4d658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:31.664858 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774c2f-8d4a-41bb-814a-8d5075d4d658 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:31.666062 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774c2f-8d4a-41bb-814a-8d5075d4d658 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:31.666550 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774c2f-8d4a-41bb-814a-8d5075d4d658 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:31.669015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774c2f-8d4a-41bb-814a-8d5075d4d658 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:31.670880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774c2f-8d4a-41bb-814a-8d5075d4d658 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:31.675426 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 114/231] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:31 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:31.679747 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774c2f-8d4a-41bb-814a-8d5075d4d658 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:31.711975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f130d48-70d8-463d-acfb-7de1c29bfb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:31.712873 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f130d48-70d8-463d-acfb-7de1c29bfb15 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:31.713159 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f130d48-70d8-463d-acfb-7de1c29bfb15 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:31.713435 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f130d48-70d8-463d-acfb-7de1c29bfb15 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:31.719373 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f130d48-70d8-463d-acfb-7de1c29bfb15 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:31.720845 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f130d48-70d8-463d-acfb-7de1c29bfb15 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:31.722804 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 118/232] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:31 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:31.731554 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f130d48-70d8-463d-acfb-7de1c29bfb15 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:31.742943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:31.852524 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774c2f-8d4a-41bb-814a-8d5075d4d658 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:31.921899 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d109952-38e9-47da-b30d-48011b404f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:31.922847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d109952-38e9-47da-b30d-48011b404f47 None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:31.923133 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d109952-38e9-47da-b30d-48011b404f47 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:31.923412 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d109952-38e9-47da-b30d-48011b404f47 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/users/ed2e8460f2b2417b89425058958efd06/roles/480e35452fc547e0a2917bdd5b782f7d` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:31.927959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d109952-38e9-47da-b30d-48011b404f47 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd8ac35f2754b9eb5961500154e91bd, user_id=ed2e8460f2b2417b89425058958efd06, role_id=480e35452fc547e0a2917bdd5b782f7d)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:31.929422 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d109952-38e9-47da-b30d-48011b404f47 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:31.942362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f130d48-70d8-463d-acfb-7de1c29bfb15 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:31.980626 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf21ca-ec39-4240-9946-502abf1d22fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:31.982205 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf21ca-ec39-4240-9946-502abf1d22fb None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:31.982499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf21ca-ec39-4240-9946-502abf1d22fb None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:31.982812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf21ca-ec39-4240-9946-502abf1d22fb None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/users/ed2e8460f2b2417b89425058958efd06/roles/715071b6b1244a559110be37cc8410ab` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:31.985249 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf21ca-ec39-4240-9946-502abf1d22fb None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd8ac35f2754b9eb5961500154e91bd, user_id=ed2e8460f2b2417b89425058958efd06, role_id=715071b6b1244a559110be37cc8410ab)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:31.986911 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf21ca-ec39-4240-9946-502abf1d22fb None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:32.006325 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 115/233] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:45:31 2022] PUT /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/users/ed2e8460f2b2417b89425058958efd06/roles/480e35452fc547e0a2917bdd5b782f7d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:32.085952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 119/234] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:45:31 2022] PUT /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/users/ed2e8460f2b2417b89425058958efd06/roles/715071b6b1244a559110be37cc8410ab => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:32.577640 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d38db-9a57-44d4-a211-8f5eca890530 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:32.578311 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d38db-9a57-44d4-a211-8f5eca890530 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:32.578867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d38db-9a57-44d4-a211-8f5eca890530 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:32.580494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 116/235] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:32.585797 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bfec4-7548-4a4b-ad0d-ff73b5658e36 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:32.586726 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bfec4-7548-4a4b-ad0d-ff73b5658e36 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:32.587288 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bfec4-7548-4a4b-ad0d-ff73b5658e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:32.611660 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-3b9bfec4-7548-4a4b-ad0d-ff73b5658e36 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:32.613243 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-3b9bfec4-7548-4a4b-ad0d-ff73b5658e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:32.625024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:32.710595 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df4cec-74f9-49b5-9a73-27bb509954c2 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:32.711198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df4cec-74f9-49b5-9a73-27bb509954c2 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:32.711198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df4cec-74f9-49b5-9a73-27bb509954c2 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:32.711507 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 120/236] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:32.712767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 117/237] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:32.718119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091252cd-2fa9-49fb-8928-e2fe763e2251 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:32.718530 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091252cd-2fa9-49fb-8928-e2fe763e2251 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:32.718948 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091252cd-2fa9-49fb-8928-e2fe763e2251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:32.736941 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-091252cd-2fa9-49fb-8928-e2fe763e2251 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:32.738141 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-091252cd-2fa9-49fb-8928-e2fe763e2251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:32.748563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df4cec-74f9-49b5-9a73-27bb509954c2 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:32.839829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 121/238] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:32.874751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091252cd-2fa9-49fb-8928-e2fe763e2251 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:32.941229 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df4cec-74f9-49b5-9a73-27bb509954c2 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:32.943401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:33.006970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:33.010896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344042e-afdb-43a8-b738-371af11b1ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:33.011709 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344042e-afdb-43a8-b738-371af11b1ae8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:33.011996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344042e-afdb-43a8-b738-371af11b1ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:33.012271 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344042e-afdb-43a8-b738-371af11b1ae8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:33.033258 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344042e-afdb-43a8-b738-371af11b1ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-3344042e-afdb-43a8-b738-371af11b1ae8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:33.046237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:33.048022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:33.049013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 118/239] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:33.062795 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344042e-afdb-43a8-b738-371af11b1ae8 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:33.078028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091252cd-2fa9-49fb-8928-e2fe763e2251 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:33.139997 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f3840-8834-4525-b869-07c1e5c0824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:33.140807 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f3840-8834-4525-b869-07c1e5c0824a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:33.141089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f3840-8834-4525-b869-07c1e5c0824a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:33.141367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f3840-8834-4525-b869-07c1e5c0824a None admin] PATH_INFO: `/v3/domains/default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:33.146729 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f3840-8834-4525-b869-07c1e5c0824a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:33.148280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f3840-8834-4525-b869-07c1e5c0824a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:33.150639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 122/240] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:33.163740 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f3840-8834-4525-b869-07c1e5c0824a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:33.243186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344042e-afdb-43a8-b738-371af11b1ae8 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:33.280771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b66cd6-df04-4b9f-a561-f900816d705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:33.281515 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b66cd6-df04-4b9f-a561-f900816d705a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:33.281801 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b66cd6-df04-4b9f-a561-f900816d705a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:33.282124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b66cd6-df04-4b9f-a561-f900816d705a None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:33.282930 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b66cd6-df04-4b9f-a561-f900816d705a None admin] RBAC: Adding query filter params (name=reader) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:33.283242 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b66cd6-df04-4b9f-a561-f900816d705a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:33.284785 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b66cd6-df04-4b9f-a561-f900816d705a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:33.294966 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 119/241] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:33.306377 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b66cd6-df04-4b9f-a561-f900816d705a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:33.352200 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:33.364523 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f3840-8834-4525-b869-07c1e5c0824a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:33.436405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4d3fd-69d7-4caa-8723-bac7d786d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:33.437015 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4d3fd-69d7-4caa-8723-bac7d786d2cc None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:33.437303 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4d3fd-69d7-4caa-8723-bac7d786d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:33.437586 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4d3fd-69d7-4caa-8723-bac7d786d2cc None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:33.438323 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4d3fd-69d7-4caa-8723-bac7d786d2cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:33.439824 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4d3fd-69d7-4caa-8723-bac7d786d2cc None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:33.491255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b66cd6-df04-4b9f-a561-f900816d705a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:33.532984 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fda26-6fd9-40b9-8920-65b90b4b976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:33.541245 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 123/242] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:45:33 2022] POST /identity/v3/users => generated 293 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:45:33.541650 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:33.542122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fda26-6fd9-40b9-8920-65b90b4b976b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:33.542463 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fda26-6fd9-40b9-8920-65b90b4b976b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:33.542809 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fda26-6fd9-40b9-8920-65b90b4b976b None admin] PATH_INFO: `/v3/users/5279e924e59b453baf6876aada5f0af0` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:33.560563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fda26-6fd9-40b9-8920-65b90b4b976b None admin] RBAC: Authorizing `identity:get_user(user_id=5279e924e59b453baf6876aada5f0af0)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:33.562253 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fda26-6fd9-40b9-8920-65b90b4b976b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:33.564556 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 120/243] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:33 2022] GET /identity/v3/users/5279e924e59b453baf6876aada5f0af0 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:33.570247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4d3fd-69d7-4caa-8723-bac7d786d2cc None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:33.692527 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4d3fd-69d7-4caa-8723-bac7d786d2cc None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:33.733823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5b7d4-fc94-4576-8f49-7322600bcb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:33.734566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b7d4-fc94-4576-8f49-7322600bcb28 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:33.734901 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b7d4-fc94-4576-8f49-7322600bcb28 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:33.735185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b7d4-fc94-4576-8f49-7322600bcb28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:33.811823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:33.813019 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5b7d4-fc94-4576-8f49-7322600bcb28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:33.814755 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5b7d4-fc94-4576-8f49-7322600bcb28 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:33.921953 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 124/244] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:33.927745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fda26-6fd9-40b9-8920-65b90b4b976b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:34.023272 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:34.041713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fda26-6fd9-40b9-8920-65b90b4b976b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:34.079532 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ba5d9-49f4-4ae0-a07a-5f8e723a0dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:34.080412 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba5d9-49f4-4ae0-a07a-5f8e723a0dc0 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:34.080701 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba5d9-49f4-4ae0-a07a-5f8e723a0dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:34.080978 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba5d9-49f4-4ae0-a07a-5f8e723a0dc0 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:34.082215 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ba5d9-49f4-4ae0-a07a-5f8e723a0dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:34.083722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ba5d9-49f4-4ae0-a07a-5f8e723a0dc0 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:34.085824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 121/245] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:33 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:34.092239 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5b7d4-fc94-4576-8f49-7322600bcb28 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:34.155867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5626bb4-b574-489b-8407-67348526c196 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:34.156240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5626bb4-b574-489b-8407-67348526c196 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:34.156427 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5626bb4-b574-489b-8407-67348526c196 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:34.157817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 122/246] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:45:34.163162 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f00d-31f7-4035-86bc-0004de1fbe9a None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:34.163715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f00d-31f7-4035-86bc-0004de1fbe9a None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:34.164203 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f00d-31f7-4035-86bc-0004de1fbe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:34.184189 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-9a91f00d-31f7-4035-86bc-0004de1fbe9a None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:34.186059 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-9a91f00d-31f7-4035-86bc-0004de1fbe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:34.216373 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5b7d4-fc94-4576-8f49-7322600bcb28 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:34.219043 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:34.265917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d218bbd-5bbd-4866-9835-1ecf88a0ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:34.267747 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d218bbd-5bbd-4866-9835-1ecf88a0ac0d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:34.267747 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d218bbd-5bbd-4866-9835-1ecf88a0ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:34.267977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d218bbd-5bbd-4866-9835-1ecf88a0ac0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:34.268786 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d218bbd-5bbd-4866-9835-1ecf88a0ac0d None admin] RBAC: Adding query filter params (role.id=429fffc185ca46c6a104c64d4325c366, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd, user.id=5279e924e59b453baf6876aada5f0af0) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:34.269101 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d218bbd-5bbd-4866-9835-1ecf88a0ac0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:34.270778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d218bbd-5bbd-4866-9835-1ecf88a0ac0d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:34.274509 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 123/247] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:34.283704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 125/248] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:34 2022] GET /identity/v3/role_assignments?user.id=5279e924e59b453baf6876aada5f0af0&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=429fffc185ca46c6a104c64d4325c366 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:34.303830 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91f00d-31f7-4035-86bc-0004de1fbe9a None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:34.408740 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:34.434529 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91f00d-31f7-4035-86bc-0004de1fbe9a None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:34.476362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160c084-8ae5-4318-961f-3c55f967d5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:34.477183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160c084-8ae5-4318-961f-3c55f967d5d5 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:34.477465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160c084-8ae5-4318-961f-3c55f967d5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:34.477740 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160c084-8ae5-4318-961f-3c55f967d5d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:34.490968 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160c084-8ae5-4318-961f-3c55f967d5d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-d160c084-8ae5-4318-961f-3c55f967d5d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:34.499898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:34.501049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:34.502027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 124/249] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:34.511821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d218bbd-5bbd-4866-9835-1ecf88a0ac0d None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:34.640192 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d218bbd-5bbd-4866-9835-1ecf88a0ac0d None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:34.697123 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23032a-f5e5-436a-b031-f771fc86d94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:34.697826 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23032a-f5e5-436a-b031-f771fc86d94a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:34.698105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23032a-f5e5-436a-b031-f771fc86d94a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:34.698389 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23032a-f5e5-436a-b031-f771fc86d94a None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:34.699218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23032a-f5e5-436a-b031-f771fc86d94a None admin] RBAC: Adding query filter params (name=member) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:34.699534 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23032a-f5e5-436a-b031-f771fc86d94a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:34.701041 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23032a-f5e5-436a-b031-f771fc86d94a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:34.716603 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 126/250] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:34.722892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160c084-8ae5-4318-961f-3c55f967d5d5 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:34.850817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160c084-8ae5-4318-961f-3c55f967d5d5 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:34.894220 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9480ce-c416-4bda-a298-547aed31efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:34.895096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9480ce-c416-4bda-a298-547aed31efd9 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:34.895386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9480ce-c416-4bda-a298-547aed31efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:34.895668 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9480ce-c416-4bda-a298-547aed31efd9 None admin] PATH_INFO: `/v3/users/d3046814eacc4adaa14d384cb53fabe0` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:34.897053 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9480ce-c416-4bda-a298-547aed31efd9 None admin] RBAC: Authorizing `identity:get_user(user_id=d3046814eacc4adaa14d384cb53fabe0)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:34.898565 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9480ce-c416-4bda-a298-547aed31efd9 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:34.900733 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 125/251] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:34 2022] GET /identity/v3/users/d3046814eacc4adaa14d384cb53fabe0 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:34.906738 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9480ce-c416-4bda-a298-547aed31efd9 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:34.907325 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d1dd4-ed49-4977-a5f5-d7ff3af88f66 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:34.907624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d1dd4-ed49-4977-a5f5-d7ff3af88f66 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:34.907904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d1dd4-ed49-4977-a5f5-d7ff3af88f66 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:34.909614 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 127/252] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:34.915628 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed4b3a-2ae1-47e1-898c-620aaaac76f8 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:34.915937 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed4b3a-2ae1-47e1-898c-620aaaac76f8 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:34.916207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed4b3a-2ae1-47e1-898c-620aaaac76f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:34.931001 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:34.962145 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-05ed4b3a-2ae1-47e1-898c-620aaaac76f8 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:34.965060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-05ed4b3a-2ae1-47e1-898c-620aaaac76f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:34.999015 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:35.083352 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9480ce-c416-4bda-a298-547aed31efd9 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:35.108812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 128/253] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:35.112421 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8382a78-d0a4-4a81-983f-910147f29040 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:35.112421 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8382a78-d0a4-4a81-983f-910147f29040 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:35.112421 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8382a78-d0a4-4a81-983f-910147f29040 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:35.117499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 129/254] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:35.129790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97a3ff-cc89-4016-95be-53e79c33e1f1 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:35.129790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97a3ff-cc89-4016-95be-53e79c33e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:35.129790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97a3ff-cc89-4016-95be-53e79c33e1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:35.142632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dba132-64db-417f-a51d-92acdf3c5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:35.142632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba132-64db-417f-a51d-92acdf3c5c2c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:35.142632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba132-64db-417f-a51d-92acdf3c5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:35.142632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba132-64db-417f-a51d-92acdf3c5c2c None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:35.151550 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dba132-64db-417f-a51d-92acdf3c5c2c None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:35.152954 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dba132-64db-417f-a51d-92acdf3c5c2c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:35.161973 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 126/255] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:34 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:35.162854 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dba132-64db-417f-a51d-92acdf3c5c2c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:35.166412 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-ac97a3ff-cc89-4016-95be-53e79c33e1f1 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:35.167647 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-ac97a3ff-cc89-4016-95be-53e79c33e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:35.379509 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:35.409649 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dba132-64db-417f-a51d-92acdf3c5c2c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:35.416427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 130/256] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:35.417368 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97a3ff-cc89-4016-95be-53e79c33e1f1 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:35.526019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e0221-72af-4fa2-95f5-c6d9bac69087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:35.526991 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e0221-72af-4fa2-95f5-c6d9bac69087 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:35.527287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e0221-72af-4fa2-95f5-c6d9bac69087 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:35.527570 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e0221-72af-4fa2-95f5-c6d9bac69087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:35.568817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e0221-72af-4fa2-95f5-c6d9bac69087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-fa8e0221-72af-4fa2-95f5-c6d9bac69087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:35.598636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:35.599847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 127/257] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:45:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:35.600810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e0221-72af-4fa2-95f5-c6d9bac69087 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:35.702539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:35.721544 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97a3ff-cc89-4016-95be-53e79c33e1f1 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:35.768534 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff5841-e006-4f55-954e-9e049645bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:35.769464 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5841-e006-4f55-954e-9e049645bbdb None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:35.769749 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5841-e006-4f55-954e-9e049645bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:35.770028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5841-e006-4f55-954e-9e049645bbdb None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/users/d3046814eacc4adaa14d384cb53fabe0/roles/b6aef1054c2f43a693e82eb19749d60b` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:35.774759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff5841-e006-4f55-954e-9e049645bbdb None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd8ac35f2754b9eb5961500154e91bd, user_id=d3046814eacc4adaa14d384cb53fabe0, role_id=b6aef1054c2f43a693e82eb19749d60b)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:35.776234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff5841-e006-4f55-954e-9e049645bbdb None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:35.837262 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e0221-72af-4fa2-95f5-c6d9bac69087 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:35.873150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 131/258] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:45:35 2022] PUT /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/users/d3046814eacc4adaa14d384cb53fabe0/roles/b6aef1054c2f43a693e82eb19749d60b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:35.874010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff5841-e006-4f55-954e-9e049645bbdb None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:35.880935 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a23fb9-6d41-41ba-9394-4b70776b278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:35.885087 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a23fb9-6d41-41ba-9394-4b70776b278e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:35.885087 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a23fb9-6d41-41ba-9394-4b70776b278e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:35.885420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a23fb9-6d41-41ba-9394-4b70776b278e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:35.893806 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:35.919739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a23fb9-6d41-41ba-9394-4b70776b278e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-23a23fb9-6d41-41ba-9394-4b70776b278e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:35.936319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:35.938658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:35.941287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 128/259] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:45:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:35.946456 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a23fb9-6d41-41ba-9394-4b70776b278e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:36.022747 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff5841-e006-4f55-954e-9e049645bbdb None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:36.065474 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2e112-ff8e-4794-b9ab-972b47128771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:36.066267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2e112-ff8e-4794-b9ab-972b47128771 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:36.066655 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2e112-ff8e-4794-b9ab-972b47128771 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:36.067014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2e112-ff8e-4794-b9ab-972b47128771 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:36.067938 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2e112-ff8e-4794-b9ab-972b47128771 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:36.068325 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2e112-ff8e-4794-b9ab-972b47128771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:36.070110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2e112-ff8e-4794-b9ab-972b47128771 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:36.082148 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 132/260] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:36.088026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2e112-ff8e-4794-b9ab-972b47128771 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:36.099314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:36.247383 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2e112-ff8e-4794-b9ab-972b47128771 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:36.292053 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c5a9b-0693-4b36-bc9f-214c95fdfbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:36.293326 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c5a9b-0693-4b36-bc9f-214c95fdfbe8 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:36.293871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c5a9b-0693-4b36-bc9f-214c95fdfbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:36.294373 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c5a9b-0693-4b36-bc9f-214c95fdfbe8 None admin] PATH_INFO: `/v3/users/ed2e8460f2b2417b89425058958efd06` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:36.296111 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c5a9b-0693-4b36-bc9f-214c95fdfbe8 None admin] RBAC: Authorizing `identity:get_user(user_id=ed2e8460f2b2417b89425058958efd06)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:36.298008 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c5a9b-0693-4b36-bc9f-214c95fdfbe8 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:36.300010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 133/261] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:36 2022] GET /identity/v3/users/ed2e8460f2b2417b89425058958efd06 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:36.306300 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c5a9b-0693-4b36-bc9f-214c95fdfbe8 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:36.340945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a23fb9-6d41-41ba-9394-4b70776b278e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:36.408003 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb58a60-676b-4e6e-9cc9-9a0580f3773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:36.408704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb58a60-676b-4e6e-9cc9-9a0580f3773b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:36.408991 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb58a60-676b-4e6e-9cc9-9a0580f3773b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:36.409267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb58a60-676b-4e6e-9cc9-9a0580f3773b None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:36.410072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb58a60-676b-4e6e-9cc9-9a0580f3773b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:36.410340 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb58a60-676b-4e6e-9cc9-9a0580f3773b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:36.410714 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:36.411782 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb58a60-676b-4e6e-9cc9-9a0580f3773b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:36.425791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 129/262] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:45:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:36.435992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb58a60-676b-4e6e-9cc9-9a0580f3773b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:36.436688 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c5a9b-0693-4b36-bc9f-214c95fdfbe8 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:36.502263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439cbde-7beb-4cef-88b3-49b28d6aed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:36.502972 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439cbde-7beb-4cef-88b3-49b28d6aed3d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:36.503263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439cbde-7beb-4cef-88b3-49b28d6aed3d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:36.503548 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439cbde-7beb-4cef-88b3-49b28d6aed3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:36.599602 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:36.631299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439cbde-7beb-4cef-88b3-49b28d6aed3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:36.632839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439cbde-7beb-4cef-88b3-49b28d6aed3d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:36.727881 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb58a60-676b-4e6e-9cc9-9a0580f3773b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:36.787008 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:36.795963 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71de71-8671-44b0-9c2a-861fb7daf5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:36.796872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71de71-8671-44b0-9c2a-861fb7daf5c6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:36.797155 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71de71-8671-44b0-9c2a-861fb7daf5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:36.797433 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71de71-8671-44b0-9c2a-861fb7daf5c6 None admin] PATH_INFO: `/v3/users/ed2e8460f2b2417b89425058958efd06` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:36.803401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71de71-8671-44b0-9c2a-861fb7daf5c6 None admin] RBAC: Authorizing `identity:get_user(user_id=ed2e8460f2b2417b89425058958efd06)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:36.804884 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71de71-8671-44b0-9c2a-861fb7daf5c6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:36.806951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 130/263] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:36 2022] GET /identity/v3/users/ed2e8460f2b2417b89425058958efd06 => generated 283 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:36.813228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71de71-8671-44b0-9c2a-861fb7daf5c6 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:36.821164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 134/264] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:45:36.827572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439cbde-7beb-4cef-88b3-49b28d6aed3d None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:36.997526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71de71-8671-44b0-9c2a-861fb7daf5c6 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:37.042967 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:37.055411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f302f7-4caf-4804-81af-27c4a99d4323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:37.056095 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f302f7-4caf-4804-81af-27c4a99d4323 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.056390 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f302f7-4caf-4804-81af-27c4a99d4323 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.056666 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f302f7-4caf-4804-81af-27c4a99d4323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.066672 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439cbde-7beb-4cef-88b3-49b28d6aed3d None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:37.155159 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27534e0-b9fd-4889-bc50-23620e2c8369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:37.156022 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27534e0-b9fd-4889-bc50-23620e2c8369 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.156304 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27534e0-b9fd-4889-bc50-23620e2c8369 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.156580 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27534e0-b9fd-4889-bc50-23620e2c8369 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.157807 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27534e0-b9fd-4889-bc50-23620e2c8369 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:37.167587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27534e0-b9fd-4889-bc50-23620e2c8369 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:37.170378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 135/265] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:36 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:37.172617 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f302f7-4caf-4804-81af-27c4a99d4323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:37.174118 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f302f7-4caf-4804-81af-27c4a99d4323 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:37.176924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27534e0-b9fd-4889-bc50-23620e2c8369 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:37.302568 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:37.315676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 131/266] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:37.321233 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f302f7-4caf-4804-81af-27c4a99d4323 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:37.382170 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:37.441829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27534e0-b9fd-4889-bc50-23620e2c8369 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:37.483070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949d347-47b0-46d6-9aeb-a6e896c208db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:37.484225 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949d347-47b0-46d6-9aeb-a6e896c208db None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.484783 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949d347-47b0-46d6-9aeb-a6e896c208db None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.485670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949d347-47b0-46d6-9aeb-a6e896c208db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.486918 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949d347-47b0-46d6-9aeb-a6e896c208db None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd, user.id=ed2e8460f2b2417b89425058958efd06) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:37.487590 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949d347-47b0-46d6-9aeb-a6e896c208db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:37.489269 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949d347-47b0-46d6-9aeb-a6e896c208db None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:37.496472 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 136/267] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:37 2022] GET /identity/v3/role_assignments?user.id=ed2e8460f2b2417b89425058958efd06&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:37.501873 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158e805-651b-4b9c-b73f-bfd02faa9af3 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.502427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158e805-651b-4b9c-b73f-bfd02faa9af3 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.502942 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158e805-651b-4b9c-b73f-bfd02faa9af3 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.508739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f302f7-4caf-4804-81af-27c4a99d4323 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:37.509217 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 137/268] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:37.511015 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b86c13-5763-46c5-83ab-4bb890288387 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.511560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b86c13-5763-46c5-83ab-4bb890288387 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.512074 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b86c13-5763-46c5-83ab-4bb890288387 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.515085 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 138/269] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:37.516712 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98302bd-30cb-4481-b9b9-683f80a3fbd5 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.517221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98302bd-30cb-4481-b9b9-683f80a3fbd5 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.523371 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98302bd-30cb-4481-b9b9-683f80a3fbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.542891 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-e98302bd-30cb-4481-b9b9-683f80a3fbd5 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:37.545227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-e98302bd-30cb-4481-b9b9-683f80a3fbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:37.563312 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad32016-29eb-4f53-bf07-1f8bc01f2851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:37.564130 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad32016-29eb-4f53-bf07-1f8bc01f2851 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.564472 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad32016-29eb-4f53-bf07-1f8bc01f2851 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.564756 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad32016-29eb-4f53-bf07-1f8bc01f2851 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.571920 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad32016-29eb-4f53-bf07-1f8bc01f2851 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:37.573648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad32016-29eb-4f53-bf07-1f8bc01f2851 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:37.576087 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 132/270] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:37 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:37.577660 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f9679-e279-4950-9ee6-b287225d894c None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.577793 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f9679-e279-4950-9ee6-b287225d894c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.578074 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f9679-e279-4950-9ee6-b287225d894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.612625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-014f9679-e279-4950-9ee6-b287225d894c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:37.613911 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-014f9679-e279-4950-9ee6-b287225d894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:37.637835 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 139/271] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:37.639324 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98302bd-30cb-4481-b9b9-683f80a3fbd5 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:37.743033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:37.763600 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 133/272] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:37.764515 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f9679-e279-4950-9ee6-b287225d894c None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:37.810717 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:37.832935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98302bd-30cb-4481-b9b9-683f80a3fbd5 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:37.877941 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae1216-f51b-41af-b11b-b4e460ba71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:37.878637 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1216-f51b-41af-b11b-b4e460ba71bb None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.878930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1216-f51b-41af-b11b-b4e460ba71bb None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.879212 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1216-f51b-41af-b11b-b4e460ba71bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.880074 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae1216-f51b-41af-b11b-b4e460ba71bb None admin] RBAC: Adding query filter params (role.id=715071b6b1244a559110be37cc8410ab, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd, user.id=ed2e8460f2b2417b89425058958efd06) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:37.880393 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae1216-f51b-41af-b11b-b4e460ba71bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:37.881980 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae1216-f51b-41af-b11b-b4e460ba71bb None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:37.889133 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 140/273] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:37 2022] GET /identity/v3/role_assignments?user.id=ed2e8460f2b2417b89425058958efd06&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=715071b6b1244a559110be37cc8410ab => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:37.890555 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27a93f-2b0e-4c8b-81d6-83b2baefcff4 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.890872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27a93f-2b0e-4c8b-81d6-83b2baefcff4 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.891154 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27a93f-2b0e-4c8b-81d6-83b2baefcff4 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.892426 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 141/274] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:37.893146 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27a93f-2b0e-4c8b-81d6-83b2baefcff4 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:37.901365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f9679-e279-4950-9ee6-b287225d894c None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:37.951319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80f427-ca53-47c3-b408-e653d333a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:37.952149 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80f427-ca53-47c3-b408-e653d333a713 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.952429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80f427-ca53-47c3-b408-e653d333a713 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.952700 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80f427-ca53-47c3-b408-e653d333a713 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.956268 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80f427-ca53-47c3-b408-e653d333a713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:37.957637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80f427-ca53-47c3-b408-e653d333a713 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:37.959708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 134/275] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:37.961097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87975f55-e441-4f5c-8644-7cf9ae046343 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:37.961388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87975f55-e441-4f5c-8644-7cf9ae046343 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:37.961667 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87975f55-e441-4f5c-8644-7cf9ae046343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:37.986745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-87975f55-e441-4f5c-8644-7cf9ae046343 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:37.988178 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-87975f55-e441-4f5c-8644-7cf9ae046343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:38.042114 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:38.050952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27a93f-2b0e-4c8b-81d6-83b2baefcff4 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:38.083039 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 135/276] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:38.085864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87975f55-e441-4f5c-8644-7cf9ae046343 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:38.118413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b551-75f6-42d0-b93e-8bb842cb8298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:38.119260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b551-75f6-42d0-b93e-8bb842cb8298 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:38.119547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b551-75f6-42d0-b93e-8bb842cb8298 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:38.119826 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b551-75f6-42d0-b93e-8bb842cb8298 None admin] PATH_INFO: `/v3/roles/member` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:38.125429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:38.134226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b551-75f6-42d0-b93e-8bb842cb8298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-3572b551-75f6-42d0-b93e-8bb842cb8298 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:38.142968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:38.144099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 142/277] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:38.145459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b551-75f6-42d0-b93e-8bb842cb8298 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:38.245870 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87975f55-e441-4f5c-8644-7cf9ae046343 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:38.280676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b551-75f6-42d0-b93e-8bb842cb8298 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:38.284351 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a922bd-2832-4b86-96e4-732c91446eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:38.285033 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a922bd-2832-4b86-96e4-732c91446eb4 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:38.285319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a922bd-2832-4b86-96e4-732c91446eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:38.285598 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a922bd-2832-4b86-96e4-732c91446eb4 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:38.286321 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a922bd-2832-4b86-96e4-732c91446eb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:38.287806 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a922bd-2832-4b86-96e4-732c91446eb4 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:38.317886 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc9da6-6919-4349-9c27-c6e4f5ed3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:38.318741 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc9da6-6919-4349-9c27-c6e4f5ed3841 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:38.319032 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc9da6-6919-4349-9c27-c6e4f5ed3841 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:38.319312 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc9da6-6919-4349-9c27-c6e4f5ed3841 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:38.330734 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc9da6-6919-4349-9c27-c6e4f5ed3841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-b3dc9da6-6919-4349-9c27-c6e4f5ed3841 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:38.339011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:38.340263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:38.341518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:38.342958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 143/278] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:38.343807 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc9da6-6919-4349-9c27-c6e4f5ed3841 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:38.367665 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:38.378635 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 136/279] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:45:38 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:45:38.378635 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a922bd-2832-4b86-96e4-732c91446eb4 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:38.485657 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:38.498648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc9da6-6919-4349-9c27-c6e4f5ed3841 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:38.512203 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a922bd-2832-4b86-96e4-732c91446eb4 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:38.541245 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ad92e-193c-4994-9b27-f8c735edaddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:38.544388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad92e-193c-4994-9b27-f8c735edaddc None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:38.544388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad92e-193c-4994-9b27-f8c735edaddc None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:38.544388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad92e-193c-4994-9b27-f8c735edaddc None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:38.544388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ad92e-193c-4994-9b27-f8c735edaddc None admin] RBAC: Adding query filter params (name=member) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:38.544388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ad92e-193c-4994-9b27-f8c735edaddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:38.545825 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ad92e-193c-4994-9b27-f8c735edaddc None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:38.556224 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 144/280] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:38.559151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1d62d-94fb-4e84-98ed-6481bed88a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:38.560279 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d62d-94fb-4e84-98ed-6481bed88a8b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:38.560568 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d62d-94fb-4e84-98ed-6481bed88a8b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:38.561063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d62d-94fb-4e84-98ed-6481bed88a8b None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:38.561872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1d62d-94fb-4e84-98ed-6481bed88a8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:38.562190 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1d62d-94fb-4e84-98ed-6481bed88a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:38.562779 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ad92e-193c-4994-9b27-f8c735edaddc None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:38.565978 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1d62d-94fb-4e84-98ed-6481bed88a8b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:38.577742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 137/281] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:38.583247 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1d62d-94fb-4e84-98ed-6481bed88a8b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:38.682084 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:38.705554 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ad92e-193c-4994-9b27-f8c735edaddc None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:38.729032 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1d62d-94fb-4e84-98ed-6481bed88a8b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:38.750170 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9c883-d0df-4638-a762-3b3219cc7b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:38.751102 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c883-d0df-4638-a762-3b3219cc7b2d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:38.751385 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c883-d0df-4638-a762-3b3219cc7b2d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:38.751662 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c883-d0df-4638-a762-3b3219cc7b2d None admin] PATH_INFO: `/v3/users/e1303eb94cfb48d8a0ee5ab0aa17dbf2` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:38.770986 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c275c3-831e-4339-a276-a63a34185518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:38.771888 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c275c3-831e-4339-a276-a63a34185518 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:38.772463 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c275c3-831e-4339-a276-a63a34185518 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:38.772463 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c275c3-831e-4339-a276-a63a34185518 None admin] PATH_INFO: `/v3/users/5279e924e59b453baf6876aada5f0af0` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:38.773721 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9c883-d0df-4638-a762-3b3219cc7b2d None admin] RBAC: Authorizing `identity:get_user(user_id=e1303eb94cfb48d8a0ee5ab0aa17dbf2)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:38.773842 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c275c3-831e-4339-a276-a63a34185518 None admin] RBAC: Authorizing `identity:get_user(user_id=5279e924e59b453baf6876aada5f0af0)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:38.775239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c275c3-831e-4339-a276-a63a34185518 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:38.775374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9c883-d0df-4638-a762-3b3219cc7b2d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:38.782641 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 138/282] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:38 2022] GET /identity/v3/users/5279e924e59b453baf6876aada5f0af0 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:38.782838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 145/283] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:38 2022] GET /identity/v3/users/e1303eb94cfb48d8a0ee5ab0aa17dbf2 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:38.782928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90edcc3-e9f6-4ea1-a088-5e291f4eb105 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:38.782928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90edcc3-e9f6-4ea1-a088-5e291f4eb105 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:38.782928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90edcc3-e9f6-4ea1-a088-5e291f4eb105 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:38.782928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 139/284] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:38.783370 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90edcc3-e9f6-4ea1-a088-5e291f4eb105 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:38.783476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9c883-d0df-4638-a762-3b3219cc7b2d None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:38.797616 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:38.917045 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9c883-d0df-4638-a762-3b3219cc7b2d None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:38.919963 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90edcc3-e9f6-4ea1-a088-5e291f4eb105 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:38.965650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57a4d4-4fa2-47a3-9fbb-4401b7bd5e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:38.965871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ed6ea-67c7-4736-b887-b4e38fbf4c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:38.966251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ed6ea-67c7-4736-b887-b4e38fbf4c07 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:38.966531 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ed6ea-67c7-4736-b887-b4e38fbf4c07 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:38.966842 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ed6ea-67c7-4736-b887-b4e38fbf4c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:38.967701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ed6ea-67c7-4736-b887-b4e38fbf4c07 None admin] RBAC: Adding query filter params (role.id=b6aef1054c2f43a693e82eb19749d60b, user.id=e1303eb94cfb48d8a0ee5ab0aa17dbf2, scope.system=all) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:38.967970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57a4d4-4fa2-47a3-9fbb-4401b7bd5e6e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:38.968081 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ed6ea-67c7-4736-b887-b4e38fbf4c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:38.968739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57a4d4-4fa2-47a3-9fbb-4401b7bd5e6e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:38.969226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57a4d4-4fa2-47a3-9fbb-4401b7bd5e6e None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:38.969452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ed6ea-67c7-4736-b887-b4e38fbf4c07 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:38.970922 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57a4d4-4fa2-47a3-9fbb-4401b7bd5e6e None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:38.972698 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57a4d4-4fa2-47a3-9fbb-4401b7bd5e6e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:38.974889 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 140/285] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:38 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:38.975848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 146/286] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:45:38 2022] GET /identity/v3/role_assignments?user.id=e1303eb94cfb48d8a0ee5ab0aa17dbf2&scope.system=all&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:38.976610 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd009bd5-4843-44c0-9fd2-73a0a71f4315 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:38.976908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd009bd5-4843-44c0-9fd2-73a0a71f4315 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:38.977186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd009bd5-4843-44c0-9fd2-73a0a71f4315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:38.982667 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ed6ea-67c7-4736-b887-b4e38fbf4c07 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:38.987956 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:38.996012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-cd009bd5-4843-44c0-9fd2-73a0a71f4315 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:38.997933 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-cd009bd5-4843-44c0-9fd2-73a0a71f4315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:39.074491 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 141/287] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:39.099149 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd009bd5-4843-44c0-9fd2-73a0a71f4315 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:39.108606 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:39.210990 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ed6ea-67c7-4736-b887-b4e38fbf4c07 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:39.212186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd009bd5-4843-44c0-9fd2-73a0a71f4315 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:39.263849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1993e-0c42-4492-8a78-655c1a7becd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:39.264595 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1993e-0c42-4492-8a78-655c1a7becd7 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:39.264879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1993e-0c42-4492-8a78-655c1a7becd7 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:39.265158 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1993e-0c42-4492-8a78-655c1a7becd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:39.277943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1993e-0c42-4492-8a78-655c1a7becd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-55b1993e-0c42-4492-8a78-655c1a7becd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:39.287940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:39.289061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:39.290019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 142/288] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:39.294633 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9df69-987e-469b-806e-0f06291360bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:39.294633 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9df69-987e-469b-806e-0f06291360bd None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:39.294633 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9df69-987e-469b-806e-0f06291360bd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:39.294633 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9df69-987e-469b-806e-0f06291360bd None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/users/5279e924e59b453baf6876aada5f0af0/roles/429fffc185ca46c6a104c64d4325c366` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:39.295867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1993e-0c42-4492-8a78-655c1a7becd7 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:39.298003 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9df69-987e-469b-806e-0f06291360bd None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd8ac35f2754b9eb5961500154e91bd, user_id=5279e924e59b453baf6876aada5f0af0, role_id=429fffc185ca46c6a104c64d4325c366)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:39.299531 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9df69-987e-469b-806e-0f06291360bd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:39.375335 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:39.382678 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 147/289] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:45:38 2022] PUT /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/users/5279e924e59b453baf6876aada5f0af0/roles/429fffc185ca46c6a104c64d4325c366 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:45:39.421820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1993e-0c42-4492-8a78-655c1a7becd7 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:39.474230 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59de84e-0560-49e4-8486-c8eaeed0acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:39.475035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59de84e-0560-49e4-8486-c8eaeed0acf0 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:39.475326 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59de84e-0560-49e4-8486-c8eaeed0acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:39.475604 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59de84e-0560-49e4-8486-c8eaeed0acf0 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:39.476410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59de84e-0560-49e4-8486-c8eaeed0acf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:39.476717 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59de84e-0560-49e4-8486-c8eaeed0acf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:39.478220 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59de84e-0560-49e4-8486-c8eaeed0acf0 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:39.488760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 143/290] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:39.494386 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9df69-987e-469b-806e-0f06291360bd None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:39.592359 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:39.641253 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9df69-987e-469b-806e-0f06291360bd None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:39.677503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15272d-78b0-4731-a3ca-225b20e2d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:39.678402 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15272d-78b0-4731-a3ca-225b20e2d83b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:39.678720 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15272d-78b0-4731-a3ca-225b20e2d83b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:39.679001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15272d-78b0-4731-a3ca-225b20e2d83b None admin] PATH_INFO: `/v3/users/d3046814eacc4adaa14d384cb53fabe0` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:39.680278 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15272d-78b0-4731-a3ca-225b20e2d83b None admin] RBAC: Authorizing `identity:get_user(user_id=d3046814eacc4adaa14d384cb53fabe0)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:39.681759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15272d-78b0-4731-a3ca-225b20e2d83b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:39.683946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 148/291] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:39 2022] GET /identity/v3/users/d3046814eacc4adaa14d384cb53fabe0 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:39.689324 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59de84e-0560-49e4-8486-c8eaeed0acf0 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:39.804138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59de84e-0560-49e4-8486-c8eaeed0acf0 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:39.833199 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:39.841964 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80d6bd-5ec2-4d68-acef-ed59acdc547b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:39.846886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80d6bd-5ec2-4d68-acef-ed59acdc547b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:39.846886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80d6bd-5ec2-4d68-acef-ed59acdc547b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:39.846886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80d6bd-5ec2-4d68-acef-ed59acdc547b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:39.938240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80d6bd-5ec2-4d68-acef-ed59acdc547b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:39.939748 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80d6bd-5ec2-4d68-acef-ed59acdc547b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:40.091885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 144/292] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:40.097486 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15272d-78b0-4731-a3ca-225b20e2d83b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:40.238325 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15272d-78b0-4731-a3ca-225b20e2d83b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:40.284297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:40.299344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99592f2-16fc-41da-9843-4eb650446be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:40.300297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99592f2-16fc-41da-9843-4eb650446be4 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:40.300587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99592f2-16fc-41da-9843-4eb650446be4 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:40.300872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99592f2-16fc-41da-9843-4eb650446be4 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:40.302168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99592f2-16fc-41da-9843-4eb650446be4 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:40.303673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99592f2-16fc-41da-9843-4eb650446be4 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:40.305785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 149/293] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:40 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:40.312378 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80d6bd-5ec2-4d68-acef-ed59acdc547b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:40.359375 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:40.464505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80d6bd-5ec2-4d68-acef-ed59acdc547b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:40.523622 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166722e3-06ef-4c59-9f8b-cbb6789e8a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:40.524601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166722e3-06ef-4c59-9f8b-cbb6789e8a3b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:40.525065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166722e3-06ef-4c59-9f8b-cbb6789e8a3b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:40.525501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166722e3-06ef-4c59-9f8b-cbb6789e8a3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:40.526502 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166722e3-06ef-4c59-9f8b-cbb6789e8a3b None admin] RBAC: Adding query filter params (role.id=b6aef1054c2f43a693e82eb19749d60b, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd, user.id=d3046814eacc4adaa14d384cb53fabe0) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:40.526993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166722e3-06ef-4c59-9f8b-cbb6789e8a3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:40.528678 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166722e3-06ef-4c59-9f8b-cbb6789e8a3b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:40.539342 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 145/294] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:40 2022] GET /identity/v3/role_assignments?user.id=d3046814eacc4adaa14d384cb53fabe0&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:41.118703 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82feb77-4393-458f-8bd0-1ce58ee94159 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:41.119260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82feb77-4393-458f-8bd0-1ce58ee94159 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:41.119260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82feb77-4393-458f-8bd0-1ce58ee94159 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:41.120667 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 150/295] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:41.129925 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673d05b-2584-4a6f-87ec-11a19c791c41 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:41.130362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673d05b-2584-4a6f-87ec-11a19c791c41 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:41.130837 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673d05b-2584-4a6f-87ec-11a19c791c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:41.149571 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-e673d05b-2584-4a6f-87ec-11a19c791c41 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:41.150821 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-e673d05b-2584-4a6f-87ec-11a19c791c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:41.226128 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 146/296] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:41.250770 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82feb77-4393-458f-8bd0-1ce58ee94159 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:41.287453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6fdb0-6c24-419f-b7c6-840b349de05c None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:41.287977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6fdb0-6c24-419f-b7c6-840b349de05c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:41.288445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6fdb0-6c24-419f-b7c6-840b349de05c None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:41.291320 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 147/297] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:41.305599 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83902fda-a009-48af-8b89-330c8599252d None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:41.307159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83902fda-a009-48af-8b89-330c8599252d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:41.308479 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83902fda-a009-48af-8b89-330c8599252d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:41.351600 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-83902fda-a009-48af-8b89-330c8599252d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:41.352853 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-83902fda-a009-48af-8b89-330c8599252d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:41.371612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:41.388619 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82feb77-4393-458f-8bd0-1ce58ee94159 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:41.429751 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 148/298] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:41.440900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76391b23-69ef-4a38-bdbc-8e4e2b43a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:41.441945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391b23-69ef-4a38-bdbc-8e4e2b43a41c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:41.442398 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391b23-69ef-4a38-bdbc-8e4e2b43a41c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:41.442856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391b23-69ef-4a38-bdbc-8e4e2b43a41c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:41.453518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83902fda-a009-48af-8b89-330c8599252d None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:41.456471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76391b23-69ef-4a38-bdbc-8e4e2b43a41c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-76391b23-69ef-4a38-bdbc-8e4e2b43a41c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:41.470017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:41.472120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:41.474089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:41.480818 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 151/299] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:41.486393 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76391b23-69ef-4a38-bdbc-8e4e2b43a41c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:41.554789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:41.574575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83902fda-a009-48af-8b89-330c8599252d None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:41.602390 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76391b23-69ef-4a38-bdbc-8e4e2b43a41c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:41.610912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b09d4-b9bb-4de5-b663-69359a939b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:41.611977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b09d4-b9bb-4de5-b663-69359a939b58 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:41.611977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b09d4-b9bb-4de5-b663-69359a939b58 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:41.612278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b09d4-b9bb-4de5-b663-69359a939b58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:41.613469 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b09d4-b9bb-4de5-b663-69359a939b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:41.614955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b09d4-b9bb-4de5-b663-69359a939b58 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:41.621333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 149/300] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:41.622251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b09d4-b9bb-4de5-b663-69359a939b58 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:41.643713 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fadf4-67c1-40e4-902b-c7f8d2696300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:41.644783 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fadf4-67c1-40e4-902b-c7f8d2696300 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:41.645336 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fadf4-67c1-40e4-902b-c7f8d2696300 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:41.645876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fadf4-67c1-40e4-902b-c7f8d2696300 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:41.646419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:41.648219 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fadf4-67c1-40e4-902b-c7f8d2696300 None admin] RBAC: Adding query filter params (name=reader) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:41.648774 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fadf4-67c1-40e4-902b-c7f8d2696300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:41.650369 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fadf4-67c1-40e4-902b-c7f8d2696300 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:41.665733 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 152/301] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:41.667134 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fadf4-67c1-40e4-902b-c7f8d2696300 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:41.737657 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b09d4-b9bb-4de5-b663-69359a939b58 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:41.775750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99824185-3b04-40ed-96df-170e7d801375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:41.776422 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99824185-3b04-40ed-96df-170e7d801375 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:41.776861 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99824185-3b04-40ed-96df-170e7d801375 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:41.777182 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99824185-3b04-40ed-96df-170e7d801375 None admin] PATH_INFO: `/v3/groups` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:41.778739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99824185-3b04-40ed-96df-170e7d801375 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:41.780658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99824185-3b04-40ed-96df-170e7d801375 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:41.798519 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fadf4-67c1-40e4-902b-c7f8d2696300 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:41.828982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:41.842962 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ae819-4308-49c6-a47d-384c3a17b40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:41.849065 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ae819-4308-49c6-a47d-384c3a17b40c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:41.849065 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ae819-4308-49c6-a47d-384c3a17b40c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:41.849065 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ae819-4308-49c6-a47d-384c3a17b40c None admin] PATH_INFO: `/v3/users/9c1636ff74934e7d822e4e03aa99e585` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:41.867770 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ae819-4308-49c6-a47d-384c3a17b40c None admin] RBAC: Authorizing `identity:get_user(user_id=9c1636ff74934e7d822e4e03aa99e585)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:41.870669 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ae819-4308-49c6-a47d-384c3a17b40c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:41.874145 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 153/302] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:41 2022] GET /identity/v3/users/9c1636ff74934e7d822e4e03aa99e585 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:41.876394 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ec6c7-aa75-459c-ad6c-048247aa52f6 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:41.879634 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ec6c7-aa75-459c-ad6c-048247aa52f6 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:41.879634 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ec6c7-aa75-459c-ad6c-048247aa52f6 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:41.880192 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 154/303] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:41.881473 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ec6c7-aa75-459c-ad6c-048247aa52f6 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:41.909547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 150/304] 10.222.0.89 () {60 vars in 1134 bytes} [Thu May 19 20:45:41 2022] POST /identity/v3/groups => generated 229 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:45:41.912032 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9834c6-0bee-44f2-9366-1df0e827bb9d None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:41.912569 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9834c6-0bee-44f2-9366-1df0e827bb9d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:41.913086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9834c6-0bee-44f2-9366-1df0e827bb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:41.963791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-ef9834c6-0bee-44f2-9366-1df0e827bb9d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:41.965259 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-ef9834c6-0bee-44f2-9366-1df0e827bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:42.021149 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ec6c7-aa75-459c-ad6c-048247aa52f6 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:42.078574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5085-96a9-4334-8920-aaa829852e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:42.079433 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5085-96a9-4334-8920-aaa829852e47 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:42.079660 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5085-96a9-4334-8920-aaa829852e47 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:42.079940 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5085-96a9-4334-8920-aaa829852e47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:42.080813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5085-96a9-4334-8920-aaa829852e47 None admin] RBAC: Adding query filter params (role.id=429fffc185ca46c6a104c64d4325c366, user.id=9c1636ff74934e7d822e4e03aa99e585, scope.system=all) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:42.081129 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5085-96a9-4334-8920-aaa829852e47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:42.082887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5085-96a9-4334-8920-aaa829852e47 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:42.088776 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 155/305] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:45:41 2022] GET /identity/v3/role_assignments?user.id=9c1636ff74934e7d822e4e03aa99e585&scope.system=all&role.id=429fffc185ca46c6a104c64d4325c366 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:42.102398 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 151/306] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:42.126828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5085-96a9-4334-8920-aaa829852e47 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:42.189860 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:42.258840 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5085-96a9-4334-8920-aaa829852e47 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:42.299795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8364c5c-3c1a-49ce-952a-2e3925ac6f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:42.300636 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8364c5c-3c1a-49ce-952a-2e3925ac6f2b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:42.300956 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8364c5c-3c1a-49ce-952a-2e3925ac6f2b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:42.301195 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8364c5c-3c1a-49ce-952a-2e3925ac6f2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:42.313409 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8364c5c-3c1a-49ce-952a-2e3925ac6f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-f8364c5c-3c1a-49ce-952a-2e3925ac6f2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:42.321584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:42.328314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:42.329375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 156/307] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:42.330289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9834c6-0bee-44f2-9366-1df0e827bb9d None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:42.342479 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:42.366774 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f620a80-ef84-4ad8-b5e7-deef938866ef None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:42.367302 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f620a80-ef84-4ad8-b5e7-deef938866ef None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:42.367686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f620a80-ef84-4ad8-b5e7-deef938866ef None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:42.369718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 157/308] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:42.376000 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cb9fe-2d48-4f6d-a382-05fbe49217f3 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:42.376415 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cb9fe-2d48-4f6d-a382-05fbe49217f3 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:42.376794 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cb9fe-2d48-4f6d-a382-05fbe49217f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:42.395503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-2d4cb9fe-2d48-4f6d-a382-05fbe49217f3 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:42.397022 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-2d4cb9fe-2d48-4f6d-a382-05fbe49217f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:42.445896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9834c6-0bee-44f2-9366-1df0e827bb9d None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:42.477332 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 158/309] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:42.486095 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4cd4-792d-43d0-9cb5-58af5ccb0b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:42.486952 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4cd4-792d-43d0-9cb5-58af5ccb0b4c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:42.487340 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4cd4-792d-43d0-9cb5-58af5ccb0b4c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:42.487757 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f4cd4-792d-43d0-9cb5-58af5ccb0b4c None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:42.488942 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f4cd4-792d-43d0-9cb5-58af5ccb0b4c None admin] RBAC: Adding query filter params (name=member) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:42.489606 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f4cd4-792d-43d0-9cb5-58af5ccb0b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:42.492263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f4cd4-792d-43d0-9cb5-58af5ccb0b4c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:42.508048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 152/310] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:42.511974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cb9fe-2d48-4f6d-a382-05fbe49217f3 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:42.513590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4cd4-792d-43d0-9cb5-58af5ccb0b4c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:42.558992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:42.591467 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:42.629233 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f4cd4-792d-43d0-9cb5-58af5ccb0b4c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:42.650225 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cb9fe-2d48-4f6d-a382-05fbe49217f3 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:42.687356 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6a2f7-9072-4ef6-8faa-526f612bef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:42.688614 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6a2f7-9072-4ef6-8faa-526f612bef94 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:42.689061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6a2f7-9072-4ef6-8faa-526f612bef94 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:42.689507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6a2f7-9072-4ef6-8faa-526f612bef94 None admin] PATH_INFO: `/v3/users/e1303eb94cfb48d8a0ee5ab0aa17dbf2` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:42.690645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3592d9e-c9b4-44a6-baa3-afaa85a85e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:42.691410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6a2f7-9072-4ef6-8faa-526f612bef94 None admin] RBAC: Authorizing `identity:get_user(user_id=e1303eb94cfb48d8a0ee5ab0aa17dbf2)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:42.691660 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3592d9e-c9b4-44a6-baa3-afaa85a85e27 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:42.692041 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3592d9e-c9b4-44a6-baa3-afaa85a85e27 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:42.692423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3592d9e-c9b4-44a6-baa3-afaa85a85e27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:42.693695 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6a2f7-9072-4ef6-8faa-526f612bef94 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:42.695881 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 153/311] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:42 2022] GET /identity/v3/users/e1303eb94cfb48d8a0ee5ab0aa17dbf2 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:42.701735 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6a2f7-9072-4ef6-8faa-526f612bef94 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:42.709319 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3592d9e-c9b4-44a6-baa3-afaa85a85e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-b3592d9e-c9b4-44a6-baa3-afaa85a85e27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:42.718812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:42.719879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:42.720876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:42.723950 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 159/312] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:42.730686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3592d9e-c9b4-44a6-baa3-afaa85a85e27 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:42.826263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6a2f7-9072-4ef6-8faa-526f612bef94 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:42.834980 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:42.848219 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3592d9e-c9b4-44a6-baa3-afaa85a85e27 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:42.864515 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f464e-729a-4da3-bed4-3cddd2cb04ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:42.865390 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f464e-729a-4da3-bed4-3cddd2cb04ae None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:42.865677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f464e-729a-4da3-bed4-3cddd2cb04ae None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:42.866218 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f464e-729a-4da3-bed4-3cddd2cb04ae None admin] PATH_INFO: `/v3/system/users/e1303eb94cfb48d8a0ee5ab0aa17dbf2/roles/b6aef1054c2f43a693e82eb19749d60b` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:42.868797 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f464e-729a-4da3-bed4-3cddd2cb04ae None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e1303eb94cfb48d8a0ee5ab0aa17dbf2, role_id=b6aef1054c2f43a693e82eb19749d60b)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:42.870185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f464e-729a-4da3-bed4-3cddd2cb04ae None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:42.883276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107671-d3b4-4bbb-8459-64e62b4d3d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:42.883963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107671-d3b4-4bbb-8459-64e62b4d3d63 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:42.884252 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107671-d3b4-4bbb-8459-64e62b4d3d63 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:42.884534 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107671-d3b4-4bbb-8459-64e62b4d3d63 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:42.885305 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107671-d3b4-4bbb-8459-64e62b4d3d63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:42.885618 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107671-d3b4-4bbb-8459-64e62b4d3d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:42.887068 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107671-d3b4-4bbb-8459-64e62b4d3d63 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:42.898656 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 160/313] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:42.902123 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107671-d3b4-4bbb-8459-64e62b4d3d63 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:42.946745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 154/314] 10.222.0.89 () {58 vars in 1334 bytes} [Thu May 19 20:45:42 2022] PUT /identity/v3/system/users/e1303eb94cfb48d8a0ee5ab0aa17dbf2/roles/b6aef1054c2f43a693e82eb19749d60b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:45:43.029267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107671-d3b4-4bbb-8459-64e62b4d3d63 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:43.073013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39411f41-2882-4b28-a5c4-07fafe876e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:43.073929 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39411f41-2882-4b28-a5c4-07fafe876e08 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:43.074275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39411f41-2882-4b28-a5c4-07fafe876e08 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:43.074561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39411f41-2882-4b28-a5c4-07fafe876e08 None admin] PATH_INFO: `/v3/users/5279e924e59b453baf6876aada5f0af0` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:43.076026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39411f41-2882-4b28-a5c4-07fafe876e08 None admin] RBAC: Authorizing `identity:get_user(user_id=5279e924e59b453baf6876aada5f0af0)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:43.077653 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39411f41-2882-4b28-a5c4-07fafe876e08 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:43.079780 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 161/315] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:42 2022] GET /identity/v3/users/5279e924e59b453baf6876aada5f0af0 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:43.085176 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f464e-729a-4da3-bed4-3cddd2cb04ae None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:43.090426 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:43.205841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f464e-729a-4da3-bed4-3cddd2cb04ae None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:43.242313 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3c7eb-8708-4503-a06e-14164587d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:43.243008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3c7eb-8708-4503-a06e-14164587d237 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:43.243295 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3c7eb-8708-4503-a06e-14164587d237 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:43.243573 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3c7eb-8708-4503-a06e-14164587d237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:43.318544 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3c7eb-8708-4503-a06e-14164587d237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:43.320048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3c7eb-8708-4503-a06e-14164587d237 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:43.323090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:43.427891 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 155/316] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:43.433530 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39411f41-2882-4b28-a5c4-07fafe876e08 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:43.461805 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:43.546821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39411f41-2882-4b28-a5c4-07fafe876e08 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:43.583028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b7aa7-1098-467f-a5ce-e7ba7a4332ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:43.584158 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b7aa7-1098-467f-a5ce-e7ba7a4332ac None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:43.584605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b7aa7-1098-467f-a5ce-e7ba7a4332ac None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:43.585071 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b7aa7-1098-467f-a5ce-e7ba7a4332ac None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:43.586462 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b7aa7-1098-467f-a5ce-e7ba7a4332ac None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:43.588125 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b7aa7-1098-467f-a5ce-e7ba7a4332ac None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:43.590025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 162/317] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:43 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:43.597108 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3c7eb-8708-4503-a06e-14164587d237 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:43.700125 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3c7eb-8708-4503-a06e-14164587d237 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:43.702582 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:43.742585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1925f-2533-4e16-b590-46806532faa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:43.742585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1925f-2533-4e16-b590-46806532faa1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:43.742585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1925f-2533-4e16-b590-46806532faa1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:43.742585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1925f-2533-4e16-b590-46806532faa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:43.743076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1925f-2533-4e16-b590-46806532faa1 None admin] RBAC: Adding query filter params (role.id=429fffc185ca46c6a104c64d4325c366, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd, user.id=5279e924e59b453baf6876aada5f0af0) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:43.743076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1925f-2533-4e16-b590-46806532faa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:43.743076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1925f-2533-4e16-b590-46806532faa1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:43.748220 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 156/318] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:45:43 2022] GET /identity/v3/role_assignments?user.id=5279e924e59b453baf6876aada5f0af0&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=429fffc185ca46c6a104c64d4325c366 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:44.322259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f584041-a4cf-4752-aba2-742db61b1cf1 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:44.322463 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f584041-a4cf-4752-aba2-742db61b1cf1 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:44.322790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f584041-a4cf-4752-aba2-742db61b1cf1 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:44.324157 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 163/319] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:44.330698 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ffa54-b9d4-402b-8a1d-5f18526a831f None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:44.330991 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ffa54-b9d4-402b-8a1d-5f18526a831f None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:44.331269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ffa54-b9d4-402b-8a1d-5f18526a831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:44.348118 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-a36ffa54-b9d4-402b-8a1d-5f18526a831f None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:44.349327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-a36ffa54-b9d4-402b-8a1d-5f18526a831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:44.420280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 157/320] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:44.443811 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f584041-a4cf-4752-aba2-742db61b1cf1 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:44.485044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499d5ee-8dd0-4930-9eba-bbcaaf6360c2 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:44.485330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499d5ee-8dd0-4930-9eba-bbcaaf6360c2 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:44.485845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499d5ee-8dd0-4930-9eba-bbcaaf6360c2 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:44.487519 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 158/321] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:45:44.492476 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653ee5-8176-4bce-940e-14f11b2fcd1c None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:44.492764 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653ee5-8176-4bce-940e-14f11b2fcd1c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:44.493043 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653ee5-8176-4bce-940e-14f11b2fcd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:44.509784 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-d5653ee5-8176-4bce-940e-14f11b2fcd1c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:44.510966 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-d5653ee5-8176-4bce-940e-14f11b2fcd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:44.544479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:44.554516 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f584041-a4cf-4752-aba2-742db61b1cf1 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:44.590291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 159/322] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:44.595856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f207df-59e5-4719-a66c-b8ae94683e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:44.596750 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f207df-59e5-4719-a66c-b8ae94683e13 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:44.597040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f207df-59e5-4719-a66c-b8ae94683e13 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:44.597358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f207df-59e5-4719-a66c-b8ae94683e13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:44.598558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f207df-59e5-4719-a66c-b8ae94683e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:44.600048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f207df-59e5-4719-a66c-b8ae94683e13 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:44.601780 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 164/323] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:45:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:44.607825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5653ee5-8176-4bce-940e-14f11b2fcd1c None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:44.613970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f207df-59e5-4719-a66c-b8ae94683e13 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:44.640458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:44.721785 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5653ee5-8176-4bce-940e-14f11b2fcd1c None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:44.731258 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f207df-59e5-4719-a66c-b8ae94683e13 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:44.759892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0d4bf-fce4-4e22-b064-bd064ce272ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:44.760675 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0d4bf-fce4-4e22-b064-bd064ce272ef None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:44.760956 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0d4bf-fce4-4e22-b064-bd064ce272ef None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:44.761410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0d4bf-fce4-4e22-b064-bd064ce272ef None admin] PATH_INFO: `/v3/groups` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:44.762006 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0d4bf-fce4-4e22-b064-bd064ce272ef None admin] RBAC: Authorizing `identity:create_group()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:44.763959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0d4bf-fce4-4e22-b064-bd064ce272ef None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:44.766724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb2939-061f-45e9-89e8-4bf6f76efe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:44.767538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2939-061f-45e9-89e8-4bf6f76efe8e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:44.767942 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2939-061f-45e9-89e8-4bf6f76efe8e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:44.768171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2939-061f-45e9-89e8-4bf6f76efe8e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:44.779661 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb2939-061f-45e9-89e8-4bf6f76efe8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-36fb2939-061f-45e9-89e8-4bf6f76efe8e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:44.787690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:44.788999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:44.790155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:44.793653 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 165/324] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:45:44.794549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb2939-061f-45e9-89e8-4bf6f76efe8e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:44.817464 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:44.845349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 160/325] 10.222.0.89 () {60 vars in 1134 bytes} [Thu May 19 20:45:44 2022] POST /identity/v3/groups => generated 226 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:45:44.916298 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb2939-061f-45e9-89e8-4bf6f76efe8e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:44.955232 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a143b-c999-4880-9be5-9fa1663cd676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:44.956291 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a143b-c999-4880-9be5-9fa1663cd676 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:44.956580 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a143b-c999-4880-9be5-9fa1663cd676 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:44.956863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a143b-c999-4880-9be5-9fa1663cd676 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:44.957637 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a143b-c999-4880-9be5-9fa1663cd676 None admin] RBAC: Adding query filter params (name=reader) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:44.957951 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a143b-c999-4880-9be5-9fa1663cd676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:44.959381 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a143b-c999-4880-9be5-9fa1663cd676 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:44.974099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 166/326] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:44.975447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0d4bf-fce4-4e22-b064-bd064ce272ef None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:45.080182 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:45.093170 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0d4bf-fce4-4e22-b064-bd064ce272ef None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:45.130258 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7289839-5770-4f9d-b775-1de85f2f7ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:45.137334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289839-5770-4f9d-b775-1de85f2f7ca1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:45.137334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289839-5770-4f9d-b775-1de85f2f7ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:45.137334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289839-5770-4f9d-b775-1de85f2f7ca1 None admin] PATH_INFO: `/v3/users/9c1636ff74934e7d822e4e03aa99e585` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:45.137334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7289839-5770-4f9d-b775-1de85f2f7ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=9c1636ff74934e7d822e4e03aa99e585)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:45.137334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7289839-5770-4f9d-b775-1de85f2f7ca1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:45.137334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 161/327] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:44 2022] GET /identity/v3/users/9c1636ff74934e7d822e4e03aa99e585 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:45.142439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a143b-c999-4880-9be5-9fa1663cd676 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:45.240700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:45.260923 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a143b-c999-4880-9be5-9fa1663cd676 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:45.299931 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8bc4d-540b-47d8-8b2e-86fc62cc3b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:45.300829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8bc4d-540b-47d8-8b2e-86fc62cc3b6f None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:45.301116 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8bc4d-540b-47d8-8b2e-86fc62cc3b6f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:45.301397 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8bc4d-540b-47d8-8b2e-86fc62cc3b6f None admin] PATH_INFO: `/v3/system/users/9c1636ff74934e7d822e4e03aa99e585/roles/429fffc185ca46c6a104c64d4325c366` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:45.303138 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8bc4d-540b-47d8-8b2e-86fc62cc3b6f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9c1636ff74934e7d822e4e03aa99e585, role_id=429fffc185ca46c6a104c64d4325c366)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:45.304561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8bc4d-540b-47d8-8b2e-86fc62cc3b6f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:45.386953 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 167/328] 10.222.0.89 () {58 vars in 1334 bytes} [Thu May 19 20:45:45 2022] PUT /identity/v3/system/users/9c1636ff74934e7d822e4e03aa99e585/roles/429fffc185ca46c6a104c64d4325c366 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:45.397473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd3eba-c9bd-45f4-9218-3c1353381c7b None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:45.409693 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd3eba-c9bd-45f4-9218-3c1353381c7b None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:45.409693 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd3eba-c9bd-45f4-9218-3c1353381c7b None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:45.409693 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 162/329] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:45.409996 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c603f9d-5cdf-4e63-b3da-331cf67fc1cf None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:45.409996 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c603f9d-5cdf-4e63-b3da-331cf67fc1cf None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:45.409996 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c603f9d-5cdf-4e63-b3da-331cf67fc1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:45.431560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-4c603f9d-5cdf-4e63-b3da-331cf67fc1cf None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:45.432809 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-4c603f9d-5cdf-4e63-b3da-331cf67fc1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:45.521410 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 168/330] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:45.554802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd3eba-c9bd-45f4-9218-3c1353381c7b None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:45.678652 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd3eba-c9bd-45f4-9218-3c1353381c7b None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:45.722888 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d45f2-ac52-4f8d-a04e-fd9a5aa7f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:45.723703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d45f2-ac52-4f8d-a04e-fd9a5aa7f538 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:45.724044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d45f2-ac52-4f8d-a04e-fd9a5aa7f538 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:45.724320 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d45f2-ac52-4f8d-a04e-fd9a5aa7f538 None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:45.739242 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d45f2-ac52-4f8d-a04e-fd9a5aa7f538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-cb5d45f2-ac52-4f8d-a04e-fd9a5aa7f538 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:45.747290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:45.748358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:45.750365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 163/331] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:45.757986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c603f9d-5cdf-4e63-b3da-331cf67fc1cf None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:45.861106 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:45.888467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c603f9d-5cdf-4e63-b3da-331cf67fc1cf None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:45.935676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc163ea6-4f9e-4cc5-9b5b-b6f0ee9425c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:45.936281 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163ea6-4f9e-4cc5-9b5b-b6f0ee9425c2 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:45.936566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163ea6-4f9e-4cc5-9b5b-b6f0ee9425c2 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:45.936846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163ea6-4f9e-4cc5-9b5b-b6f0ee9425c2 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:45.937631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc163ea6-4f9e-4cc5-9b5b-b6f0ee9425c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:45.937944 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc163ea6-4f9e-4cc5-9b5b-b6f0ee9425c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:45.939364 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc163ea6-4f9e-4cc5-9b5b-b6f0ee9425c2 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:45.948562 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 169/332] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:45.955724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d45f2-ac52-4f8d-a04e-fd9a5aa7f538 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:45.995276 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:46.113918 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d45f2-ac52-4f8d-a04e-fd9a5aa7f538 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:46.161084 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244c3b6-81e4-4ba3-9d07-9c36d98d4006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:46.161984 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c3b6-81e4-4ba3-9d07-9c36d98d4006 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:46.162270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c3b6-81e4-4ba3-9d07-9c36d98d4006 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:46.162550 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c3b6-81e4-4ba3-9d07-9c36d98d4006 None admin] PATH_INFO: `/v3/users/e1303eb94cfb48d8a0ee5ab0aa17dbf2` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:46.163862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244c3b6-81e4-4ba3-9d07-9c36d98d4006 None admin] RBAC: Authorizing `identity:get_user(user_id=e1303eb94cfb48d8a0ee5ab0aa17dbf2)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:46.165323 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244c3b6-81e4-4ba3-9d07-9c36d98d4006 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:46.167327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 164/333] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:45 2022] GET /identity/v3/users/e1303eb94cfb48d8a0ee5ab0aa17dbf2 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:46.173509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc163ea6-4f9e-4cc5-9b5b-b6f0ee9425c2 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:46.293960 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc163ea6-4f9e-4cc5-9b5b-b6f0ee9425c2 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:46.334247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749f368-7721-4788-a1a6-e1c86e781abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:46.335434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f368-7721-4788-a1a6-e1c86e781abd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:46.335434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f368-7721-4788-a1a6-e1c86e781abd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:46.335613 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f368-7721-4788-a1a6-e1c86e781abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:46.336341 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749f368-7721-4788-a1a6-e1c86e781abd None admin] RBAC: Adding query filter params (role.id=b6aef1054c2f43a693e82eb19749d60b, user.id=e1303eb94cfb48d8a0ee5ab0aa17dbf2, scope.system=all) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:46.336662 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749f368-7721-4788-a1a6-e1c86e781abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:46.338133 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749f368-7721-4788-a1a6-e1c86e781abd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:46.348354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:46.358936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 170/334] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:45:46 2022] GET /identity/v3/role_assignments?user.id=e1303eb94cfb48d8a0ee5ab0aa17dbf2&scope.system=all&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:48.272804 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f981b1-149a-45c6-a716-2476c4c84081 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:48.273366 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f981b1-149a-45c6-a716-2476c4c84081 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:48.273366 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f981b1-149a-45c6-a716-2476c4c84081 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:48.275076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 165/335] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:48.292797 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da7544-0c4a-412d-9c4f-8920d97af173 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:48.293399 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da7544-0c4a-412d-9c4f-8920d97af173 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:48.293399 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da7544-0c4a-412d-9c4f-8920d97af173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:48.320521 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-a2da7544-0c4a-412d-9c4f-8920d97af173 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:48.321811 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-a2da7544-0c4a-412d-9c4f-8920d97af173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:48.417414 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 171/336] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:48.467236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f981b1-149a-45c6-a716-2476c4c84081 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:48.571551 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:48.596288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f981b1-149a-45c6-a716-2476c4c84081 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:48.642308 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c06221-6a4f-4a94-b3f4-d04caaee7726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:48.643749 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c06221-6a4f-4a94-b3f4-d04caaee7726 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:48.643749 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c06221-6a4f-4a94-b3f4-d04caaee7726 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:48.643749 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c06221-6a4f-4a94-b3f4-d04caaee7726 None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:48.660235 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c06221-6a4f-4a94-b3f4-d04caaee7726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-d5c06221-6a4f-4a94-b3f4-d04caaee7726 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:48.668188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:48.669282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:48.670236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 166/337] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:48.675515 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c06221-6a4f-4a94-b3f4-d04caaee7726 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:48.676240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aa799-9a92-41a6-98b8-f568e1865878 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:48.676773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aa799-9a92-41a6-98b8-f568e1865878 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:48.677271 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aa799-9a92-41a6-98b8-f568e1865878 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:48.679659 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 172/338] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:45:48.692280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26d1c-c752-46b9-a930-555bec003c2d None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:48.693016 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26d1c-c752-46b9-a930-555bec003c2d None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:48.693562 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26d1c-c752-46b9-a930-555bec003c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:48.727464 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-98f26d1c-c752-46b9-a930-555bec003c2d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:48.729137 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-98f26d1c-c752-46b9-a930-555bec003c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:48.810701 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c06221-6a4f-4a94-b3f4-d04caaee7726 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:48.846716 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 173/339] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:48.851843 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4ec93-0f70-4f1d-91cd-dbf336b598d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:48.852551 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ec93-0f70-4f1d-91cd-dbf336b598d4 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:48.852824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ec93-0f70-4f1d-91cd-dbf336b598d4 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:48.853113 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ec93-0f70-4f1d-91cd-dbf336b598d4 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:48.853869 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4ec93-0f70-4f1d-91cd-dbf336b598d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:48.854180 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4ec93-0f70-4f1d-91cd-dbf336b598d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:48.855691 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4ec93-0f70-4f1d-91cd-dbf336b598d4 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:48.866536 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 167/340] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:48.873090 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f26d1c-c752-46b9-a930-555bec003c2d None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:48.888832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4ec93-0f70-4f1d-91cd-dbf336b598d4 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:48.901802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:48.977169 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:49.016571 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4ec93-0f70-4f1d-91cd-dbf336b598d4 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:49.064079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7455d9f-aaae-4c8a-958e-572d54be6268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:49.064917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7455d9f-aaae-4c8a-958e-572d54be6268 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:49.065202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7455d9f-aaae-4c8a-958e-572d54be6268 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:49.065478 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7455d9f-aaae-4c8a-958e-572d54be6268 None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:49.080042 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f26d1c-c752-46b9-a930-555bec003c2d None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:49.095518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7455d9f-aaae-4c8a-958e-572d54be6268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-a7455d9f-aaae-4c8a-958e-572d54be6268 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:49.103750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:49.104867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:49.105811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 168/341] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:45:49.106748 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059086d7-15fe-47bc-b749-169eb9a65ec2 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:49.106748 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059086d7-15fe-47bc-b749-169eb9a65ec2 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:49.122723 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059086d7-15fe-47bc-b749-169eb9a65ec2 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:49.124227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 169/342] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:49 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:49.131148 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059086d7-15fe-47bc-b749-169eb9a65ec2 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:49.200464 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0047bf1-43c5-4f45-8317-0e8af9317de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:49.201148 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047bf1-43c5-4f45-8317-0e8af9317de8 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:49.201437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047bf1-43c5-4f45-8317-0e8af9317de8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:49.201719 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047bf1-43c5-4f45-8317-0e8af9317de8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:49.213363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:49.271354 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059086d7-15fe-47bc-b749-169eb9a65ec2 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:49.305260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0047bf1-43c5-4f45-8317-0e8af9317de8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:49.307464 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0047bf1-43c5-4f45-8317-0e8af9317de8 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:49.320165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83868732-1228-4290-88c5-31dc75631ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:49.320902 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83868732-1228-4290-88c5-31dc75631ed1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:49.321131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83868732-1228-4290-88c5-31dc75631ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:49.321415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83868732-1228-4290-88c5-31dc75631ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:49.323965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83868732-1228-4290-88c5-31dc75631ed1 None admin] RBAC: Adding query filter params (name=member) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:49.323965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83868732-1228-4290-88c5-31dc75631ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:49.324419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83868732-1228-4290-88c5-31dc75631ed1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:49.336451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 170/343] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:49.338402 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78723-e6ed-4a26-9e40-5522510b8728 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:49.340760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78723-e6ed-4a26-9e40-5522510b8728 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:49.340760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78723-e6ed-4a26-9e40-5522510b8728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:49.361681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-a3e78723-e6ed-4a26-9e40-5522510b8728 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:49.363188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-a3e78723-e6ed-4a26-9e40-5522510b8728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:49.388292 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:49.502914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 171/345] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:49.504666 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabfd83-dc5d-4dfe-8012-84dfa4a62957 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:49.505197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabfd83-dc5d-4dfe-8012-84dfa4a62957 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:49.505691 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabfd83-dc5d-4dfe-8012-84dfa4a62957 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:49.506743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 174/345] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:49.507502 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 172/346] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:49.508183 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c9d6-8720-4983-ac06-43b2f66d2c94 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:49.508478 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c9d6-8720-4983-ac06-43b2f66d2c94 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:49.508759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c9d6-8720-4983-ac06-43b2f66d2c94 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:49.509179 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabfd83-dc5d-4dfe-8012-84dfa4a62957 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:49.516826 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 175/347] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:49.518794 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d001-2cb0-4563-bc3b-78539887f97b None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:49.518794 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d001-2cb0-4563-bc3b-78539887f97b None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:49.518983 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d001-2cb0-4563-bc3b-78539887f97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:49.536925 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-8e23d001-2cb0-4563-bc3b-78539887f97b None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:49.538267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-8e23d001-2cb0-4563-bc3b-78539887f97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:49.593550 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:49.640130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 176/348] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:49.641391 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b30cee-e660-45ce-94e4-71f3ed764134 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:49.641835 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b30cee-e660-45ce-94e4-71f3ed764134 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:49.642119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b30cee-e660-45ce-94e4-71f3ed764134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:49.650371 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabfd83-dc5d-4dfe-8012-84dfa4a62957 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:49.664436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-34b30cee-e660-45ce-94e4-71f3ed764134 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:49.665764 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-34b30cee-e660-45ce-94e4-71f3ed764134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:49.695482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145816fe-eb2d-4f74-9f55-ea994fd8f6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:49.695972 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145816fe-eb2d-4f74-9f55-ea994fd8f6bc None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:49.696252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145816fe-eb2d-4f74-9f55-ea994fd8f6bc None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:49.696526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145816fe-eb2d-4f74-9f55-ea994fd8f6bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:49.756813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 177/349] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:49.758087 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b30cee-e660-45ce-94e4-71f3ed764134 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:49.779430 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:49.793296 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145816fe-eb2d-4f74-9f55-ea994fd8f6bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:49.796671 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145816fe-eb2d-4f74-9f55-ea994fd8f6bc None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:49.864390 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:49.882031 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b30cee-e660-45ce-94e4-71f3ed764134 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:49.915724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 173/350] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:49.916318 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145816fe-eb2d-4f74-9f55-ea994fd8f6bc None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:49.922453 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316afc2-8b71-434e-b612-f34a820a2129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:49.923537 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316afc2-8b71-434e-b612-f34a820a2129 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:49.923537 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316afc2-8b71-434e-b612-f34a820a2129 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:49.923750 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316afc2-8b71-434e-b612-f34a820a2129 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:49.927473 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316afc2-8b71-434e-b612-f34a820a2129 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:49.928935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316afc2-8b71-434e-b612-f34a820a2129 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:49.931173 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 178/351] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:49 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:49.931466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316afc2-8b71-434e-b612-f34a820a2129 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:50.035451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:50.051768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145816fe-eb2d-4f74-9f55-ea994fd8f6bc None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:50.056578 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316afc2-8b71-434e-b612-f34a820a2129 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:50.096020 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c29c0-eeac-4b4e-b39c-f6ebfa8962ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:50.096837 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c29c0-eeac-4b4e-b39c-f6ebfa8962ab None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.097113 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c29c0-eeac-4b4e-b39c-f6ebfa8962ab None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.097377 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c29c0-eeac-4b4e-b39c-f6ebfa8962ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.101455 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5201f9-793a-4707-9374-565a60361fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:50.102402 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5201f9-793a-4707-9374-565a60361fb1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.102902 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5201f9-793a-4707-9374-565a60361fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.103179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5201f9-793a-4707-9374-565a60361fb1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.109727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c29c0-eeac-4b4e-b39c-f6ebfa8962ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:50.114118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5201f9-793a-4707-9374-565a60361fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-203c29c0-eeac-4b4e-b39c-f6ebfa8962ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:50.117977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:50.119089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:50.120049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 174/352] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:45:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:50.120850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c29c0-eeac-4b4e-b39c-f6ebfa8962ab None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-cb5201f9-793a-4707-9374-565a60361fb1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:50.123203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:50.124652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 179/353] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:50.125739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0955aa-95df-43a5-87ed-2022f9481247 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.126776 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0955aa-95df-43a5-87ed-2022f9481247 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.126776 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0955aa-95df-43a5-87ed-2022f9481247 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.127005 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 180/354] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:50.128426 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0955aa-95df-43a5-87ed-2022f9481247 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:50.142353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:50.240296 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c29c0-eeac-4b4e-b39c-f6ebfa8962ab None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:50.257523 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0955aa-95df-43a5-87ed-2022f9481247 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:50.283914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223b225-f693-4c99-afcb-8f86a84c22a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:50.285469 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223b225-f693-4c99-afcb-8f86a84c22a1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.285597 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223b225-f693-4c99-afcb-8f86a84c22a1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.285816 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223b225-f693-4c99-afcb-8f86a84c22a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.298476 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223b225-f693-4c99-afcb-8f86a84c22a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:50.300889 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24cb7-2326-4d47-b6b9-7f3593001364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:50.302447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24cb7-2326-4d47-b6b9-7f3593001364 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.302931 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24cb7-2326-4d47-b6b9-7f3593001364 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.303395 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24cb7-2326-4d47-b6b9-7f3593001364 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.304758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e24cb7-2326-4d47-b6b9-7f3593001364 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:50.306190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e24cb7-2326-4d47-b6b9-7f3593001364 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-a223b225-f693-4c99-afcb-8f86a84c22a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:50.307013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:50.308098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:50.310362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:50.311292 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 181/355] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:50 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:50.311420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 175/356] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:45:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:50.311420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223b225-f693-4c99-afcb-8f86a84c22a1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:50.315119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24cb7-2326-4d47-b6b9-7f3593001364 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:50.333284 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:50.414582 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:50.432318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24cb7-2326-4d47-b6b9-7f3593001364 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:50.438961 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223b225-f693-4c99-afcb-8f86a84c22a1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:50.470579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052f443-a7da-4e88-8c82-106f435e0428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:50.472117 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052f443-a7da-4e88-8c82-106f435e0428 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.472117 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052f443-a7da-4e88-8c82-106f435e0428 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.472117 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052f443-a7da-4e88-8c82-106f435e0428 None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.479240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052f443-a7da-4e88-8c82-106f435e0428 None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:50.480684 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052f443-a7da-4e88-8c82-106f435e0428 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:50.481268 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e72b6-d6d5-4dd9-bc83-a4ffe90455c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:50.482154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e72b6-d6d5-4dd9-bc83-a4ffe90455c3 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.482674 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e72b6-d6d5-4dd9-bc83-a4ffe90455c3 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.482789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 182/357] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:45:50 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:50.483254 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e72b6-d6d5-4dd9-bc83-a4ffe90455c3 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.483595 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052f443-a7da-4e88-8c82-106f435e0428 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:50.484360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e72b6-d6d5-4dd9-bc83-a4ffe90455c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:50.484674 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e72b6-d6d5-4dd9-bc83-a4ffe90455c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:50.486299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e72b6-d6d5-4dd9-bc83-a4ffe90455c3 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:50.496416 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 176/358] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:50.498701 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee51560-4298-4513-b18e-b93f3d290c60 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.499230 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee51560-4298-4513-b18e-b93f3d290c60 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.499745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee51560-4298-4513-b18e-b93f3d290c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.521119 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-7ee51560-4298-4513-b18e-b93f3d290c60 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:50.522373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-7ee51560-4298-4513-b18e-b93f3d290c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:50.582421 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:50.610836 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052f443-a7da-4e88-8c82-106f435e0428 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:50.624641 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 177/359] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:50.625510 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee51560-4298-4513-b18e-b93f3d290c60 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:50.655052 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d547245-d232-494a-8f69-c81645c00b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:50.655749 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d547245-d232-494a-8f69-c81645c00b73 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.656037 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d547245-d232-494a-8f69-c81645c00b73 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.656318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d547245-d232-494a-8f69-c81645c00b73 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.657094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d547245-d232-494a-8f69-c81645c00b73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:50.657408 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d547245-d232-494a-8f69-c81645c00b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:50.659044 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d547245-d232-494a-8f69-c81645c00b73 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:50.673417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 183/360] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:45:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:50.674353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d547245-d232-494a-8f69-c81645c00b73 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:50.714052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:50.752460 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee51560-4298-4513-b18e-b93f3d290c60 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:50.794241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c33ac-2181-4502-8c78-8fd91a0a311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:50.795219 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c33ac-2181-4502-8c78-8fd91a0a311b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.795502 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c33ac-2181-4502-8c78-8fd91a0a311b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.795891 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c33ac-2181-4502-8c78-8fd91a0a311b None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.796972 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c33ac-2181-4502-8c78-8fd91a0a311b None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:50.798076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d547245-d232-494a-8f69-c81645c00b73 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:50.798416 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c33ac-2181-4502-8c78-8fd91a0a311b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:50.800159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 178/361] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:45:50 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:50.801352 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c33ac-2181-4502-8c78-8fd91a0a311b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:50.838254 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a862e-17fe-4dd3-b99b-ffae20e5ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:50.838967 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a862e-17fe-4dd3-b99b-ffae20e5ec6a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.839251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a862e-17fe-4dd3-b99b-ffae20e5ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.839524 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a862e-17fe-4dd3-b99b-ffae20e5ec6a None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.841040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a862e-17fe-4dd3-b99b-ffae20e5ec6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:50.841040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a862e-17fe-4dd3-b99b-ffae20e5ec6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:50.842578 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a862e-17fe-4dd3-b99b-ffae20e5ec6a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:50.848731 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:50.852538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 184/362] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:45:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:50.853480 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a862e-17fe-4dd3-b99b-ffae20e5ec6a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:50.913859 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c33ac-2181-4502-8c78-8fd91a0a311b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:50.948591 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db149b6-e9b0-48a4-b3ef-8fd99db46f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:50.949247 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db149b6-e9b0-48a4-b3ef-8fd99db46f95 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.949525 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db149b6-e9b0-48a4-b3ef-8fd99db46f95 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.949831 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db149b6-e9b0-48a4-b3ef-8fd99db46f95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.950686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db149b6-e9b0-48a4-b3ef-8fd99db46f95 None admin] RBAC: Adding query filter params (group.id=9890e92d4d27447386c5ec3bc6cc76a7, role.id=b6aef1054c2f43a693e82eb19749d60b, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:50.951004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db149b6-e9b0-48a4-b3ef-8fd99db46f95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:50.952432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db149b6-e9b0-48a4-b3ef-8fd99db46f95 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:50.955447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a862e-17fe-4dd3-b99b-ffae20e5ec6a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:50.957873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 179/363] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:45:50 2022] GET /identity/v3/role_assignments?group.id=9890e92d4d27447386c5ec3bc6cc76a7&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:50.958672 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db149b6-e9b0-48a4-b3ef-8fd99db46f95 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:50.961208 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:50.993816 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1188-d363-4c34-84e3-59dee31c80fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:50.994754 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1188-d363-4c34-84e3-59dee31c80fd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:50.995050 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1188-d363-4c34-84e3-59dee31c80fd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:50.995327 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1188-d363-4c34-84e3-59dee31c80fd None admin] PATH_INFO: `/v3/users/9c1636ff74934e7d822e4e03aa99e585` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:50.997203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1188-d363-4c34-84e3-59dee31c80fd None admin] RBAC: Authorizing `identity:get_user(user_id=9c1636ff74934e7d822e4e03aa99e585)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:50.998730 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1188-d363-4c34-84e3-59dee31c80fd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:51.005358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 185/364] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:45:50 2022] GET /identity/v3/users/9c1636ff74934e7d822e4e03aa99e585 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:51.005358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1188-d363-4c34-84e3-59dee31c80fd None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:51.088757 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db149b6-e9b0-48a4-b3ef-8fd99db46f95 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:51.094419 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:51.132574 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a231b-9658-457f-8e0b-06150efd8416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:51.133407 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a231b-9658-457f-8e0b-06150efd8416 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:51.133697 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a231b-9658-457f-8e0b-06150efd8416 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:51.133980 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a231b-9658-457f-8e0b-06150efd8416 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:51.135259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1188-d363-4c34-84e3-59dee31c80fd None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:51.146764 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a231b-9658-457f-8e0b-06150efd8416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-1e1a231b-9658-457f-8e0b-06150efd8416 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:51.155349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:51.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:51.157344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 180/365] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:45:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:51.158143 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a231b-9658-457f-8e0b-06150efd8416 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:51.180100 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf494a30-2069-400a-bee0-1d46da73b9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:51.180765 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf494a30-2069-400a-bee0-1d46da73b9dc None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:51.181102 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf494a30-2069-400a-bee0-1d46da73b9dc None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:51.181353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf494a30-2069-400a-bee0-1d46da73b9dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:51.227726 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:51.257571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf494a30-2069-400a-bee0-1d46da73b9dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:51.258977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf494a30-2069-400a-bee0-1d46da73b9dc None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:51.271383 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a231b-9658-457f-8e0b-06150efd8416 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:51.310029 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e13734-105f-47bd-81ca-fa1f4172205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:51.310730 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e13734-105f-47bd-81ca-fa1f4172205e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:51.311019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e13734-105f-47bd-81ca-fa1f4172205e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:51.311530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e13734-105f-47bd-81ca-fa1f4172205e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:51.312132 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e13734-105f-47bd-81ca-fa1f4172205e None admin] RBAC: Adding query filter params (group.id=9890e92d4d27447386c5ec3bc6cc76a7, role.id=b6aef1054c2f43a693e82eb19749d60b, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:51.312445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e13734-105f-47bd-81ca-fa1f4172205e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:51.313912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e13734-105f-47bd-81ca-fa1f4172205e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:51.330958 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 181/366] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:45:51 2022] GET /identity/v3/role_assignments?group.id=9890e92d4d27447386c5ec3bc6cc76a7&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:51.330958 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e13734-105f-47bd-81ca-fa1f4172205e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:51.342817 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:51.403301 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 186/367] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:51.404616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf494a30-2069-400a-bee0-1d46da73b9dc None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:51.477600 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e13734-105f-47bd-81ca-fa1f4172205e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:51.513950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:51.525485 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca628-3f78-4e52-b1bc-c1316fd94805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:51.529998 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca628-3f78-4e52-b1bc-c1316fd94805 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:51.529998 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca628-3f78-4e52-b1bc-c1316fd94805 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:51.529998 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca628-3f78-4e52-b1bc-c1316fd94805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:51.537204 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf494a30-2069-400a-bee0-1d46da73b9dc None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:51.588594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df434-96cb-485a-85c0-a18acc255eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:51.589658 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df434-96cb-485a-85c0-a18acc255eb4 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:51.590039 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df434-96cb-485a-85c0-a18acc255eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:51.590992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df434-96cb-485a-85c0-a18acc255eb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:51.592536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df434-96cb-485a-85c0-a18acc255eb4 None admin] RBAC: Adding query filter params (role.id=429fffc185ca46c6a104c64d4325c366, user.id=9c1636ff74934e7d822e4e03aa99e585, scope.system=all) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:51.592860 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df434-96cb-485a-85c0-a18acc255eb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:51.594922 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df434-96cb-485a-85c0-a18acc255eb4 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:51.605559 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca628-3f78-4e52-b1bc-c1316fd94805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:51.607214 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca628-3f78-4e52-b1bc-c1316fd94805 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:51.612064 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 187/368] 10.222.0.89 () {56 vars in 1308 bytes} [Thu May 19 20:45:51 2022] GET /identity/v3/role_assignments?user.id=9c1636ff74934e7d822e4e03aa99e585&scope.system=all&role.id=429fffc185ca46c6a104c64d4325c366 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:51.613036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df434-96cb-485a-85c0-a18acc255eb4 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:51.656001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:51.724907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 182/369] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:51.725660 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca628-3f78-4e52-b1bc-c1316fd94805 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:51.750339 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df434-96cb-485a-85c0-a18acc255eb4 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:51.755985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:51.790039 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61769519-a52b-43a2-87c5-9f5ee3c5f68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:51.790664 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61769519-a52b-43a2-87c5-9f5ee3c5f68e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:51.790958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61769519-a52b-43a2-87c5-9f5ee3c5f68e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:51.791240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61769519-a52b-43a2-87c5-9f5ee3c5f68e None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:51.792007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61769519-a52b-43a2-87c5-9f5ee3c5f68e None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:51.792322 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61769519-a52b-43a2-87c5-9f5ee3c5f68e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:51.793753 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61769519-a52b-43a2-87c5-9f5ee3c5f68e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:51.803455 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 188/370] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:51.804352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61769519-a52b-43a2-87c5-9f5ee3c5f68e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:51.840925 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca628-3f78-4e52-b1bc-c1316fd94805 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:51.880214 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673db524-9dfd-4a9b-8479-e8c23fcb1b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:51.881147 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db524-9dfd-4a9b-8479-e8c23fcb1b6b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:51.881441 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db524-9dfd-4a9b-8479-e8c23fcb1b6b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:51.881720 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db524-9dfd-4a9b-8479-e8c23fcb1b6b None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:51.883030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673db524-9dfd-4a9b-8479-e8c23fcb1b6b None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:51.884503 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673db524-9dfd-4a9b-8479-e8c23fcb1b6b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:51.886509 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 183/371] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:51 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:51.887164 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673db524-9dfd-4a9b-8479-e8c23fcb1b6b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:51.905792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:51.920623 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61769519-a52b-43a2-87c5-9f5ee3c5f68e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:51.968086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f396f4-dd4a-4694-a353-9c1fd33eb602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:51.968993 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f396f4-dd4a-4694-a353-9c1fd33eb602 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:51.969280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f396f4-dd4a-4694-a353-9c1fd33eb602 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:51.969562 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f396f4-dd4a-4694-a353-9c1fd33eb602 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:51.970914 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f396f4-dd4a-4694-a353-9c1fd33eb602 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:51.972448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f396f4-dd4a-4694-a353-9c1fd33eb602 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:51.974595 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 189/372] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:51 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:51.975438 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f396f4-dd4a-4694-a353-9c1fd33eb602 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:51.995733 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:52.007873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673db524-9dfd-4a9b-8479-e8c23fcb1b6b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:52.063156 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d047a09-5314-4e73-ae24-39222fbd7ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:52.064171 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d047a09-5314-4e73-ae24-39222fbd7ebc None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:52.064856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d047a09-5314-4e73-ae24-39222fbd7ebc None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:52.065330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d047a09-5314-4e73-ae24-39222fbd7ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:52.132363 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f396f4-dd4a-4694-a353-9c1fd33eb602 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:52.141172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d047a09-5314-4e73-ae24-39222fbd7ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:52.143076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d047a09-5314-4e73-ae24-39222fbd7ebc None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:52.170692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8f8a-9df0-4aea-8be6-0ed51aa8d0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:52.171609 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8f8a-9df0-4aea-8be6-0ed51aa8d0ea None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:52.171971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8f8a-9df0-4aea-8be6-0ed51aa8d0ea None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:52.172321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8f8a-9df0-4aea-8be6-0ed51aa8d0ea None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:52.174009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8f8a-9df0-4aea-8be6-0ed51aa8d0ea None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:52.175631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8f8a-9df0-4aea-8be6-0ed51aa8d0ea None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:52.182529 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 190/373] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:45:51 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:52.182529 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8f8a-9df0-4aea-8be6-0ed51aa8d0ea None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:52.213624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:52.258534 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:52.269292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 184/374] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:52.270578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d047a09-5314-4e73-ae24-39222fbd7ebc None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:52.324155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8f8a-9df0-4aea-8be6-0ed51aa8d0ea None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:52.364423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664ac61-a7ef-4e83-afbc-5d93e4c092bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:52.366117 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664ac61-a7ef-4e83-afbc-5d93e4c092bf None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:52.366633 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664ac61-a7ef-4e83-afbc-5d93e4c092bf None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:52.367120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664ac61-a7ef-4e83-afbc-5d93e4c092bf None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:52.368555 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664ac61-a7ef-4e83-afbc-5d93e4c092bf None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:52.371197 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664ac61-a7ef-4e83-afbc-5d93e4c092bf None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:52.378596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 191/375] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:45:52 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:52.379934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664ac61-a7ef-4e83-afbc-5d93e4c092bf None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:52.403187 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d047a09-5314-4e73-ae24-39222fbd7ebc None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:52.448927 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72c2b4-fdd2-4adc-aaa1-d7223613edb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:52.450047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c2b4-fdd2-4adc-aaa1-d7223613edb8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:52.450663 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c2b4-fdd2-4adc-aaa1-d7223613edb8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:52.451286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c2b4-fdd2-4adc-aaa1-d7223613edb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:52.452334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72c2b4-fdd2-4adc-aaa1-d7223613edb8 None admin] RBAC: Adding query filter params (group.id=9890e92d4d27447386c5ec3bc6cc76a7, role.id=715071b6b1244a559110be37cc8410ab, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:52.452917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72c2b4-fdd2-4adc-aaa1-d7223613edb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:52.454847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72c2b4-fdd2-4adc-aaa1-d7223613edb8 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:52.461361 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 185/376] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:45:52 2022] GET /identity/v3/role_assignments?group.id=9890e92d4d27447386c5ec3bc6cc76a7&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=715071b6b1244a559110be37cc8410ab => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:52.462695 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72c2b4-fdd2-4adc-aaa1-d7223613edb8 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:52.501646 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:52.515858 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664ac61-a7ef-4e83-afbc-5d93e4c092bf None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:52.541919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:52.565590 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6dba-dceb-4802-b0b6-08f67cae64e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:52.566500 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6dba-dceb-4802-b0b6-08f67cae64e1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:52.566818 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6dba-dceb-4802-b0b6-08f67cae64e1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:52.567097 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6dba-dceb-4802-b0b6-08f67cae64e1 None admin] PATH_INFO: `/v3/projects/0cd97939f145462186b2c89bb3a6460f` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:52.569068 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6dba-dceb-4802-b0b6-08f67cae64e1 None admin] RBAC: Authorizing `identity:get_project(project_id=0cd97939f145462186b2c89bb3a6460f)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:52.570925 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6dba-dceb-4802-b0b6-08f67cae64e1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:52.573781 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 192/377] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:52 2022] GET /identity/v3/projects/0cd97939f145462186b2c89bb3a6460f => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:52.579188 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6dba-dceb-4802-b0b6-08f67cae64e1 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:52.599795 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72c2b4-fdd2-4adc-aaa1-d7223613edb8 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:52.690000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7006-40ba-443c-9104-817e180d3751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:52.691126 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7006-40ba-443c-9104-817e180d3751 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:52.693188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7006-40ba-443c-9104-817e180d3751 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:52.693704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7006-40ba-443c-9104-817e180d3751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:52.694831 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba7006-40ba-443c-9104-817e180d3751 None admin] RBAC: Adding query filter params (group.id=9890e92d4d27447386c5ec3bc6cc76a7, role.id=715071b6b1244a559110be37cc8410ab, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:52.696555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba7006-40ba-443c-9104-817e180d3751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:52.698417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba7006-40ba-443c-9104-817e180d3751 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:52.712467 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 186/378] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:45:52 2022] GET /identity/v3/role_assignments?group.id=9890e92d4d27447386c5ec3bc6cc76a7&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=715071b6b1244a559110be37cc8410ab => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:52.771276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6dba-dceb-4802-b0b6-08f67cae64e1 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:52.816965 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfceb85f-06dd-4ee8-ab89-32b2e7995e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:52.818053 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceb85f-06dd-4ee8-ab89-32b2e7995e1b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:52.818343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceb85f-06dd-4ee8-ab89-32b2e7995e1b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:52.818640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceb85f-06dd-4ee8-ab89-32b2e7995e1b None admin] PATH_INFO: `/v3/groups/da3cbac8fa194be692977c534812a65f` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:52.824524 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfceb85f-06dd-4ee8-ab89-32b2e7995e1b None admin] RBAC: Authorizing `identity:get_group(group_id=da3cbac8fa194be692977c534812a65f)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:52.826096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfceb85f-06dd-4ee8-ab89-32b2e7995e1b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:52.828398 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 193/379] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:45:52 2022] GET /identity/v3/groups/da3cbac8fa194be692977c534812a65f => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:52.833939 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7006-40ba-443c-9104-817e180d3751 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:52.946145 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7006-40ba-443c-9104-817e180d3751 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:52.971937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:52.984319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad323f8a-358b-42da-bff0-8a9315eb6e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:52.984981 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad323f8a-358b-42da-bff0-8a9315eb6e1d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:52.989908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad323f8a-358b-42da-bff0-8a9315eb6e1d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:52.989908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad323f8a-358b-42da-bff0-8a9315eb6e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:52.989908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad323f8a-358b-42da-bff0-8a9315eb6e1d None admin] RBAC: Adding query filter params (group.id=da3cbac8fa194be692977c534812a65f, role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=0cd97939f145462186b2c89bb3a6460f) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:52.989908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad323f8a-358b-42da-bff0-8a9315eb6e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:52.989908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad323f8a-358b-42da-bff0-8a9315eb6e1d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:52.997672 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 187/380] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:45:52 2022] GET /identity/v3/role_assignments?group.id=da3cbac8fa194be692977c534812a65f&scope.project.id=0cd97939f145462186b2c89bb3a6460f&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:53.870754 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9498-858e-4d1c-96e7-9544bd04f59f None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:53.872216 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9498-858e-4d1c-96e7-9544bd04f59f None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:53.872658 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9498-858e-4d1c-96e7-9544bd04f59f None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:53.874598 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 194/381] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:53.880928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c17c9-8b43-4fac-babd-20e0d9ad1ac4 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:53.881837 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c17c9-8b43-4fac-babd-20e0d9ad1ac4 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:53.882298 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c17c9-8b43-4fac-babd-20e0d9ad1ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:53.907709 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-6f2c17c9-8b43-4fac-babd-20e0d9ad1ac4 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:53.909247 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-6f2c17c9-8b43-4fac-babd-20e0d9ad1ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:54.005294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 188/382] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:54.035497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f9498-858e-4d1c-96e7-9544bd04f59f None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:54.087787 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:54.203152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f9498-858e-4d1c-96e7-9544bd04f59f None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:54.254921 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f08d7c-05d7-4e47-96c3-cb0689835b2f None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:54.255522 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f08d7c-05d7-4e47-96c3-cb0689835b2f None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:54.255951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f08d7c-05d7-4e47-96c3-cb0689835b2f None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:54.257774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 189/383] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:54.261559 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d487569-90d1-4ae9-8e21-460425b7e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:54.262401 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d487569-90d1-4ae9-8e21-460425b7e88c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:54.262717 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d487569-90d1-4ae9-8e21-460425b7e88c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:54.262996 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d487569-90d1-4ae9-8e21-460425b7e88c None admin] PATH_INFO: `/v3/roles/member` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:54.273952 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a21280-4a6b-4621-b430-f18f5f31debc None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:54.274546 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a21280-4a6b-4621-b430-f18f5f31debc None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:54.275086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a21280-4a6b-4621-b430-f18f5f31debc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:54.280714 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d487569-90d1-4ae9-8e21-460425b7e88c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-0d487569-90d1-4ae9-8e21-460425b7e88c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:54.286267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:54.287358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:54.289599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 195/384] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:54.303956 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d487569-90d1-4ae9-8e21-460425b7e88c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:54.306283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-a3a21280-4a6b-4621-b430-f18f5f31debc None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:54.307798 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-a3a21280-4a6b-4621-b430-f18f5f31debc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:54.429961 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 190/385] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:54.452994 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a21280-4a6b-4621-b430-f18f5f31debc None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:54.483764 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:54.517801 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d487569-90d1-4ae9-8e21-460425b7e88c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:54.540790 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:54.582349 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9f72f-2d79-41fa-95df-3944d14df281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:54.583499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9f72f-2d79-41fa-95df-3944d14df281 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:54.584003 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9f72f-2d79-41fa-95df-3944d14df281 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:54.584524 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9f72f-2d79-41fa-95df-3944d14df281 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:54.585527 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9f72f-2d79-41fa-95df-3944d14df281 None admin] RBAC: Adding query filter params (name=member) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:54.586055 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9f72f-2d79-41fa-95df-3944d14df281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:54.587718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9f72f-2d79-41fa-95df-3944d14df281 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:54.609486 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 196/386] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:54.615609 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9f72f-2d79-41fa-95df-3944d14df281 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:54.640713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a21280-4a6b-4621-b430-f18f5f31debc None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:54.712762 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b5fed-c08b-48a2-a900-a227ab9ba5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:54.716733 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b5fed-c08b-48a2-a900-a227ab9ba5ac None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:54.717247 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b5fed-c08b-48a2-a900-a227ab9ba5ac None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:54.717770 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b5fed-c08b-48a2-a900-a227ab9ba5ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:54.738702 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b5fed-c08b-48a2-a900-a227ab9ba5ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-822b5fed-c08b-48a2-a900-a227ab9ba5ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:54.750464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:54.751586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:54.752555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:54.760197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 191/387] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:45:54.768284 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b5fed-c08b-48a2-a900-a227ab9ba5ac None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:54.816826 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9f72f-2d79-41fa-95df-3944d14df281 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:54.892971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36466a22-f70b-419a-af1c-ac1fa2e9f1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:54.895952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466a22-f70b-419a-af1c-ac1fa2e9f1ac None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:54.897752 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466a22-f70b-419a-af1c-ac1fa2e9f1ac None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:54.898297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466a22-f70b-419a-af1c-ac1fa2e9f1ac None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:54.901874 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36466a22-f70b-419a-af1c-ac1fa2e9f1ac None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:54.906169 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36466a22-f70b-419a-af1c-ac1fa2e9f1ac None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:54.908221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 197/388] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:45:54 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:54.914073 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36466a22-f70b-419a-af1c-ac1fa2e9f1ac None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:54.946960 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:54.972033 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b5fed-c08b-48a2-a900-a227ab9ba5ac None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:54.985644 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:55.027339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200a47c-dffc-449a-baf3-1618fcee9331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:55.028466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200a47c-dffc-449a-baf3-1618fcee9331 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.028922 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200a47c-dffc-449a-baf3-1618fcee9331 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.029416 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200a47c-dffc-449a-baf3-1618fcee9331 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.030369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200a47c-dffc-449a-baf3-1618fcee9331 None admin] RBAC: Adding query filter params (name=member) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:55.030857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200a47c-dffc-449a-baf3-1618fcee9331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:55.032680 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200a47c-dffc-449a-baf3-1618fcee9331 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:55.052976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 192/389] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:55.056238 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200a47c-dffc-449a-baf3-1618fcee9331 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:55.116559 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36466a22-f70b-419a-af1c-ac1fa2e9f1ac None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:55.189764 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47b3a1-cd9d-4774-af78-ee4fd8e70284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:55.190683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47b3a1-cd9d-4774-af78-ee4fd8e70284 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.190971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47b3a1-cd9d-4774-af78-ee4fd8e70284 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.191248 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47b3a1-cd9d-4774-af78-ee4fd8e70284 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.192503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47b3a1-cd9d-4774-af78-ee4fd8e70284 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:55.193958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47b3a1-cd9d-4774-af78-ee4fd8e70284 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:55.200276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 198/390] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:54 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:55.206004 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47b3a1-cd9d-4774-af78-ee4fd8e70284 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:55.260745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200a47c-dffc-449a-baf3-1618fcee9331 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:55.328393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215c818-ee5d-47f8-9b4c-025c38be62bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:55.329646 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215c818-ee5d-47f8-9b4c-025c38be62bf None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.330148 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215c818-ee5d-47f8-9b4c-025c38be62bf None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.330688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215c818-ee5d-47f8-9b4c-025c38be62bf None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.332912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215c818-ee5d-47f8-9b4c-025c38be62bf None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:55.334658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215c818-ee5d-47f8-9b4c-025c38be62bf None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:55.339580 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 193/391] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:45:55 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:55.341405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:55.342282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215c818-ee5d-47f8-9b4c-025c38be62bf None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:55.374142 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47b3a1-cd9d-4774-af78-ee4fd8e70284 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:55.401157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:55.412660 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15538ca3-36fb-43db-85a2-85d9ff5ae67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:55.413558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538ca3-36fb-43db-85a2-85d9ff5ae67e None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.414172 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538ca3-36fb-43db-85a2-85d9ff5ae67e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.414172 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538ca3-36fb-43db-85a2-85d9ff5ae67e None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/groups/9890e92d4d27447386c5ec3bc6cc76a7/roles/b6aef1054c2f43a693e82eb19749d60b` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.416207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15538ca3-36fb-43db-85a2-85d9ff5ae67e None admin] RBAC: Authorizing `identity:create_grant(project_id=41f0c6987ff94c9cb442a42b28d9f386, group_id=9890e92d4d27447386c5ec3bc6cc76a7, role_id=b6aef1054c2f43a693e82eb19749d60b)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:55.417685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15538ca3-36fb-43db-85a2-85d9ff5ae67e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:55.491253 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215c818-ee5d-47f8-9b4c-025c38be62bf None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:55.502927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 199/392] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:45:55 2022] PUT /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/groups/9890e92d4d27447386c5ec3bc6cc76a7/roles/b6aef1054c2f43a693e82eb19749d60b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:55.505021 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977bc67-9ff6-4f1a-a77c-2580a5e686b6 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.505402 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977bc67-9ff6-4f1a-a77c-2580a5e686b6 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.505691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977bc67-9ff6-4f1a-a77c-2580a5e686b6 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.518650 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 200/393] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:55.530835 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ea4c-873a-4e39-8fa8-30f7eb8b1350 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.531266 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ea4c-873a-4e39-8fa8-30f7eb8b1350 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.533711 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ea4c-873a-4e39-8fa8-30f7eb8b1350 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.543025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 201/394] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:55 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:55.543025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ea04-219e-4643-b286-e8af2d9f16e8 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.543025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ea04-219e-4643-b286-e8af2d9f16e8 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.543025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ea04-219e-4643-b286-e8af2d9f16e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.552369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b807bb7-36ec-478a-b253-b57d458d3c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:55.553272 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b807bb7-36ec-478a-b253-b57d458d3c71 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.553563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b807bb7-36ec-478a-b253-b57d458d3c71 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.553844 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b807bb7-36ec-478a-b253-b57d458d3c71 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.555268 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b807bb7-36ec-478a-b253-b57d458d3c71 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:55.556936 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b807bb7-36ec-478a-b253-b57d458d3c71 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:55.564776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 194/395] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:55 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:55.566269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0040d4-6b48-4760-ab20-090c2c2752f0 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.566694 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0040d4-6b48-4760-ab20-090c2c2752f0 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.566994 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0040d4-6b48-4760-ab20-090c2c2752f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.568429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-14c0ea04-219e-4643-b286-e8af2d9f16e8 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:55.569956 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-14c0ea04-219e-4643-b286-e8af2d9f16e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:55.587047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-7f0040d4-6b48-4760-ab20-090c2c2752f0 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:55.588253 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-7f0040d4-6b48-4760-ab20-090c2c2752f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:55.659467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 202/396] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:55.660443 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0ea04-219e-4643-b286-e8af2d9f16e8 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:55.671433 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 195/397] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:55.695935 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0040d4-6b48-4760-ab20-090c2c2752f0 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:55.739466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:55.761580 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:55.796248 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0ea04-219e-4643-b286-e8af2d9f16e8 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:55.821218 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0040d4-6b48-4760-ab20-090c2c2752f0 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:55.836505 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79c7a-76dc-4978-837f-3e00449cd767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:55.837457 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79c7a-76dc-4978-837f-3e00449cd767 None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.837724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79c7a-76dc-4978-837f-3e00449cd767 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.837988 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79c7a-76dc-4978-837f-3e00449cd767 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/groups/9890e92d4d27447386c5ec3bc6cc76a7/roles/b6aef1054c2f43a693e82eb19749d60b` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.840910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f79c7a-76dc-4978-837f-3e00449cd767 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd8ac35f2754b9eb5961500154e91bd, group_id=9890e92d4d27447386c5ec3bc6cc76a7, role_id=b6aef1054c2f43a693e82eb19749d60b)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:55.842367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f79c7a-76dc-4978-837f-3e00449cd767 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:55.860358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca71f55-b4f5-4c81-8ef1-484912e41c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:55.861177 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71f55-b4f5-4c81-8ef1-484912e41c13 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.861458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71f55-b4f5-4c81-8ef1-484912e41c13 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.861730 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71f55-b4f5-4c81-8ef1-484912e41c13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.872517 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca71f55-b4f5-4c81-8ef1-484912e41c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-aca71f55-b4f5-4c81-8ef1-484912e41c13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:55.880708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:55.881970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 196/398] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:45:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:55.883044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca71f55-b4f5-4c81-8ef1-484912e41c13 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:55.913706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 203/399] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:45:55 2022] PUT /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/groups/9890e92d4d27447386c5ec3bc6cc76a7/roles/b6aef1054c2f43a693e82eb19749d60b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:55.915801 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0093ccf-19b9-4d12-b555-510ddb530547 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:55.916319 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0093ccf-19b9-4d12-b555-510ddb530547 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:55.916850 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0093ccf-19b9-4d12-b555-510ddb530547 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:55.919171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 204/400] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:55.920228 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0093ccf-19b9-4d12-b555-510ddb530547 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:56.008677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:56.016780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca71f55-b4f5-4c81-8ef1-484912e41c13 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:56.062440 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9beb5-b0d9-40c0-966d-9a493fde8ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:56.063306 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9beb5-b0d9-40c0-966d-9a493fde8ddc None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:56.063587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9beb5-b0d9-40c0-966d-9a493fde8ddc None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:56.063863 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9beb5-b0d9-40c0-966d-9a493fde8ddc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:56.077558 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9beb5-b0d9-40c0-966d-9a493fde8ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:56.084174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0093ccf-19b9-4d12-b555-510ddb530547 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-84a9beb5-b0d9-40c0-966d-9a493fde8ddc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:56.086777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:56.087928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:45:56.088934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 197/401] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:45:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:56.090847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f53db-c24b-4e61-9568-f2d40f65692a None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:56.090847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f53db-c24b-4e61-9568-f2d40f65692a None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:56.091107 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f53db-c24b-4e61-9568-f2d40f65692a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:56.110171 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-ff3f53db-c24b-4e61-9568-f2d40f65692a None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:56.111481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-ff3f53db-c24b-4e61-9568-f2d40f65692a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:56.130556 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:56.140085 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd2364-2421-4a4a-b8bf-d1834790c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:56.140939 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2364-2421-4a4a-b8bf-d1834790c477 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:56.141439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2364-2421-4a4a-b8bf-d1834790c477 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:56.143279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2364-2421-4a4a-b8bf-d1834790c477 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:56.143279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd2364-2421-4a4a-b8bf-d1834790c477 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:56.143279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd2364-2421-4a4a-b8bf-d1834790c477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:56.145348 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd2364-2421-4a4a-b8bf-d1834790c477 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:56.156365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 205/402] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:45:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:56.157566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd2364-2421-4a4a-b8bf-d1834790c477 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:56.200167 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 198/403] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:56.206268 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f53db-c24b-4e61-9568-f2d40f65692a None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:56.292485 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd2364-2421-4a4a-b8bf-d1834790c477 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:56.332438 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84217cc1-4afb-41a0-ac6e-8b922b42ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:56.333531 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84217cc1-4afb-41a0-ac6e-8b922b42ca99 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:56.334051 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84217cc1-4afb-41a0-ac6e-8b922b42ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:56.334553 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84217cc1-4afb-41a0-ac6e-8b922b42ca99 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:56.335238 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:56.335808 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84217cc1-4afb-41a0-ac6e-8b922b42ca99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:56.336334 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84217cc1-4afb-41a0-ac6e-8b922b42ca99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:56.337996 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84217cc1-4afb-41a0-ac6e-8b922b42ca99 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:56.347686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 206/404] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:45:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:56.348935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84217cc1-4afb-41a0-ac6e-8b922b42ca99 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:56.355914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f53db-c24b-4e61-9568-f2d40f65692a None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:56.404169 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badba48-82f3-4922-9061-9a105ed4b9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:56.405066 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badba48-82f3-4922-9061-9a105ed4b9c7 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:56.405612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badba48-82f3-4922-9061-9a105ed4b9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:56.405900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badba48-82f3-4922-9061-9a105ed4b9c7 None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:56.407158 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badba48-82f3-4922-9061-9a105ed4b9c7 None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:56.409083 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badba48-82f3-4922-9061-9a105ed4b9c7 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:56.410785 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 199/405] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:45:56 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:56.411580 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badba48-82f3-4922-9061-9a105ed4b9c7 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:56.416708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:56.469883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84217cc1-4afb-41a0-ac6e-8b922b42ca99 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:56.515616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e1370-2aaa-4142-b12d-2f2b76c82430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:56.516415 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e1370-2aaa-4142-b12d-2f2b76c82430 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:56.516712 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e1370-2aaa-4142-b12d-2f2b76c82430 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:56.516986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e1370-2aaa-4142-b12d-2f2b76c82430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:56.532298 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e1370-2aaa-4142-b12d-2f2b76c82430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:56.535838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badba48-82f3-4922-9061-9a105ed4b9c7 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-ed0e1370-2aaa-4142-b12d-2f2b76c82430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:56.541992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:56.543218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:56.544230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 207/406] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:45:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:56.545549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e1370-2aaa-4142-b12d-2f2b76c82430 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:56.581093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bfd1-6dab-46a5-bd40-c5a31b16ea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:56.582388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bfd1-6dab-46a5-bd40-c5a31b16ea08 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:56.582934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bfd1-6dab-46a5-bd40-c5a31b16ea08 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:56.583431 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bfd1-6dab-46a5-bd40-c5a31b16ea08 None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:56.585240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9bfd1-6dab-46a5-bd40-c5a31b16ea08 None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:56.586941 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9bfd1-6dab-46a5-bd40-c5a31b16ea08 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:56.588910 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 200/407] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:45:56 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:56.589926 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bfd1-6dab-46a5-bd40-c5a31b16ea08 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:56.618671 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:56.693443 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e1370-2aaa-4142-b12d-2f2b76c82430 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:56.731837 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:56.758314 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bfd1-6dab-46a5-bd40-c5a31b16ea08 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:56.768815 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4268a8-c7c0-425a-9183-0c1a09d4d45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:56.770212 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4268a8-c7c0-425a-9183-0c1a09d4d45d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:56.770727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4268a8-c7c0-425a-9183-0c1a09d4d45d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:56.771212 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4268a8-c7c0-425a-9183-0c1a09d4d45d None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:56.773318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4268a8-c7c0-425a-9183-0c1a09d4d45d None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:56.776662 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4268a8-c7c0-425a-9183-0c1a09d4d45d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:56.781220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 208/408] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:56 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:56.783068 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4268a8-c7c0-425a-9183-0c1a09d4d45d None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:56.833144 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac48f34-6c77-4ce4-b402-5c0b1a646ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:56.833852 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac48f34-6c77-4ce4-b402-5c0b1a646ba6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:56.834141 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac48f34-6c77-4ce4-b402-5c0b1a646ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:56.834422 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac48f34-6c77-4ce4-b402-5c0b1a646ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:56.835301 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac48f34-6c77-4ce4-b402-5c0b1a646ba6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:56.835616 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac48f34-6c77-4ce4-b402-5c0b1a646ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:56.837784 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac48f34-6c77-4ce4-b402-5c0b1a646ba6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:56.850487 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 201/409] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:56.851661 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac48f34-6c77-4ce4-b402-5c0b1a646ba6 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:56.937651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4268a8-c7c0-425a-9183-0c1a09d4d45d None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:56.967780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:56.977277 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6993b-5615-4f30-b8bc-def189ed80b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:56.978441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6993b-5615-4f30-b8bc-def189ed80b5 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:56.978912 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6993b-5615-4f30-b8bc-def189ed80b5 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:56.984467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6993b-5615-4f30-b8bc-def189ed80b5 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:56.984467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6993b-5615-4f30-b8bc-def189ed80b5 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:56.984467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6993b-5615-4f30-b8bc-def189ed80b5 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:56.984889 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 209/410] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:56 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:56.985697 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6993b-5615-4f30-b8bc-def189ed80b5 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:56.994813 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac48f34-6c77-4ce4-b402-5c0b1a646ba6 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:57.030755 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ed7a7-8b98-45a0-9d3d-e6a35aa5686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:57.031636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ed7a7-8b98-45a0-9d3d-e6a35aa5686e None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:57.031916 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ed7a7-8b98-45a0-9d3d-e6a35aa5686e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:57.032749 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ed7a7-8b98-45a0-9d3d-e6a35aa5686e None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/groups/9890e92d4d27447386c5ec3bc6cc76a7/roles/715071b6b1244a559110be37cc8410ab` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:57.034461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ed7a7-8b98-45a0-9d3d-e6a35aa5686e None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd8ac35f2754b9eb5961500154e91bd, group_id=9890e92d4d27447386c5ec3bc6cc76a7, role_id=715071b6b1244a559110be37cc8410ab)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:57.035993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ed7a7-8b98-45a0-9d3d-e6a35aa5686e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:57.054555 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:57.102840 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6993b-5615-4f30-b8bc-def189ed80b5 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:57.137245 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a767b1-f82f-4f9b-aa6e-4399a57cfd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:57.138158 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a767b1-f82f-4f9b-aa6e-4399a57cfd22 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:57.138447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a767b1-f82f-4f9b-aa6e-4399a57cfd22 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:57.138755 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a767b1-f82f-4f9b-aa6e-4399a57cfd22 None admin] PATH_INFO: `/v3/groups/da3cbac8fa194be692977c534812a65f` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:57.139958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a767b1-f82f-4f9b-aa6e-4399a57cfd22 None admin] RBAC: Authorizing `identity:get_group(group_id=da3cbac8fa194be692977c534812a65f)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:57.141445 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a767b1-f82f-4f9b-aa6e-4399a57cfd22 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:57.146749 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 210/411] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:45:56 2022] GET /identity/v3/groups/da3cbac8fa194be692977c534812a65f => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:57.146749 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a767b1-f82f-4f9b-aa6e-4399a57cfd22 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:57.153906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 202/412] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:45:56 2022] PUT /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd/groups/9890e92d4d27447386c5ec3bc6cc76a7/roles/715071b6b1244a559110be37cc8410ab => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:57.155113 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ed7a7-8b98-45a0-9d3d-e6a35aa5686e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:57.291393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ed7a7-8b98-45a0-9d3d-e6a35aa5686e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:57.341579 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518e450-3d97-449b-ac5d-13a5e8078709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:57.342874 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518e450-3d97-449b-ac5d-13a5e8078709 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:57.345474 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518e450-3d97-449b-ac5d-13a5e8078709 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:57.347025 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518e450-3d97-449b-ac5d-13a5e8078709 None admin] PATH_INFO: `/v3/projects/0cd97939f145462186b2c89bb3a6460f` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:57.349412 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518e450-3d97-449b-ac5d-13a5e8078709 None admin] RBAC: Authorizing `identity:get_project(project_id=0cd97939f145462186b2c89bb3a6460f)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:57.352395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518e450-3d97-449b-ac5d-13a5e8078709 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:57.364259 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 203/413] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:57 2022] GET /identity/v3/projects/0cd97939f145462186b2c89bb3a6460f => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:57.380137 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518e450-3d97-449b-ac5d-13a5e8078709 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:57.399407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a767b1-f82f-4f9b-aa6e-4399a57cfd22 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:57.400135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:57.447442 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:57.475701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d45f6-19f3-485f-9128-98b1f35d1aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:57.476609 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d45f6-19f3-485f-9128-98b1f35d1aeb None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:57.476891 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d45f6-19f3-485f-9128-98b1f35d1aeb None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:57.477168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d45f6-19f3-485f-9128-98b1f35d1aeb None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/groups/9890e92d4d27447386c5ec3bc6cc76a7/roles/715071b6b1244a559110be37cc8410ab` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:57.480214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d45f6-19f3-485f-9128-98b1f35d1aeb None admin] RBAC: Authorizing `identity:create_grant(project_id=41f0c6987ff94c9cb442a42b28d9f386, group_id=9890e92d4d27447386c5ec3bc6cc76a7, role_id=715071b6b1244a559110be37cc8410ab)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:57.482342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d45f6-19f3-485f-9128-98b1f35d1aeb None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:57.529419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518e450-3d97-449b-ac5d-13a5e8078709 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:57.563498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 211/414] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:45:57 2022] PUT /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386/groups/9890e92d4d27447386c5ec3bc6cc76a7/roles/715071b6b1244a559110be37cc8410ab => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:45:57.570349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296b0ae-62b6-4afb-9988-2a3de474d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:57.571410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296b0ae-62b6-4afb-9988-2a3de474d26d None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:57.571755 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296b0ae-62b6-4afb-9988-2a3de474d26d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:57.572045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296b0ae-62b6-4afb-9988-2a3de474d26d None admin] PATH_INFO: `/v3/projects/0cd97939f145462186b2c89bb3a6460f/groups/da3cbac8fa194be692977c534812a65f/roles/480e35452fc547e0a2917bdd5b782f7d` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:57.575228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296b0ae-62b6-4afb-9988-2a3de474d26d None admin] RBAC: Authorizing `identity:create_grant(project_id=0cd97939f145462186b2c89bb3a6460f, group_id=da3cbac8fa194be692977c534812a65f, role_id=480e35452fc547e0a2917bdd5b782f7d)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:57.576795 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296b0ae-62b6-4afb-9988-2a3de474d26d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:57.667559 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 204/415] 10.222.0.89 () {58 vars in 1442 bytes} [Thu May 19 20:45:57 2022] PUT /identity/v3/projects/0cd97939f145462186b2c89bb3a6460f/groups/da3cbac8fa194be692977c534812a65f/roles/480e35452fc547e0a2917bdd5b782f7d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:45:58.016148 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6facb3-5aad-4487-8d50-c30bef419343 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:58.016673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6facb3-5aad-4487-8d50-c30bef419343 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:58.016673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6facb3-5aad-4487-8d50-c30bef419343 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:58.018343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 212/416] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:58.024316 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368c7b7-7835-49b6-9e9a-33518dd48d64 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:58.024611 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368c7b7-7835-49b6-9e9a-33518dd48d64 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:58.024895 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368c7b7-7835-49b6-9e9a-33518dd48d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:58.050629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-e368c7b7-7835-49b6-9e9a-33518dd48d64 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:58.050629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-e368c7b7-7835-49b6-9e9a-33518dd48d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:58.149585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:58.157030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 205/417] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:45:58.195831 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6facb3-5aad-4487-8d50-c30bef419343 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:58.348219 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6facb3-5aad-4487-8d50-c30bef419343 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:58.396676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bb7f3-043c-41f5-a462-3ebcca213ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:58.397489 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bb7f3-043c-41f5-a462-3ebcca213ad3 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:58.397775 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bb7f3-043c-41f5-a462-3ebcca213ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:58.398047 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bb7f3-043c-41f5-a462-3ebcca213ad3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:58.415362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bb7f3-043c-41f5-a462-3ebcca213ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-7e5bb7f3-043c-41f5-a462-3ebcca213ad3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:58.423535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:58.424607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:58.425564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 213/418] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:45:58.436189 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368c7b7-7835-49b6-9e9a-33518dd48d64 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:58.536560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573593e-4b9a-4cad-a25f-c1fb5c990b33 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:58.536937 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573593e-4b9a-4cad-a25f-c1fb5c990b33 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:58.537127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573593e-4b9a-4cad-a25f-c1fb5c990b33 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:58.540065 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 214/419] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:58.544674 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c9431-c272-44cb-9bce-7009ae88f5f5 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:58.545003 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c9431-c272-44cb-9bce-7009ae88f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:58.545229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c9431-c272-44cb-9bce-7009ae88f5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:58.556318 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368c7b7-7835-49b6-9e9a-33518dd48d64 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:58.583663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-9f2c9431-c272-44cb-9bce-7009ae88f5f5 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:58.584884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-9f2c9431-c272-44cb-9bce-7009ae88f5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:58.594715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742669c4-9292-4135-9bdd-14bffb4954c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:58.595611 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742669c4-9292-4135-9bdd-14bffb4954c7 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:58.595900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742669c4-9292-4135-9bdd-14bffb4954c7 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:58.597026 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742669c4-9292-4135-9bdd-14bffb4954c7 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:58.597820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742669c4-9292-4135-9bdd-14bffb4954c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:58.598140 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742669c4-9292-4135-9bdd-14bffb4954c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:58.599619 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742669c4-9292-4135-9bdd-14bffb4954c7 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:58.609724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 206/420] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:58.614972 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742669c4-9292-4135-9bdd-14bffb4954c7 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:58.666963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:58.733940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:58.741275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 215/421] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:58.776225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742669c4-9292-4135-9bdd-14bffb4954c7 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:58.781735 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c9431-c272-44cb-9bce-7009ae88f5f5 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:58.816681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08269c11-59be-447c-a92a-3be9d65090d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:58.817714 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08269c11-59be-447c-a92a-3be9d65090d5 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:58.818225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08269c11-59be-447c-a92a-3be9d65090d5 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:58.818764 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08269c11-59be-447c-a92a-3be9d65090d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:58.905517 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08269c11-59be-447c-a92a-3be9d65090d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:58.907012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08269c11-59be-447c-a92a-3be9d65090d5 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:58.981292 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c9431-c272-44cb-9bce-7009ae88f5f5 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:59.018752 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:59.042452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e24b3-bfbd-4bba-b29d-4a6a1ac3682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:59.043498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e24b3-bfbd-4bba-b29d-4a6a1ac3682b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:59.043790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e24b3-bfbd-4bba-b29d-4a6a1ac3682b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:59.049147 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e24b3-bfbd-4bba-b29d-4a6a1ac3682b None admin] PATH_INFO: `/v3/roles/member` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:59.066064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 207/422] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:59.071265 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08269c11-59be-447c-a92a-3be9d65090d5 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:59.075555 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e24b3-bfbd-4bba-b29d-4a6a1ac3682b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-6a2e24b3-bfbd-4bba-b29d-4a6a1ac3682b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:45:59.083581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:45:59.084673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:45:59.085629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:45:59.090946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 216/423] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:45:59.096524 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e24b3-bfbd-4bba-b29d-4a6a1ac3682b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:59.135796 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:59.254953 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e24b3-bfbd-4bba-b29d-4a6a1ac3682b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:59.268350 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08269c11-59be-447c-a92a-3be9d65090d5 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:59.308136 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7db396-b2d3-4be9-ad3c-a884791a00f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:59.309553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db396-b2d3-4be9-ad3c-a884791a00f6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:59.310094 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db396-b2d3-4be9-ad3c-a884791a00f6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:59.310394 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db396-b2d3-4be9-ad3c-a884791a00f6 None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:59.311652 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7db396-b2d3-4be9-ad3c-a884791a00f6 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:59.313116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7db396-b2d3-4be9-ad3c-a884791a00f6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:59.315271 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 208/424] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:59 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:59.320732 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7db396-b2d3-4be9-ad3c-a884791a00f6 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:59.321944 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464401ce-2b7c-484d-b414-04e842467157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:59.322663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464401ce-2b7c-484d-b414-04e842467157 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:59.322958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464401ce-2b7c-484d-b414-04e842467157 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:59.323243 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464401ce-2b7c-484d-b414-04e842467157 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:59.324018 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464401ce-2b7c-484d-b414-04e842467157 None admin] RBAC: Adding query filter params (name=member) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:59.324334 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464401ce-2b7c-484d-b414-04e842467157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:59.326306 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464401ce-2b7c-484d-b414-04e842467157 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:59.346989 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 217/425] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:45:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:45:59.351821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464401ce-2b7c-484d-b414-04e842467157 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:59.355788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:59.433556 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7db396-b2d3-4be9-ad3c-a884791a00f6 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:59.475226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e8e61-eb9e-4ba7-9feb-8c43e9b55609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:59.476225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e8e61-eb9e-4ba7-9feb-8c43e9b55609 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:59.476518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e8e61-eb9e-4ba7-9feb-8c43e9b55609 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:59.476908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e8e61-eb9e-4ba7-9feb-8c43e9b55609 None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:59.478167 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e8e61-eb9e-4ba7-9feb-8c43e9b55609 None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:59.479667 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e8e61-eb9e-4ba7-9feb-8c43e9b55609 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:59.481897 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 209/426] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:45:59 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:59.487749 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e8e61-eb9e-4ba7-9feb-8c43e9b55609 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:59.526961 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:59.538951 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464401ce-2b7c-484d-b414-04e842467157 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:59.605885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c291fb-c5cc-4d63-b989-a106801cd8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:59.606575 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c291fb-c5cc-4d63-b989-a106801cd8db None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:59.606893 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c291fb-c5cc-4d63-b989-a106801cd8db None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:59.607173 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c291fb-c5cc-4d63-b989-a106801cd8db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:59.673294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:59.680885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e8e61-eb9e-4ba7-9feb-8c43e9b55609 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:45:59.741222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c291fb-c5cc-4d63-b989-a106801cd8db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:59.743330 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c291fb-c5cc-4d63-b989-a106801cd8db None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:59.750834 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4bec9-4ad9-47dc-b17b-f0a1098b8a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:45:59.751885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4bec9-4ad9-47dc-b17b-f0a1098b8a77 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:59.752382 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4bec9-4ad9-47dc-b17b-f0a1098b8a77 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:59.752888 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4bec9-4ad9-47dc-b17b-f0a1098b8a77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:59.753954 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4bec9-4ad9-47dc-b17b-f0a1098b8a77 None admin] RBAC: Adding query filter params (group.id=9890e92d4d27447386c5ec3bc6cc76a7, role.id=b6aef1054c2f43a693e82eb19749d60b, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:45:59.754496 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4bec9-4ad9-47dc-b17b-f0a1098b8a77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:45:59.756185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4bec9-4ad9-47dc-b17b-f0a1098b8a77 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:45:59.763289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 210/427] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:45:59 2022] GET /identity/v3/role_assignments?group.id=9890e92d4d27447386c5ec3bc6cc76a7&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 611 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:45:59.798193 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b3658-acd5-4fea-bdd6-ef93306c3f30 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:59.798901 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b3658-acd5-4fea-bdd6-ef93306c3f30 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:59.799522 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b3658-acd5-4fea-bdd6-ef93306c3f30 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:59.803140 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 211/428] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:45:59.808272 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5cc54-ad88-4578-ad90-326480578785 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:45:59.809527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5cc54-ad88-4578-ad90-326480578785 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:45:59.810288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5cc54-ad88-4578-ad90-326480578785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:45:59.829037 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-46f5cc54-ad88-4578-ad90-326480578785 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:45:59.830739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-46f5cc54-ad88-4578-ad90-326480578785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:45:59.848984 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:45:59.859583 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 218/429] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:45:59.866476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c291fb-c5cc-4d63-b989-a106801cd8db None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:45:59.961802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 212/430] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:45:59.976120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c291fb-c5cc-4d63-b989-a106801cd8db None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:00.005118 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5cc54-ad88-4578-ad90-326480578785 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:00.015825 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522358cc-dd45-4421-b4fd-90802194a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:00.016741 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522358cc-dd45-4421-b4fd-90802194a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:00.017008 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522358cc-dd45-4421-b4fd-90802194a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:00.017290 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522358cc-dd45-4421-b4fd-90802194a5c3 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:00.023375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522358cc-dd45-4421-b4fd-90802194a5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:00.023375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522358cc-dd45-4421-b4fd-90802194a5c3 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:00.023375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 219/431] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:45:59 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:00.030631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522358cc-dd45-4421-b4fd-90802194a5c3 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:00.099052 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:00.153088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522358cc-dd45-4421-b4fd-90802194a5c3 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:00.176892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:00.187676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5cc54-ad88-4578-ad90-326480578785 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:00.209761 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7c8f0-8689-438e-b18f-23ad34b7e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:00.210681 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c8f0-8689-438e-b18f-23ad34b7e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:00.210978 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c8f0-8689-438e-b18f-23ad34b7e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:00.211263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c8f0-8689-438e-b18f-23ad34b7e2d8 None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:00.213009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7c8f0-8689-438e-b18f-23ad34b7e2d8 None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:00.215517 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7c8f0-8689-438e-b18f-23ad34b7e2d8 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:00.218372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 220/432] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:46:00 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:00.224298 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7c8f0-8689-438e-b18f-23ad34b7e2d8 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:00.237175 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cdd7e-7f5f-43d3-bfe9-36b31a349e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:00.238054 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cdd7e-7f5f-43d3-bfe9-36b31a349e52 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:00.238878 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cdd7e-7f5f-43d3-bfe9-36b31a349e52 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:00.239166 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cdd7e-7f5f-43d3-bfe9-36b31a349e52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:00.259187 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cdd7e-7f5f-43d3-bfe9-36b31a349e52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-a00cdd7e-7f5f-43d3-bfe9-36b31a349e52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:00.271040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:00.272165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:46:00.273123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:00.273849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 213/433] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:46:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:00.279853 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cdd7e-7f5f-43d3-bfe9-36b31a349e52 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:00.374476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7c8f0-8689-438e-b18f-23ad34b7e2d8 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:00.424263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:00.435465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257474cc-d446-48af-86b6-74ffe9a5f7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:00.436317 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257474cc-d446-48af-86b6-74ffe9a5f7a9 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:00.440746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257474cc-d446-48af-86b6-74ffe9a5f7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:00.440746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257474cc-d446-48af-86b6-74ffe9a5f7a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:00.440746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257474cc-d446-48af-86b6-74ffe9a5f7a9 None admin] RBAC: Adding query filter params (group.id=9890e92d4d27447386c5ec3bc6cc76a7, role.id=b6aef1054c2f43a693e82eb19749d60b, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:00.440746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257474cc-d446-48af-86b6-74ffe9a5f7a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:00.440746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257474cc-d446-48af-86b6-74ffe9a5f7a9 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:00.441417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cdd7e-7f5f-43d3-bfe9-36b31a349e52 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:00.448866 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 221/434] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:46:00 2022] GET /identity/v3/role_assignments?group.id=9890e92d4d27447386c5ec3bc6cc76a7&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=b6aef1054c2f43a693e82eb19749d60b => generated 611 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:00.494423 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf357ff3-16f9-41df-9773-a0a0291e7b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:00.495460 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357ff3-16f9-41df-9773-a0a0291e7b2d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:00.495901 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357ff3-16f9-41df-9773-a0a0291e7b2d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:00.496397 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357ff3-16f9-41df-9773-a0a0291e7b2d None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:00.497400 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf357ff3-16f9-41df-9773-a0a0291e7b2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:00.497874 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf357ff3-16f9-41df-9773-a0a0291e7b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:00.499650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf357ff3-16f9-41df-9773-a0a0291e7b2d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:00.510652 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 214/435] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:00.516821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257474cc-d446-48af-86b6-74ffe9a5f7a9 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:00.588663 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1ec2a-c033-4f4d-8db5-97f032db439e None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:00.589031 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1ec2a-c033-4f4d-8db5-97f032db439e None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:00.589224 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1ec2a-c033-4f4d-8db5-97f032db439e None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:00.591222 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 215/436] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:00.598554 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35957d8-0b20-490d-b6d1-9e6e36616d41 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:00.599173 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35957d8-0b20-490d-b6d1-9e6e36616d41 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:00.599708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35957d8-0b20-490d-b6d1-9e6e36616d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:00.617762 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-f35957d8-0b20-490d-b6d1-9e6e36616d41 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:00.619117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-f35957d8-0b20-490d-b6d1-9e6e36616d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:00.635401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:00.651504 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257474cc-d446-48af-86b6-74ffe9a5f7a9 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:00.700398 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbb2bf-a0c7-4d2f-a878-5ec2879ed35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:00.701518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbb2bf-a0c7-4d2f-a878-5ec2879ed35c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:00.701518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbb2bf-a0c7-4d2f-a878-5ec2879ed35c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:00.701704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbb2bf-a0c7-4d2f-a878-5ec2879ed35c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:00.724064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 216/437] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:46:00.725674 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22b2c-5c9e-4346-89dd-8db415fd69d6 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:00.725972 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22b2c-5c9e-4346-89dd-8db415fd69d6 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:00.726249 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22b2c-5c9e-4346-89dd-8db415fd69d6 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:00.728370 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 217/438] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:00.733903 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ba5c2-5ebb-4db9-853f-ba474bf2c7e1 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:00.734314 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ba5c2-5ebb-4db9-853f-ba474bf2c7e1 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:00.734846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ba5c2-5ebb-4db9-853f-ba474bf2c7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:00.755739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-e76ba5c2-5ebb-4db9-853f-ba474bf2c7e1 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:00.757226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-e76ba5c2-5ebb-4db9-853f-ba474bf2c7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:00.781811 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:00.792036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbb2bf-a0c7-4d2f-a878-5ec2879ed35c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:00.793616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbb2bf-a0c7-4d2f-a878-5ec2879ed35c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:00.829631 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 218/439] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:46:00.830480 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ba5c2-5ebb-4db9-853f-ba474bf2c7e1 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:00.899399 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 222/440] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:00.900017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbb2bf-a0c7-4d2f-a878-5ec2879ed35c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:00.913371 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:00.938059 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ba5c2-5ebb-4db9-853f-ba474bf2c7e1 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:00.972398 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dbf85-3e9c-4c74-8218-3f7e5de14b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:00.973244 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dbf85-3e9c-4c74-8218-3f7e5de14b9e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:00.973533 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dbf85-3e9c-4c74-8218-3f7e5de14b9e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:00.973813 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dbf85-3e9c-4c74-8218-3f7e5de14b9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:00.984599 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dbf85-3e9c-4c74-8218-3f7e5de14b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-ac6dbf85-3e9c-4c74-8218-3f7e5de14b9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:00.992773 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:00.993992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:00.995048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 219/441] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:46:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:00.995863 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dbf85-3e9c-4c74-8218-3f7e5de14b9e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:00.997113 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:01.003279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbb2bf-a0c7-4d2f-a878-5ec2879ed35c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:01.041777 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637fd36-31bb-45f8-9737-fad43a4b5e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:01.041777 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fd36-31bb-45f8-9737-fad43a4b5e41 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:01.041777 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fd36-31bb-45f8-9737-fad43a4b5e41 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:01.041777 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fd36-31bb-45f8-9737-fad43a4b5e41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:01.052476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637fd36-31bb-45f8-9737-fad43a4b5e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-d637fd36-31bb-45f8-9737-fad43a4b5e41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:01.060536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:01.066579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 223/442] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:01.067829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637fd36-31bb-45f8-9737-fad43a4b5e41 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:01.097659 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dbf85-3e9c-4c74-8218-3f7e5de14b9e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:01.131651 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d3d68-d40a-41be-96e8-76a4260fcdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:01.132507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d3d68-d40a-41be-96e8-76a4260fcdb3 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:01.132785 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d3d68-d40a-41be-96e8-76a4260fcdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:01.133056 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d3d68-d40a-41be-96e8-76a4260fcdb3 None admin] PATH_INFO: `/v3/projects/3bd8ac35f2754b9eb5961500154e91bd` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:01.134246 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d3d68-d40a-41be-96e8-76a4260fcdb3 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd8ac35f2754b9eb5961500154e91bd)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:01.135706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d3d68-d40a-41be-96e8-76a4260fcdb3 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:01.138357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 220/443] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:46:00 2022] GET /identity/v3/projects/3bd8ac35f2754b9eb5961500154e91bd => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:01.142519 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d3d68-d40a-41be-96e8-76a4260fcdb3 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:01.145641 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:01.168178 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637fd36-31bb-45f8-9737-fad43a4b5e41 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:01.203581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678825f6-c8d3-45ea-b2b3-b782ef6f9d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:01.204244 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678825f6-c8d3-45ea-b2b3-b782ef6f9d5d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:01.204526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678825f6-c8d3-45ea-b2b3-b782ef6f9d5d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:01.204802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678825f6-c8d3-45ea-b2b3-b782ef6f9d5d None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:01.205554 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678825f6-c8d3-45ea-b2b3-b782ef6f9d5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:01.205863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678825f6-c8d3-45ea-b2b3-b782ef6f9d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:01.207278 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678825f6-c8d3-45ea-b2b3-b782ef6f9d5d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:01.220348 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 224/444] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:01.220348 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678825f6-c8d3-45ea-b2b3-b782ef6f9d5d None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:01.232624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:01.244600 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d3d68-d40a-41be-96e8-76a4260fcdb3 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:01.281139 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b397ed3-24b9-4824-bfb1-adefb813daec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:01.281818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b397ed3-24b9-4824-bfb1-adefb813daec None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:01.282103 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b397ed3-24b9-4824-bfb1-adefb813daec None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:01.282384 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b397ed3-24b9-4824-bfb1-adefb813daec None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:01.283181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b397ed3-24b9-4824-bfb1-adefb813daec None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:01.283494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b397ed3-24b9-4824-bfb1-adefb813daec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:01.284890 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b397ed3-24b9-4824-bfb1-adefb813daec None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:01.293656 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 221/445] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:01.294489 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b397ed3-24b9-4824-bfb1-adefb813daec None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:01.325303 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678825f6-c8d3-45ea-b2b3-b782ef6f9d5d None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:01.356086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:01.359677 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08139-e92b-4e69-a028-3877543e7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:01.360549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08139-e92b-4e69-a028-3877543e7dba None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:01.360837 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08139-e92b-4e69-a028-3877543e7dba None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:01.361113 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08139-e92b-4e69-a028-3877543e7dba None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:01.362330 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee08139-e92b-4e69-a028-3877543e7dba None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:01.363803 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee08139-e92b-4e69-a028-3877543e7dba None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:01.370172 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 225/446] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:46:01 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:01.370172 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08139-e92b-4e69-a028-3877543e7dba None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:01.394405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b397ed3-24b9-4824-bfb1-adefb813daec None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:01.428897 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d6dab-343d-4e1e-bbcb-77bd8618a901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:01.429473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6dab-343d-4e1e-bbcb-77bd8618a901 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:01.429754 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6dab-343d-4e1e-bbcb-77bd8618a901 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:01.430028 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6dab-343d-4e1e-bbcb-77bd8618a901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:01.448227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:01.467046 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08139-e92b-4e69-a028-3877543e7dba None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:01.500221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d6dab-343d-4e1e-bbcb-77bd8618a901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:01.500758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce7eca-cff0-4b6f-b41b-6f234e0cdc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:01.501419 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce7eca-cff0-4b6f-b41b-6f234e0cdc43 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:01.501696 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d6dab-343d-4e1e-bbcb-77bd8618a901 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:01.501812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce7eca-cff0-4b6f-b41b-6f234e0cdc43 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:01.501975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce7eca-cff0-4b6f-b41b-6f234e0cdc43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:01.565270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:01.571732 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce7eca-cff0-4b6f-b41b-6f234e0cdc43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:01.573191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce7eca-cff0-4b6f-b41b-6f234e0cdc43 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:01.604067 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 222/447] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:01.605018 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d6dab-343d-4e1e-bbcb-77bd8618a901 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:01.656585 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:01.675484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 226/448] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:01.676677 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce7eca-cff0-4b6f-b41b-6f234e0cdc43 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:01.706429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d6dab-343d-4e1e-bbcb-77bd8618a901 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:01.740621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f074b4b-9836-4779-84f0-4f12bb35939c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:01.741281 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f074b4b-9836-4779-84f0-4f12bb35939c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:01.741560 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f074b4b-9836-4779-84f0-4f12bb35939c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:01.741839 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f074b4b-9836-4779-84f0-4f12bb35939c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:01.742696 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f074b4b-9836-4779-84f0-4f12bb35939c None admin] RBAC: Adding query filter params (group.id=9890e92d4d27447386c5ec3bc6cc76a7, role.id=715071b6b1244a559110be37cc8410ab, scope.project.id=3bd8ac35f2754b9eb5961500154e91bd) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:01.743012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f074b4b-9836-4779-84f0-4f12bb35939c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:01.744452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f074b4b-9836-4779-84f0-4f12bb35939c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:01.750919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 223/449] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:46:01 2022] GET /identity/v3/role_assignments?group.id=9890e92d4d27447386c5ec3bc6cc76a7&scope.project.id=3bd8ac35f2754b9eb5961500154e91bd&role.id=715071b6b1244a559110be37cc8410ab => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:01.751723 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f074b4b-9836-4779-84f0-4f12bb35939c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:01.789978 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:01.799964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce7eca-cff0-4b6f-b41b-6f234e0cdc43 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:01.840501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e192a-b41b-4ce4-ba5e-6707eba9468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:01.841394 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e192a-b41b-4ce4-ba5e-6707eba9468a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:01.841673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e192a-b41b-4ce4-ba5e-6707eba9468a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:01.841950 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e192a-b41b-4ce4-ba5e-6707eba9468a None admin] PATH_INFO: `/v3/projects/41f0c6987ff94c9cb442a42b28d9f386` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:01.843270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e192a-b41b-4ce4-ba5e-6707eba9468a None admin] RBAC: Authorizing `identity:get_project(project_id=41f0c6987ff94c9cb442a42b28d9f386)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:01.844731 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e192a-b41b-4ce4-ba5e-6707eba9468a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:01.846497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 227/450] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:46:01 2022] GET /identity/v3/projects/41f0c6987ff94c9cb442a42b28d9f386 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:01.852305 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e192a-b41b-4ce4-ba5e-6707eba9468a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:01.879758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f074b4b-9836-4779-84f0-4f12bb35939c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:01.911486 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:01.922305 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4849f-de3a-4bba-a4cf-8e5fb19edd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:01.931824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4849f-de3a-4bba-a4cf-8e5fb19edd3c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:01.931824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4849f-de3a-4bba-a4cf-8e5fb19edd3c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:01.931824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4849f-de3a-4bba-a4cf-8e5fb19edd3c None admin] PATH_INFO: `/v3/projects/0cd97939f145462186b2c89bb3a6460f` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:01.931824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4849f-de3a-4bba-a4cf-8e5fb19edd3c None admin] RBAC: Authorizing `identity:get_project(project_id=0cd97939f145462186b2c89bb3a6460f)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:01.931824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4849f-de3a-4bba-a4cf-8e5fb19edd3c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:01.931824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 224/451] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:46:01 2022] GET /identity/v3/projects/0cd97939f145462186b2c89bb3a6460f => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:01.935306 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4849f-de3a-4bba-a4cf-8e5fb19edd3c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:01.989850 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e192a-b41b-4ce4-ba5e-6707eba9468a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:02.025855 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7956b40-9b9e-46e4-ae3d-3a0bd8ed79ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:02.026752 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7956b40-9b9e-46e4-ae3d-3a0bd8ed79ca None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:02.027034 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7956b40-9b9e-46e4-ae3d-3a0bd8ed79ca None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:02.027306 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7956b40-9b9e-46e4-ae3d-3a0bd8ed79ca None admin] PATH_INFO: `/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:02.028548 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7956b40-9b9e-46e4-ae3d-3a0bd8ed79ca None admin] RBAC: Authorizing `identity:get_group(group_id=9890e92d4d27447386c5ec3bc6cc76a7)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:02.029982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7956b40-9b9e-46e4-ae3d-3a0bd8ed79ca None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:02.031645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 228/452] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:46:01 2022] GET /identity/v3/groups/9890e92d4d27447386c5ec3bc6cc76a7 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:02.037476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7956b40-9b9e-46e4-ae3d-3a0bd8ed79ca None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:02.042592 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:02.053612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4849f-de3a-4bba-a4cf-8e5fb19edd3c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:02.089134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357dd67-ba4f-4b8d-903c-056abc40192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:02.089993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357dd67-ba4f-4b8d-903c-056abc40192c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:02.090278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357dd67-ba4f-4b8d-903c-056abc40192c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:02.090557 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357dd67-ba4f-4b8d-903c-056abc40192c None admin] PATH_INFO: `/v3/groups/da3cbac8fa194be692977c534812a65f` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:02.091788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357dd67-ba4f-4b8d-903c-056abc40192c None admin] RBAC: Authorizing `identity:get_group(group_id=da3cbac8fa194be692977c534812a65f)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:02.093224 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357dd67-ba4f-4b8d-903c-056abc40192c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:02.094902 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 225/453] 10.222.0.89 () {56 vars in 1180 bytes} [Thu May 19 20:46:01 2022] GET /identity/v3/groups/da3cbac8fa194be692977c534812a65f => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:02.100616 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357dd67-ba4f-4b8d-903c-056abc40192c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:02.143162 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7956b40-9b9e-46e4-ae3d-3a0bd8ed79ca None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:02.160325 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:02.177317 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6da3b1-7a02-4d93-b3f1-adc6e989ab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:02.177993 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6da3b1-7a02-4d93-b3f1-adc6e989ab9e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:02.178255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6da3b1-7a02-4d93-b3f1-adc6e989ab9e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:02.178530 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6da3b1-7a02-4d93-b3f1-adc6e989ab9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:02.179404 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6da3b1-7a02-4d93-b3f1-adc6e989ab9e None admin] RBAC: Adding query filter params (group.id=9890e92d4d27447386c5ec3bc6cc76a7, role.id=715071b6b1244a559110be37cc8410ab, scope.project.id=41f0c6987ff94c9cb442a42b28d9f386) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:02.179719 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6da3b1-7a02-4d93-b3f1-adc6e989ab9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:02.181246 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6da3b1-7a02-4d93-b3f1-adc6e989ab9e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:02.188322 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 229/454] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:46:02 2022] GET /identity/v3/role_assignments?group.id=9890e92d4d27447386c5ec3bc6cc76a7&scope.project.id=41f0c6987ff94c9cb442a42b28d9f386&role.id=715071b6b1244a559110be37cc8410ab => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:02.200585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357dd67-ba4f-4b8d-903c-056abc40192c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:02.238623 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c34f8-885b-4d6d-bcca-411f3e93e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:02.239306 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c34f8-885b-4d6d-bcca-411f3e93e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:02.239596 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c34f8-885b-4d6d-bcca-411f3e93e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:02.239936 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c34f8-885b-4d6d-bcca-411f3e93e6e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:02.240740 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c34f8-885b-4d6d-bcca-411f3e93e6e6 None admin] RBAC: Adding query filter params (group.id=da3cbac8fa194be692977c534812a65f, role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=0cd97939f145462186b2c89bb3a6460f) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:02.241061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c34f8-885b-4d6d-bcca-411f3e93e6e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:02.242571 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c34f8-885b-4d6d-bcca-411f3e93e6e6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:02.250693 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 226/455] 10.222.0.89 () {56 vars in 1376 bytes} [Thu May 19 20:46:02 2022] GET /identity/v3/role_assignments?group.id=da3cbac8fa194be692977c534812a65f&scope.project.id=0cd97939f145462186b2c89bb3a6460f&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:05.308330 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f308307-e093-4443-b3b0-0cb4a2ab5a96 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:05.309453 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f308307-e093-4443-b3b0-0cb4a2ab5a96 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:05.309453 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f308307-e093-4443-b3b0-0cb4a2ab5a96 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:05.311481 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 230/456] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:05.316966 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904c5f-a787-4e14-b5c9-fcbfa42d9186 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:05.317955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904c5f-a787-4e14-b5c9-fcbfa42d9186 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:05.318458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3904c5f-a787-4e14-b5c9-fcbfa42d9186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:05.341498 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-f3904c5f-a787-4e14-b5c9-fcbfa42d9186 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:05.343083 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-f3904c5f-a787-4e14-b5c9-fcbfa42d9186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:05.376994 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:05.449523 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 227/457] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:05.488630 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f308307-e093-4443-b3b0-0cb4a2ab5a96 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:05.520314 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb0999-1d53-4fbd-8fd3-f0805c0e7bed None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:05.520734 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb0999-1d53-4fbd-8fd3-f0805c0e7bed None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:05.520856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb0999-1d53-4fbd-8fd3-f0805c0e7bed None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:05.522547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 228/458] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:46:05.536494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697d2f4-4b3a-4c6c-8f51-c8c91abdecf3 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:05.537119 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697d2f4-4b3a-4c6c-8f51-c8c91abdecf3 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:05.537603 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697d2f4-4b3a-4c6c-8f51-c8c91abdecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:05.562438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-0697d2f4-4b3a-4c6c-8f51-c8c91abdecf3 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:05.565853 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-0697d2f4-4b3a-4c6c-8f51-c8c91abdecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:05.670107 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f308307-e093-4443-b3b0-0cb4a2ab5a96 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:05.716543 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 229/459] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:46:05.736239 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8f0dd-3f0c-4f06-afb1-e8a7c63df1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:05.737061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8f0dd-3f0c-4f06-afb1-e8a7c63df1d7 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:05.737348 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8f0dd-3f0c-4f06-afb1-e8a7c63df1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:05.737631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8f0dd-3f0c-4f06-afb1-e8a7c63df1d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:05.742351 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697d2f4-4b3a-4c6c-8f51-c8c91abdecf3 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:05.767988 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8f0dd-3f0c-4f06-afb1-e8a7c63df1d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:05.769593 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8f0dd-3f0c-4f06-afb1-e8a7c63df1d7 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-49c8f0dd-3f0c-4f06-afb1-e8a7c63df1d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:05.802203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:05.803351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:05.804387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:05.804387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:05.804387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:05.804387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:05.805078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 231/460] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:05.819145 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8f0dd-3f0c-4f06-afb1-e8a7c63df1d7 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:05.897745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:05.914889 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:05.933520 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697d2f4-4b3a-4c6c-8f51-c8c91abdecf3 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:05.997322 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6b2a4-ed7b-4133-8f93-c4ca768ea75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:05.998147 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6b2a4-ed7b-4133-8f93-c4ca768ea75f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:05.998430 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6b2a4-ed7b-4133-8f93-c4ca768ea75f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:05.998756 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6b2a4-ed7b-4133-8f93-c4ca768ea75f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:06.011883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6b2a4-ed7b-4133-8f93-c4ca768ea75f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:06.014248 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6b2a4-ed7b-4133-8f93-c4ca768ea75f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-e2f6b2a4-ed7b-4133-8f93-c4ca768ea75f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:06.037082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:06.039091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:06.041091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:06.041091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:06.041091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:06.041091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:06.043736 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8f0dd-3f0c-4f06-afb1-e8a7c63df1d7 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:06.045213 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 230/461] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:06.047980 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4e76-6bbc-4a12-bd5b-0e6b48bf38e1 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:06.048483 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4e76-6bbc-4a12-bd5b-0e6b48bf38e1 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:06.048965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4e76-6bbc-4a12-bd5b-0e6b48bf38e1 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:06.051937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 231/462] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:06.053363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e4e76-6bbc-4a12-bd5b-0e6b48bf38e1 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:06.096051 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788359e-52d3-47ba-bc2b-1a01e98c056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:06.097037 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788359e-52d3-47ba-bc2b-1a01e98c056f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:06.097777 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788359e-52d3-47ba-bc2b-1a01e98c056f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:06.098214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788359e-52d3-47ba-bc2b-1a01e98c056f None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:06.100216 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788359e-52d3-47ba-bc2b-1a01e98c056f None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:06.100748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788359e-52d3-47ba-bc2b-1a01e98c056f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:06.102382 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788359e-52d3-47ba-bc2b-1a01e98c056f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:06.120317 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 232/463] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:06.125797 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2677ae0-b5c3-40eb-8fd3-d3d972ef5097 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:06.125797 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2677ae0-b5c3-40eb-8fd3-d3d972ef5097 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:06.125797 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2677ae0-b5c3-40eb-8fd3-d3d972ef5097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:06.147212 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-d2677ae0-b5c3-40eb-8fd3-d3d972ef5097 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:06.148845 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-d2677ae0-b5c3-40eb-8fd3-d3d972ef5097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:06.195244 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e4e76-6bbc-4a12-bd5b-0e6b48bf38e1 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:06.237329 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 233/464] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:06.238179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2677ae0-b5c3-40eb-8fd3-d3d972ef5097 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:06.241163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a599478-47e6-4d85-9aae-e3af830e6c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:06.241834 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599478-47e6-4d85-9aae-e3af830e6c1d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:06.242196 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599478-47e6-4d85-9aae-e3af830e6c1d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:06.242475 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599478-47e6-4d85-9aae-e3af830e6c1d None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:06.243419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a599478-47e6-4d85-9aae-e3af830e6c1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:06.243916 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a599478-47e6-4d85-9aae-e3af830e6c1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:06.245465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a599478-47e6-4d85-9aae-e3af830e6c1d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:06.256953 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:06.260732 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 232/465] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:06.262725 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408101a-d795-449c-b03b-f58aa59fa155 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:06.271862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408101a-d795-449c-b03b-f58aa59fa155 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:06.271862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408101a-d795-449c-b03b-f58aa59fa155 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:06.271862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 233/466] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:06.271862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408101a-d795-449c-b03b-f58aa59fa155 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:06.272265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:06.364723 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2677ae0-b5c3-40eb-8fd3-d3d972ef5097 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:06.391776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408101a-d795-449c-b03b-f58aa59fa155 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:06.408461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008987b-e7a7-4a0a-8e4b-4fd350714f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:06.409149 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008987b-e7a7-4a0a-8e4b-4fd350714f53 None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:06.409436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008987b-e7a7-4a0a-8e4b-4fd350714f53 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:06.409715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008987b-e7a7-4a0a-8e4b-4fd350714f53 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:06.410706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008987b-e7a7-4a0a-8e4b-4fd350714f53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:06.412181 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008987b-e7a7-4a0a-8e4b-4fd350714f53 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:06.439426 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c00c8-529a-4a8d-b278-dcf41dd23c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:06.440312 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c00c8-529a-4a8d-b278-dcf41dd23c78 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:06.440591 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c00c8-529a-4a8d-b278-dcf41dd23c78 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:06.440868 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c00c8-529a-4a8d-b278-dcf41dd23c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:06.452766 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c00c8-529a-4a8d-b278-dcf41dd23c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:06.454244 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c00c8-529a-4a8d-b278-dcf41dd23c78 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-e64c00c8-529a-4a8d-b278-dcf41dd23c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:06.477291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:06.479114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:06.480494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:06.480494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:06.480494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:06.480494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:06.480494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 234/467] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:06.480494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c00c8-529a-4a8d-b278-dcf41dd23c78 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:06.503122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 234/468] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:46:06 2022] POST /identity/v3/users => generated 246 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:46:06.510438 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322ca57-8483-48cf-9883-4d802894c86a None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:06.510438 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322ca57-8483-48cf-9883-4d802894c86a None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:06.510438 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322ca57-8483-48cf-9883-4d802894c86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:06.537042 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-4322ca57-8483-48cf-9883-4d802894c86a None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:06.538512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-4322ca57-8483-48cf-9883-4d802894c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:06.558383 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:06.626128 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c00c8-529a-4a8d-b278-dcf41dd23c78 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:06.663481 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 235/469] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:06.665252 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322ca57-8483-48cf-9883-4d802894c86a None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:06.675367 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b4e8e-c7bd-4eb7-bb94-2980fd8a5ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:06.676204 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b4e8e-c7bd-4eb7-bb94-2980fd8a5ee3 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:06.676541 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b4e8e-c7bd-4eb7-bb94-2980fd8a5ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:06.676828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b4e8e-c7bd-4eb7-bb94-2980fd8a5ee3 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:06.677575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b4e8e-c7bd-4eb7-bb94-2980fd8a5ee3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:06.679119 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b4e8e-c7bd-4eb7-bb94-2980fd8a5ee3 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:06.681637 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:06.799508 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 235/470] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:46:06 2022] POST /identity/v3/users => generated 248 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:46:06.800614 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b4e8e-c7bd-4eb7-bb94-2980fd8a5ee3 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:06.815489 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322ca57-8483-48cf-9883-4d802894c86a None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:06.877682 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4882-d9e4-4c26-a0d8-821e1ff1bf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:06.878315 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4882-d9e4-4c26-a0d8-821e1ff1bf03 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:06.878698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4882-d9e4-4c26-a0d8-821e1ff1bf03 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:06.879033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4882-d9e4-4c26-a0d8-821e1ff1bf03 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:06.879839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c4882-d9e4-4c26-a0d8-821e1ff1bf03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:06.880156 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c4882-d9e4-4c26-a0d8-821e1ff1bf03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:06.881747 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c4882-d9e4-4c26-a0d8-821e1ff1bf03 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:06.901118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 236/471] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:06.907677 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4882-d9e4-4c26-a0d8-821e1ff1bf03 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:06.969062 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b4e8e-c7bd-4eb7-bb94-2980fd8a5ee3 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:06.981057 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:07.001347 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:07.024121 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd20d0-da5a-4b95-af25-99f2b26b2c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:07.024966 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd20d0-da5a-4b95-af25-99f2b26b2c15 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:07.025312 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd20d0-da5a-4b95-af25-99f2b26b2c15 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:07.025604 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd20d0-da5a-4b95-af25-99f2b26b2c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:07.040874 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4882-d9e4-4c26-a0d8-821e1ff1bf03 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:07.065812 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd20d0-da5a-4b95-af25-99f2b26b2c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:07.067324 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd20d0-da5a-4b95-af25-99f2b26b2c15 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-37dd20d0-da5a-4b95-af25-99f2b26b2c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:07.093004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:07.094429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:07.095864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:07.095864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:07.095864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:07.095864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:07.095864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 236/472] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:07.101069 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd20d0-da5a-4b95-af25-99f2b26b2c15 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:07.101500 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952d489-d5a5-4eae-a88d-a399ab6c3663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:07.102312 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952d489-d5a5-4eae-a88d-a399ab6c3663 None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:07.102733 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952d489-d5a5-4eae-a88d-a399ab6c3663 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:07.103111 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952d489-d5a5-4eae-a88d-a399ab6c3663 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:07.103855 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952d489-d5a5-4eae-a88d-a399ab6c3663 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:07.106283 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952d489-d5a5-4eae-a88d-a399ab6c3663 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:07.215872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 237/473] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:46:06 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:46:07.218654 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff5c3d-8aa6-478e-9950-5763e8cbecaf None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:07.219231 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff5c3d-8aa6-478e-9950-5763e8cbecaf None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:07.220019 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff5c3d-8aa6-478e-9950-5763e8cbecaf None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:07.222281 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 238/474] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:07.232972 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d376577-c7dc-47ce-beae-7eb09451c72c None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:07.233293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d376577-c7dc-47ce-beae-7eb09451c72c None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:07.233530 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d376577-c7dc-47ce-beae-7eb09451c72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:07.248871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd20d0-da5a-4b95-af25-99f2b26b2c15 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:07.264964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-9d376577-c7dc-47ce-beae-7eb09451c72c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:07.266260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-9d376577-c7dc-47ce-beae-7eb09451c72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:07.303592 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c023d39-df62-465c-baf7-81149d8834bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:07.304771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c023d39-df62-465c-baf7-81149d8834bb None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:07.305585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c023d39-df62-465c-baf7-81149d8834bb None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:07.306630 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c023d39-df62-465c-baf7-81149d8834bb None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:07.307929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c023d39-df62-465c-baf7-81149d8834bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:07.308759 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c023d39-df62-465c-baf7-81149d8834bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:07.311613 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c023d39-df62-465c-baf7-81149d8834bb None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:07.332616 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 237/475] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:07.342073 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c023d39-df62-465c-baf7-81149d8834bb None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:07.381635 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 239/476] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 20:46:07.390495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:07.430626 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d376577-c7dc-47ce-beae-7eb09451c72c None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:07.503110 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c023d39-df62-465c-baf7-81149d8834bb None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:07.534551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:07.578838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3468d83-923a-482c-8f2d-42840b2a5122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:07.579830 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468d83-923a-482c-8f2d-42840b2a5122 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:07.580293 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468d83-923a-482c-8f2d-42840b2a5122 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:07.580738 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468d83-923a-482c-8f2d-42840b2a5122 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:07.581645 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3468d83-923a-482c-8f2d-42840b2a5122 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:07.583380 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3468d83-923a-482c-8f2d-42840b2a5122 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:07.608471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d376577-c7dc-47ce-beae-7eb09451c72c None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:07.660922 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 238/477] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:46:07 2022] POST /identity/v3/users => generated 249 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:46:07.667495 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61955245-6ad7-4991-b76d-c0d43602dbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:07.668253 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61955245-6ad7-4991-b76d-c0d43602dbdc None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:07.668547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61955245-6ad7-4991-b76d-c0d43602dbdc None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:07.668832 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61955245-6ad7-4991-b76d-c0d43602dbdc None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:07.669755 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61955245-6ad7-4991-b76d-c0d43602dbdc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:07.671340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61955245-6ad7-4991-b76d-c0d43602dbdc None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:07.707275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.sql.core [None req-61955245-6ad7-4991-b76d-c0d43602dbdc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:46:07.707275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 20:46:07.707275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [parameters: {'id': '278753982e6c4a1eac7385615dce0567', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 20:46:07.707275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=284561) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-61955245-6ad7-4991-b76d-c0d43602dbdc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application conn.query(q) May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application result.read() May 19 20:46:07.727218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return ref.to_dict() May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:46:07.728353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application next(self.gen) May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application yield resource May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application next(self.gen) May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise self.value May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application session.commit() May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:46:07.729515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self.session.flush() May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application compat.raise_( May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:46:07.730708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:46:07.731862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application conn.query(q) May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application result.read() May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:46:07.733724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [parameters: {'id': '278753982e6c4a1eac7385615dce0567', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:07.738894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 20:46:07.741417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:07.743670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 240/478] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:46:07 2022] POST /identity/v3/roles => generated 144 bytes in 299 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:07.743825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3468d83-923a-482c-8f2d-42840b2a5122 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:07.851022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:07.889596 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3468d83-923a-482c-8f2d-42840b2a5122 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:07.941319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46000ba5-6795-4aa6-aea2-af7f7eac5c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:07.942187 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46000ba5-6795-4aa6-aea2-af7f7eac5c6a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:07.942475 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46000ba5-6795-4aa6-aea2-af7f7eac5c6a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:07.942772 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46000ba5-6795-4aa6-aea2-af7f7eac5c6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:07.961887 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46000ba5-6795-4aa6-aea2-af7f7eac5c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-46000ba5-6795-4aa6-aea2-af7f7eac5c6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:07.973154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:07.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:07.977744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 239/479] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:46:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:07.982638 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61955245-6ad7-4991-b76d-c0d43602dbdc None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:08.126571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61955245-6ad7-4991-b76d-c0d43602dbdc None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:08.151192 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:08.167244 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bbbb2-c6ce-4b79-9f64-41963c577d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:08.174365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bbbb2-c6ce-4b79-9f64-41963c577d15 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:08.174365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bbbb2-c6ce-4b79-9f64-41963c577d15 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:08.174365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bbbb2-c6ce-4b79-9f64-41963c577d15 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:08.174365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bbbb2-c6ce-4b79-9f64-41963c577d15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:08.174365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bbbb2-c6ce-4b79-9f64-41963c577d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:08.174365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bbbb2-c6ce-4b79-9f64-41963c577d15 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:08.181763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 241/480] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:09.376411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3310-abe0-49c4-afcd-d7a9985b717d None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:09.377444 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3310-abe0-49c4-afcd-d7a9985b717d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:09.377940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3310-abe0-49c4-afcd-d7a9985b717d None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:09.379858 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 240/481] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:09.384871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461097-d6b9-4a77-ad71-55e49f6d8719 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:09.385718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461097-d6b9-4a77-ad71-55e49f6d8719 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:09.386203 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461097-d6b9-4a77-ad71-55e49f6d8719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:09.407910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-18461097-d6b9-4a77-ad71-55e49f6d8719 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:09.409536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-18461097-d6b9-4a77-ad71-55e49f6d8719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:09.485979 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 242/482] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:09.501267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40f1ff-6fa8-4849-a6c9-ea24a0a4573e None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:09.501641 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40f1ff-6fa8-4849-a6c9-ea24a0a4573e None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:09.501817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40f1ff-6fa8-4849-a6c9-ea24a0a4573e None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:09.503516 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 241/483] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:09.509113 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392498a-8a59-4721-a101-630415c503d2 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:09.509408 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392498a-8a59-4721-a101-630415c503d2 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:09.509693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392498a-8a59-4721-a101-630415c503d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:09.522495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40f1ff-6fa8-4849-a6c9-ea24a0a4573e None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:09.539694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-4392498a-8a59-4721-a101-630415c503d2 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:09.540909 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-4392498a-8a59-4721-a101-630415c503d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:09.665195 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 243/484] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:09.675335 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40f1ff-6fa8-4849-a6c9-ea24a0a4573e None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:09.711152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392498a-8a59-4721-a101-630415c503d2 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:09.713963 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cb116-ff9c-488b-aca5-c2d0c28fb16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:09.714856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cb116-ff9c-488b-aca5-c2d0c28fb16d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:09.715655 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cb116-ff9c-488b-aca5-c2d0c28fb16d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:09.715933 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cb116-ff9c-488b-aca5-c2d0c28fb16d None admin] PATH_INFO: `/v3/roles/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:09.724158 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:09.728282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cb116-ff9c-488b-aca5-c2d0c28fb16d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-761cb116-ff9c-488b-aca5-c2d0c28fb16d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:09.736501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:09.741275 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:09.742239 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 242/485] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:09.743843 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cb116-ff9c-488b-aca5-c2d0c28fb16d None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:09.798639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:09.937459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392498a-8a59-4721-a101-630415c503d2 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:09.963252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cb116-ff9c-488b-aca5-c2d0c28fb16d None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:10.007402 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d6953-4d8a-4960-af87-ec4838e9d442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:10.008224 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d6953-4d8a-4960-af87-ec4838e9d442 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.008509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d6953-4d8a-4960-af87-ec4838e9d442 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.008786 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d6953-4d8a-4960-af87-ec4838e9d442 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.031974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d6953-4d8a-4960-af87-ec4838e9d442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:10.048758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e435e71-deba-41ef-aec1-b17a7a40527c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:10.049777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e435e71-deba-41ef-aec1-b17a7a40527c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.050200 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e435e71-deba-41ef-aec1-b17a7a40527c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.050642 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e435e71-deba-41ef-aec1-b17a7a40527c None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.051848 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e435e71-deba-41ef-aec1-b17a7a40527c None admin] RBAC: Adding query filter params (name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:10.052395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e435e71-deba-41ef-aec1-b17a7a40527c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:10.054716 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e435e71-deba-41ef-aec1-b17a7a40527c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-480d6953-4d8a-4960-af87-ec4838e9d442 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:10.060299 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:10.061484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:10.062451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:10.063733 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 244/486] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:10.071685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d6953-4d8a-4960-af87-ec4838e9d442 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:10.072964 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 243/487] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:10.080441 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e435e71-deba-41ef-aec1-b17a7a40527c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:10.197916 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:10.252865 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e435e71-deba-41ef-aec1-b17a7a40527c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:10.257607 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d6953-4d8a-4960-af87-ec4838e9d442 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:10.259542 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:10.298284 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a509-dec5-46c2-abce-a612ac187e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:10.299551 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a509-dec5-46c2-abce-a612ac187e5a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.299747 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a509-dec5-46c2-abce-a612ac187e5a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.299908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a509-dec5-46c2-abce-a612ac187e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.313655 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7a509-dec5-46c2-abce-a612ac187e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:10.315218 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7a509-dec5-46c2-abce-a612ac187e5a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:10.319857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ce123-21b4-4db7-b10e-7dbb15a21983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:10.320875 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce123-21b4-4db7-b10e-7dbb15a21983 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.321414 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce123-21b4-4db7-b10e-7dbb15a21983 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.321922 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce123-21b4-4db7-b10e-7dbb15a21983 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.323418 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ce123-21b4-4db7-b10e-7dbb15a21983 None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:10.323954 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ce123-21b4-4db7-b10e-7dbb15a21983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:10.327006 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ce123-21b4-4db7-b10e-7dbb15a21983 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-89c7a509-dec5-46c2-abce-a612ac187e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:10.334120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:10.335172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:10.336193 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:10.336193 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:10.336193 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:10.336193 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:10.340203 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 244/488] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:10.345287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894f497-7942-4f71-9c41-210a8a83ea87 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.345287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894f497-7942-4f71-9c41-210a8a83ea87 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.345287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894f497-7942-4f71-9c41-210a8a83ea87 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.345287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 245/490] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:10.345287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894f497-7942-4f71-9c41-210a8a83ea87 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:10.346302 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 245/490] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:10.351042 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ce123-21b4-4db7-b10e-7dbb15a21983 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:10.461963 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894f497-7942-4f71-9c41-210a8a83ea87 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:10.472617 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ce123-21b4-4db7-b10e-7dbb15a21983 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:10.475411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:10.502812 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cdc1a-020d-4901-b809-9a91613037a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:10.503527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cdc1a-020d-4901-b809-9a91613037a6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.503814 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cdc1a-020d-4901-b809-9a91613037a6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.504098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cdc1a-020d-4901-b809-9a91613037a6 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.504979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cdc1a-020d-4901-b809-9a91613037a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:10.505174 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cdc1a-020d-4901-b809-9a91613037a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:10.506534 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cdc1a-020d-4901-b809-9a91613037a6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:10.518963 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 246/491] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:10.519591 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d320dcb-daed-4c05-8829-726e153586f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:10.520266 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b48e5f-f5da-4444-830d-8e8eccd10cd3 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.520560 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b48e5f-f5da-4444-830d-8e8eccd10cd3 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.520843 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b48e5f-f5da-4444-830d-8e8eccd10cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.521293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d320dcb-daed-4c05-8829-726e153586f7 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.521833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d320dcb-daed-4c05-8829-726e153586f7 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.522297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d320dcb-daed-4c05-8829-726e153586f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.536321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d320dcb-daed-4c05-8829-726e153586f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:10.538097 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d320dcb-daed-4c05-8829-726e153586f7 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:10.544300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-e9b48e5f-f5da-4444-830d-8e8eccd10cd3 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:10.545516 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-e9b48e5f-f5da-4444-830d-8e8eccd10cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-9d320dcb-daed-4c05-8829-726e153586f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:10.560027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:10.561135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:10.562213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:10.562213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:10.562213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:10.562213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:10.568546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 246/492] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:10.569670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d320dcb-daed-4c05-8829-726e153586f7 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:10.592101 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:10.624127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 247/493] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:10.624127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b48e5f-f5da-4444-830d-8e8eccd10cd3 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:10.710726 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d320dcb-daed-4c05-8829-726e153586f7 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:10.736025 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:10.739859 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b48e5f-f5da-4444-830d-8e8eccd10cd3 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:10.748895 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cf849-f0b0-4cd3-b9ae-cbc7b0b710cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:10.754485 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cf849-f0b0-4cd3-b9ae-cbc7b0b710cd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.754485 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cf849-f0b0-4cd3-b9ae-cbc7b0b710cd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.754485 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cf849-f0b0-4cd3-b9ae-cbc7b0b710cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.759628 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cf849-f0b0-4cd3-b9ae-cbc7b0b710cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:10.761325 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cf849-f0b0-4cd3-b9ae-cbc7b0b710cd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:10.778400 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e1f91-5306-435d-85b9-9eb2476d1595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:10.779111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e1f91-5306-435d-85b9-9eb2476d1595 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.779405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e1f91-5306-435d-85b9-9eb2476d1595 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.779791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e1f91-5306-435d-85b9-9eb2476d1595 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.780538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e1f91-5306-435d-85b9-9eb2476d1595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:10.780851 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e1f91-5306-435d-85b9-9eb2476d1595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-738cf849-f0b0-4cd3-b9ae-cbc7b0b710cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:10.781035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:10.782070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:10.783279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:10.783279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:10.783279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:10.783279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:10.783279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:10.783279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:10.783279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:10.783279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:10.783279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:10.783279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:10.784053 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e1f91-5306-435d-85b9-9eb2476d1595 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:10.785683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 247/494] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:46:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:10.786857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cf849-f0b0-4cd3-b9ae-cbc7b0b710cd None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:10.806715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 248/495] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:10.806715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e1f91-5306-435d-85b9-9eb2476d1595 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:10.889282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:10.915858 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cf849-f0b0-4cd3-b9ae-cbc7b0b710cd None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:10.933138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e1f91-5306-435d-85b9-9eb2476d1595 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:10.957807 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb988e-133d-4b6e-894f-733e837d7af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:10.959065 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb988e-133d-4b6e-894f-733e837d7af0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.959666 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb988e-133d-4b6e-894f-733e837d7af0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.960172 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb988e-133d-4b6e-894f-733e837d7af0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.973359 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcb9de-0dc4-4f9c-975b-9c801d7b5e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:10.974079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb9de-0dc4-4f9c-975b-9c801d7b5e06 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:10.974367 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb9de-0dc4-4f9c-975b-9c801d7b5e06 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:10.974686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb9de-0dc4-4f9c-975b-9c801d7b5e06 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:10.975575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcb9de-0dc4-4f9c-975b-9c801d7b5e06 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:10.975892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcb9de-0dc4-4f9c-975b-9c801d7b5e06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:10.976608 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb988e-133d-4b6e-894f-733e837d7af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:10.977416 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcb9de-0dc4-4f9c-975b-9c801d7b5e06 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-56bb988e-133d-4b6e-894f-733e837d7af0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:10.985546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:10.986760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:10.987773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:10.995768 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 248/496] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:10.997331 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb988e-133d-4b6e-894f-733e837d7af0 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:11.020139 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 249/497] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:46:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:11.020938 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcb9de-0dc4-4f9c-975b-9c801d7b5e06 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:11.049362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:11.121238 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb988e-133d-4b6e-894f-733e837d7af0 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:11.140621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcb9de-0dc4-4f9c-975b-9c801d7b5e06 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:11.160905 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb2713-2cdf-4b96-a12b-653cd7b7a8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:11.161727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2713-2cdf-4b96-a12b-653cd7b7a8ae None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.162014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2713-2cdf-4b96-a12b-653cd7b7a8ae None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.162293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2713-2cdf-4b96-a12b-653cd7b7a8ae None admin] PATH_INFO: `/v3/users/glance` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.166176 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:11.173720 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb2713-2cdf-4b96-a12b-653cd7b7a8ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:11.175263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb2713-2cdf-4b96-a12b-653cd7b7a8ae None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:11.179746 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113b11e-e6a4-44ee-9265-82c40eb6050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:11.180427 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113b11e-e6a4-44ee-9265-82c40eb6050a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.180708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113b11e-e6a4-44ee-9265-82c40eb6050a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.180982 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113b11e-e6a4-44ee-9265-82c40eb6050a None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.181735 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113b11e-e6a4-44ee-9265-82c40eb6050a None admin] RBAC: Adding query filter params (name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:11.182044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113b11e-e6a4-44ee-9265-82c40eb6050a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:11.183490 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113b11e-e6a4-44ee-9265-82c40eb6050a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-4ccb2713-2cdf-4b96-a12b-653cd7b7a8ae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:11.191010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:11.197573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:11.198819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:11.198819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:11.198819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:11.198819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:11.198819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:11.198819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:11.198819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:11.198819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:11.198819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:46:11.198819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:11.198819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 249/498] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:11.200480 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 250/499] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:11.200480 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113b11e-e6a4-44ee-9265-82c40eb6050a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:11.200982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22346b-ed23-40ef-a303-0f41e9851d68 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.200982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22346b-ed23-40ef-a303-0f41e9851d68 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.200982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22346b-ed23-40ef-a303-0f41e9851d68 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.200982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 250/500] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:11.200982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0133b-d0b1-4cbb-a578-de52a99e738f None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.200982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0133b-d0b1-4cbb-a578-de52a99e738f None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.202040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0133b-d0b1-4cbb-a578-de52a99e738f None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.202040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 251/501] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:11.202040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0133b-d0b1-4cbb-a578-de52a99e738f None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:11.294533 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:11.313791 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0133b-d0b1-4cbb-a578-de52a99e738f None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:11.316412 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113b11e-e6a4-44ee-9265-82c40eb6050a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:11.351477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea3a97-0fb1-4c50-9642-8c85a19dd7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:11.351477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea3a97-0fb1-4c50-9642-8c85a19dd7d2 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.351911 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea3a97-0fb1-4c50-9642-8c85a19dd7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.352007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea3a97-0fb1-4c50-9642-8c85a19dd7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.354392 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1a71e-26df-463a-b5be-1b5718f7e14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:11.355097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1a71e-26df-463a-b5be-1b5718f7e14b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.355404 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1a71e-26df-463a-b5be-1b5718f7e14b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.355691 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1a71e-26df-463a-b5be-1b5718f7e14b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.364487 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea3a97-0fb1-4c50-9642-8c85a19dd7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:11.365950 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea3a97-0fb1-4c50-9642-8c85a19dd7d2 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-1aea3a97-0fb1-4c50-9642-8c85a19dd7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:11.384708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:11.385822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:11.387574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:11.387574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:11.387574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:11.387574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:11.387574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 252/502] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:11.387574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea3a97-0fb1-4c50-9642-8c85a19dd7d2 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:11.432538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1a71e-26df-463a-b5be-1b5718f7e14b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:11.434044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1a71e-26df-463a-b5be-1b5718f7e14b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:11.443260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:11.500182 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea3a97-0fb1-4c50-9642-8c85a19dd7d2 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:11.536460 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:11.541178 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee924533-27c4-4cd9-9400-3330fb0886b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:11.541857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924533-27c4-4cd9-9400-3330fb0886b3 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.542138 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924533-27c4-4cd9-9400-3330fb0886b3 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.542412 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924533-27c4-4cd9-9400-3330fb0886b3 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.543863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee924533-27c4-4cd9-9400-3330fb0886b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:11.544171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee924533-27c4-4cd9-9400-3330fb0886b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:11.545689 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee924533-27c4-4cd9-9400-3330fb0886b3 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:11.557014 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 251/503] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:11.558328 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e4df-3687-4ed7-ab9c-cf447ab26f42 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.558632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e4df-3687-4ed7-ab9c-cf447ab26f42 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.558937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e4df-3687-4ed7-ab9c-cf447ab26f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.575964 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-67f9e4df-3687-4ed7-ab9c-cf447ab26f42 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:11.577203 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-67f9e4df-3687-4ed7-ab9c-cf447ab26f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:11.584550 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 253/504] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:46:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:11.585943 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6c263-83d2-439b-89ee-f69358d43b36 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.586245 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6c263-83d2-439b-89ee-f69358d43b36 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.586529 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6c263-83d2-439b-89ee-f69358d43b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.603789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-0dc6c263-83d2-439b-89ee-f69358d43b36 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:11.605007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-0dc6c263-83d2-439b-89ee-f69358d43b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:11.644951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 252/505] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:11.645800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e4df-3687-4ed7-ab9c-cf447ab26f42 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:11.686863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 254/506] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:11.687727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6c263-83d2-439b-89ee-f69358d43b36 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:11.723350 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:11.764626 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e4df-3687-4ed7-ab9c-cf447ab26f42 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:11.776429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:11.792395 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6c263-83d2-439b-89ee-f69358d43b36 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:11.801299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191f486-9a3e-40af-afc3-cbc7f96dd98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:11.801889 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f486-9a3e-40af-afc3-cbc7f96dd98b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.802172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f486-9a3e-40af-afc3-cbc7f96dd98b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.802449 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f486-9a3e-40af-afc3-cbc7f96dd98b None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.803214 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191f486-9a3e-40af-afc3-cbc7f96dd98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:11.803523 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191f486-9a3e-40af-afc3-cbc7f96dd98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:11.804910 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191f486-9a3e-40af-afc3-cbc7f96dd98b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:11.818226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 253/507] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:11.819098 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191f486-9a3e-40af-afc3-cbc7f96dd98b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:11.840570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c01898-d7c7-46d0-9cd4-b48838960fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:11.841379 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01898-d7c7-46d0-9cd4-b48838960fda None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.841661 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01898-d7c7-46d0-9cd4-b48838960fda None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.841936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01898-d7c7-46d0-9cd4-b48838960fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.854619 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c01898-d7c7-46d0-9cd4-b48838960fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:11.856172 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c01898-d7c7-46d0-9cd4-b48838960fda None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-71c01898-d7c7-46d0-9cd4-b48838960fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:11.875476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:11.876605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:11.877611 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:11.877611 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:11.877611 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:11.877611 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:11.881390 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 255/508] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:11.882108 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c01898-d7c7-46d0-9cd4-b48838960fda None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:11.923857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191f486-9a3e-40af-afc3-cbc7f96dd98b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:11.958148 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d3cc1-1351-4ed7-b106-005d87261e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:11.958834 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d3cc1-1351-4ed7-b106-005d87261e1b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:11.959123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d3cc1-1351-4ed7-b106-005d87261e1b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:11.959403 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d3cc1-1351-4ed7-b106-005d87261e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:11.971784 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:11.983715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c01898-d7c7-46d0-9cd4-b48838960fda None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:11.998737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:12.018516 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7405b16-181b-491d-bf6d-bda44f2a4b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:12.019361 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405b16-181b-491d-bf6d-bda44f2a4b4a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:12.019645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405b16-181b-491d-bf6d-bda44f2a4b4a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:12.019932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405b16-181b-491d-bf6d-bda44f2a4b4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:12.029043 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d3cc1-1351-4ed7-b106-005d87261e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:12.030508 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d3cc1-1351-4ed7-b106-005d87261e1b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:12.030853 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7405b16-181b-491d-bf6d-bda44f2a4b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-a7405b16-181b-491d-bf6d-bda44f2a4b4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:12.041460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:12.042582 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 256/509] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:12.043564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7405b16-181b-491d-bf6d-bda44f2a4b4a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.134623 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 254/510] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:12.135549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d3cc1-1351-4ed7-b106-005d87261e1b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.171390 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7405b16-181b-491d-bf6d-bda44f2a4b4a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:12.216295 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15394999-ab33-4415-85ea-d206eefa2202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:12.217189 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:12.217478 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15394999-ab33-4415-85ea-d206eefa2202 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:12.218381 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15394999-ab33-4415-85ea-d206eefa2202 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:12.218842 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15394999-ab33-4415-85ea-d206eefa2202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:12.232033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15394999-ab33-4415-85ea-d206eefa2202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:12.233504 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15394999-ab33-4415-85ea-d206eefa2202 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:12.241892 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:12.249764 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d3cc1-1351-4ed7-b106-005d87261e1b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-15394999-ab33-4415-85ea-d206eefa2202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:12.251177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:12.252265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:12.253281 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:12.253281 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:12.253281 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:12.253281 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:12.253281 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 257/511] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:12.253281 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15394999-ab33-4415-85ea-d206eefa2202 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.287084 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6bb4d-fdb9-4bde-b1df-cb04fbadb422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:12.287895 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6bb4d-fdb9-4bde-b1df-cb04fbadb422 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:12.288178 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6bb4d-fdb9-4bde-b1df-cb04fbadb422 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:12.288455 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6bb4d-fdb9-4bde-b1df-cb04fbadb422 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:12.296882 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6bb4d-fdb9-4bde-b1df-cb04fbadb422 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:12.298357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6bb4d-fdb9-4bde-b1df-cb04fbadb422 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-0ad6bb4d-fdb9-4bde-b1df-cb04fbadb422 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:12.314873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:12.316146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 255/512] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:12.317415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6bb4d-fdb9-4bde-b1df-cb04fbadb422 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.361253 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15394999-ab33-4415-85ea-d206eefa2202 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:12.396133 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6ad0b-7306-496e-8958-2ea729efc94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:12.396717 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ad0b-7306-496e-8958-2ea729efc94e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:12.396999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ad0b-7306-496e-8958-2ea729efc94e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:12.397274 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ad0b-7306-496e-8958-2ea729efc94e None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:12.398007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6ad0b-7306-496e-8958-2ea729efc94e None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:12.398316 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6ad0b-7306-496e-8958-2ea729efc94e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:12.399746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6ad0b-7306-496e-8958-2ea729efc94e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:12.411706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 258/513] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:12.412547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6ad0b-7306-496e-8958-2ea729efc94e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.421717 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6bb4d-fdb9-4bde-b1df-cb04fbadb422 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:12.450903 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:12.457023 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57b813-d8fa-4e11-993b-af6380fbc8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:12.457703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57b813-d8fa-4e11-993b-af6380fbc8c1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:12.457990 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57b813-d8fa-4e11-993b-af6380fbc8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:12.458268 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57b813-d8fa-4e11-993b-af6380fbc8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:12.459064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57b813-d8fa-4e11-993b-af6380fbc8c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:12.459376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57b813-d8fa-4e11-993b-af6380fbc8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:12.460784 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57b813-d8fa-4e11-993b-af6380fbc8c1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:12.469724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 256/514] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:12.470576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57b813-d8fa-4e11-993b-af6380fbc8c1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.478728 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:12.531021 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6ad0b-7306-496e-8958-2ea729efc94e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:12.567684 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbf334-e0d9-45f0-ad03-45cce13814b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:12.574790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf334-e0d9-45f0-ad03-45cce13814b6 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:12.574790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf334-e0d9-45f0-ad03-45cce13814b6 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:12.574790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf334-e0d9-45f0-ad03-45cce13814b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:12.581229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbf334-e0d9-45f0-ad03-45cce13814b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:12.582775 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbf334-e0d9-45f0-ad03-45cce13814b6 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:12.583958 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57b813-d8fa-4e11-993b-af6380fbc8c1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-33dbf334-e0d9-45f0-ad03-45cce13814b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:12.602054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:12.603512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:12.604723 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:12.604723 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:12.604723 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:12.604723 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:12.604723 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 259/515] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:12.604723 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbf334-e0d9-45f0-ad03-45cce13814b6 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.623140 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f38378-ac72-4ede-9dc0-0cd2fcb17d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:12.623824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38378-ac72-4ede-9dc0-0cd2fcb17d59 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:12.624108 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38378-ac72-4ede-9dc0-0cd2fcb17d59 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:12.624385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38378-ac72-4ede-9dc0-0cd2fcb17d59 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:12.625125 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f38378-ac72-4ede-9dc0-0cd2fcb17d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:12.625433 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f38378-ac72-4ede-9dc0-0cd2fcb17d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:12.626881 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f38378-ac72-4ede-9dc0-0cd2fcb17d59 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:12.640122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 257/516] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:12.640994 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f38378-ac72-4ede-9dc0-0cd2fcb17d59 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.697640 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:12.714024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbf334-e0d9-45f0-ad03-45cce13814b6 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:12.727789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:12.746272 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f38378-ac72-4ede-9dc0-0cd2fcb17d59 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:12.748640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71654264-d515-4fb3-8a47-f3483594a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:12.749314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71654264-d515-4fb3-8a47-f3483594a4bc None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:12.749595 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71654264-d515-4fb3-8a47-f3483594a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:12.749868 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71654264-d515-4fb3-8a47-f3483594a4bc None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:12.750732 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71654264-d515-4fb3-8a47-f3483594a4bc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:12.751043 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71654264-d515-4fb3-8a47-f3483594a4bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:12.752560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71654264-d515-4fb3-8a47-f3483594a4bc None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:12.775997 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 260/517] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:46:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:12.775997 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71654264-d515-4fb3-8a47-f3483594a4bc None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.785651 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46976119-cdbf-4442-b10d-fa8214f9ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:12.786449 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976119-cdbf-4442-b10d-fa8214f9ff7d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:12.786762 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976119-cdbf-4442-b10d-fa8214f9ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:12.787038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976119-cdbf-4442-b10d-fa8214f9ff7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:12.793905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46976119-cdbf-4442-b10d-fa8214f9ff7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:12.795375 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46976119-cdbf-4442-b10d-fa8214f9ff7d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-46976119-cdbf-4442-b10d-fa8214f9ff7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:12.811767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:12.812832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:12.813856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:12.813856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:12.813856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:12.813856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:12.813856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:12.813856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:12.813856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:12.813856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:12.813856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 258/518] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:12.814454 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46976119-cdbf-4442-b10d-fa8214f9ff7d None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.879956 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71654264-d515-4fb3-8a47-f3483594a4bc None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:12.915044 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0ca9d-f319-46dc-aa99-7a7cfa4bad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:12.915818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46976119-cdbf-4442-b10d-fa8214f9ff7d None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:12.915969 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0ca9d-f319-46dc-aa99-7a7cfa4bad2f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:12.916098 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0ca9d-f319-46dc-aa99-7a7cfa4bad2f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:12.916390 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0ca9d-f319-46dc-aa99-7a7cfa4bad2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:12.927370 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0ca9d-f319-46dc-aa99-7a7cfa4bad2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:12.928808 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0ca9d-f319-46dc-aa99-7a7cfa4bad2f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:12.929534 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-f3f0ca9d-f319-46dc-aa99-7a7cfa4bad2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:12.946848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:12.948122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:12.949391 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:12.949391 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:12.949391 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:12.949391 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:12.949391 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 261/519] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:12.949391 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0ca9d-f319-46dc-aa99-7a7cfa4bad2f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.953031 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a0856-16db-4aaf-bd7a-d9466c34e5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:12.953743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a0856-16db-4aaf-bd7a-d9466c34e5ea None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:12.954029 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a0856-16db-4aaf-bd7a-d9466c34e5ea None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:12.954309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a0856-16db-4aaf-bd7a-d9466c34e5ea None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:12.955092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a0856-16db-4aaf-bd7a-d9466c34e5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:12.955406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a0856-16db-4aaf-bd7a-d9466c34e5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:12.956907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a0856-16db-4aaf-bd7a-d9466c34e5ea None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:12.969721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 259/520] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:12.970774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a0856-16db-4aaf-bd7a-d9466c34e5ea None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:12.976665 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:13.055243 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0ca9d-f319-46dc-aa99-7a7cfa4bad2f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:13.074592 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a0856-16db-4aaf-bd7a-d9466c34e5ea None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:13.092980 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c877549-8dd2-4103-8871-38be98195181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:13.093658 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877549-8dd2-4103-8871-38be98195181 None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:13.093946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877549-8dd2-4103-8871-38be98195181 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:13.094227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877549-8dd2-4103-8871-38be98195181 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:13.094988 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c877549-8dd2-4103-8871-38be98195181 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:13.096433 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c877549-8dd2-4103-8871-38be98195181 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:13.108838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35e517-9bae-4155-a1a8-865f12e3ff89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:13.109493 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35e517-9bae-4155-a1a8-865f12e3ff89 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:13.109779 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35e517-9bae-4155-a1a8-865f12e3ff89 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:13.110055 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35e517-9bae-4155-a1a8-865f12e3ff89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:13.150365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:13.159028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 262/521] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:46:12 2022] POST /identity/v3/users => generated 247 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:46:13.159857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c877549-8dd2-4103-8871-38be98195181 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:13.183273 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35e517-9bae-4155-a1a8-865f12e3ff89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:13.185029 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35e517-9bae-4155-a1a8-865f12e3ff89 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:13.259917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:13.288513 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c877549-8dd2-4103-8871-38be98195181 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:13.303518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 260/522] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:13.305676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35e517-9bae-4155-a1a8-865f12e3ff89 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:13.335117 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ef908-862a-49a3-bab5-7243b1ed61c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:13.336168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ef908-862a-49a3-bab5-7243b1ed61c0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:13.336460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ef908-862a-49a3-bab5-7243b1ed61c0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:13.336737 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ef908-862a-49a3-bab5-7243b1ed61c0 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:13.337558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ef908-862a-49a3-bab5-7243b1ed61c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:13.337872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ef908-862a-49a3-bab5-7243b1ed61c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:13.339388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ef908-862a-49a3-bab5-7243b1ed61c0 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:13.360097 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 263/523] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:13.361035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ef908-862a-49a3-bab5-7243b1ed61c0 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:13.395152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:13.425532 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35e517-9bae-4155-a1a8-865f12e3ff89 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:13.462397 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff420cd-dfbf-4b03-94b6-89eb941a86d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:13.463101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff420cd-dfbf-4b03-94b6-89eb941a86d8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:13.463389 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff420cd-dfbf-4b03-94b6-89eb941a86d8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:13.463670 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff420cd-dfbf-4b03-94b6-89eb941a86d8 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:13.464432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff420cd-dfbf-4b03-94b6-89eb941a86d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:13.464778 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff420cd-dfbf-4b03-94b6-89eb941a86d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:13.466683 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff420cd-dfbf-4b03-94b6-89eb941a86d8 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:13.479278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 261/524] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:13.480123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff420cd-dfbf-4b03-94b6-89eb941a86d8 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:13.495368 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ef908-862a-49a3-bab5-7243b1ed61c0 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:13.538552 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcb86c-de43-4c7d-af29-310ebaa6daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:13.539374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb86c-de43-4c7d-af29-310ebaa6daaa None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:13.539789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb86c-de43-4c7d-af29-310ebaa6daaa None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:13.540071 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb86c-de43-4c7d-af29-310ebaa6daaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:13.550500 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcb86c-de43-4c7d-af29-310ebaa6daaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:13.552530 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcb86c-de43-4c7d-af29-310ebaa6daaa None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:13.555086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-aedcb86c-de43-4c7d-af29-310ebaa6daaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:13.575668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:13.576785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:13.577904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:13.577904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:13.577904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:13.577904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:13.577904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:13.577904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:13.577904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:13.577904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:13.577904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 264/525] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:13.577904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcb86c-de43-4c7d-af29-310ebaa6daaa None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:13.606834 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff420cd-dfbf-4b03-94b6-89eb941a86d8 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:13.643529 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:13.648625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e759c-6093-401a-8682-8f75ee2d3032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:13.649420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e759c-6093-401a-8682-8f75ee2d3032 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:13.649707 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e759c-6093-401a-8682-8f75ee2d3032 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:13.649992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e759c-6093-401a-8682-8f75ee2d3032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:13.660526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e759c-6093-401a-8682-8f75ee2d3032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:13.661999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e759c-6093-401a-8682-8f75ee2d3032 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-157e759c-6093-401a-8682-8f75ee2d3032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:13.680999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:13.682278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:13.683364 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:13.683364 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:13.683364 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:13.683364 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:13.683364 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 262/526] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:13.683364 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e759c-6093-401a-8682-8f75ee2d3032 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:13.699836 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcb86c-de43-4c7d-af29-310ebaa6daaa None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:13.738068 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bfb9e-122a-4aeb-8280-f3206523102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:13.738743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bfb9e-122a-4aeb-8280-f3206523102c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:13.739028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bfb9e-122a-4aeb-8280-f3206523102c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:13.739314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bfb9e-122a-4aeb-8280-f3206523102c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:13.740175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bfb9e-122a-4aeb-8280-f3206523102c None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=7a36f250f3d04faab08146d937ef840e) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:13.740492 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bfb9e-122a-4aeb-8280-f3206523102c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:13.741949 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bfb9e-122a-4aeb-8280-f3206523102c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:13.748415 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 265/527] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:13 2022] GET /identity/v3/role_assignments?user.id=7a36f250f3d04faab08146d937ef840e&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:13.755721 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bfb9e-122a-4aeb-8280-f3206523102c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:13.802063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e759c-6093-401a-8682-8f75ee2d3032 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:13.844692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc0b65-322d-4f8e-99f6-86127aa696fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:13.845521 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc0b65-322d-4f8e-99f6-86127aa696fd None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:13.845804 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc0b65-322d-4f8e-99f6-86127aa696fd None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:13.846082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc0b65-322d-4f8e-99f6-86127aa696fd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:13.850530 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:13.854594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc0b65-322d-4f8e-99f6-86127aa696fd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:13.856223 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc0b65-322d-4f8e-99f6-86127aa696fd None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-d6dc0b65-322d-4f8e-99f6-86127aa696fd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:13.875549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:13.876929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 263/528] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:13.878157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc0b65-322d-4f8e-99f6-86127aa696fd None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:13.908565 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bfb9e-122a-4aeb-8280-f3206523102c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:13.935679 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:13.952252 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110548-e0db-4dc1-9edc-baac71f42635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:13.953130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110548-e0db-4dc1-9edc-baac71f42635 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:13.953418 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110548-e0db-4dc1-9edc-baac71f42635 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:13.953695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110548-e0db-4dc1-9edc-baac71f42635 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:13.954510 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110548-e0db-4dc1-9edc-baac71f42635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:13.954858 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110548-e0db-4dc1-9edc-baac71f42635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:13.956322 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110548-e0db-4dc1-9edc-baac71f42635 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:13.975949 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 266/529] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:13.976769 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110548-e0db-4dc1-9edc-baac71f42635 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:14.014402 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc0b65-322d-4f8e-99f6-86127aa696fd None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:14.052757 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf44a-dcba-4ba3-b97b-30dec41fb4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:14.053658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf44a-dcba-4ba3-b97b-30dec41fb4f2 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:14.054117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf44a-dcba-4ba3-b97b-30dec41fb4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:14.054566 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf44a-dcba-4ba3-b97b-30dec41fb4f2 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:14.055558 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf44a-dcba-4ba3-b97b-30dec41fb4f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:14.056059 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf44a-dcba-4ba3-b97b-30dec41fb4f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:14.057727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf44a-dcba-4ba3-b97b-30dec41fb4f2 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:14.076539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 264/530] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:14.077755 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf44a-dcba-4ba3-b97b-30dec41fb4f2 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:14.107748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110548-e0db-4dc1-9edc-baac71f42635 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:14.141872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:14.159644 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669259c-c1fe-4354-9d79-24a6f2f72da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:14.164242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669259c-c1fe-4354-9d79-24a6f2f72da1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:14.164242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669259c-c1fe-4354-9d79-24a6f2f72da1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:14.164242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669259c-c1fe-4354-9d79-24a6f2f72da1 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:14.164242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669259c-c1fe-4354-9d79-24a6f2f72da1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:14.164242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669259c-c1fe-4354-9d79-24a6f2f72da1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:14.164242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669259c-c1fe-4354-9d79-24a6f2f72da1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:14.190024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 267/531] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 20:46:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:14.191247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669259c-c1fe-4354-9d79-24a6f2f72da1 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:14.195436 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf44a-dcba-4ba3-b97b-30dec41fb4f2 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:14.199844 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:14.243129 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cf8ba-f0fd-41a8-88b1-a85c4768436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:14.243874 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cf8ba-f0fd-41a8-88b1-a85c4768436b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:14.244164 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cf8ba-f0fd-41a8-88b1-a85c4768436b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:14.244443 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cf8ba-f0fd-41a8-88b1-a85c4768436b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:14.245309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cf8ba-f0fd-41a8-88b1-a85c4768436b None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=a25e781a47a44801932d5fc4384de045) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:14.245667 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cf8ba-f0fd-41a8-88b1-a85c4768436b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:14.248032 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cf8ba-f0fd-41a8-88b1-a85c4768436b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:14.256356 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 265/532] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:14 2022] GET /identity/v3/role_assignments?user.id=a25e781a47a44801932d5fc4384de045&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:14.258859 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cf8ba-f0fd-41a8-88b1-a85c4768436b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:14.403516 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669259c-c1fe-4354-9d79-24a6f2f72da1 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:14.412336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cf8ba-f0fd-41a8-88b1-a85c4768436b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:14.465578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18aa33e-7490-4316-9cee-8cde6732269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:14.466554 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa33e-7490-4316-9cee-8cde6732269d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:14.467109 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa33e-7490-4316-9cee-8cde6732269d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:14.467554 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa33e-7490-4316-9cee-8cde6732269d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:14.484571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b5245-522f-44e8-992c-0f26e9c03625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:14.486646 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b5245-522f-44e8-992c-0f26e9c03625 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:14.486646 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b5245-522f-44e8-992c-0f26e9c03625 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:14.486646 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b5245-522f-44e8-992c-0f26e9c03625 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:14.497585 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b5245-522f-44e8-992c-0f26e9c03625 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:14.499178 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b5245-522f-44e8-992c-0f26e9c03625 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-742b5245-522f-44e8-992c-0f26e9c03625 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:14.516036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:14.517096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:14.518095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:14.518095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:14.518095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:14.518095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:14.518095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:14.518095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:14.518095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:14.518095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:14.518095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 268/533] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:14.522863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b5245-522f-44e8-992c-0f26e9c03625 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:14.529741 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:14.567077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18aa33e-7490-4316-9cee-8cde6732269d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:14.568569 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18aa33e-7490-4316-9cee-8cde6732269d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:14.611049 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:14.728273 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 266/534] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:14.735695 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18aa33e-7490-4316-9cee-8cde6732269d None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:14.738725 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b5245-522f-44e8-992c-0f26e9c03625 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:14.810477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74a195-ef6c-4298-94e2-c477fa5b2479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:14.811571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a195-ef6c-4298-94e2-c477fa5b2479 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:14.812098 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a195-ef6c-4298-94e2-c477fa5b2479 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:14.812589 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a195-ef6c-4298-94e2-c477fa5b2479 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:14.813611 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74a195-ef6c-4298-94e2-c477fa5b2479 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:14.814143 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74a195-ef6c-4298-94e2-c477fa5b2479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:14.815844 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74a195-ef6c-4298-94e2-c477fa5b2479 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:14.841662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:14.842001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 269/535] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:14.847347 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74a195-ef6c-4298-94e2-c477fa5b2479 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:14.879858 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18aa33e-7490-4316-9cee-8cde6732269d None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:14.945316 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d60c5c-be44-4f6d-b5fe-ba6926fa6fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:14.946133 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d60c5c-be44-4f6d-b5fe-ba6926fa6fe3 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:14.946414 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d60c5c-be44-4f6d-b5fe-ba6926fa6fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:14.946713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d60c5c-be44-4f6d-b5fe-ba6926fa6fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:14.958176 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d60c5c-be44-4f6d-b5fe-ba6926fa6fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:14.959804 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d60c5c-be44-4f6d-b5fe-ba6926fa6fe3 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-46d60c5c-be44-4f6d-b5fe-ba6926fa6fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:14.980079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:14.981665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:14.982769 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:14.982769 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:14.982769 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:14.982769 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:14.995508 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 267/536] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:14.998223 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d60c5c-be44-4f6d-b5fe-ba6926fa6fe3 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:15.068445 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:15.073052 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74a195-ef6c-4298-94e2-c477fa5b2479 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:15.138129 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173147c1-c2cc-45eb-9ac7-aeefca027521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:15.138852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173147c1-c2cc-45eb-9ac7-aeefca027521 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:15.139140 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173147c1-c2cc-45eb-9ac7-aeefca027521 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:15.139417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173147c1-c2cc-45eb-9ac7-aeefca027521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:15.140273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173147c1-c2cc-45eb-9ac7-aeefca027521 None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=359041f2d03f4e499f3964ac1ddce468) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:15.140588 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173147c1-c2cc-45eb-9ac7-aeefca027521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:15.142037 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173147c1-c2cc-45eb-9ac7-aeefca027521 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:15.157009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 270/537] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:14 2022] GET /identity/v3/role_assignments?user.id=359041f2d03f4e499f3964ac1ddce468&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:15.187732 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d60c5c-be44-4f6d-b5fe-ba6926fa6fe3 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:15.210287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:15.231015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee17182-6d68-47f4-aa6d-c9d5ed80a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:15.231623 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee17182-6d68-47f4-aa6d-c9d5ed80a747 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:15.231907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee17182-6d68-47f4-aa6d-c9d5ed80a747 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:15.232184 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee17182-6d68-47f4-aa6d-c9d5ed80a747 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:15.232923 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee17182-6d68-47f4-aa6d-c9d5ed80a747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:15.233235 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee17182-6d68-47f4-aa6d-c9d5ed80a747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:15.234695 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee17182-6d68-47f4-aa6d-c9d5ed80a747 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:15.253375 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 268/538] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:15.259876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173147c1-c2cc-45eb-9ac7-aeefca027521 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:15.401879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173147c1-c2cc-45eb-9ac7-aeefca027521 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:15.455292 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1715d7b-38ac-44e0-8aa0-766aa08f277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:15.456103 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715d7b-38ac-44e0-8aa0-766aa08f277e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:15.456388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715d7b-38ac-44e0-8aa0-766aa08f277e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:15.456663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715d7b-38ac-44e0-8aa0-766aa08f277e None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:15.464510 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1715d7b-38ac-44e0-8aa0-766aa08f277e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:15.466575 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1715d7b-38ac-44e0-8aa0-766aa08f277e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-b1715d7b-38ac-44e0-8aa0-766aa08f277e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:15.485897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:15.487007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:15.488033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:15.488033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:15.488033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:15.488033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:15.488033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:15.488033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:15.488033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:15.488033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:15.489512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 271/539] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:15.495914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee17182-6d68-47f4-aa6d-c9d5ed80a747 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:15.643303 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee17182-6d68-47f4-aa6d-c9d5ed80a747 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:15.678094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7442b-6b49-484f-a8f0-40d3bc456085 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:15.678842 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7442b-6b49-484f-a8f0-40d3bc456085 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:15.678842 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7442b-6b49-484f-a8f0-40d3bc456085 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:15.680188 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 272/540] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:15.693888 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d119-e8a4-4531-9b90-4260c522b00d None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:15.694289 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d119-e8a4-4531-9b90-4260c522b00d None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:15.694578 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d119-e8a4-4531-9b90-4260c522b00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:15.695381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eedee3-0578-46d7-87a5-762a091e1f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:15.696101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eedee3-0578-46d7-87a5-762a091e1f51 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:15.696387 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eedee3-0578-46d7-87a5-762a091e1f51 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:15.696664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eedee3-0578-46d7-87a5-762a091e1f51 None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:15.697458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eedee3-0578-46d7-87a5-762a091e1f51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:15.697768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eedee3-0578-46d7-87a5-762a091e1f51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:15.699317 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eedee3-0578-46d7-87a5-762a091e1f51 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:15.728897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-0c38d119-e8a4-4531-9b90-4260c522b00d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:15.730146 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-0c38d119-e8a4-4531-9b90-4260c522b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:15.735079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 269/541] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:15.741287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eedee3-0578-46d7-87a5-762a091e1f51 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:15.770528 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:15.839229 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:15.848429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 273/542] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:15.896912 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38d119-e8a4-4531-9b90-4260c522b00d None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:15.905706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eedee3-0578-46d7-87a5-762a091e1f51 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:15.956191 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fe2c6-60d4-47cb-85c7-f5fc2f54d86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:15.956989 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fe2c6-60d4-47cb-85c7-f5fc2f54d86b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:15.957280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fe2c6-60d4-47cb-85c7-f5fc2f54d86b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:15.957560 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fe2c6-60d4-47cb-85c7-f5fc2f54d86b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:15.958518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fe2c6-60d4-47cb-85c7-f5fc2f54d86b None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=68547d17dd4546469230112f91a48764) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:15.958859 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fe2c6-60d4-47cb-85c7-f5fc2f54d86b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:15.960537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fe2c6-60d4-47cb-85c7-f5fc2f54d86b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:15.973061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 270/543] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:15 2022] GET /identity/v3/role_assignments?user.id=68547d17dd4546469230112f91a48764&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:16.023017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38d119-e8a4-4531-9b90-4260c522b00d None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:16.067551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3239e4f-5ef9-42a6-98a1-17a44f6ac594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:16.068392 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3239e4f-5ef9-42a6-98a1-17a44f6ac594 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:16.068679 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3239e4f-5ef9-42a6-98a1-17a44f6ac594 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:16.068959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3239e4f-5ef9-42a6-98a1-17a44f6ac594 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:16.091875 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3239e4f-5ef9-42a6-98a1-17a44f6ac594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-f3239e4f-5ef9-42a6-98a1-17a44f6ac594 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:16.104425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:16.106213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:16.107222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 274/544] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:16.112503 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fe2c6-60d4-47cb-85c7-f5fc2f54d86b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:16.274495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fe2c6-60d4-47cb-85c7-f5fc2f54d86b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:16.276925 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:16.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebe1ec-75e1-49ee-a41b-c9c15a6e8654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:16.366308 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebe1ec-75e1-49ee-a41b-c9c15a6e8654 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:16.366591 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebe1ec-75e1-49ee-a41b-c9c15a6e8654 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:16.366897 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebe1ec-75e1-49ee-a41b-c9c15a6e8654 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:16.367734 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebe1ec-75e1-49ee-a41b-c9c15a6e8654 None admin] RBAC: Adding query filter params (name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:16.368047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebe1ec-75e1-49ee-a41b-c9c15a6e8654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:16.369446 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebe1ec-75e1-49ee-a41b-c9c15a6e8654 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:16.373821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1cf1b-dca7-447e-8024-6040855e87ea None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:16.374118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1cf1b-dca7-447e-8024-6040855e87ea None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:16.374404 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1cf1b-dca7-447e-8024-6040855e87ea None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:16.375973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 275/545] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:46:16.381623 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737124-aadf-4e9a-982e-969eb28e1792 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:16.382207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737124-aadf-4e9a-982e-969eb28e1792 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:16.382743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737124-aadf-4e9a-982e-969eb28e1792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:16.383218 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 271/546] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:16.388391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebe1ec-75e1-49ee-a41b-c9c15a6e8654 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:16.410088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-2b737124-aadf-4e9a-982e-969eb28e1792 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:16.411339 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-2b737124-aadf-4e9a-982e-969eb28e1792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:16.435088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:16.544640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 276/547] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:46:16.554702 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebe1ec-75e1-49ee-a41b-c9c15a6e8654 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:16.579681 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b737124-aadf-4e9a-982e-969eb28e1792 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:16.611559 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce64ac-a646-4e08-8dde-840c7d145e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:16.612771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce64ac-a646-4e08-8dde-840c7d145e91 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:16.613274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce64ac-a646-4e08-8dde-840c7d145e91 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:16.613775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce64ac-a646-4e08-8dde-840c7d145e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:16.629989 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce64ac-a646-4e08-8dde-840c7d145e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:16.632948 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce64ac-a646-4e08-8dde-840c7d145e91 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-86ce64ac-a646-4e08-8dde-840c7d145e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:16.666715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:16.668372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:16.669401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:16.669401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:16.669401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:16.669401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:16.679091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 272/548] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:16.684604 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce64ac-a646-4e08-8dde-840c7d145e91 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:16.727036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:16.784250 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b737124-aadf-4e9a-982e-969eb28e1792 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:16.872444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf2aab-8160-4ee3-b16f-ad780be053a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:16.873276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf2aab-8160-4ee3-b16f-ad780be053a8 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:16.873658 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf2aab-8160-4ee3-b16f-ad780be053a8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:16.873946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf2aab-8160-4ee3-b16f-ad780be053a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:16.875880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce64ac-a646-4e08-8dde-840c7d145e91 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:16.905833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf2aab-8160-4ee3-b16f-ad780be053a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-15bf2aab-8160-4ee3-b16f-ad780be053a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:16.914434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:16.916009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:16.917518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 277/549] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:16.922426 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf2aab-8160-4ee3-b16f-ad780be053a8 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:16.928307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1adbd-ff2b-4601-aa5c-aab425c7dbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:16.929000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1adbd-ff2b-4601-aa5c-aab425c7dbf3 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:16.929280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1adbd-ff2b-4601-aa5c-aab425c7dbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:16.929561 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1adbd-ff2b-4601-aa5c-aab425c7dbf3 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:16.930304 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1adbd-ff2b-4601-aa5c-aab425c7dbf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:16.930593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1adbd-ff2b-4601-aa5c-aab425c7dbf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:16.932180 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1adbd-ff2b-4601-aa5c-aab425c7dbf3 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:16.936980 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:16.946512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 273/550] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:16.956296 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1adbd-ff2b-4601-aa5c-aab425c7dbf3 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:17.080512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf2aab-8160-4ee3-b16f-ad780be053a8 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:17.103535 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:17.119625 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daf10a-0c9b-434d-849f-beac77be276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:17.120927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daf10a-0c9b-434d-849f-beac77be276c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:17.120927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daf10a-0c9b-434d-849f-beac77be276c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:17.121225 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daf10a-0c9b-434d-849f-beac77be276c None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:17.121953 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daf10a-0c9b-434d-849f-beac77be276c None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:17.122339 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daf10a-0c9b-434d-849f-beac77be276c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:17.123907 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daf10a-0c9b-434d-849f-beac77be276c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:17.126950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1adbd-ff2b-4601-aa5c-aab425c7dbf3 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:17.133185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 278/551] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:17.134694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591e70a-09b2-449a-9919-659d6cf95a2b None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:17.135076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591e70a-09b2-449a-9919-659d6cf95a2b None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:17.135434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591e70a-09b2-449a-9919-659d6cf95a2b None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:17.137562 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 279/552] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:17.143652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591e70a-09b2-449a-9919-659d6cf95a2b None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:17.174527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9e2f7-966b-4016-b4dc-c875516c7450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:17.175360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9e2f7-966b-4016-b4dc-c875516c7450 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:17.175653 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9e2f7-966b-4016-b4dc-c875516c7450 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:17.175929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9e2f7-966b-4016-b4dc-c875516c7450 None admin] PATH_INFO: `/v3/users/swift` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:17.186323 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9e2f7-966b-4016-b4dc-c875516c7450 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:17.187817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9e2f7-966b-4016-b4dc-c875516c7450 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-c1b9e2f7-966b-4016-b4dc-c875516c7450 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:17.204058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:17.205186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:17.206267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:17.206267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:17.206267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:17.206267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:17.206267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:17.206267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:17.206267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:17.206267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:17.206267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:17.206267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:17.206267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 274/553] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:17.207927 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b03dc-3ce3-4615-a3b9-234205a8b366 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:17.207927 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b03dc-3ce3-4615-a3b9-234205a8b366 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:17.207927 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b03dc-3ce3-4615-a3b9-234205a8b366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:17.225015 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:17.226739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-a33b03dc-3ce3-4615-a3b9-234205a8b366 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:17.227967 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-a33b03dc-3ce3-4615-a3b9-234205a8b366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:17.266087 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591e70a-09b2-449a-9919-659d6cf95a2b None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:17.306778 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 275/554] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:17.307761 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b03dc-3ce3-4615-a3b9-234205a8b366 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:17.312783 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc598c1-3a63-4b2f-8992-538606bebaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:17.313700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc598c1-3a63-4b2f-8992-538606bebaa3 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:17.313991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc598c1-3a63-4b2f-8992-538606bebaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:17.314267 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc598c1-3a63-4b2f-8992-538606bebaa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:17.337789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc598c1-3a63-4b2f-8992-538606bebaa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:17.340353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc598c1-3a63-4b2f-8992-538606bebaa3 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-bbc598c1-3a63-4b2f-8992-538606bebaa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:17.366934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:17.369497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:17.372272 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:17.372272 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:17.372272 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:17.372272 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:17.376679 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 280/555] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:17.376679 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc598c1-3a63-4b2f-8992-538606bebaa3 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:17.408681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:17.453872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b03dc-3ce3-4615-a3b9-234205a8b366 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:17.500130 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2fbd0-1d9d-4049-b7e6-20bd65cc1484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:17.500847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2fbd0-1d9d-4049-b7e6-20bd65cc1484 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:17.501131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2fbd0-1d9d-4049-b7e6-20bd65cc1484 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:17.501410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2fbd0-1d9d-4049-b7e6-20bd65cc1484 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:17.502937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2fbd0-1d9d-4049-b7e6-20bd65cc1484 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:17.503414 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2fbd0-1d9d-4049-b7e6-20bd65cc1484 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:17.505285 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2fbd0-1d9d-4049-b7e6-20bd65cc1484 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:17.516503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc598c1-3a63-4b2f-8992-538606bebaa3 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:17.530704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 276/556] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:46:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:17.531598 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2fbd0-1d9d-4049-b7e6-20bd65cc1484 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:17.547889 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:17.569264 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84f15-cc6c-458c-8344-87d69a4cc856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:17.570147 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84f15-cc6c-458c-8344-87d69a4cc856 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:17.570440 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84f15-cc6c-458c-8344-87d69a4cc856 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:17.570751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84f15-cc6c-458c-8344-87d69a4cc856 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:17.585304 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e84f15-cc6c-458c-8344-87d69a4cc856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-33e84f15-cc6c-458c-8344-87d69a4cc856 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:17.596088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:17.597444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 281/557] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:17.598792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84f15-cc6c-458c-8344-87d69a4cc856 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:17.673802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2fbd0-1d9d-4049-b7e6-20bd65cc1484 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:17.713064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:17.726232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118470-eb83-474e-bcc9-f844a5e1abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:17.727011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118470-eb83-474e-bcc9-f844a5e1abbc None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:17.727303 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118470-eb83-474e-bcc9-f844a5e1abbc None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:17.727586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118470-eb83-474e-bcc9-f844a5e1abbc None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:17.728656 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118470-eb83-474e-bcc9-f844a5e1abbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:17.729443 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118470-eb83-474e-bcc9-f844a5e1abbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:17.731299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118470-eb83-474e-bcc9-f844a5e1abbc None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:17.732566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84f15-cc6c-458c-8344-87d69a4cc856 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:17.746587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 277/558] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:17.747903 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118470-eb83-474e-bcc9-f844a5e1abbc None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:17.787010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786d503-e547-4229-9ed8-cb471cbd7e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:17.788718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786d503-e547-4229-9ed8-cb471cbd7e1a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:17.789760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786d503-e547-4229-9ed8-cb471cbd7e1a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:17.790243 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786d503-e547-4229-9ed8-cb471cbd7e1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:17.864856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:17.893734 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786d503-e547-4229-9ed8-cb471cbd7e1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:17.896093 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786d503-e547-4229-9ed8-cb471cbd7e1a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:17.910622 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118470-eb83-474e-bcc9-f844a5e1abbc None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:17.960878 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3084cb-1166-4860-b9ab-1d97e5d78a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:17.961626 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3084cb-1166-4860-b9ab-1d97e5d78a01 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:17.962280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3084cb-1166-4860-b9ab-1d97e5d78a01 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:17.962697 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3084cb-1166-4860-b9ab-1d97e5d78a01 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:17.964039 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3084cb-1166-4860-b9ab-1d97e5d78a01 None admin] RBAC: Adding query filter params (name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:17.965198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3084cb-1166-4860-b9ab-1d97e5d78a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:17.967201 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3084cb-1166-4860-b9ab-1d97e5d78a01 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:17.980817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 278/559] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:17.982001 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3084cb-1166-4860-b9ab-1d97e5d78a01 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:18.014998 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 282/560] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:18.016699 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da10b0-8f4f-4fbf-a22e-e1c52e24f792 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.017054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da10b0-8f4f-4fbf-a22e-e1c52e24f792 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.017340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da10b0-8f4f-4fbf-a22e-e1c52e24f792 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.018808 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 283/561] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:18.019422 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da10b0-8f4f-4fbf-a22e-e1c52e24f792 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:18.039050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:18.104270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3084cb-1166-4860-b9ab-1d97e5d78a01 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:18.113131 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:18.136166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da10b0-8f4f-4fbf-a22e-e1c52e24f792 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:18.142237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e409ccc-45ad-4d56-a52b-7318ed2d37eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:18.143074 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e409ccc-45ad-4d56-a52b-7318ed2d37eb None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.143361 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e409ccc-45ad-4d56-a52b-7318ed2d37eb None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.143638 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e409ccc-45ad-4d56-a52b-7318ed2d37eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.152305 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e409ccc-45ad-4d56-a52b-7318ed2d37eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:18.153733 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e409ccc-45ad-4d56-a52b-7318ed2d37eb None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-7e409ccc-45ad-4d56-a52b-7318ed2d37eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:18.168081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:18.169186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 279/562] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:46:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:18.170280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e409ccc-45ad-4d56-a52b-7318ed2d37eb None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:18.177933 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56907d4-ac93-43ff-bb2a-3ba2a5972906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:18.178755 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56907d4-ac93-43ff-bb2a-3ba2a5972906 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.179045 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56907d4-ac93-43ff-bb2a-3ba2a5972906 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.179323 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56907d4-ac93-43ff-bb2a-3ba2a5972906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.191606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56907d4-ac93-43ff-bb2a-3ba2a5972906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:18.193156 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56907d4-ac93-43ff-bb2a-3ba2a5972906 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-c56907d4-ac93-43ff-bb2a-3ba2a5972906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:18.213616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:18.214744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:18.215793 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:18.215793 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:18.215793 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:18.215793 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:18.215793 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 284/563] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:18.216114 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d04ae-608b-4240-a97e-e1ee4f4a9edc None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.217052 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d04ae-608b-4240-a97e-e1ee4f4a9edc None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.217052 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d04ae-608b-4240-a97e-e1ee4f4a9edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.233935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-8c4d04ae-608b-4240-a97e-e1ee4f4a9edc None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:18.235233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-8c4d04ae-608b-4240-a97e-e1ee4f4a9edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:18.283461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e409ccc-45ad-4d56-a52b-7318ed2d37eb None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:18.293002 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:18.317863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 285/564] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:18.319296 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d04ae-608b-4240-a97e-e1ee4f4a9edc None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:18.332360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f195a3-47d0-4e49-a744-86f9e84e98ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:18.333182 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f195a3-47d0-4e49-a744-86f9e84e98ec None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.333475 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f195a3-47d0-4e49-a744-86f9e84e98ec None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.333762 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f195a3-47d0-4e49-a744-86f9e84e98ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.345833 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f195a3-47d0-4e49-a744-86f9e84e98ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:18.347347 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f195a3-47d0-4e49-a744-86f9e84e98ec None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-54f195a3-47d0-4e49-a744-86f9e84e98ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:18.365883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:18.367038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:18.368665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:18.368665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:18.368665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:18.368665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:18.368665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 280/565] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:18.368665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f195a3-47d0-4e49-a744-86f9e84e98ec None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:18.396762 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:18.445368 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d04ae-608b-4240-a97e-e1ee4f4a9edc None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:18.483693 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f195a3-47d0-4e49-a744-86f9e84e98ec None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:18.484873 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb55a-3f04-4ef0-a9a8-2c6eec880070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:18.485563 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb55a-3f04-4ef0-a9a8-2c6eec880070 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.485856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb55a-3f04-4ef0-a9a8-2c6eec880070 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.486132 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb55a-3f04-4ef0-a9a8-2c6eec880070 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.487029 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbb55a-3f04-4ef0-a9a8-2c6eec880070 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:18.487349 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbb55a-3f04-4ef0-a9a8-2c6eec880070 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:18.488828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbb55a-3f04-4ef0-a9a8-2c6eec880070 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:18.507691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 286/566] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:46:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:18.508541 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb55a-3f04-4ef0-a9a8-2c6eec880070 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:18.525780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045db61b-a88f-4f8d-9d41-837358117b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:18.526568 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db61b-a88f-4f8d-9d41-837358117b30 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.526784 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db61b-a88f-4f8d-9d41-837358117b30 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.527089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db61b-a88f-4f8d-9d41-837358117b30 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.527824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045db61b-a88f-4f8d-9d41-837358117b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:18.528136 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045db61b-a88f-4f8d-9d41-837358117b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:18.529513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045db61b-a88f-4f8d-9d41-837358117b30 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:18.541817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 281/567] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:18.543312 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045db61b-a88f-4f8d-9d41-837358117b30 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:18.566163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:18.614171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb55a-3f04-4ef0-a9a8-2c6eec880070 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:18.633931 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:18.645607 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045db61b-a88f-4f8d-9d41-837358117b30 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:18.650730 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb85f4-d609-43d1-ba29-d5f926220740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:18.651544 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb85f4-d609-43d1-ba29-d5f926220740 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.651829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb85f4-d609-43d1-ba29-d5f926220740 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.652107 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb85f4-d609-43d1-ba29-d5f926220740 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.662578 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb85f4-d609-43d1-ba29-d5f926220740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-30bb85f4-d609-43d1-ba29-d5f926220740 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:18.671001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:18.672118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:18.673076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 287/568] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:18.673959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9c67-0939-47b0-bc62-876eb9f5f287 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.673959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9c67-0939-47b0-bc62-876eb9f5f287 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.674156 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9c67-0939-47b0-bc62-876eb9f5f287 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.675849 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 288/569] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:18.677017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d9c67-0939-47b0-bc62-876eb9f5f287 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:18.689662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6691bd4-fb95-4cb9-a77a-065dad1da6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:18.690429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6691bd4-fb95-4cb9-a77a-065dad1da6f1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.690816 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6691bd4-fb95-4cb9-a77a-065dad1da6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.691100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6691bd4-fb95-4cb9-a77a-065dad1da6f1 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.691836 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6691bd4-fb95-4cb9-a77a-065dad1da6f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:18.692140 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6691bd4-fb95-4cb9-a77a-065dad1da6f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:18.693534 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6691bd4-fb95-4cb9-a77a-065dad1da6f1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:18.705735 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 282/570] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:18.706702 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6691bd4-fb95-4cb9-a77a-065dad1da6f1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:18.786121 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d9c67-0939-47b0-bc62-876eb9f5f287 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:18.787715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:18.807785 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6691bd4-fb95-4cb9-a77a-065dad1da6f1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:18.823329 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584adc6-41bc-47c9-9c5a-bb1e52ab6d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:18.824136 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584adc6-41bc-47c9-9c5a-bb1e52ab6d4f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.824420 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584adc6-41bc-47c9-9c5a-bb1e52ab6d4f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.824697 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584adc6-41bc-47c9-9c5a-bb1e52ab6d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.835836 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584adc6-41bc-47c9-9c5a-bb1e52ab6d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:18.837330 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584adc6-41bc-47c9-9c5a-bb1e52ab6d4f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:18.845173 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e712798-e05b-4471-be8d-22225df14899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:18.846027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712798-e05b-4471-be8d-22225df14899 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.846301 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712798-e05b-4471-be8d-22225df14899 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.846574 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712798-e05b-4471-be8d-22225df14899 None admin] PATH_INFO: `/v3/users/glance` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.854699 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e712798-e05b-4471-be8d-22225df14899 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:18.856721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e712798-e05b-4471-be8d-22225df14899 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-f584adc6-41bc-47c9-9c5a-bb1e52ab6d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:18.858704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:18.859743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:18.860761 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:18.860761 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:18.860761 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:18.860761 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:18.860761 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 289/571] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:18.860761 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584adc6-41bc-47c9-9c5a-bb1e52ab6d4f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-5e712798-e05b-4471-be8d-22225df14899 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:18.875192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:18.881637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 283/572] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7e07e-7e92-4f78-b7a3-57b884a59ab2 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:18.883086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7e07e-7e92-4f78-b7a3-57b884a59ab2 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:18.884010 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7e07e-7e92-4f78-b7a3-57b884a59ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:18.897427 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-fbd7e07e-7e92-4f78-b7a3-57b884a59ab2 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:18.898713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-fbd7e07e-7e92-4f78-b7a3-57b884a59ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:18.899968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:18.969621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 284/573] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:18.970480 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7e07e-7e92-4f78-b7a3-57b884a59ab2 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:18.981535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584adc6-41bc-47c9-9c5a-bb1e52ab6d4f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.016991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877881-82b2-4ead-8925-477d190d8172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.017668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877881-82b2-4ead-8925-477d190d8172 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.017949 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877881-82b2-4ead-8925-477d190d8172 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.018230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877881-82b2-4ead-8925-477d190d8172 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.019019 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40877881-82b2-4ead-8925-477d190d8172 None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:19.019332 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40877881-82b2-4ead-8925-477d190d8172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.020704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40877881-82b2-4ead-8925-477d190d8172 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.028827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 290/574] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:19.029628 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877881-82b2-4ead-8925-477d190d8172 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.051879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:19.077731 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7e07e-7e92-4f78-b7a3-57b884a59ab2 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.112694 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d32685-4826-47ed-8c4a-869e309867aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.113488 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d32685-4826-47ed-8c4a-869e309867aa None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.113783 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d32685-4826-47ed-8c4a-869e309867aa None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.114064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d32685-4826-47ed-8c4a-869e309867aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.121013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d32685-4826-47ed-8c4a-869e309867aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.122487 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d32685-4826-47ed-8c4a-869e309867aa None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.126834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:19.135436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877881-82b2-4ead-8925-477d190d8172 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-16d32685-4826-47ed-8c4a-869e309867aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:19.136540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:19.142093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:19.143154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:19.143154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:19.143154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:19.143154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:19.143154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:19.143154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:19.143154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:19.143154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:19.143154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 285/575] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:19.143154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d32685-4826-47ed-8c4a-869e309867aa None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.171877 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11df74-46d8-4b94-bb08-13b4f2f136dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.172551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11df74-46d8-4b94-bb08-13b4f2f136dd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.172840 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11df74-46d8-4b94-bb08-13b4f2f136dd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.173118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11df74-46d8-4b94-bb08-13b4f2f136dd None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.173905 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11df74-46d8-4b94-bb08-13b4f2f136dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:19.174220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11df74-46d8-4b94-bb08-13b4f2f136dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.175628 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11df74-46d8-4b94-bb08-13b4f2f136dd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.188008 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 291/576] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:19.188732 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11df74-46d8-4b94-bb08-13b4f2f136dd None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.245827 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d32685-4826-47ed-8c4a-869e309867aa None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.274995 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:19.281055 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dae72-5533-4146-8f77-9edc1e2a3503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.281727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dae72-5533-4146-8f77-9edc1e2a3503 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.282007 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dae72-5533-4146-8f77-9edc1e2a3503 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.282287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dae72-5533-4146-8f77-9edc1e2a3503 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.283389 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dae72-5533-4146-8f77-9edc1e2a3503 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:19.283704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dae72-5533-4146-8f77-9edc1e2a3503 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.285212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dae72-5533-4146-8f77-9edc1e2a3503 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.290285 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11df74-46d8-4b94-bb08-13b4f2f136dd None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.305209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 286/577] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:19.306092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dae72-5533-4146-8f77-9edc1e2a3503 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.325294 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78421b8-64ff-4fa6-8530-3844d16459b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.326098 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78421b8-64ff-4fa6-8530-3844d16459b2 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.326382 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78421b8-64ff-4fa6-8530-3844d16459b2 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.326687 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78421b8-64ff-4fa6-8530-3844d16459b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.336866 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78421b8-64ff-4fa6-8530-3844d16459b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-d78421b8-64ff-4fa6-8530-3844d16459b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:19.345213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:19.346483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 292/578] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:19.347917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78421b8-64ff-4fa6-8530-3844d16459b2 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.363749 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:19.411435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dae72-5533-4146-8f77-9edc1e2a3503 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.446531 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da32a5a-5588-4fed-89b5-f9c6ed691d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.447359 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da32a5a-5588-4fed-89b5-f9c6ed691d66 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.447645 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da32a5a-5588-4fed-89b5-f9c6ed691d66 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.447950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da32a5a-5588-4fed-89b5-f9c6ed691d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.452350 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78421b8-64ff-4fa6-8530-3844d16459b2 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.458757 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da32a5a-5588-4fed-89b5-f9c6ed691d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.460210 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da32a5a-5588-4fed-89b5-f9c6ed691d66 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-6da32a5a-5588-4fed-89b5-f9c6ed691d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:19.478484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:19.479585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:19.480665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:19.480665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:19.480665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:19.480665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:19.480665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 287/579] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:19.480665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da32a5a-5588-4fed-89b5-f9c6ed691d66 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.489036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391702a3-dfd8-49ce-920c-0ec5aa333f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.489704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391702a3-dfd8-49ce-920c-0ec5aa333f50 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.489987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391702a3-dfd8-49ce-920c-0ec5aa333f50 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.490263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391702a3-dfd8-49ce-920c-0ec5aa333f50 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.491150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391702a3-dfd8-49ce-920c-0ec5aa333f50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:19.491460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391702a3-dfd8-49ce-920c-0ec5aa333f50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.492907 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391702a3-dfd8-49ce-920c-0ec5aa333f50 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.505153 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 293/580] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:19.505966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391702a3-dfd8-49ce-920c-0ec5aa333f50 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.525178 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:19.578487 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:19.585074 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da32a5a-5588-4fed-89b5-f9c6ed691d66 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.608212 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391702a3-dfd8-49ce-920c-0ec5aa333f50 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.618234 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f565e-d834-434e-b87e-102ba168167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.619059 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f565e-d834-434e-b87e-102ba168167c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.619343 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f565e-d834-434e-b87e-102ba168167c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.619615 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f565e-d834-434e-b87e-102ba168167c None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.626872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f565e-d834-434e-b87e-102ba168167c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.628319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f565e-d834-434e-b87e-102ba168167c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-d32f565e-d834-434e-b87e-102ba168167c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:19.643102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:19.644251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:19.645304 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:19.645304 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:19.645304 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:19.645304 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:19.645304 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:19.645304 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:19.645304 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:19.645304 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:19.645786 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffb2f6-0233-4202-be81-2aa005e41846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.645786 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffb2f6-0233-4202-be81-2aa005e41846 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.645786 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffb2f6-0233-4202-be81-2aa005e41846 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.646042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 288/581] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:19.646126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffb2f6-0233-4202-be81-2aa005e41846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.646201 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f565e-d834-434e-b87e-102ba168167c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.656921 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffb2f6-0233-4202-be81-2aa005e41846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.658376 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffb2f6-0233-4202-be81-2aa005e41846 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-c6ffb2f6-0233-4202-be81-2aa005e41846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:19.676127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:19.677335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:19.678587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:19.678587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:19.678587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:19.678587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:19.678587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 294/582] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:19.678587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffb2f6-0233-4202-be81-2aa005e41846 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.748114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:19.751045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f565e-d834-434e-b87e-102ba168167c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.785174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffb2f6-0233-4202-be81-2aa005e41846 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.786421 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4df8b4-8285-4853-8b9f-5c76cbd02230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.787128 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df8b4-8285-4853-8b9f-5c76cbd02230 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.787411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df8b4-8285-4853-8b9f-5c76cbd02230 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.787691 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df8b4-8285-4853-8b9f-5c76cbd02230 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.788449 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4df8b4-8285-4853-8b9f-5c76cbd02230 None admin] RBAC: Adding query filter params (name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:19.788810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4df8b4-8285-4853-8b9f-5c76cbd02230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.790217 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4df8b4-8285-4853-8b9f-5c76cbd02230 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.798882 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 289/583] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:19.799466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4df8b4-8285-4853-8b9f-5c76cbd02230 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.814914 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:19.826482 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c986f96-ad7c-4dff-bc7c-69384b2c1a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.827198 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986f96-ad7c-4dff-bc7c-69384b2c1a80 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.827485 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986f96-ad7c-4dff-bc7c-69384b2c1a80 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.827766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986f96-ad7c-4dff-bc7c-69384b2c1a80 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.828562 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c986f96-ad7c-4dff-bc7c-69384b2c1a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:19.828819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c986f96-ad7c-4dff-bc7c-69384b2c1a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.830199 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c986f96-ad7c-4dff-bc7c-69384b2c1a80 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.842680 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 295/584] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:19.843513 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c986f96-ad7c-4dff-bc7c-69384b2c1a80 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.902922 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4df8b4-8285-4853-8b9f-5c76cbd02230 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.938067 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0f9af-2b7c-4181-8a75-8af9dc7cddb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.938758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0f9af-2b7c-4181-8a75-8af9dc7cddb5 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.939048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0f9af-2b7c-4181-8a75-8af9dc7cddb5 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.939329 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0f9af-2b7c-4181-8a75-8af9dc7cddb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.940171 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0f9af-2b7c-4181-8a75-8af9dc7cddb5 None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=aab1ecd7a8074c288ac9b70065e6efa2) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:19.940485 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0f9af-2b7c-4181-8a75-8af9dc7cddb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.941925 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0f9af-2b7c-4181-8a75-8af9dc7cddb5 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.946411 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c986f96-ad7c-4dff-bc7c-69384b2c1a80 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:19.947694 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 290/585] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/role_assignments?user.id=aab1ecd7a8074c288ac9b70065e6efa2&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:19.948632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0f9af-2b7c-4181-8a75-8af9dc7cddb5 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:19.986240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be589d-a08a-4a61-b9b6-647ed856f654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:19.986967 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be589d-a08a-4a61-b9b6-647ed856f654 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:19.987262 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be589d-a08a-4a61-b9b6-647ed856f654 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:19.987540 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be589d-a08a-4a61-b9b6-647ed856f654 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:19.988366 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be589d-a08a-4a61-b9b6-647ed856f654 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:19.988699 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be589d-a08a-4a61-b9b6-647ed856f654 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:19.990196 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be589d-a08a-4a61-b9b6-647ed856f654 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:19.994987 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:20.004304 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 296/586] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:20.005484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be589d-a08a-4a61-b9b6-647ed856f654 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:20.074300 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:20.092713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0f9af-2b7c-4181-8a75-8af9dc7cddb5 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:20.132844 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2de58-20fc-4981-ada4-dd56e27aca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:20.133524 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2de58-20fc-4981-ada4-dd56e27aca6a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:20.133804 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2de58-20fc-4981-ada4-dd56e27aca6a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:20.134077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2de58-20fc-4981-ada4-dd56e27aca6a None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:20.134845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2de58-20fc-4981-ada4-dd56e27aca6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:20.135163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2de58-20fc-4981-ada4-dd56e27aca6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:20.136569 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2de58-20fc-4981-ada4-dd56e27aca6a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:20.139031 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be589d-a08a-4a61-b9b6-647ed856f654 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:20.150671 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 291/587] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:20.152281 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2de58-20fc-4981-ada4-dd56e27aca6a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:20.182805 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de8e02-f403-4f89-9c4b-745993c2fd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:20.185270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de8e02-f403-4f89-9c4b-745993c2fd7a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:20.185270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de8e02-f403-4f89-9c4b-745993c2fd7a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:20.185270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de8e02-f403-4f89-9c4b-745993c2fd7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:20.200769 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de8e02-f403-4f89-9c4b-745993c2fd7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:20.202252 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de8e02-f403-4f89-9c4b-745993c2fd7a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-05de8e02-f403-4f89-9c4b-745993c2fd7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:20.221488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:20.222772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:20.224040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:20.224040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:20.224040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:20.224040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:20.227408 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 297/588] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:20.228241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de8e02-f403-4f89-9c4b-745993c2fd7a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:20.250523 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:20.267544 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2de58-20fc-4981-ada4-dd56e27aca6a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:20.304356 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ca200-0ccc-4ca6-9481-ddf55c717afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:20.305180 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ca200-0ccc-4ca6-9481-ddf55c717afe None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:20.305458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ca200-0ccc-4ca6-9481-ddf55c717afe None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:20.305729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ca200-0ccc-4ca6-9481-ddf55c717afe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:20.315402 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ca200-0ccc-4ca6-9481-ddf55c717afe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:20.316842 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ca200-0ccc-4ca6-9481-ddf55c717afe None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-815ca200-0ccc-4ca6-9481-ddf55c717afe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:20.331152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:20.332453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:20.333846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:20.333846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:20.333846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:20.333846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:20.333846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:20.333846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:20.333846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:20.333846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:20.333846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:46:20.333846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:20.335896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:20.337067 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 292/589] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:20.337920 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ca200-0ccc-4ca6-9481-ddf55c717afe None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:20.348624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de8e02-f403-4f89-9c4b-745993c2fd7a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:20.381768 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577f088-92cc-4f13-9bfd-f1f17560b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:20.382708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577f088-92cc-4f13-9bfd-f1f17560b39a None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:20.382996 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577f088-92cc-4f13-9bfd-f1f17560b39a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:20.383271 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577f088-92cc-4f13-9bfd-f1f17560b39a None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/7a36f250f3d04faab08146d937ef840e/roles/df1609ea031d4414971c13ff878a13e2` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:20.398906 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577f088-92cc-4f13-9bfd-f1f17560b39a None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=7a36f250f3d04faab08146d937ef840e, role_id=df1609ea031d4414971c13ff878a13e2)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:20.400356 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577f088-92cc-4f13-9bfd-f1f17560b39a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:20.446781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ca200-0ccc-4ca6-9481-ddf55c717afe None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:20.484131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282f4bb-9b6c-43b7-b773-fe69a11f698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:20.484928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f4bb-9b6c-43b7-b773-fe69a11f698a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:20.485216 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f4bb-9b6c-43b7-b773-fe69a11f698a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:20.485495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f4bb-9b6c-43b7-b773-fe69a11f698a None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:20.492465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282f4bb-9b6c-43b7-b773-fe69a11f698a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:20.493924 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282f4bb-9b6c-43b7-b773-fe69a11f698a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:20.501962 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 298/590] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:46:20 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/7a36f250f3d04faab08146d937ef840e/roles/df1609ea031d4414971c13ff878a13e2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-1282f4bb-9b6c-43b7-b773-fe69a11f698a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:20.509829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:20.517047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:20.518088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:20.518088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:20.518088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:20.518088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:20.518088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:20.518088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:20.518088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:20.518088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:20.518088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 293/591] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:20.518088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282f4bb-9b6c-43b7-b773-fe69a11f698a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:20.519904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577f088-92cc-4f13-9bfd-f1f17560b39a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:20.527779 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:20.659808 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282f4bb-9b6c-43b7-b773-fe69a11f698a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:20.668860 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577f088-92cc-4f13-9bfd-f1f17560b39a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:20.709074 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be7878-b680-48d7-a6c6-05cbbbef40ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:20.709334 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be7878-b680-48d7-a6c6-05cbbbef40ec None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:20.709639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be7878-b680-48d7-a6c6-05cbbbef40ec None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:20.709957 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be7878-b680-48d7-a6c6-05cbbbef40ec None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:20.711236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be7878-b680-48d7-a6c6-05cbbbef40ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:20.711236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be7878-b680-48d7-a6c6-05cbbbef40ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:20.712539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be7878-b680-48d7-a6c6-05cbbbef40ec None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:20.717084 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055d69e-fd36-4857-b00f-9a7623a03681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:20.717776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d69e-fd36-4857-b00f-9a7623a03681 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:20.718059 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d69e-fd36-4857-b00f-9a7623a03681 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:20.718337 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d69e-fd36-4857-b00f-9a7623a03681 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:20.719230 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055d69e-fd36-4857-b00f-9a7623a03681 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:20.719577 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055d69e-fd36-4857-b00f-9a7623a03681 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:20.720997 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055d69e-fd36-4857-b00f-9a7623a03681 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:20.728417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 299/592] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:20.729345 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be7878-b680-48d7-a6c6-05cbbbef40ec None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:20.738802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:20.748131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 294/593] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:46:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:20.749149 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055d69e-fd36-4857-b00f-9a7623a03681 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:20.820844 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:20.863360 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be7878-b680-48d7-a6c6-05cbbbef40ec None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:20.873724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055d69e-fd36-4857-b00f-9a7623a03681 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:20.903786 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb01e6-1145-4695-bb95-7dc618d2e845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:20.904876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb01e6-1145-4695-bb95-7dc618d2e845 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:20.905405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb01e6-1145-4695-bb95-7dc618d2e845 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:20.905912 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb01e6-1145-4695-bb95-7dc618d2e845 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:20.906965 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb01e6-1145-4695-bb95-7dc618d2e845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:20.907601 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb01e6-1145-4695-bb95-7dc618d2e845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:20.909289 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb01e6-1145-4695-bb95-7dc618d2e845 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:20.916591 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bb9d6-4191-47ca-bf14-7ec4ce5ef4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:20.918417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb9d6-4191-47ca-bf14-7ec4ce5ef4d5 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:20.918718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb9d6-4191-47ca-bf14-7ec4ce5ef4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:20.918995 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb9d6-4191-47ca-bf14-7ec4ce5ef4d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:20.928881 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bb9d6-4191-47ca-bf14-7ec4ce5ef4d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:20.929239 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 300/594] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:20.929514 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bb9d6-4191-47ca-bf14-7ec4ce5ef4d5 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:20.930762 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb01e6-1145-4695-bb95-7dc618d2e845 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-bc7bb9d6-4191-47ca-bf14-7ec4ce5ef4d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:20.949547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:20.950760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:20.951872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:20.951872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:20.951872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:20.951872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:20.951872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:20.951872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:20.951872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:20.951872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:20.951872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:46:20.951872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:20.954719 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 295/595] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:20.955780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bb9d6-4191-47ca-bf14-7ec4ce5ef4d5 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:21.018917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:21.066666 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb01e6-1145-4695-bb95-7dc618d2e845 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:21.104687 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bb9d6-4191-47ca-bf14-7ec4ce5ef4d5 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:21.108952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39acb6e-0ee7-4d0c-bd38-8341b3d0da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:21.110150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39acb6e-0ee7-4d0c-bd38-8341b3d0da12 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:21.110738 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39acb6e-0ee7-4d0c-bd38-8341b3d0da12 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:21.111351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39acb6e-0ee7-4d0c-bd38-8341b3d0da12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:21.123604 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39acb6e-0ee7-4d0c-bd38-8341b3d0da12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:21.125388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39acb6e-0ee7-4d0c-bd38-8341b3d0da12 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:21.131836 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:21.143768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f42a6-c08e-430d-8d50-ef54820bdabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:21.144686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f42a6-c08e-430d-8d50-ef54820bdabb None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:21.144973 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f42a6-c08e-430d-8d50-ef54820bdabb None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:21.145258 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f42a6-c08e-430d-8d50-ef54820bdabb None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/a25e781a47a44801932d5fc4384de045/roles/df1609ea031d4414971c13ff878a13e2` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-c39acb6e-0ee7-4d0c-bd38-8341b3d0da12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:21.146167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:21.147220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:21.148221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:21.148221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:21.148221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:21.148221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:21.150846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 301/596] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:21.152753 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39acb6e-0ee7-4d0c-bd38-8341b3d0da12 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:21.164612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f42a6-c08e-430d-8d50-ef54820bdabb None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=a25e781a47a44801932d5fc4384de045, role_id=df1609ea031d4414971c13ff878a13e2)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:21.166084 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f42a6-c08e-430d-8d50-ef54820bdabb None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:21.243013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 296/597] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:46:20 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/a25e781a47a44801932d5fc4384de045/roles/df1609ea031d4414971c13ff878a13e2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:46:21.244173 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f42a6-c08e-430d-8d50-ef54820bdabb None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:21.264905 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39acb6e-0ee7-4d0c-bd38-8341b3d0da12 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:21.291819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:21.305184 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652be18b-5200-4cb6-a956-eec64515edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:21.305885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652be18b-5200-4cb6-a956-eec64515edaf None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:21.306170 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652be18b-5200-4cb6-a956-eec64515edaf None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:21.306503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652be18b-5200-4cb6-a956-eec64515edaf None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:21.307418 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652be18b-5200-4cb6-a956-eec64515edaf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:21.307737 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652be18b-5200-4cb6-a956-eec64515edaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:21.309447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652be18b-5200-4cb6-a956-eec64515edaf None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:21.330074 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 302/598] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 20:46:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:21.335290 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652be18b-5200-4cb6-a956-eec64515edaf None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:21.442883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f42a6-c08e-430d-8d50-ef54820bdabb None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:21.450947 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652be18b-5200-4cb6-a956-eec64515edaf None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:21.490353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed26e71-3fdb-4515-9469-b26cec967d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:21.491224 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26e71-3fdb-4515-9469-b26cec967d88 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:21.491513 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26e71-3fdb-4515-9469-b26cec967d88 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:21.491852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26e71-3fdb-4515-9469-b26cec967d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:21.504518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed26e71-3fdb-4515-9469-b26cec967d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:21.505970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed26e71-3fdb-4515-9469-b26cec967d88 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:21.514618 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178b1ac-5917-4bd8-9714-a67de155369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:21.515317 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178b1ac-5917-4bd8-9714-a67de155369a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:21.515653 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178b1ac-5917-4bd8-9714-a67de155369a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:21.515935 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178b1ac-5917-4bd8-9714-a67de155369a None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:21.516679 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178b1ac-5917-4bd8-9714-a67de155369a None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:21.516989 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178b1ac-5917-4bd8-9714-a67de155369a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:21.518395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178b1ac-5917-4bd8-9714-a67de155369a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-9ed26e71-3fdb-4515-9469-b26cec967d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:21.525887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:21.527028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:21.528055 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:21.528055 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:21.528055 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:21.528055 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:21.528055 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 303/599] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:21.532692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed26e71-3fdb-4515-9469-b26cec967d88 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:21.541053 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 297/600] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:21.546597 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178b1ac-5917-4bd8-9714-a67de155369a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:21.606978 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:21.615442 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:21.695247 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178b1ac-5917-4bd8-9714-a67de155369a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:21.711362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed26e71-3fdb-4515-9469-b26cec967d88 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:21.733668 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904df5e-6ef2-4d6b-b45c-ecf170657660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:21.734975 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904df5e-6ef2-4d6b-b45c-ecf170657660 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:21.734975 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904df5e-6ef2-4d6b-b45c-ecf170657660 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:21.734975 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904df5e-6ef2-4d6b-b45c-ecf170657660 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:21.742379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904df5e-6ef2-4d6b-b45c-ecf170657660 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:21.743959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904df5e-6ef2-4d6b-b45c-ecf170657660 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-9904df5e-6ef2-4d6b-b45c-ecf170657660 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:21.762745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:21.764117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:21.765360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:21.765360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:21.765360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:21.765360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:21.765360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:21.765360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:21.765360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:21.765360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:21.765360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 298/601] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:21.767835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904df5e-6ef2-4d6b-b45c-ecf170657660 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:21.779375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301a5a1-5a13-47c3-9ea1-79fe50985056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:21.780464 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a5a1-5a13-47c3-9ea1-79fe50985056 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:21.780924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a5a1-5a13-47c3-9ea1-79fe50985056 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:21.781380 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a5a1-5a13-47c3-9ea1-79fe50985056 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:21.782294 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301a5a1-5a13-47c3-9ea1-79fe50985056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:21.782918 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301a5a1-5a13-47c3-9ea1-79fe50985056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:21.784558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301a5a1-5a13-47c3-9ea1-79fe50985056 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:21.811637 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 304/602] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:21.812876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301a5a1-5a13-47c3-9ea1-79fe50985056 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:21.879924 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:21.882281 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904df5e-6ef2-4d6b-b45c-ecf170657660 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:21.921057 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74af8ce-f058-45a2-8648-fa56af63ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:21.921863 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74af8ce-f058-45a2-8648-fa56af63ea01 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:21.922268 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74af8ce-f058-45a2-8648-fa56af63ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:21.923160 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74af8ce-f058-45a2-8648-fa56af63ea01 None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:21.924049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74af8ce-f058-45a2-8648-fa56af63ea01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:21.924439 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74af8ce-f058-45a2-8648-fa56af63ea01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:21.925955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74af8ce-f058-45a2-8648-fa56af63ea01 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:21.940268 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 299/603] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:21.945718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74af8ce-f058-45a2-8648-fa56af63ea01 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:22.008255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:22.024754 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301a5a1-5a13-47c3-9ea1-79fe50985056 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:22.058542 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120398af-5652-4944-be41-27ee4ef20a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:22.059383 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120398af-5652-4944-be41-27ee4ef20a3a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:22.059669 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120398af-5652-4944-be41-27ee4ef20a3a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:22.060205 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120398af-5652-4944-be41-27ee4ef20a3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:22.067704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120398af-5652-4944-be41-27ee4ef20a3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:22.069161 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120398af-5652-4944-be41-27ee4ef20a3a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-120398af-5652-4944-be41-27ee4ef20a3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:22.086466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:22.087535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:22.088533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:22.088533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:22.088533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:22.088533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:22.088533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:22.088533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:22.088533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:22.088533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:22.088533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 305/604] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:22.093911 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120398af-5652-4944-be41-27ee4ef20a3a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:22.206567 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120398af-5652-4944-be41-27ee4ef20a3a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:22.206845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74af8ce-f058-45a2-8648-fa56af63ea01 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:22.244322 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7e7ce-765c-4ee0-8a00-766b38f51073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:22.245009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e7ce-765c-4ee0-8a00-766b38f51073 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:22.245297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e7ce-765c-4ee0-8a00-766b38f51073 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:22.245639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e7ce-765c-4ee0-8a00-766b38f51073 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:22.246694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7e7ce-765c-4ee0-8a00-766b38f51073 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:22.247019 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7e7ce-765c-4ee0-8a00-766b38f51073 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:22.248469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7e7ce-765c-4ee0-8a00-766b38f51073 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:22.262584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 306/605] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:22.268519 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7e7ce-765c-4ee0-8a00-766b38f51073 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:22.278678 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70262f1b-363e-455b-83ad-ad1a0b764186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:22.279527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262f1b-363e-455b-83ad-ad1a0b764186 None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:22.279814 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262f1b-363e-455b-83ad-ad1a0b764186 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:22.280093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262f1b-363e-455b-83ad-ad1a0b764186 None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/359041f2d03f4e499f3964ac1ddce468/roles/df1609ea031d4414971c13ff878a13e2` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:22.283012 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:22.312175 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70262f1b-363e-455b-83ad-ad1a0b764186 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=359041f2d03f4e499f3964ac1ddce468, role_id=df1609ea031d4414971c13ff878a13e2)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:22.313671 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70262f1b-363e-455b-83ad-ad1a0b764186 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:22.383241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7e7ce-765c-4ee0-8a00-766b38f51073 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:22.410733 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 300/606] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:46:21 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/359041f2d03f4e499f3964ac1ddce468/roles/df1609ea031d4414971c13ff878a13e2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:46:22.412355 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4adc4-8a53-42f7-9d21-f24b20a58622 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:22.412647 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4adc4-8a53-42f7-9d21-f24b20a58622 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:22.412927 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4adc4-8a53-42f7-9d21-f24b20a58622 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:22.416721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 301/607] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:22.425706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c63e2a-a175-4e37-b7f1-3cab75aef8fb None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:22.425991 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c63e2a-a175-4e37-b7f1-3cab75aef8fb None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:22.426272 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c63e2a-a175-4e37-b7f1-3cab75aef8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:22.441396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eca15b-cf2b-4cbf-b3f2-57039b79ed4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:22.442332 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eca15b-cf2b-4cbf-b3f2-57039b79ed4b None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:22.442641 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eca15b-cf2b-4cbf-b3f2-57039b79ed4b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:22.442925 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eca15b-cf2b-4cbf-b3f2-57039b79ed4b None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/68547d17dd4546469230112f91a48764/roles/df1609ea031d4414971c13ff878a13e2` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:22.443997 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:22.466224 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-20c63e2a-a175-4e37-b7f1-3cab75aef8fb None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:22.469026 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-20c63e2a-a175-4e37-b7f1-3cab75aef8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:22.480061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eca15b-cf2b-4cbf-b3f2-57039b79ed4b None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=68547d17dd4546469230112f91a48764, role_id=df1609ea031d4414971c13ff878a13e2)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:22.481589 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eca15b-cf2b-4cbf-b3f2-57039b79ed4b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:22.556988 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 302/608] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:22.595558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 307/609] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:46:22 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/68547d17dd4546469230112f91a48764/roles/df1609ea031d4414971c13ff878a13e2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:46:22.596712 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c63e2a-a175-4e37-b7f1-3cab75aef8fb None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:22.721758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c63e2a-a175-4e37-b7f1-3cab75aef8fb None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:22.760626 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d60afa-1707-4dae-9970-9978281b38f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:22.762055 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60afa-1707-4dae-9970-9978281b38f3 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:22.762345 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60afa-1707-4dae-9970-9978281b38f3 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:22.762656 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60afa-1707-4dae-9970-9978281b38f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:22.764951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:22.776012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d60afa-1707-4dae-9970-9978281b38f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-72d60afa-1707-4dae-9970-9978281b38f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:22.784372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:22.786379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:22.788369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 303/610] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:22.793543 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eca15b-cf2b-4cbf-b3f2-57039b79ed4b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:22.904329 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:22.967231 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eca15b-cf2b-4cbf-b3f2-57039b79ed4b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:23.023090 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b56be8-e0a3-49a1-9afb-635226ea1c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:23.024657 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56be8-e0a3-49a1-9afb-635226ea1c85 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:23.025175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56be8-e0a3-49a1-9afb-635226ea1c85 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:23.025684 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56be8-e0a3-49a1-9afb-635226ea1c85 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:23.026700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b56be8-e0a3-49a1-9afb-635226ea1c85 None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:23.027777 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b56be8-e0a3-49a1-9afb-635226ea1c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:23.029391 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b56be8-e0a3-49a1-9afb-635226ea1c85 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:23.054348 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 308/611] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:23.059732 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d60afa-1707-4dae-9970-9978281b38f3 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:23.107650 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a621428-7147-43ae-b8ed-fe5036bf43f2 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:23.108308 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a621428-7147-43ae-b8ed-fe5036bf43f2 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:23.108837 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a621428-7147-43ae-b8ed-fe5036bf43f2 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:23.110751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 309/612] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:23.115663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7432d-eef7-4b3f-a122-70675119d35e None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:23.115949 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7432d-eef7-4b3f-a122-70675119d35e None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:23.116229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7432d-eef7-4b3f-a122-70675119d35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:23.142870 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-e1e7432d-eef7-4b3f-a122-70675119d35e None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:23.144086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-e1e7432d-eef7-4b3f-a122-70675119d35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:23.208736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d60afa-1707-4dae-9970-9978281b38f3 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:23.248574 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2eb12-fe68-4081-af27-40e2c6f0b44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:23.249386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2eb12-fe68-4081-af27-40e2c6f0b44f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:23.249673 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2eb12-fe68-4081-af27-40e2c6f0b44f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:23.249955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2eb12-fe68-4081-af27-40e2c6f0b44f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:23.262855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2eb12-fe68-4081-af27-40e2c6f0b44f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:23.264719 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2eb12-fe68-4081-af27-40e2c6f0b44f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-2ad2eb12-fe68-4081-af27-40e2c6f0b44f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:23.285823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:23.286950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:23.287957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:23.287957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:23.287957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:23.287957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:23.287957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 304/613] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:23.289968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 310/614] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:46:23.295962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2eb12-fe68-4081-af27-40e2c6f0b44f None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:23.369847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7432d-eef7-4b3f-a122-70675119d35e None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:23.372029 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:23.429676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2eb12-fe68-4081-af27-40e2c6f0b44f None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:23.445199 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:23.473749 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605a6b-3ae4-43a8-b81b-e2464eaf6b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:23.474340 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605a6b-3ae4-43a8-b81b-e2464eaf6b65 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:23.474645 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605a6b-3ae4-43a8-b81b-e2464eaf6b65 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:23.474930 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605a6b-3ae4-43a8-b81b-e2464eaf6b65 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:23.475670 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0605a6b-3ae4-43a8-b81b-e2464eaf6b65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:23.475980 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0605a6b-3ae4-43a8-b81b-e2464eaf6b65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:23.477952 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0605a6b-3ae4-43a8-b81b-e2464eaf6b65 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:23.494092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 305/615] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:23.500702 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605a6b-3ae4-43a8-b81b-e2464eaf6b65 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:23.520206 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7432d-eef7-4b3f-a122-70675119d35e None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:23.604164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fded9b-c855-4feb-a3fb-ac62d8654a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:23.604997 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fded9b-c855-4feb-a3fb-ac62d8654a62 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:23.605848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fded9b-c855-4feb-a3fb-ac62d8654a62 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:23.606130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fded9b-c855-4feb-a3fb-ac62d8654a62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:23.617260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605a6b-3ae4-43a8-b81b-e2464eaf6b65 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:23.631033 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:23.632667 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fded9b-c855-4feb-a3fb-ac62d8654a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-46fded9b-c855-4feb-a3fb-ac62d8654a62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:23.648234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:23.655094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:23.657229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 311/616] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:23.659021 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a2242-3a50-4ca8-b670-1108318997df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:23.659021 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a2242-3a50-4ca8-b670-1108318997df None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:23.659021 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a2242-3a50-4ca8-b670-1108318997df None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:23.659021 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a2242-3a50-4ca8-b670-1108318997df None admin] PATH_INFO: `/v3/users/swift` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:23.666632 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fded9b-c855-4feb-a3fb-ac62d8654a62 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:23.666931 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a2242-3a50-4ca8-b670-1108318997df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:23.666931 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a2242-3a50-4ca8-b670-1108318997df None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-cb6a2242-3a50-4ca8-b670-1108318997df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:23.685742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:23.688185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:23.690555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:23.690555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:23.690555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:23.690555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:23.690555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:23.690555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:23.690555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:23.690555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:23.690555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:23.690555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:23.694726 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 306/617] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:23.694726 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a2242-3a50-4ca8-b670-1108318997df None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:23.855854 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fded9b-c855-4feb-a3fb-ac62d8654a62 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:23.862915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a2242-3a50-4ca8-b670-1108318997df None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:23.877240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:23.898485 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba0e3d-55a1-45e8-88a0-9b69f17c2798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:23.899203 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba0e3d-55a1-45e8-88a0-9b69f17c2798 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:23.899577 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba0e3d-55a1-45e8-88a0-9b69f17c2798 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:23.899859 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba0e3d-55a1-45e8-88a0-9b69f17c2798 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:23.900713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba0e3d-55a1-45e8-88a0-9b69f17c2798 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:23.901021 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba0e3d-55a1-45e8-88a0-9b69f17c2798 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:23.902499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba0e3d-55a1-45e8-88a0-9b69f17c2798 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:23.926039 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 307/618] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:46:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:23.926976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba0e3d-55a1-45e8-88a0-9b69f17c2798 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:23.927177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bef415-f834-461a-98ab-a576264396b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:23.927739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bef415-f834-461a-98ab-a576264396b3 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:23.928032 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bef415-f834-461a-98ab-a576264396b3 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:23.928315 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bef415-f834-461a-98ab-a576264396b3 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:23.929093 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bef415-f834-461a-98ab-a576264396b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:23.929408 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bef415-f834-461a-98ab-a576264396b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:23.930827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bef415-f834-461a-98ab-a576264396b3 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:23.949835 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 312/619] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:23.954662 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bef415-f834-461a-98ab-a576264396b3 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:23.957706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:24.038475 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba0e3d-55a1-45e8-88a0-9b69f17c2798 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:24.081352 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8a8af-ac09-43c6-9305-85900f519dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:24.082179 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8a8af-ac09-43c6-9305-85900f519dac None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:24.082462 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8a8af-ac09-43c6-9305-85900f519dac None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:24.082795 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8a8af-ac09-43c6-9305-85900f519dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:24.095605 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8a8af-ac09-43c6-9305-85900f519dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:24.097133 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8a8af-ac09-43c6-9305-85900f519dac None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-cdf8a8af-ac09-43c6-9305-85900f519dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:24.116780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:24.117828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:24.118871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:24.118871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:24.118871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:24.118871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:24.118871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 308/620] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:24.124007 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8a8af-ac09-43c6-9305-85900f519dac None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:24.179160 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bef415-f834-461a-98ab-a576264396b3 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:24.231012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:24.240147 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8a8af-ac09-43c6-9305-85900f519dac None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:24.264839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191579bb-9b55-49f4-8a32-3befb37680ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:24.265658 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191579bb-9b55-49f4-8a32-3befb37680ab None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:24.265941 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191579bb-9b55-49f4-8a32-3befb37680ab None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:24.266217 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191579bb-9b55-49f4-8a32-3befb37680ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:24.294475 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191579bb-9b55-49f4-8a32-3befb37680ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:24.296461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191579bb-9b55-49f4-8a32-3befb37680ab None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:24.306091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f5c05-e7a3-452d-b0d5-1b9fb3527818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:24.307051 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f5c05-e7a3-452d-b0d5-1b9fb3527818 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:24.307527 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f5c05-e7a3-452d-b0d5-1b9fb3527818 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:24.308010 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f5c05-e7a3-452d-b0d5-1b9fb3527818 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:24.308959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f5c05-e7a3-452d-b0d5-1b9fb3527818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:24.309471 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f5c05-e7a3-452d-b0d5-1b9fb3527818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:24.311338 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f5c05-e7a3-452d-b0d5-1b9fb3527818 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-191579bb-9b55-49f4-8a32-3befb37680ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:24.318405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:24.319444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:24.320446 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:24.320446 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:24.320446 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:24.320446 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:24.320446 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 313/621] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:24.321324 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97bed9-1f2f-44b4-bcd6-a4bd6a311404 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:24.321611 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97bed9-1f2f-44b4-bcd6-a4bd6a311404 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:24.321889 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97bed9-1f2f-44b4-bcd6-a4bd6a311404 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:24.327288 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 314/622] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:24.329108 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97bed9-1f2f-44b4-bcd6-a4bd6a311404 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:24.334828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 309/623] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:24.337162 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3086135-baac-40f3-982e-675dd0a568fa None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:24.337459 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3086135-baac-40f3-982e-675dd0a568fa None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:24.337740 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3086135-baac-40f3-982e-675dd0a568fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:24.362871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:24.366662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-a3086135-baac-40f3-982e-675dd0a568fa None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:24.368230 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-a3086135-baac-40f3-982e-675dd0a568fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:24.443223 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 310/624] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:24.444441 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3086135-baac-40f3-982e-675dd0a568fa None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:24.465793 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97bed9-1f2f-44b4-bcd6-a4bd6a311404 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:24.518173 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:24.519156 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c85a3-8a71-4c64-9d72-780990650349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:24.520792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c85a3-8a71-4c64-9d72-780990650349 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:24.521241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c85a3-8a71-4c64-9d72-780990650349 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:24.521717 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c85a3-8a71-4c64-9d72-780990650349 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:24.522683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c85a3-8a71-4c64-9d72-780990650349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:24.523186 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c85a3-8a71-4c64-9d72-780990650349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:24.524810 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c85a3-8a71-4c64-9d72-780990650349 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:24.542913 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 315/625] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:24.544151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c85a3-8a71-4c64-9d72-780990650349 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:24.557266 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3086135-baac-40f3-982e-675dd0a568fa None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:24.596428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdbe34-6875-49c9-8289-4e05d47c85ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:24.597236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdbe34-6875-49c9-8289-4e05d47c85ba None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:24.597538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdbe34-6875-49c9-8289-4e05d47c85ba None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:24.597903 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdbe34-6875-49c9-8289-4e05d47c85ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:24.605801 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdbe34-6875-49c9-8289-4e05d47c85ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:24.607445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdbe34-6875-49c9-8289-4e05d47c85ba None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-16cdbe34-6875-49c9-8289-4e05d47c85ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:24.623065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:24.624076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:24.625090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:24.625090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:24.625090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:24.625090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:24.625090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:24.625090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:24.625090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:24.625090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:24.625090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 311/626] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:24.625655 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdbe34-6875-49c9-8289-4e05d47c85ba None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:24.644196 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:24.662351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c85a3-8a71-4c64-9d72-780990650349 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:24.701654 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c964d68-ff87-4cba-aa11-248f3e880f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:24.702838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c964d68-ff87-4cba-aa11-248f3e880f88 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:24.703301 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c964d68-ff87-4cba-aa11-248f3e880f88 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:24.703816 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c964d68-ff87-4cba-aa11-248f3e880f88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:24.716782 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c964d68-ff87-4cba-aa11-248f3e880f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-7c964d68-ff87-4cba-aa11-248f3e880f88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:24.725467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:24.726767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:24.727968 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:24.734935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 316/627] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:24.736098 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c964d68-ff87-4cba-aa11-248f3e880f88 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:24.743812 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdbe34-6875-49c9-8289-4e05d47c85ba None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:24.775908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:24.786179 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68560965-9829-441e-82a9-0398197dad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:24.787087 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68560965-9829-441e-82a9-0398197dad6d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:24.790287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68560965-9829-441e-82a9-0398197dad6d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:24.790287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68560965-9829-441e-82a9-0398197dad6d None admin] PATH_INFO: `/v3/users/nova` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:24.798014 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68560965-9829-441e-82a9-0398197dad6d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:24.799464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68560965-9829-441e-82a9-0398197dad6d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-68560965-9829-441e-82a9-0398197dad6d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:24.817576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:24.818976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:24.820202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:24.820202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:24.820202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:24.820202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:24.820202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:24.820202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:24.820202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:24.820202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:24.820202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:24.820202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:24.823731 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 312/628] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:46:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:24.824832 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68560965-9829-441e-82a9-0398197dad6d None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:24.863854 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c964d68-ff87-4cba-aa11-248f3e880f88 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:24.901799 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a0fa4-ead8-438c-aadf-968cab6269cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:24.903431 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a0fa4-ead8-438c-aadf-968cab6269cd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:24.903999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a0fa4-ead8-438c-aadf-968cab6269cd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:24.904462 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a0fa4-ead8-438c-aadf-968cab6269cd None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:24.905432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a0fa4-ead8-438c-aadf-968cab6269cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:24.905908 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a0fa4-ead8-438c-aadf-968cab6269cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:24.907527 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a0fa4-ead8-438c-aadf-968cab6269cd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:24.922389 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 317/629] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:24.923510 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a0fa4-ead8-438c-aadf-968cab6269cd None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:24.927917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:24.944057 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68560965-9829-441e-82a9-0398197dad6d None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:24.983072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579dbba-bfd6-4149-a01e-0251a8cb72d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:24.983797 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579dbba-bfd6-4149-a01e-0251a8cb72d3 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:24.984088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579dbba-bfd6-4149-a01e-0251a8cb72d3 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:24.984368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579dbba-bfd6-4149-a01e-0251a8cb72d3 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:24.985233 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579dbba-bfd6-4149-a01e-0251a8cb72d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:24.985546 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579dbba-bfd6-4149-a01e-0251a8cb72d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:24.986953 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579dbba-bfd6-4149-a01e-0251a8cb72d3 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:25.001626 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 313/630] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:25.001626 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579dbba-bfd6-4149-a01e-0251a8cb72d3 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:25.044979 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a0fa4-ead8-438c-aadf-968cab6269cd None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:25.067108 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:25.090008 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155158de-ecd6-4dab-ba81-0f3db1a6747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:25.095629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155158de-ecd6-4dab-ba81-0f3db1a6747a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.095629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155158de-ecd6-4dab-ba81-0f3db1a6747a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.095629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155158de-ecd6-4dab-ba81-0f3db1a6747a None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:25.095629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155158de-ecd6-4dab-ba81-0f3db1a6747a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:25.095629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155158de-ecd6-4dab-ba81-0f3db1a6747a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:25.095629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155158de-ecd6-4dab-ba81-0f3db1a6747a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:25.116994 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 318/631] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:46:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:25.118196 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155158de-ecd6-4dab-ba81-0f3db1a6747a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:25.135428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579dbba-bfd6-4149-a01e-0251a8cb72d3 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:25.173637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ee5d3-9015-4c94-ac76-4b80f9d76a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:25.174508 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee5d3-9015-4c94-ac76-4b80f9d76a72 None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.174829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee5d3-9015-4c94-ac76-4b80f9d76a72 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.175107 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee5d3-9015-4c94-ac76-4b80f9d76a72 None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/aab1ecd7a8074c288ac9b70065e6efa2/roles/df1609ea031d4414971c13ff878a13e2` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:25.187674 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:25.193579 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ee5d3-9015-4c94-ac76-4b80f9d76a72 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=aab1ecd7a8074c288ac9b70065e6efa2, role_id=df1609ea031d4414971c13ff878a13e2)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:25.195230 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ee5d3-9015-4c94-ac76-4b80f9d76a72 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:25.231499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155158de-ecd6-4dab-ba81-0f3db1a6747a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:25.268719 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72140483-cba8-414e-93bf-562c0565aa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:25.269541 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140483-cba8-414e-93bf-562c0565aa39 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140483-cba8-414e-93bf-562c0565aa39 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.270107 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140483-cba8-414e-93bf-562c0565aa39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:25.274914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 314/632] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:46:24 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/aab1ecd7a8074c288ac9b70065e6efa2/roles/df1609ea031d4414971c13ff878a13e2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:46:25.276724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ee5d3-9015-4c94-ac76-4b80f9d76a72 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:25.284865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72140483-cba8-414e-93bf-562c0565aa39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:25.286640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72140483-cba8-414e-93bf-562c0565aa39 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-72140483-cba8-414e-93bf-562c0565aa39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:25.315040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:25.316180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:25.317271 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:25.317271 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:25.317271 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:25.317271 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:25.317271 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 319/633] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:25.318381 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5901b-969a-4c36-9aa1-2de174a4b7ca None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.318705 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5901b-969a-4c36-9aa1-2de174a4b7ca None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.318986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5901b-969a-4c36-9aa1-2de174a4b7ca None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:25.320477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 320/634] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:25.321525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07b365-b984-4384-ab59-a82950dc1890 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.321810 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07b365-b984-4384-ab59-a82950dc1890 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.322086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07b365-b984-4384-ab59-a82950dc1890 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:25.327803 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 321/635] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:25.327803 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07b365-b984-4384-ab59-a82950dc1890 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:25.397383 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:25.401745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ee5d3-9015-4c94-ac76-4b80f9d76a72 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:25.441887 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aa0c6-6866-4b0d-b328-47e1a020f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:25.442473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa0c6-6866-4b0d-b328-47e1a020f24a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.442792 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa0c6-6866-4b0d-b328-47e1a020f24a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.443077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa0c6-6866-4b0d-b328-47e1a020f24a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:25.451188 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07b365-b984-4384-ab59-a82950dc1890 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:25.468401 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:25.493670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffe759-1a68-4624-805f-6740827a4305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:25.494365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffe759-1a68-4624-805f-6740827a4305 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.494728 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffe759-1a68-4624-805f-6740827a4305 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.494942 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffe759-1a68-4624-805f-6740827a4305 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:25.495744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffe759-1a68-4624-805f-6740827a4305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:25.496063 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffe759-1a68-4624-805f-6740827a4305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:25.497475 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffe759-1a68-4624-805f-6740827a4305 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:25.511599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 322/636] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:25.516371 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00cb7e-51f7-4088-8fa9-e4d536ef0f44 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.516371 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00cb7e-51f7-4088-8fa9-e4d536ef0f44 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.516371 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00cb7e-51f7-4088-8fa9-e4d536ef0f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:25.531331 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319aa0c6-6866-4b0d-b328-47e1a020f24a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:25.532802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319aa0c6-6866-4b0d-b328-47e1a020f24a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:25.533447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-5f00cb7e-51f7-4088-8fa9-e4d536ef0f44 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:25.534680 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-5f00cb7e-51f7-4088-8fa9-e4d536ef0f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:25.616905 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 323/637] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:25.623160 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b61c8-a9de-47a6-9fc8-76dcabfad6dd None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.623525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b61c8-a9de-47a6-9fc8-76dcabfad6dd None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.623884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b61c8-a9de-47a6-9fc8-76dcabfad6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:25.642159 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-ba0b61c8-a9de-47a6-9fc8-76dcabfad6dd None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:25.643717 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-ba0b61c8-a9de-47a6-9fc8-76dcabfad6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:25.650418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:25.657131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 315/638] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:25.657985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aa0c6-6866-4b0d-b328-47e1a020f24a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:25.725187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 324/639] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:25.726405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b61c8-a9de-47a6-9fc8-76dcabfad6dd None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:25.763775 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:25.772273 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aa0c6-6866-4b0d-b328-47e1a020f24a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:25.812597 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f274b-68a3-4f45-96e5-7a1c55f10038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:25.813409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f274b-68a3-4f45-96e5-7a1c55f10038 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.813698 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f274b-68a3-4f45-96e5-7a1c55f10038 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.813975 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f274b-68a3-4f45-96e5-7a1c55f10038 None admin] PATH_INFO: `/v3/users/glance` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:25.821560 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f274b-68a3-4f45-96e5-7a1c55f10038 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:25.823169 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f274b-68a3-4f45-96e5-7a1c55f10038 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:25.834310 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b61c8-a9de-47a6-9fc8-76dcabfad6dd None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-819f274b-68a3-4f45-96e5-7a1c55f10038 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:25.838060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:25.839315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:25.841030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:25.841030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:25.841030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:25.841030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:25.841030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:25.841030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:25.841030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:25.841030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:25.841030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:46:25.841030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:25.841030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 316/640] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:25.841690 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f274b-68a3-4f45-96e5-7a1c55f10038 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:25.876698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91417fc-516f-4527-8f2d-8c458b467e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:25.877802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91417fc-516f-4527-8f2d-8c458b467e62 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.878272 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91417fc-516f-4527-8f2d-8c458b467e62 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.878551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91417fc-516f-4527-8f2d-8c458b467e62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:25.889481 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91417fc-516f-4527-8f2d-8c458b467e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-b91417fc-516f-4527-8f2d-8c458b467e62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:25.897241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:25.898362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 325/641] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:25.899365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91417fc-516f-4527-8f2d-8c458b467e62 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:25.911186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:25.957881 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f274b-68a3-4f45-96e5-7a1c55f10038 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:25.997390 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b1fda-c553-4611-9083-cc7d562cbede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:25.998220 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1fda-c553-4611-9083-cc7d562cbede None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:25.998569 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1fda-c553-4611-9083-cc7d562cbede None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:25.998875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1fda-c553-4611-9083-cc7d562cbede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:26.007924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:26.011995 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b1fda-c553-4611-9083-cc7d562cbede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:26.013501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b1fda-c553-4611-9083-cc7d562cbede None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:26.016140 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91417fc-516f-4527-8f2d-8c458b467e62 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-956b1fda-c553-4611-9083-cc7d562cbede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:26.032060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:26.033100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:26.034139 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:26.034139 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:26.034139 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:26.034139 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:26.034139 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 317/642] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:26.034467 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b1fda-c553-4611-9083-cc7d562cbede None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:26.062277 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cce72-2ba3-46d2-a8a3-4f800cebfccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:26.063127 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cce72-2ba3-46d2-a8a3-4f800cebfccd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:26.063429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cce72-2ba3-46d2-a8a3-4f800cebfccd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:26.063691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cce72-2ba3-46d2-a8a3-4f800cebfccd None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:26.077085 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cce72-2ba3-46d2-a8a3-4f800cebfccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-8b0cce72-2ba3-46d2-a8a3-4f800cebfccd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:26.096539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:26.097691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 326/643] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:26.098694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cce72-2ba3-46d2-a8a3-4f800cebfccd None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:26.151198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b1fda-c553-4611-9083-cc7d562cbede None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:26.162654 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:26.187716 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9dda5-cff7-4f34-b547-331ba95211b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:26.188778 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9dda5-cff7-4f34-b547-331ba95211b1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:26.189233 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9dda5-cff7-4f34-b547-331ba95211b1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:26.189520 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9dda5-cff7-4f34-b547-331ba95211b1 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:26.190374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9dda5-cff7-4f34-b547-331ba95211b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:26.190722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9dda5-cff7-4f34-b547-331ba95211b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:26.192160 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9dda5-cff7-4f34-b547-331ba95211b1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:26.207904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cce72-2ba3-46d2-a8a3-4f800cebfccd None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:26.211616 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 318/644] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:46:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:26.212672 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9dda5-cff7-4f34-b547-331ba95211b1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:26.245861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92c65c-61af-4670-a5fe-98c667f00ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:26.246535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92c65c-61af-4670-a5fe-98c667f00ff2 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:26.246895 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92c65c-61af-4670-a5fe-98c667f00ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:26.247500 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92c65c-61af-4670-a5fe-98c667f00ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:26.247936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92c65c-61af-4670-a5fe-98c667f00ff2 None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:26.248249 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92c65c-61af-4670-a5fe-98c667f00ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:26.249646 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92c65c-61af-4670-a5fe-98c667f00ff2 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:26.263726 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 327/645] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:26.263726 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92c65c-61af-4670-a5fe-98c667f00ff2 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:26.283560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:26.329135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9dda5-cff7-4f34-b547-331ba95211b1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:26.368190 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c3dde-3c7a-47a2-b531-9c71f31db20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:26.369119 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c3dde-3c7a-47a2-b531-9c71f31db20e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:26.369597 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c3dde-3c7a-47a2-b531-9c71f31db20e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:26.370033 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c3dde-3c7a-47a2-b531-9c71f31db20e None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:26.371494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c3dde-3c7a-47a2-b531-9c71f31db20e None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:26.371980 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c3dde-3c7a-47a2-b531-9c71f31db20e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:26.373533 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c3dde-3c7a-47a2-b531-9c71f31db20e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:26.374048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92c65c-61af-4670-a5fe-98c667f00ff2 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:26.388192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 319/646] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:26.389065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c3dde-3c7a-47a2-b531-9c71f31db20e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:26.416558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca1f13-af26-4ff0-92a7-d04f33671e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:26.417739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca1f13-af26-4ff0-92a7-d04f33671e83 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:26.418029 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca1f13-af26-4ff0-92a7-d04f33671e83 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:26.418313 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca1f13-af26-4ff0-92a7-d04f33671e83 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:26.419119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca1f13-af26-4ff0-92a7-d04f33671e83 None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:26.419436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca1f13-af26-4ff0-92a7-d04f33671e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:26.420882 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca1f13-af26-4ff0-92a7-d04f33671e83 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:26.425130 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:26.431143 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 328/647] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:26.437461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca1f13-af26-4ff0-92a7-d04f33671e83 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:26.507215 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c3dde-3c7a-47a2-b531-9c71f31db20e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:26.523257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:26.546336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88c803-fffc-4b27-b184-2dec22e7997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:26.546650 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca1f13-af26-4ff0-92a7-d04f33671e83 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:26.547487 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88c803-fffc-4b27-b184-2dec22e7997f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:26.547931 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88c803-fffc-4b27-b184-2dec22e7997f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:26.548360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88c803-fffc-4b27-b184-2dec22e7997f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:26.585512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300b043-7c97-4a39-bf43-21a4a5bcfc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:26.586318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300b043-7c97-4a39-bf43-21a4a5bcfc99 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:26.586685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300b043-7c97-4a39-bf43-21a4a5bcfc99 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:26.586973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300b043-7c97-4a39-bf43-21a4a5bcfc99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:26.598551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300b043-7c97-4a39-bf43-21a4a5bcfc99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:26.600151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300b043-7c97-4a39-bf43-21a4a5bcfc99 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-1300b043-7c97-4a39-bf43-21a4a5bcfc99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:26.617966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:26.619403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:26.621285 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:26.621285 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:26.621285 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:26.621285 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:26.621285 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 329/648] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:26.621285 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300b043-7c97-4a39-bf43-21a4a5bcfc99 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:26.628378 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88c803-fffc-4b27-b184-2dec22e7997f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:26.629845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88c803-fffc-4b27-b184-2dec22e7997f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:26.659252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:26.730855 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300b043-7c97-4a39-bf43-21a4a5bcfc99 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:26.737996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 320/649] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:26.738901 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88c803-fffc-4b27-b184-2dec22e7997f None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:26.765548 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:26.771941 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30cd2d-bae7-47a9-86a6-61f65ceda520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:26.772885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30cd2d-bae7-47a9-86a6-61f65ceda520 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:26.777253 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30cd2d-bae7-47a9-86a6-61f65ceda520 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:26.777253 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30cd2d-bae7-47a9-86a6-61f65ceda520 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:26.780585 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30cd2d-bae7-47a9-86a6-61f65ceda520 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:26.782057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30cd2d-bae7-47a9-86a6-61f65ceda520 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-6d30cd2d-bae7-47a9-86a6-61f65ceda520 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:26.798715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:26.799802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:26.800834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:26.800834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:26.800834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:26.800834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:26.800834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:26.800834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:26.800834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:26.800834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:26.805723 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 330/650] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:26.806694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30cd2d-bae7-47a9-86a6-61f65ceda520 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:26.854489 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88c803-fffc-4b27-b184-2dec22e7997f None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:26.884393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:26.897254 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b21770-63d2-4ac4-9d01-a5e4d4179859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:26.898063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b21770-63d2-4ac4-9d01-a5e4d4179859 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:26.898353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b21770-63d2-4ac4-9d01-a5e4d4179859 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:26.911299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b21770-63d2-4ac4-9d01-a5e4d4179859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:26.911299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b21770-63d2-4ac4-9d01-a5e4d4179859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:26.911299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b21770-63d2-4ac4-9d01-a5e4d4179859 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:26.919545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30cd2d-bae7-47a9-86a6-61f65ceda520 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-64b21770-63d2-4ac4-9d01-a5e4d4179859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:26.930183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:26.931458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:26.932656 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:26.932656 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:26.932656 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:26.932656 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:26.939206 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 321/651] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:26.939206 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b21770-63d2-4ac4-9d01-a5e4d4179859 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:26.966917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ee39c-4337-4242-9880-a8006cc7ef07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:26.967627 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee39c-4337-4242-9880-a8006cc7ef07 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:26.967912 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee39c-4337-4242-9880-a8006cc7ef07 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:26.968191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee39c-4337-4242-9880-a8006cc7ef07 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:26.968933 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ee39c-4337-4242-9880-a8006cc7ef07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:26.969242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ee39c-4337-4242-9880-a8006cc7ef07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:26.970670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ee39c-4337-4242-9880-a8006cc7ef07 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:26.983779 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 331/652] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:26.984641 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ee39c-4337-4242-9880-a8006cc7ef07 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:27.039964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:27.066648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b21770-63d2-4ac4-9d01-a5e4d4179859 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:27.100493 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ee39c-4337-4242-9880-a8006cc7ef07 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:27.106151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd76dae-b9ab-4f51-8a28-c3a66e359c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:27.106995 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd76dae-b9ab-4f51-8a28-c3a66e359c42 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:27.107287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd76dae-b9ab-4f51-8a28-c3a66e359c42 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:27.107565 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd76dae-b9ab-4f51-8a28-c3a66e359c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:27.118951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd76dae-b9ab-4f51-8a28-c3a66e359c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:27.120451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd76dae-b9ab-4f51-8a28-c3a66e359c42 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:27.138247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9f2cc-8ec3-409c-b5cd-6b708db1697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-9fd76dae-b9ab-4f51-8a28-c3a66e359c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:27.138448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:27.139648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:27.141126 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:27.141126 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:27.141126 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:27.141126 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:27.141445 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9f2cc-8ec3-409c-b5cd-6b708db1697f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:27.141445 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9f2cc-8ec3-409c-b5cd-6b708db1697f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:27.141445 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9f2cc-8ec3-409c-b5cd-6b708db1697f None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:27.142041 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9f2cc-8ec3-409c-b5cd-6b708db1697f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:27.142427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9f2cc-8ec3-409c-b5cd-6b708db1697f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:27.144177 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 322/653] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:27.144368 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9f2cc-8ec3-409c-b5cd-6b708db1697f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:27.144758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd76dae-b9ab-4f51-8a28-c3a66e359c42 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:27.158522 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 332/654] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:27.163585 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9f2cc-8ec3-409c-b5cd-6b708db1697f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:27.182986 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:27.259246 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd76dae-b9ab-4f51-8a28-c3a66e359c42 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:27.279798 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9f2cc-8ec3-409c-b5cd-6b708db1697f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:27.300215 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:27.300399 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5e367-6564-44e3-81bf-387882013ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:27.300399 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e367-6564-44e3-81bf-387882013ba9 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:27.300399 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e367-6564-44e3-81bf-387882013ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:27.300399 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e367-6564-44e3-81bf-387882013ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:27.300758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5e367-6564-44e3-81bf-387882013ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:27.300758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5e367-6564-44e3-81bf-387882013ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:27.300758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5e367-6564-44e3-81bf-387882013ba9 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:27.318249 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 323/655] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:27.318249 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5e367-6564-44e3-81bf-387882013ba9 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:27.320612 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6075-d0d1-4dd6-a46c-172301b0a3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:27.321424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6075-d0d1-4dd6-a46c-172301b0a3ef None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:27.321713 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6075-d0d1-4dd6-a46c-172301b0a3ef None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:27.321992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6075-d0d1-4dd6-a46c-172301b0a3ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:27.329834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d6075-d0d1-4dd6-a46c-172301b0a3ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:27.331330 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d6075-d0d1-4dd6-a46c-172301b0a3ef None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-870d6075-d0d1-4dd6-a46c-172301b0a3ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:27.346900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:27.348286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 333/656] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:27.349423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6075-d0d1-4dd6-a46c-172301b0a3ef None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:27.427366 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:27.439230 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5e367-6564-44e3-81bf-387882013ba9 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:27.465141 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6075-d0d1-4dd6-a46c-172301b0a3ef None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:27.483071 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cd432-740f-40eb-a39d-0a35a406369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:27.483917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd432-740f-40eb-a39d-0a35a406369a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:27.484301 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd432-740f-40eb-a39d-0a35a406369a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:27.484586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd432-740f-40eb-a39d-0a35a406369a None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:27.485333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cd432-740f-40eb-a39d-0a35a406369a None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:27.485645 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cd432-740f-40eb-a39d-0a35a406369a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:27.487082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cd432-740f-40eb-a39d-0a35a406369a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:27.501212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 324/657] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:27.501877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cd432-740f-40eb-a39d-0a35a406369a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:27.516382 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e45aaf-f22a-40bf-a21d-fd5b6dec4e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:27.517067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e45aaf-f22a-40bf-a21d-fd5b6dec4e79 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:27.517585 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e45aaf-f22a-40bf-a21d-fd5b6dec4e79 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:27.517934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e45aaf-f22a-40bf-a21d-fd5b6dec4e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:27.518868 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e45aaf-f22a-40bf-a21d-fd5b6dec4e79 None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=7a36f250f3d04faab08146d937ef840e) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:27.519374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e45aaf-f22a-40bf-a21d-fd5b6dec4e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:27.520978 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e45aaf-f22a-40bf-a21d-fd5b6dec4e79 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:27.529130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 334/658] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:27 2022] GET /identity/v3/role_assignments?user.id=7a36f250f3d04faab08146d937ef840e&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:27.529956 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e45aaf-f22a-40bf-a21d-fd5b6dec4e79 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:27.572744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:27.637844 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cd432-740f-40eb-a39d-0a35a406369a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:27.654242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e45aaf-f22a-40bf-a21d-fd5b6dec4e79 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:27.675674 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226438de-aef7-4cea-8957-23169c576822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:27.676505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226438de-aef7-4cea-8957-23169c576822 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:27.676791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226438de-aef7-4cea-8957-23169c576822 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:27.677069 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226438de-aef7-4cea-8957-23169c576822 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:27.687215 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226438de-aef7-4cea-8957-23169c576822 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:27.688735 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226438de-aef7-4cea-8957-23169c576822 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:27.696458 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5053994-6432-4ce0-8aa2-2317cc3bc8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:27.697479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5053994-6432-4ce0-8aa2-2317cc3bc8cd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:27.697963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5053994-6432-4ce0-8aa2-2317cc3bc8cd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:27.698466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5053994-6432-4ce0-8aa2-2317cc3bc8cd None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:27.700084 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5053994-6432-4ce0-8aa2-2317cc3bc8cd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:27.700620 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5053994-6432-4ce0-8aa2-2317cc3bc8cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:27.702311 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5053994-6432-4ce0-8aa2-2317cc3bc8cd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-226438de-aef7-4cea-8957-23169c576822 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:27.705277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:27.706588 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 325/659] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:27.707810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226438de-aef7-4cea-8957-23169c576822 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:27.726229 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:27.734511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 335/660] 10.222.0.89 () {56 vars in 1137 bytes} [Thu May 19 20:46:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:27.736026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617731a6-c7f5-4fef-9dce-60140f324213 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:27.738651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617731a6-c7f5-4fef-9dce-60140f324213 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:27.738651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617731a6-c7f5-4fef-9dce-60140f324213 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:27.738651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 336/661] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:27.738651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617731a6-c7f5-4fef-9dce-60140f324213 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:27.837584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226438de-aef7-4cea-8957-23169c576822 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:27.851540 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:27.861537 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617731a6-c7f5-4fef-9dce-60140f324213 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:27.878729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e0adc-93c2-4af5-bd16-772eaba2f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:27.880664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0adc-93c2-4af5-bd16-772eaba2f8f5 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:27.881046 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0adc-93c2-4af5-bd16-772eaba2f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:27.881532 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0adc-93c2-4af5-bd16-772eaba2f8f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:27.891433 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e0adc-93c2-4af5-bd16-772eaba2f8f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:27.893156 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e0adc-93c2-4af5-bd16-772eaba2f8f5 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:27.898568 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a204ed4-f551-46a6-badb-f4bd62e2593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:27.899295 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a204ed4-f551-46a6-badb-f4bd62e2593b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:27.899580 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a204ed4-f551-46a6-badb-f4bd62e2593b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:27.899976 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a204ed4-f551-46a6-badb-f4bd62e2593b None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:27.900839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a204ed4-f551-46a6-badb-f4bd62e2593b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:27.901529 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a204ed4-f551-46a6-badb-f4bd62e2593b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:27.903550 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a204ed4-f551-46a6-badb-f4bd62e2593b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:27.924617 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 337/662] 10.222.0.89 () {56 vars in 1139 bytes} [Thu May 19 20:46:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:27.925601 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a204ed4-f551-46a6-badb-f4bd62e2593b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-229e0adc-93c2-4af5-bd16-772eaba2f8f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:28.033985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:28.035289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:28.036537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:28.036537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:28.036537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:28.036537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:28.036537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:28.036537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:28.036537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:28.036537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:28.038712 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 326/663] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:28.040099 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f1b4d-76bf-41be-939d-13724794ff7b None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:28.040382 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f1b4d-76bf-41be-939d-13724794ff7b None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:28.040661 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f1b4d-76bf-41be-939d-13724794ff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:28.047133 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a204ed4-f551-46a6-badb-f4bd62e2593b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:28.065904 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-a27f1b4d-76bf-41be-939d-13724794ff7b None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:28.067157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-a27f1b4d-76bf-41be-939d-13724794ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:28.089085 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607c266-d0ac-4ba4-a8f4-dc6d64662bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:28.089792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607c266-d0ac-4ba4-a8f4-dc6d64662bd1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:28.090003 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607c266-d0ac-4ba4-a8f4-dc6d64662bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:28.090258 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607c266-d0ac-4ba4-a8f4-dc6d64662bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:28.111812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:28.145631 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 327/664] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:28.145631 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f1b4d-76bf-41be-939d-13724794ff7b None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:28.145631 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:28.176266 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607c266-d0ac-4ba4-a8f4-dc6d64662bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:28.178113 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607c266-d0ac-4ba4-a8f4-dc6d64662bd1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:28.255259 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f1b4d-76bf-41be-939d-13724794ff7b None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:28.292052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee86758-2300-4c4d-bca2-571ed3ada6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:28.293241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86758-2300-4c4d-bca2-571ed3ada6cf None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:28.293524 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86758-2300-4c4d-bca2-571ed3ada6cf None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:28.293796 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86758-2300-4c4d-bca2-571ed3ada6cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:28.306399 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 338/665] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:28.306399 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607c266-d0ac-4ba4-a8f4-dc6d64662bd1 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:28.357792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:28.370716 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee86758-2300-4c4d-bca2-571ed3ada6cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:28.372863 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee86758-2300-4c4d-bca2-571ed3ada6cf None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:28.375133 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:28.410352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607c266-d0ac-4ba4-a8f4-dc6d64662bd1 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:28.452674 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297630b0-4ea1-4d22-ae39-5a61be2f93de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:28.453361 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297630b0-4ea1-4d22-ae39-5a61be2f93de None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:28.453651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297630b0-4ea1-4d22-ae39-5a61be2f93de None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:28.454302 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297630b0-4ea1-4d22-ae39-5a61be2f93de None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:28.455139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297630b0-4ea1-4d22-ae39-5a61be2f93de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:28.455780 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297630b0-4ea1-4d22-ae39-5a61be2f93de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:28.457545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297630b0-4ea1-4d22-ae39-5a61be2f93de None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:28.478109 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 339/666] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:28.478109 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297630b0-4ea1-4d22-ae39-5a61be2f93de None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:28.478414 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 328/667] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:28.479448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee86758-2300-4c4d-bca2-571ed3ada6cf None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:28.591894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297630b0-4ea1-4d22-ae39-5a61be2f93de None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:28.599915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee86758-2300-4c4d-bca2-571ed3ada6cf None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:28.601597 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:28.604527 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:28.638471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791a261-94a6-4469-a7b2-ba28c56c70cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:28.638471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791a261-94a6-4469-a7b2-ba28c56c70cb None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:28.638471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791a261-94a6-4469-a7b2-ba28c56c70cb None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:28.638471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791a261-94a6-4469-a7b2-ba28c56c70cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:28.640650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e21380-6c64-4e7b-966d-9feb6d4627e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:28.641456 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e21380-6c64-4e7b-966d-9feb6d4627e3 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:28.641742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e21380-6c64-4e7b-966d-9feb6d4627e3 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:28.642019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e21380-6c64-4e7b-966d-9feb6d4627e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:28.650263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791a261-94a6-4469-a7b2-ba28c56c70cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:28.654142 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e21380-6c64-4e7b-966d-9feb6d4627e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:28.655624 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e21380-6c64-4e7b-966d-9feb6d4627e3 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-7791a261-94a6-4469-a7b2-ba28c56c70cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:28.658772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:28.665511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 340/668] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:28.666511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791a261-94a6-4469-a7b2-ba28c56c70cb None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-94e21380-6c64-4e7b-966d-9feb6d4627e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:28.680768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:28.682122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:28.683386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:28.683386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:28.683386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:28.683386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:28.683386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 329/669] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:28.683386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e21380-6c64-4e7b-966d-9feb6d4627e3 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:28.781776 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791a261-94a6-4469-a7b2-ba28c56c70cb None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:28.792289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e21380-6c64-4e7b-966d-9feb6d4627e3 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:28.826230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11cfe7-bbbb-49b7-a4d2-7eee4d550088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:28.826950 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11cfe7-bbbb-49b7-a4d2-7eee4d550088 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:28.827222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11cfe7-bbbb-49b7-a4d2-7eee4d550088 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:28.827506 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11cfe7-bbbb-49b7-a4d2-7eee4d550088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:28.828387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11cfe7-bbbb-49b7-a4d2-7eee4d550088 None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=a25e781a47a44801932d5fc4384de045) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:28.828710 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11cfe7-bbbb-49b7-a4d2-7eee4d550088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:28.830199 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11cfe7-bbbb-49b7-a4d2-7eee4d550088 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:28.833055 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3822f-f28c-4cff-92dd-d88f34f82974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:28.834884 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3822f-f28c-4cff-92dd-d88f34f82974 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:28.835423 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3822f-f28c-4cff-92dd-d88f34f82974 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:28.835869 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3822f-f28c-4cff-92dd-d88f34f82974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:28.836983 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 341/670] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:28 2022] GET /identity/v3/role_assignments?user.id=a25e781a47a44801932d5fc4384de045&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:28.837807 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11cfe7-bbbb-49b7-a4d2-7eee4d550088 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:28.859428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3822f-f28c-4cff-92dd-d88f34f82974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:28.861272 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3822f-f28c-4cff-92dd-d88f34f82974 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-c1f3822f-f28c-4cff-92dd-d88f34f82974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:28.882590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:28.883912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:28.885170 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:28.885170 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:28.885170 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:28.885170 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:28.891976 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 330/671] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:28.893128 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3822f-f28c-4cff-92dd-d88f34f82974 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:28.895328 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:28.904767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:28.975423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11cfe7-bbbb-49b7-a4d2-7eee4d550088 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:29.020166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe70c9-d5b4-466f-acde-64d718eae0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:29.021288 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe70c9-d5b4-466f-acde-64d718eae0af None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:29.021817 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe70c9-d5b4-466f-acde-64d718eae0af None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:29.022413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe70c9-d5b4-466f-acde-64d718eae0af None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:29.023434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe70c9-d5b4-466f-acde-64d718eae0af None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:29.023991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe70c9-d5b4-466f-acde-64d718eae0af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:29.025598 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe70c9-d5b4-466f-acde-64d718eae0af None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:29.035233 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3822f-f28c-4cff-92dd-d88f34f82974 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:29.035865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 342/672] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:29.036953 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe70c9-d5b4-466f-acde-64d718eae0af None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:29.089181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ae8a1-dd86-4edf-b24d-cd51c11d581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:29.090707 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ae8a1-dd86-4edf-b24d-cd51c11d581b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:29.090825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ae8a1-dd86-4edf-b24d-cd51c11d581b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:29.091017 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ae8a1-dd86-4edf-b24d-cd51c11d581b None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:29.091755 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ae8a1-dd86-4edf-b24d-cd51c11d581b None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:29.092068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ae8a1-dd86-4edf-b24d-cd51c11d581b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:29.093451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ae8a1-dd86-4edf-b24d-cd51c11d581b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:29.113908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 331/673] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:29.114917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ae8a1-dd86-4edf-b24d-cd51c11d581b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:29.172198 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:29.178525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe70c9-d5b4-466f-acde-64d718eae0af None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:29.215302 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:29.227750 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd474-6766-48c8-b616-cc4e39807b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:29.228534 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd474-6766-48c8-b616-cc4e39807b05 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:29.229344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd474-6766-48c8-b616-cc4e39807b05 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:29.229712 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd474-6766-48c8-b616-cc4e39807b05 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:29.230902 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefd474-6766-48c8-b616-cc4e39807b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:29.231293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefd474-6766-48c8-b616-cc4e39807b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:29.233674 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefd474-6766-48c8-b616-cc4e39807b05 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:29.240974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ae8a1-dd86-4edf-b24d-cd51c11d581b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:29.250991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 343/674] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:29.254862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd474-6766-48c8-b616-cc4e39807b05 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:29.287382 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d6114-a4d8-4cb0-9625-91c0fd02af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:29.288240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d6114-a4d8-4cb0-9625-91c0fd02af46 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:29.288543 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d6114-a4d8-4cb0-9625-91c0fd02af46 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:29.288801 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d6114-a4d8-4cb0-9625-91c0fd02af46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:29.300867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d6114-a4d8-4cb0-9625-91c0fd02af46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:29.302333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d6114-a4d8-4cb0-9625-91c0fd02af46 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-8b6d6114-a4d8-4cb0-9625-91c0fd02af46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:29.321704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:29.322838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:29.324432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:29.324432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:29.324432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:29.324432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:29.324432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 332/675] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:29.324771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d6114-a4d8-4cb0-9625-91c0fd02af46 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:29.394274 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd474-6766-48c8-b616-cc4e39807b05 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:29.439421 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d6114-a4d8-4cb0-9625-91c0fd02af46 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:29.441785 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58678c-ee1f-4d01-baa8-42e5a7b3dc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:29.443478 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58678c-ee1f-4d01-baa8-42e5a7b3dc8b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:29.443760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58678c-ee1f-4d01-baa8-42e5a7b3dc8b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:29.444036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58678c-ee1f-4d01-baa8-42e5a7b3dc8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:29.455638 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58678c-ee1f-4d01-baa8-42e5a7b3dc8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:29.458207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58678c-ee1f-4d01-baa8-42e5a7b3dc8b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:29.459805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-fa58678c-ee1f-4d01-baa8-42e5a7b3dc8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:29.478309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:29.479436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:29.481078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:29.481078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:29.481078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:29.481078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:29.481078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:29.481078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:29.481078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:29.481078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:29.481576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d351ad-4723-45f0-a454-38a1641a968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:29.481576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d351ad-4723-45f0-a454-38a1641a968a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:29.481576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d351ad-4723-45f0-a454-38a1641a968a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:29.481576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d351ad-4723-45f0-a454-38a1641a968a None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:29.484331 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 344/676] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:29.485410 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58678c-ee1f-4d01-baa8-42e5a7b3dc8b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:29.490395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d351ad-4723-45f0-a454-38a1641a968a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:29.492657 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d351ad-4723-45f0-a454-38a1641a968a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:29.511913 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-e5d351ad-4723-45f0-a454-38a1641a968a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:29.514473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:29.515545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:29.516563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:29.516563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:29.516563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:29.516563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:29.516563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:29.516563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:29.516563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:29.516563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:29.519594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 333/677] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:29.521214 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d351ad-4723-45f0-a454-38a1641a968a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:29.601231 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58678c-ee1f-4d01-baa8-42e5a7b3dc8b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:29.640810 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec92c-ac78-40ef-95b7-e70e7815f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:29.641483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec92c-ac78-40ef-95b7-e70e7815f879 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:29.642083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec92c-ac78-40ef-95b7-e70e7815f879 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:29.642224 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec92c-ac78-40ef-95b7-e70e7815f879 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:29.642923 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec92c-ac78-40ef-95b7-e70e7815f879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:29.643240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec92c-ac78-40ef-95b7-e70e7815f879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:29.644613 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec92c-ac78-40ef-95b7-e70e7815f879 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:29.660387 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d351ad-4723-45f0-a454-38a1641a968a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:29.671812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 345/678] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:29.671812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec92c-ac78-40ef-95b7-e70e7815f879 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:29.718623 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adb5c5-7b2c-48f7-a72a-2be73e0a6d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:29.719899 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb5c5-7b2c-48f7-a72a-2be73e0a6d79 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:29.720413 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb5c5-7b2c-48f7-a72a-2be73e0a6d79 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:29.721911 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb5c5-7b2c-48f7-a72a-2be73e0a6d79 None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:29.722994 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adb5c5-7b2c-48f7-a72a-2be73e0a6d79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:29.723479 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adb5c5-7b2c-48f7-a72a-2be73e0a6d79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:29.725180 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adb5c5-7b2c-48f7-a72a-2be73e0a6d79 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:29.744158 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 334/679] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:29.745582 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adb5c5-7b2c-48f7-a72a-2be73e0a6d79 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:29.771104 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:29.795863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec92c-ac78-40ef-95b7-e70e7815f879 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:29.807740 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:29.835102 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb15e80-d68a-4b70-bb1f-230b6d26e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:29.835939 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb15e80-d68a-4b70-bb1f-230b6d26e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:29.836287 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb15e80-d68a-4b70-bb1f-230b6d26e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:29.836854 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb15e80-d68a-4b70-bb1f-230b6d26e7b6 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:29.837575 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb15e80-d68a-4b70-bb1f-230b6d26e7b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:29.838076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb15e80-d68a-4b70-bb1f-230b6d26e7b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:29.840119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb15e80-d68a-4b70-bb1f-230b6d26e7b6 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:29.853460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 346/680] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:29.854359 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb15e80-d68a-4b70-bb1f-230b6d26e7b6 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:29.881601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adb5c5-7b2c-48f7-a72a-2be73e0a6d79 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:29.919295 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c8f84-35e2-4a2d-a77c-2508c2bc734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:29.920410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c8f84-35e2-4a2d-a77c-2508c2bc734a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:29.920701 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c8f84-35e2-4a2d-a77c-2508c2bc734a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:29.920981 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c8f84-35e2-4a2d-a77c-2508c2bc734a None admin] PATH_INFO: `/v3/users/swift` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:29.928453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c8f84-35e2-4a2d-a77c-2508c2bc734a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:29.929891 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c8f84-35e2-4a2d-a77c-2508c2bc734a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-d97c8f84-35e2-4a2d-a77c-2508c2bc734a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:29.944905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:29.946034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 335/681] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:29.947151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c8f84-35e2-4a2d-a77c-2508c2bc734a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:29.972280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb15e80-d68a-4b70-bb1f-230b6d26e7b6 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:30.010352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99286dc2-2455-497e-8564-f362a0b5fb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:30.011062 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286dc2-2455-497e-8564-f362a0b5fb31 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:30.011928 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286dc2-2455-497e-8564-f362a0b5fb31 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:30.012212 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286dc2-2455-497e-8564-f362a0b5fb31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:30.013070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99286dc2-2455-497e-8564-f362a0b5fb31 None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=359041f2d03f4e499f3964ac1ddce468) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:30.013388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99286dc2-2455-497e-8564-f362a0b5fb31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:30.015141 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99286dc2-2455-497e-8564-f362a0b5fb31 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:30.018862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:30.030640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 347/682] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:29 2022] GET /identity/v3/role_assignments?user.id=359041f2d03f4e499f3964ac1ddce468&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:30.030640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a831da-c92a-4a56-8732-ad2f38718c6d None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:30.030640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a831da-c92a-4a56-8732-ad2f38718c6d None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:30.030640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a831da-c92a-4a56-8732-ad2f38718c6d None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:30.030640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 348/683] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:30.030640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a831da-c92a-4a56-8732-ad2f38718c6d None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:30.105892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:30.112086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c8f84-35e2-4a2d-a77c-2508c2bc734a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:30.155680 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620969e-0827-4de7-9728-3c3d3149d295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:30.156548 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620969e-0827-4de7-9728-3c3d3149d295 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:30.156930 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620969e-0827-4de7-9728-3c3d3149d295 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:30.157337 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620969e-0827-4de7-9728-3c3d3149d295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:30.158397 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620969e-0827-4de7-9728-3c3d3149d295 None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=68547d17dd4546469230112f91a48764) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:30.158946 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620969e-0827-4de7-9728-3c3d3149d295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:30.160589 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620969e-0827-4de7-9728-3c3d3149d295 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:30.170522 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a831da-c92a-4a56-8732-ad2f38718c6d None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:30.175314 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 336/684] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:29 2022] GET /identity/v3/role_assignments?user.id=68547d17dd4546469230112f91a48764&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:30.176974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22721a82-e501-45b2-b5bb-c31d611cd771 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:30.177262 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22721a82-e501-45b2-b5bb-c31d611cd771 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:30.177541 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22721a82-e501-45b2-b5bb-c31d611cd771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:30.211710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-22721a82-e501-45b2-b5bb-c31d611cd771 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:30.213071 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-22721a82-e501-45b2-b5bb-c31d611cd771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:30.248230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84b2ee-f39a-4240-a8b8-cdba84e465b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:30.249419 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84b2ee-f39a-4240-a8b8-cdba84e465b1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:30.250812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84b2ee-f39a-4240-a8b8-cdba84e465b1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:30.251369 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84b2ee-f39a-4240-a8b8-cdba84e465b1 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:30.252801 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84b2ee-f39a-4240-a8b8-cdba84e465b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:30.253375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84b2ee-f39a-4240-a8b8-cdba84e465b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:30.255274 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84b2ee-f39a-4240-a8b8-cdba84e465b1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:30.287587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 349/685] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:46:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:30.293254 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84b2ee-f39a-4240-a8b8-cdba84e465b1 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:30.314807 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 337/686] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:30.347890 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22721a82-e501-45b2-b5bb-c31d611cd771 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:30.396192 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:30.446171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84b2ee-f39a-4240-a8b8-cdba84e465b1 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:30.465633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:30.475535 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22721a82-e501-45b2-b5bb-c31d611cd771 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:30.484361 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b3f7d-f886-4bb6-93e5-3697a913a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:30.485036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b3f7d-f886-4bb6-93e5-3697a913a6aa None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:30.485322 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b3f7d-f886-4bb6-93e5-3697a913a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:30.485599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b3f7d-f886-4bb6-93e5-3697a913a6aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:30.513582 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe181924-af59-47bb-aa24-8420d5eed1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:30.514364 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe181924-af59-47bb-aa24-8420d5eed1f4 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:30.514690 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe181924-af59-47bb-aa24-8420d5eed1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:30.515019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe181924-af59-47bb-aa24-8420d5eed1f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:30.526804 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe181924-af59-47bb-aa24-8420d5eed1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-fe181924-af59-47bb-aa24-8420d5eed1f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:30.535688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:30.536800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:30.537760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 338/687] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:30.549997 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe181924-af59-47bb-aa24-8420d5eed1f4 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:30.568579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b3f7d-f886-4bb6-93e5-3697a913a6aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:30.570054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b3f7d-f886-4bb6-93e5-3697a913a6aa None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:30.638638 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:30.670551 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe181924-af59-47bb-aa24-8420d5eed1f4 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:30.689847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 350/688] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:30.695707 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b3f7d-f886-4bb6-93e5-3697a913a6aa None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:30.710431 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8a235-a0a9-479c-b7c3-decc94b2e0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:30.710431 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8a235-a0a9-479c-b7c3-decc94b2e0c6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:30.710431 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8a235-a0a9-479c-b7c3-decc94b2e0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:30.710431 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8a235-a0a9-479c-b7c3-decc94b2e0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:30.710922 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8a235-a0a9-479c-b7c3-decc94b2e0c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:30.710922 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8a235-a0a9-479c-b7c3-decc94b2e0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:30.710922 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8a235-a0a9-479c-b7c3-decc94b2e0c6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:30.722349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 339/689] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:30.727803 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8a235-a0a9-479c-b7c3-decc94b2e0c6 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:30.753740 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:30.878587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b3f7d-f886-4bb6-93e5-3697a913a6aa None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:30.922435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8a235-a0a9-479c-b7c3-decc94b2e0c6 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:30.943477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d2826-c829-4afc-8399-e97080132d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:30.944284 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d2826-c829-4afc-8399-e97080132d30 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:30.944567 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d2826-c829-4afc-8399-e97080132d30 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:30.944843 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d2826-c829-4afc-8399-e97080132d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:30.970084 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcad24-d195-4473-beed-2280c852c97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:30.970950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcad24-d195-4473-beed-2280c852c97a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:30.971227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcad24-d195-4473-beed-2280c852c97a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:30.971562 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcad24-d195-4473-beed-2280c852c97a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:30.972308 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d2826-c829-4afc-8399-e97080132d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:30.974020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d2826-c829-4afc-8399-e97080132d30 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-438d2826-c829-4afc-8399-e97080132d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:30.993344 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:30.994432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:30.996134 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:30.996134 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:30.996134 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:30.996134 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:30.998473 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 351/690] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:31.000758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcad24-d195-4473-beed-2280c852c97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:31.002232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcad24-d195-4473-beed-2280c852c97a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:31.003668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d2826-c829-4afc-8399-e97080132d30 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:31.042236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-06dcad24-d195-4473-beed-2280c852c97a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:31.046634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:31.047835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:31.048836 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:31.048836 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:31.048836 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:31.048836 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:31.050155 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 340/691] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:31.054633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcad24-d195-4473-beed-2280c852c97a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:31.189930 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:31.230746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d2826-c829-4afc-8399-e97080132d30 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:31.259349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcad24-d195-4473-beed-2280c852c97a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:31.284196 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344d874-f34c-43ea-abf9-411962700c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:31.284971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344d874-f34c-43ea-abf9-411962700c92 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:31.285264 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344d874-f34c-43ea-abf9-411962700c92 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:31.285596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344d874-f34c-43ea-abf9-411962700c92 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:31.286368 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344d874-f34c-43ea-abf9-411962700c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:31.286711 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344d874-f34c-43ea-abf9-411962700c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:31.288165 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344d874-f34c-43ea-abf9-411962700c92 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:31.315982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 352/692] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:31.323696 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344d874-f34c-43ea-abf9-411962700c92 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:31.324140 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e53a0e-0c0c-42ef-b615-13e26401ade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:31.324813 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e53a0e-0c0c-42ef-b615-13e26401ade6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:31.325101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e53a0e-0c0c-42ef-b615-13e26401ade6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:31.325379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e53a0e-0c0c-42ef-b615-13e26401ade6 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:31.326119 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e53a0e-0c0c-42ef-b615-13e26401ade6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:31.326428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e53a0e-0c0c-42ef-b615-13e26401ade6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:31.327845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e53a0e-0c0c-42ef-b615-13e26401ade6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:31.342587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 341/693] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:31.347623 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e53a0e-0c0c-42ef-b615-13e26401ade6 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:31.460836 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e53a0e-0c0c-42ef-b615-13e26401ade6 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:31.492676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:31.502741 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf257e3c-1241-4852-bb41-6da358621b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:31.503711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257e3c-1241-4852-bb41-6da358621b23 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:31.504279 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257e3c-1241-4852-bb41-6da358621b23 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:31.504426 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257e3c-1241-4852-bb41-6da358621b23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:31.512382 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf257e3c-1241-4852-bb41-6da358621b23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:31.514069 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf257e3c-1241-4852-bb41-6da358621b23 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:31.523051 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-cf257e3c-1241-4852-bb41-6da358621b23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:31.530445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:31.531825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:31.533086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:31.533086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:31.533086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:31.533086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:31.533086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:31.533086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:31.533086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:31.533086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:31.533086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:31.533086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:31.538892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 342/694] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:46:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:31.540505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c65b57-5fd4-42c9-bdf7-ec0940b8717e None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:31.540788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c65b57-5fd4-42c9-bdf7-ec0940b8717e None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:31.541063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c65b57-5fd4-42c9-bdf7-ec0940b8717e None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:31.542943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 343/695] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:31.547347 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c65b57-5fd4-42c9-bdf7-ec0940b8717e None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:31.570441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344d874-f34c-43ea-abf9-411962700c92 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:31.627259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38043b9f-408a-4ce8-8141-3a76edfa7233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:31.628157 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38043b9f-408a-4ce8-8141-3a76edfa7233 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:31.628718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38043b9f-408a-4ce8-8141-3a76edfa7233 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:31.629049 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38043b9f-408a-4ce8-8141-3a76edfa7233 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:31.639437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38043b9f-408a-4ce8-8141-3a76edfa7233 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:31.641427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38043b9f-408a-4ce8-8141-3a76edfa7233 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-38043b9f-408a-4ce8-8141-3a76edfa7233 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:31.663167 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:31.664223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:31.665251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:31.665251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:31.665251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:31.665251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:31.665251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:31.665251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:31.665251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:31.665251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:31.670374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 353/696] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:31.671982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258861c-f639-40cb-a805-6e299964a673 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:31.672270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258861c-f639-40cb-a805-6e299964a673 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:31.672549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258861c-f639-40cb-a805-6e299964a673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:31.675528 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c65b57-5fd4-42c9-bdf7-ec0940b8717e None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:31.694472 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-8258861c-f639-40cb-a805-6e299964a673 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:31.696394 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-8258861c-f639-40cb-a805-6e299964a673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:31.715180 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a77cc-130a-4283-95ca-1eedcb87b6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:31.716314 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a77cc-130a-4283-95ca-1eedcb87b6dd None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:31.716818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a77cc-130a-4283-95ca-1eedcb87b6dd None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:31.717303 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a77cc-130a-4283-95ca-1eedcb87b6dd None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:31.718427 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a77cc-130a-4283-95ca-1eedcb87b6dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:31.719000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a77cc-130a-4283-95ca-1eedcb87b6dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:31.720679 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a77cc-130a-4283-95ca-1eedcb87b6dd None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:31.745406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 344/697] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:46:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:31.745406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a77cc-130a-4283-95ca-1eedcb87b6dd None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:31.797470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 354/698] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:31.797470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258861c-f639-40cb-a805-6e299964a673 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:31.810928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:31.870861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:31.883229 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a77cc-130a-4283-95ca-1eedcb87b6dd None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:31.921824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e704c-7d3d-4911-a467-77bcdee3b222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:31.922956 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e704c-7d3d-4911-a467-77bcdee3b222 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:31.923459 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e704c-7d3d-4911-a467-77bcdee3b222 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:31.923949 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e704c-7d3d-4911-a467-77bcdee3b222 None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:31.924765 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258861c-f639-40cb-a805-6e299964a673 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:31.925217 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e704c-7d3d-4911-a467-77bcdee3b222 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:31.925737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e704c-7d3d-4911-a467-77bcdee3b222 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:31.927649 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e704c-7d3d-4911-a467-77bcdee3b222 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:31.944486 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 345/699] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:31.945705 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e704c-7d3d-4911-a467-77bcdee3b222 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:31.965273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf7f3-d9a8-4de6-acd8-40f1ce050899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:31.966371 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf7f3-d9a8-4de6-acd8-40f1ce050899 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:31.966902 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf7f3-d9a8-4de6-acd8-40f1ce050899 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:31.967425 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf7f3-d9a8-4de6-acd8-40f1ce050899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:32.041458 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf7f3-d9a8-4de6-acd8-40f1ce050899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:32.043377 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf7f3-d9a8-4de6-acd8-40f1ce050899 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:32.088245 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e704c-7d3d-4911-a467-77bcdee3b222 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:32.091861 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:32.112946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:32.138724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1deed36-1b17-477c-b404-d30ea27b7889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:32.139829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1deed36-1b17-477c-b404-d30ea27b7889 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:32.140340 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1deed36-1b17-477c-b404-d30ea27b7889 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:32.140630 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1deed36-1b17-477c-b404-d30ea27b7889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:32.156393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1deed36-1b17-477c-b404-d30ea27b7889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:32.158540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1deed36-1b17-477c-b404-d30ea27b7889 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:32.169960 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 355/700] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:32.171285 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf7f3-d9a8-4de6-acd8-40f1ce050899 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-e1deed36-1b17-477c-b404-d30ea27b7889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:32.179681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:32.180760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:32.181802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:32.181802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:32.181802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:32.181802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:32.186224 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 346/701] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:32.187442 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1deed36-1b17-477c-b404-d30ea27b7889 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:32.309302 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1deed36-1b17-477c-b404-d30ea27b7889 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:32.309938 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf7f3-d9a8-4de6-acd8-40f1ce050899 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:32.348035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118201a-c877-433c-80e4-f2347f8264cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:32.348708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118201a-c877-433c-80e4-f2347f8264cf None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:32.349023 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118201a-c877-433c-80e4-f2347f8264cf None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:32.349427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118201a-c877-433c-80e4-f2347f8264cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:32.350415 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118201a-c877-433c-80e4-f2347f8264cf None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=aab1ecd7a8074c288ac9b70065e6efa2) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:32.350861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118201a-c877-433c-80e4-f2347f8264cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:32.352401 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118201a-c877-433c-80e4-f2347f8264cf None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:32.353129 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d83687-6a06-43fe-93f1-7c5648dd0667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:32.354180 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d83687-6a06-43fe-93f1-7c5648dd0667 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:32.354740 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d83687-6a06-43fe-93f1-7c5648dd0667 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:32.355798 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d83687-6a06-43fe-93f1-7c5648dd0667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:32.359925 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 356/702] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:32 2022] GET /identity/v3/role_assignments?user.id=aab1ecd7a8074c288ac9b70065e6efa2&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:32.360926 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118201a-c877-433c-80e4-f2347f8264cf None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:32.368556 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d83687-6a06-43fe-93f1-7c5648dd0667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:32.370510 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d83687-6a06-43fe-93f1-7c5648dd0667 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-b4d83687-6a06-43fe-93f1-7c5648dd0667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:32.389686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:32.391077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:32.392125 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:32.392125 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:32.392125 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:32.392125 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:32.392378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:32.394516 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 347/703] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:32.400643 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d83687-6a06-43fe-93f1-7c5648dd0667 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:32.427116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:32.569406 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118201a-c877-433c-80e4-f2347f8264cf None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:32.615068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d83687-6a06-43fe-93f1-7c5648dd0667 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:32.631061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129d155-b97f-44a1-9723-95f0bd9178fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:32.632142 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d155-b97f-44a1-9723-95f0bd9178fd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:32.632644 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d155-b97f-44a1-9723-95f0bd9178fd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:32.633130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d155-b97f-44a1-9723-95f0bd9178fd None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:32.634366 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129d155-b97f-44a1-9723-95f0bd9178fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:32.634946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129d155-b97f-44a1-9723-95f0bd9178fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:32.636378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129d155-b97f-44a1-9723-95f0bd9178fd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:32.654586 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 357/704] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:32.656019 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4962cb-b995-4bdd-b9e9-e067eb42b74c None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:32.656310 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4962cb-b995-4bdd-b9e9-e067eb42b74c None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:32.656591 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4962cb-b995-4bdd-b9e9-e067eb42b74c None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:32.658034 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 358/705] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:32.662620 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4962cb-b995-4bdd-b9e9-e067eb42b74c None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:32.664991 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86db7e-dcde-4a82-b1e8-e7d9ec94a4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:32.665675 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86db7e-dcde-4a82-b1e8-e7d9ec94a4ff None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:32.665956 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86db7e-dcde-4a82-b1e8-e7d9ec94a4ff None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:32.666650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86db7e-dcde-4a82-b1e8-e7d9ec94a4ff None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:32.667004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86db7e-dcde-4a82-b1e8-e7d9ec94a4ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:32.667345 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86db7e-dcde-4a82-b1e8-e7d9ec94a4ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:32.669270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86db7e-dcde-4a82-b1e8-e7d9ec94a4ff None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:32.687263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 348/706] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:32.688455 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaffe46-9443-49e9-b2a3-bf4096dc4093 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:32.688758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaffe46-9443-49e9-b2a3-bf4096dc4093 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:32.689018 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaffe46-9443-49e9-b2a3-bf4096dc4093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:32.708896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-4eaffe46-9443-49e9-b2a3-bf4096dc4093 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:32.711638 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-4eaffe46-9443-49e9-b2a3-bf4096dc4093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:32.783077 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:32.796048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4962cb-b995-4bdd-b9e9-e067eb42b74c None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:32.796289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 349/707] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:32.797032 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaffe46-9443-49e9-b2a3-bf4096dc4093 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:32.817919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:32.859528 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038c23b-5f20-43d0-8fb4-c31f79431ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:32.860251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c23b-5f20-43d0-8fb4-c31f79431ea9 None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:32.860531 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c23b-5f20-43d0-8fb4-c31f79431ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:32.860975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c23b-5f20-43d0-8fb4-c31f79431ea9 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:32.862021 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038c23b-5f20-43d0-8fb4-c31f79431ea9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:32.863540 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038c23b-5f20-43d0-8fb4-c31f79431ea9 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:32.916476 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaffe46-9443-49e9-b2a3-bf4096dc4093 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:32.950770 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 359/708] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:46:32 2022] POST /identity/v3/users => generated 254 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:46:32.951742 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038c23b-5f20-43d0-8fb4-c31f79431ea9 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:32.955823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b85884-8b45-4f3f-8b86-165f9ceb976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:32.956690 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b85884-8b45-4f3f-8b86-165f9ceb976c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:32.956972 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b85884-8b45-4f3f-8b86-165f9ceb976c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:32.957511 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b85884-8b45-4f3f-8b86-165f9ceb976c None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:32.967794 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b85884-8b45-4f3f-8b86-165f9ceb976c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:32.969474 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b85884-8b45-4f3f-8b86-165f9ceb976c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-38b85884-8b45-4f3f-8b86-165f9ceb976c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:32.988080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:32.989209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:32.990885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:32.990885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:32.990885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:32.990885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:32.990885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:32.990885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:32.990885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:32.990885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:32.990885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 350/709] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:32.997018 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b85884-8b45-4f3f-8b86-165f9ceb976c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:33.075088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:33.129357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b85884-8b45-4f3f-8b86-165f9ceb976c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:33.148189 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038c23b-5f20-43d0-8fb4-c31f79431ea9 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:33.180835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dc2f8-90b4-4eb2-b857-a3bbab8c4cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:33.182218 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dc2f8-90b4-4eb2-b857-a3bbab8c4cdd None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:33.183582 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dc2f8-90b4-4eb2-b857-a3bbab8c4cdd None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:33.183899 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dc2f8-90b4-4eb2-b857-a3bbab8c4cdd None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:33.184734 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49dc2f8-90b4-4eb2-b857-a3bbab8c4cdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:33.185309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49dc2f8-90b4-4eb2-b857-a3bbab8c4cdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:33.186853 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49dc2f8-90b4-4eb2-b857-a3bbab8c4cdd None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:33.193000 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e60798-34a7-4727-b961-523db3464a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:33.194181 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e60798-34a7-4727-b961-523db3464a57 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:33.195366 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e60798-34a7-4727-b961-523db3464a57 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:33.195868 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e60798-34a7-4727-b961-523db3464a57 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:33.196845 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e60798-34a7-4727-b961-523db3464a57 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:33.199776 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e60798-34a7-4727-b961-523db3464a57 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:33.208186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 351/710] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:33.209644 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724cadb-856d-4ae7-8b37-ca4d65d2ca57 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:33.209938 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724cadb-856d-4ae7-8b37-ca4d65d2ca57 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:33.210218 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724cadb-856d-4ae7-8b37-ca4d65d2ca57 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:33.211820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 352/711] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:33.212539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724cadb-856d-4ae7-8b37-ca4d65d2ca57 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-08e60798-34a7-4727-b961-523db3464a57 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:33.218320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:33.219570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:33.220560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 360/712] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 20:46:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:33.221536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5370-bb83-4364-bc83-a4a8a2b5ade5 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:33.221536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5370-bb83-4364-bc83-a4a8a2b5ade5 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:33.222690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5370-bb83-4364-bc83-a4a8a2b5ade5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:33.235690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:33.247013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-a8ce5370-bb83-4364-bc83-a4a8a2b5ade5 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:33.248244 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-a8ce5370-bb83-4364-bc83-a4a8a2b5ade5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:33.345504 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 361/713] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:33.345504 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5370-bb83-4364-bc83-a4a8a2b5ade5 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:33.346660 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724cadb-856d-4ae7-8b37-ca4d65d2ca57 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:33.387238 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:33.408599 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf63ad-e2f4-4775-8080-101b7c7cffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:33.409610 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf63ad-e2f4-4775-8080-101b7c7cffa1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:33.410077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf63ad-e2f4-4775-8080-101b7c7cffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:33.410560 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf63ad-e2f4-4775-8080-101b7c7cffa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:33.411738 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf63ad-e2f4-4775-8080-101b7c7cffa1 None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=7a36f250f3d04faab08146d937ef840e) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:33.412289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf63ad-e2f4-4775-8080-101b7c7cffa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:33.413898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf63ad-e2f4-4775-8080-101b7c7cffa1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:33.421423 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 353/714] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:33 2022] GET /identity/v3/role_assignments?user.id=7a36f250f3d04faab08146d937ef840e&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:33.422540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf63ad-e2f4-4775-8080-101b7c7cffa1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:33.498858 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5370-bb83-4364-bc83-a4a8a2b5ade5 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:33.538249 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf63ad-e2f4-4775-8080-101b7c7cffa1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:33.555672 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84577c8e-3380-4e24-8bb9-65a4250613a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:33.556434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84577c8e-3380-4e24-8bb9-65a4250613a0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:33.556652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84577c8e-3380-4e24-8bb9-65a4250613a0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:33.556922 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84577c8e-3380-4e24-8bb9-65a4250613a0 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:33.557658 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84577c8e-3380-4e24-8bb9-65a4250613a0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:33.558029 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84577c8e-3380-4e24-8bb9-65a4250613a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:33.559967 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84577c8e-3380-4e24-8bb9-65a4250613a0 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:33.561681 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:33.570128 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 362/715] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:46:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:33.585886 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84577c8e-3380-4e24-8bb9-65a4250613a0 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:33.591900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3a746-5a48-44e4-aeb1-34702feeafc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:33.593042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3a746-5a48-44e4-aeb1-34702feeafc1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:33.593541 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3a746-5a48-44e4-aeb1-34702feeafc1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:33.594111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3a746-5a48-44e4-aeb1-34702feeafc1 None admin] PATH_INFO: `/v3/services/network` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:33.599780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3a746-5a48-44e4-aeb1-34702feeafc1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:33.601536 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3a746-5a48-44e4-aeb1-34702feeafc1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-76c3a746-5a48-44e4-aeb1-34702feeafc1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:33.633682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:33.636727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:33.639135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 354/716] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:33 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:33.641364 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3a746-5a48-44e4-aeb1-34702feeafc1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:33.728903 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:33.777874 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84577c8e-3380-4e24-8bb9-65a4250613a0 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:33.826054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64eaa7e-05c7-4ce3-ab17-bfb9551e7295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:33.826776 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eaa7e-05c7-4ce3-ab17-bfb9551e7295 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:33.827064 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eaa7e-05c7-4ce3-ab17-bfb9551e7295 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:33.827342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eaa7e-05c7-4ce3-ab17-bfb9551e7295 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:33.828072 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64eaa7e-05c7-4ce3-ab17-bfb9551e7295 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:33.828387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64eaa7e-05c7-4ce3-ab17-bfb9551e7295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:33.829777 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64eaa7e-05c7-4ce3-ab17-bfb9551e7295 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:33.846102 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 363/717] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:46:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:33.852612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3a746-5a48-44e4-aeb1-34702feeafc1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:33.892181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54e08e-ac21-4d6e-8613-92c2d134d325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:33.892789 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e08e-ac21-4d6e-8613-92c2d134d325 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:33.893077 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e08e-ac21-4d6e-8613-92c2d134d325 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:33.893359 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e08e-ac21-4d6e-8613-92c2d134d325 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:33.894096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54e08e-ac21-4d6e-8613-92c2d134d325 None admin] RBAC: Adding query filter params (name=network) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:33.894409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54e08e-ac21-4d6e-8613-92c2d134d325 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:33.895955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54e08e-ac21-4d6e-8613-92c2d134d325 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:33.902302 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 355/718] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:46:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:33.907988 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64eaa7e-05c7-4ce3-ab17-bfb9551e7295 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:34.019027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:34.057802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64eaa7e-05c7-4ce3-ab17-bfb9551e7295 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:34.112888 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff5017-4b94-480d-91c1-187ff6f8577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:34.113591 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5017-4b94-480d-91c1-187ff6f8577c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:34.113879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5017-4b94-480d-91c1-187ff6f8577c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:34.114160 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5017-4b94-480d-91c1-187ff6f8577c None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:34.114924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5017-4b94-480d-91c1-187ff6f8577c None admin] RBAC: Adding query filter params (type=network) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:34.115240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5017-4b94-480d-91c1-187ff6f8577c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:34.116631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5017-4b94-480d-91c1-187ff6f8577c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:34.126766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 364/719] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:46:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:34.951654 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c460a39-e44f-460e-b88d-2d57715fa185 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:34.952487 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c460a39-e44f-460e-b88d-2d57715fa185 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:34.952487 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c460a39-e44f-460e-b88d-2d57715fa185 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:34.953975 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 356/720] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:34.959676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862fd2a-9ef1-463c-b2eb-1dba2495292a None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:34.960427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862fd2a-9ef1-463c-b2eb-1dba2495292a None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:34.960427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862fd2a-9ef1-463c-b2eb-1dba2495292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:34.978477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-f862fd2a-9ef1-463c-b2eb-1dba2495292a None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:34.979823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-f862fd2a-9ef1-463c-b2eb-1dba2495292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:35.077789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 365/721] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:35.101764 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c460a39-e44f-460e-b88d-2d57715fa185 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:35.220881 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c460a39-e44f-460e-b88d-2d57715fa185 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:35.232875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:35.257463 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb293d-feb5-484e-b81d-0d9f660f0aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:35.258280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb293d-feb5-484e-b81d-0d9f660f0aaf None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:35.258563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb293d-feb5-484e-b81d-0d9f660f0aaf None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:35.258872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb293d-feb5-484e-b81d-0d9f660f0aaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:35.271164 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb293d-feb5-484e-b81d-0d9f660f0aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-44eb293d-feb5-484e-b81d-0d9f660f0aaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:35.279820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:35.281788 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:35.287116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 357/722] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:35.288837 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862fd2a-9ef1-463c-b2eb-1dba2495292a None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:35.359055 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:35.411330 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862fd2a-9ef1-463c-b2eb-1dba2495292a None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:35.463580 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f665f4-8aaf-4077-9374-c8f5d0438139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:35.464301 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f665f4-8aaf-4077-9374-c8f5d0438139 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:35.464589 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f665f4-8aaf-4077-9374-c8f5d0438139 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:35.464872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f665f4-8aaf-4077-9374-c8f5d0438139 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:35.465702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f665f4-8aaf-4077-9374-c8f5d0438139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:35.466017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f665f4-8aaf-4077-9374-c8f5d0438139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:35.467472 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f665f4-8aaf-4077-9374-c8f5d0438139 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:35.477195 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 366/723] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:35.482704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb293d-feb5-484e-b81d-0d9f660f0aaf None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:35.600996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb293d-feb5-484e-b81d-0d9f660f0aaf None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:35.651033 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4867c4-c9dd-420d-8808-36514054b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:35.652385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4867c4-c9dd-420d-8808-36514054b83f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:35.652671 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4867c4-c9dd-420d-8808-36514054b83f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:35.652950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4867c4-c9dd-420d-8808-36514054b83f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:35.665979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4867c4-c9dd-420d-8808-36514054b83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:35.668114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4867c4-c9dd-420d-8808-36514054b83f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-7a4867c4-c9dd-420d-8808-36514054b83f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:35.688260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:35.689363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:35.690398 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:35.690398 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:35.690398 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:35.690398 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:35.690398 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 358/724] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:35.695887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f665f4-8aaf-4077-9374-c8f5d0438139 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:35.733737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35369-5664-4af3-a89d-07aba61a1492 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:35.733922 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35369-5664-4af3-a89d-07aba61a1492 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:35.734200 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35369-5664-4af3-a89d-07aba61a1492 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:35.735677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 359/725] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:35.742238 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d0d5-d869-443c-b542-e2d4c07ad827 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:35.742448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d0d5-d869-443c-b542-e2d4c07ad827 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:35.742716 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d0d5-d869-443c-b542-e2d4c07ad827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:35.779602 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-ce63d0d5-d869-443c-b542-e2d4c07ad827 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:35.786631 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-ce63d0d5-d869-443c-b542-e2d4c07ad827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:35.843390 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:35.962981 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 360/726] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:46:35.968784 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f665f4-8aaf-4077-9374-c8f5d0438139 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:36.007697 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63d0d5-d869-443c-b542-e2d4c07ad827 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:36.042568 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:36.066881 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97178ab-7d56-4884-97a7-a23f43d20ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:36.067625 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97178ab-7d56-4884-97a7-a23f43d20ccc None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:36.067914 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97178ab-7d56-4884-97a7-a23f43d20ccc None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:36.068187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97178ab-7d56-4884-97a7-a23f43d20ccc None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:36.068938 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97178ab-7d56-4884-97a7-a23f43d20ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:36.069242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97178ab-7d56-4884-97a7-a23f43d20ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:36.070681 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97178ab-7d56-4884-97a7-a23f43d20ccc None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:36.102811 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 367/727] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:36.106935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97178ab-7d56-4884-97a7-a23f43d20ccc None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:36.216217 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63d0d5-d869-443c-b542-e2d4c07ad827 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:36.288701 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1912-d18f-4222-a366-3bf6a767a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:36.290568 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1912-d18f-4222-a366-3bf6a767a259 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:36.290568 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1912-d18f-4222-a366-3bf6a767a259 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:36.290568 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1912-d18f-4222-a366-3bf6a767a259 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:36.331198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab1912-d18f-4222-a366-3bf6a767a259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:36.345487 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97178ab-7d56-4884-97a7-a23f43d20ccc None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-73ab1912-d18f-4222-a366-3bf6a767a259 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:36.354451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:36.364669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:36.365627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 361/728] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:36.372441 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1912-d18f-4222-a366-3bf6a767a259 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:36.422996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:36.474915 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95a78-76d5-4be9-95b2-68cfa680eb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:36.475738 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95a78-76d5-4be9-95b2-68cfa680eb7c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:36.476020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95a78-76d5-4be9-95b2-68cfa680eb7c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:36.476297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95a78-76d5-4be9-95b2-68cfa680eb7c None admin] PATH_INFO: `/v3/users/swift` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:36.509495 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae95a78-76d5-4be9-95b2-68cfa680eb7c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:36.511564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae95a78-76d5-4be9-95b2-68cfa680eb7c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-eae95a78-76d5-4be9-95b2-68cfa680eb7c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:36.540766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:36.541885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:36.543060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:36.543060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:36.543060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:36.543060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:36.543060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:36.543060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:36.543060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:36.543060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:36.543060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:36.543060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:36.543666 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 368/729] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:36.550574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f079097-3b73-4ea7-ba5f-3d0eda47f6d8 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:36.550879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f079097-3b73-4ea7-ba5f-3d0eda47f6d8 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:36.551172 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f079097-3b73-4ea7-ba5f-3d0eda47f6d8 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:36.559852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 369/730] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:36.561032 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f079097-3b73-4ea7-ba5f-3d0eda47f6d8 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:36.623459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:36.629998 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1912-d18f-4222-a366-3bf6a767a259 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:36.666587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe0f6f-cf98-4f9f-a231-ff8ace1ef517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:36.667324 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0f6f-cf98-4f9f-a231-ff8ace1ef517 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:36.667608 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0f6f-cf98-4f9f-a231-ff8ace1ef517 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:36.667887 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0f6f-cf98-4f9f-a231-ff8ace1ef517 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:36.668707 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe0f6f-cf98-4f9f-a231-ff8ace1ef517 None admin] RBAC: Adding query filter params (name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:36.669280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe0f6f-cf98-4f9f-a231-ff8ace1ef517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:36.670718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe0f6f-cf98-4f9f-a231-ff8ace1ef517 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:36.684780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 362/731] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:36.686599 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f62760-1299-492c-81b9-97b14898bde8 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:36.686910 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f62760-1299-492c-81b9-97b14898bde8 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:36.687186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f62760-1299-492c-81b9-97b14898bde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:36.697713 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f079097-3b73-4ea7-ba5f-3d0eda47f6d8 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:36.705733 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-a0f62760-1299-492c-81b9-97b14898bde8 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:36.706965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-a0f62760-1299-492c-81b9-97b14898bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:36.739326 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3cd7-a662-4c7c-b09c-496bca69395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:36.740430 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3cd7-a662-4c7c-b09c-496bca69395c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:36.740940 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3cd7-a662-4c7c-b09c-496bca69395c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:36.741470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3cd7-a662-4c7c-b09c-496bca69395c None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:36.742578 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3cd7-a662-4c7c-b09c-496bca69395c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:36.743149 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3cd7-a662-4c7c-b09c-496bca69395c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:36.744874 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3cd7-a662-4c7c-b09c-496bca69395c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:36.767506 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 370/732] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:46:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:36.768939 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3cd7-a662-4c7c-b09c-496bca69395c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:36.822713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 363/733] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:36.822713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f62760-1299-492c-81b9-97b14898bde8 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:36.822713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:36.895306 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:36.902588 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3cd7-a662-4c7c-b09c-496bca69395c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:36.935547 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f62760-1299-492c-81b9-97b14898bde8 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:36.944667 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984da0c-c931-40f9-aeee-7dca517417b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:36.945926 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984da0c-c931-40f9-aeee-7dca517417b2 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:36.946465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984da0c-c931-40f9-aeee-7dca517417b2 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:36.946999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984da0c-c931-40f9-aeee-7dca517417b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:36.960075 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984da0c-c931-40f9-aeee-7dca517417b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:36.961985 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984da0c-c931-40f9-aeee-7dca517417b2 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:36.978662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8b1c7-972e-4b3a-b8f0-e0a504e6a5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:36.979338 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b1c7-972e-4b3a-b8f0-e0a504e6a5ae None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:36.979614 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b1c7-972e-4b3a-b8f0-e0a504e6a5ae None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:36.981802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b1c7-972e-4b3a-b8f0-e0a504e6a5ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-5984da0c-c931-40f9-aeee-7dca517417b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:36.983470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:36.985708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:36.987318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:36.987318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:36.987318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:36.987318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:36.987318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 371/734] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:36.987318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984da0c-c931-40f9-aeee-7dca517417b2 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:37.081849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8b1c7-972e-4b3a-b8f0-e0a504e6a5ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:37.083699 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8b1c7-972e-4b3a-b8f0-e0a504e6a5ae None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:37.088277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:37.210967 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 364/735] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:46:37.212422 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667e63-5f3e-4182-a00b-e986bfac3a55 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.212708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667e63-5f3e-4182-a00b-e986bfac3a55 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.212992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667e63-5f3e-4182-a00b-e986bfac3a55 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.214330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 365/736] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:37.215097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f667e63-5f3e-4182-a00b-e986bfac3a55 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:37.237365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984da0c-c931-40f9-aeee-7dca517417b2 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:37.273304 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54561c-c5f8-4f97-a3b2-e26a3ac856bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:37.274109 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54561c-c5f8-4f97-a3b2-e26a3ac856bc None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.274390 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54561c-c5f8-4f97-a3b2-e26a3ac856bc None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.276257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54561c-c5f8-4f97-a3b2-e26a3ac856bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.287488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54561c-c5f8-4f97-a3b2-e26a3ac856bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-bf54561c-c5f8-4f97-a3b2-e26a3ac856bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:37.295927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:37.297179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:37.298263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 372/737] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:37.299088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9046d-66c5-460f-af75-0dc40f8cfdfb None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.299314 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9046d-66c5-460f-af75-0dc40f8cfdfb None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.299659 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9046d-66c5-460f-af75-0dc40f8cfdfb None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.300962 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 373/738] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:37.301669 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9046d-66c5-460f-af75-0dc40f8cfdfb None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:37.315196 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:37.328425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f667e63-5f3e-4182-a00b-e986bfac3a55 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:37.331258 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:37.367969 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a9c9e-4b28-4076-b6ae-b39f32c95283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:37.371151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a9c9e-4b28-4076-b6ae-b39f32c95283 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.371151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a9c9e-4b28-4076-b6ae-b39f32c95283 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.371151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a9c9e-4b28-4076-b6ae-b39f32c95283 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.371151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a9c9e-4b28-4076-b6ae-b39f32c95283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:37.371151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a9c9e-4b28-4076-b6ae-b39f32c95283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:37.372458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a9c9e-4b28-4076-b6ae-b39f32c95283 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:37.385240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 366/739] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:37.386824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8897c-ba0a-4c0c-94dd-b81019aa8b9f None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.387603 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8897c-ba0a-4c0c-94dd-b81019aa8b9f None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.388263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8897c-ba0a-4c0c-94dd-b81019aa8b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.406120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-69b8897c-ba0a-4c0c-94dd-b81019aa8b9f None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:37.407374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-69b8897c-ba0a-4c0c-94dd-b81019aa8b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:37.436706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9046d-66c5-460f-af75-0dc40f8cfdfb None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:37.476246 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbcaee-3807-4841-a0c1-fa0485ba2ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:37.477044 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbcaee-3807-4841-a0c1-fa0485ba2ded None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.477318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbcaee-3807-4841-a0c1-fa0485ba2ded None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.477594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbcaee-3807-4841-a0c1-fa0485ba2ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.483197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 367/740] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:37.484043 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8897c-ba0a-4c0c-94dd-b81019aa8b9f None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:37.489434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbcaee-3807-4841-a0c1-fa0485ba2ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:37.490957 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbcaee-3807-4841-a0c1-fa0485ba2ded None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-c9cbcaee-3807-4841-a0c1-fa0485ba2ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:37.514130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:37.515280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:37.516321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:37.516321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:37.516321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:37.516321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:37.516321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 374/741] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:37.517300 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c1a30-52b3-41c0-b257-9dfe0b19857b None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.517300 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c1a30-52b3-41c0-b257-9dfe0b19857b None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.517300 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c1a30-52b3-41c0-b257-9dfe0b19857b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.534329 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-f46c1a30-52b3-41c0-b257-9dfe0b19857b None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:37.535570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-f46c1a30-52b3-41c0-b257-9dfe0b19857b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:37.593619 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:37.594340 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:37.600545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8897c-ba0a-4c0c-94dd-b81019aa8b9f None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:37.605701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 375/742] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:46:37.606581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c1a30-52b3-41c0-b257-9dfe0b19857b None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:37.637214 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368041bf-a8c7-410d-b157-ad9217841f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:37.637780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368041bf-a8c7-410d-b157-ad9217841f60 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.638063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368041bf-a8c7-410d-b157-ad9217841f60 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.638342 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368041bf-a8c7-410d-b157-ad9217841f60 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.639127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368041bf-a8c7-410d-b157-ad9217841f60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:37.639440 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368041bf-a8c7-410d-b157-ad9217841f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:37.640837 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368041bf-a8c7-410d-b157-ad9217841f60 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:37.649975 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 368/743] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:37.650844 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368041bf-a8c7-410d-b157-ad9217841f60 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:37.711215 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c1a30-52b3-41c0-b257-9dfe0b19857b None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:37.746896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b756f-e151-4518-8d60-4fe91cd5c4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:37.747710 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b756f-e151-4518-8d60-4fe91cd5c4fd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.747994 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b756f-e151-4518-8d60-4fe91cd5c4fd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.748282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b756f-e151-4518-8d60-4fe91cd5c4fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.754058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368041bf-a8c7-410d-b157-ad9217841f60 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:37.755455 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b756f-e151-4518-8d60-4fe91cd5c4fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:37.756900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b756f-e151-4518-8d60-4fe91cd5c4fd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-044b756f-e151-4518-8d60-4fe91cd5c4fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:37.772447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:37.773645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 376/744] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:46:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:37.774986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b756f-e151-4518-8d60-4fe91cd5c4fd None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:37.792566 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32587ac5-bcd3-4a80-908b-27ac1bbd1d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:37.793237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32587ac5-bcd3-4a80-908b-27ac1bbd1d6c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.793522 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32587ac5-bcd3-4a80-908b-27ac1bbd1d6c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.793800 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32587ac5-bcd3-4a80-908b-27ac1bbd1d6c None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.794530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32587ac5-bcd3-4a80-908b-27ac1bbd1d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:37.794885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32587ac5-bcd3-4a80-908b-27ac1bbd1d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:37.796264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32587ac5-bcd3-4a80-908b-27ac1bbd1d6c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:37.808819 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 369/745] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:37.809612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32587ac5-bcd3-4a80-908b-27ac1bbd1d6c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:37.828251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:37.828605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:37.880081 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b756f-e151-4518-8d60-4fe91cd5c4fd None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:37.912153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32587ac5-bcd3-4a80-908b-27ac1bbd1d6c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:37.913975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641761c-0575-4cc3-b87b-bdfcaf785897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:37.914679 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641761c-0575-4cc3-b87b-bdfcaf785897 None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.914970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641761c-0575-4cc3-b87b-bdfcaf785897 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.915249 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641761c-0575-4cc3-b87b-bdfcaf785897 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.915984 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641761c-0575-4cc3-b87b-bdfcaf785897 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:37.917911 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641761c-0575-4cc3-b87b-bdfcaf785897 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:37.946261 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab2b1b-4a7f-42a8-8990-0798743c0435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:37.946956 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab2b1b-4a7f-42a8-8990-0798743c0435 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:37.947238 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab2b1b-4a7f-42a8-8990-0798743c0435 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:37.947511 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab2b1b-4a7f-42a8-8990-0798743c0435 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:37.948226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab2b1b-4a7f-42a8-8990-0798743c0435 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:37.950116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab2b1b-4a7f-42a8-8990-0798743c0435 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:38.016854 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 377/746] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:46:37 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:46:38.017722 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641761c-0575-4cc3-b87b-bdfcaf785897 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:38.052768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 370/747] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:46:37 2022] POST /identity/v3/services => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:46:38.053731 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab2b1b-4a7f-42a8-8990-0798743c0435 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:38.167310 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:38.193533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641761c-0575-4cc3-b87b-bdfcaf785897 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:38.204291 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:38.211009 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab2b1b-4a7f-42a8-8990-0798743c0435 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:38.250825 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a42ad-b20e-4523-8708-99a77a48e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:38.251672 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a42ad-b20e-4523-8708-99a77a48e29b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:38.251989 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a42ad-b20e-4523-8708-99a77a48e29b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:38.252236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a42ad-b20e-4523-8708-99a77a48e29b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:38.259758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d89d4-64c8-4ea0-b0e2-58230c809eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:38.261700 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d89d4-64c8-4ea0-b0e2-58230c809eb6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:38.266510 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d89d4-64c8-4ea0-b0e2-58230c809eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:38.266510 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d89d4-64c8-4ea0-b0e2-58230c809eb6 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:38.266510 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d89d4-64c8-4ea0-b0e2-58230c809eb6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:38.266510 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d89d4-64c8-4ea0-b0e2-58230c809eb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:38.266510 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d89d4-64c8-4ea0-b0e2-58230c809eb6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:38.266981 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a42ad-b20e-4523-8708-99a77a48e29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:38.267862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a42ad-b20e-4523-8708-99a77a48e29b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:38.291804 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 371/748] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:46:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:38.292950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d89d4-64c8-4ea0-b0e2-58230c809eb6 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-697a42ad-b20e-4523-8708-99a77a48e29b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:38.296333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:38.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:38.298935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:38.298935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:38.298935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:38.298935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:38.302819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 378/749] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:38.302819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a42ad-b20e-4523-8708-99a77a48e29b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:38.432465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d89d4-64c8-4ea0-b0e2-58230c809eb6 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:38.472877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:38.480642 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7f2b2-02dc-4cc5-9bc5-d3bbe6d770e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:38.481711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f2b2-02dc-4cc5-9bc5-d3bbe6d770e6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:38.482029 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f2b2-02dc-4cc5-9bc5-d3bbe6d770e6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:38.482291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f2b2-02dc-4cc5-9bc5-d3bbe6d770e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:38.488095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a42ad-b20e-4523-8708-99a77a48e29b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:38.490480 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7f2b2-02dc-4cc5-9bc5-d3bbe6d770e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:38.493227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7f2b2-02dc-4cc5-9bc5-d3bbe6d770e6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-a3f7f2b2-02dc-4cc5-9bc5-d3bbe6d770e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:38.510385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:38.513286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:38.515774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:38.515774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:38.515774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:38.515774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:38.515774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:38.515774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:38.515774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:38.515774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:38.515774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 372/750] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:38.515774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7f2b2-02dc-4cc5-9bc5-d3bbe6d770e6 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:38.564280 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994e6a9-afd5-4590-815e-943e39fa604c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:38.565219 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994e6a9-afd5-4590-815e-943e39fa604c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:38.565503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994e6a9-afd5-4590-815e-943e39fa604c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:38.565778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994e6a9-afd5-4590-815e-943e39fa604c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:38.604366 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:38.660262 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994e6a9-afd5-4590-815e-943e39fa604c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:38.662441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994e6a9-afd5-4590-815e-943e39fa604c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:38.677174 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7f2b2-02dc-4cc5-9bc5-d3bbe6d770e6 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:38.727559 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0d8ab-f9b8-4e86-902b-85e5a6bf814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:38.728143 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0d8ab-f9b8-4e86-902b-85e5a6bf814e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:38.728482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0d8ab-f9b8-4e86-902b-85e5a6bf814e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:38.728759 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0d8ab-f9b8-4e86-902b-85e5a6bf814e None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:38.729518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0d8ab-f9b8-4e86-902b-85e5a6bf814e None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:38.730358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0d8ab-f9b8-4e86-902b-85e5a6bf814e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:38.732151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0d8ab-f9b8-4e86-902b-85e5a6bf814e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:38.747334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 373/751] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:38.748399 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0d8ab-f9b8-4e86-902b-85e5a6bf814e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:38.804758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 379/752] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:46:38.806027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994e6a9-afd5-4590-815e-943e39fa604c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:38.819008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:38.863769 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0d8ab-f9b8-4e86-902b-85e5a6bf814e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:38.870379 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:38.902625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11722e8a-b209-4189-9ca3-e80602ff7d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:38.903322 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722e8a-b209-4189-9ca3-e80602ff7d63 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:38.903660 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722e8a-b209-4189-9ca3-e80602ff7d63 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:38.903947 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722e8a-b209-4189-9ca3-e80602ff7d63 None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:38.904965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11722e8a-b209-4189-9ca3-e80602ff7d63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:38.905281 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11722e8a-b209-4189-9ca3-e80602ff7d63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:38.907792 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11722e8a-b209-4189-9ca3-e80602ff7d63 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:38.920637 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994e6a9-afd5-4590-815e-943e39fa604c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:38.927801 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 374/753] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:38.928795 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11722e8a-b209-4189-9ca3-e80602ff7d63 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:38.967454 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645c7ba-88eb-4e67-85b6-1115e06c4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:38.968417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c7ba-88eb-4e67-85b6-1115e06c4759 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:38.968708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c7ba-88eb-4e67-85b6-1115e06c4759 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:38.968988 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c7ba-88eb-4e67-85b6-1115e06c4759 None admin] PATH_INFO: `/v3/users/nova` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:38.981088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645c7ba-88eb-4e67-85b6-1115e06c4759 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:38.982570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645c7ba-88eb-4e67-85b6-1115e06c4759 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-b645c7ba-88eb-4e67-85b6-1115e06c4759 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:39.000033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:39.001214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:39.002413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:39.002413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:39.002413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:39.002413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:39.002413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:39.002413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:39.002413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:39.002413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:39.002413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:39.002413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:39.002413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 380/754] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:46:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:39.003170 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645c7ba-88eb-4e67-85b6-1115e06c4759 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:39.041482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11722e8a-b209-4189-9ca3-e80602ff7d63 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:39.055828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:39.082642 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb84ec-d6a0-40bf-975e-7afd8012b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:39.083463 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb84ec-d6a0-40bf-975e-7afd8012b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:39.083781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb84ec-d6a0-40bf-975e-7afd8012b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:39.084137 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb84ec-d6a0-40bf-975e-7afd8012b5b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:39.096240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb84ec-d6a0-40bf-975e-7afd8012b5b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:39.097717 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb84ec-d6a0-40bf-975e-7afd8012b5b2 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-0bdb84ec-d6a0-40bf-975e-7afd8012b5b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:39.118327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:39.119434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:39.120594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:39.120594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:39.120594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:39.120594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:39.120594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 375/755] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:39.121451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb84ec-d6a0-40bf-975e-7afd8012b5b2 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:39.129132 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645c7ba-88eb-4e67-85b6-1115e06c4759 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:39.148549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:39.168402 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ebb7-7d8b-45a8-b981-0dc393fdbaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:39.169350 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ebb7-7d8b-45a8-b981-0dc393fdbaa6 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:39.169501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ebb7-7d8b-45a8-b981-0dc393fdbaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:39.169729 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ebb7-7d8b-45a8-b981-0dc393fdbaa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:39.170583 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ebb7-7d8b-45a8-b981-0dc393fdbaa6 None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=aab1ecd7a8074c288ac9b70065e6efa2) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:39.170930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ebb7-7d8b-45a8-b981-0dc393fdbaa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:39.172503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ebb7-7d8b-45a8-b981-0dc393fdbaa6 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:39.179731 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 381/756] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:39 2022] GET /identity/v3/role_assignments?user.id=aab1ecd7a8074c288ac9b70065e6efa2&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:39.180849 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ebb7-7d8b-45a8-b981-0dc393fdbaa6 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:39.304088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb84ec-d6a0-40bf-975e-7afd8012b5b2 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:39.374162 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285d2e6-a3c2-49eb-90f3-1b7c9279aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:39.374896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285d2e6-a3c2-49eb-90f3-1b7c9279aad1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:39.375181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285d2e6-a3c2-49eb-90f3-1b7c9279aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:39.375467 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285d2e6-a3c2-49eb-90f3-1b7c9279aad1 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:39.376738 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285d2e6-a3c2-49eb-90f3-1b7c9279aad1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:39.377060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285d2e6-a3c2-49eb-90f3-1b7c9279aad1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:39.378536 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285d2e6-a3c2-49eb-90f3-1b7c9279aad1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:39.411687 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ebb7-7d8b-45a8-b981-0dc393fdbaa6 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:39.425173 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 376/757] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:46:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:39.431925 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285d2e6-a3c2-49eb-90f3-1b7c9279aad1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:39.455807 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:39.471516 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b535-ffb4-40c0-b20d-0d4171f1fcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:39.473486 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b535-ffb4-40c0-b20d-0d4171f1fcc1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:39.473966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b535-ffb4-40c0-b20d-0d4171f1fcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:39.474437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b535-ffb4-40c0-b20d-0d4171f1fcc1 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:39.475383 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627b535-ffb4-40c0-b20d-0d4171f1fcc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:39.475857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627b535-ffb4-40c0-b20d-0d4171f1fcc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:39.477415 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627b535-ffb4-40c0-b20d-0d4171f1fcc1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:39.497243 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 382/758] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:39.502787 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b535-ffb4-40c0-b20d-0d4171f1fcc1 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:39.555913 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:39.629545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b535-ffb4-40c0-b20d-0d4171f1fcc1 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:39.633942 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285d2e6-a3c2-49eb-90f3-1b7c9279aad1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:39.672145 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff77c4-b4ac-40ad-82ed-1157d99b0eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:39.673663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff77c4-b4ac-40ad-82ed-1157d99b0eff None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:39.674021 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff77c4-b4ac-40ad-82ed-1157d99b0eff None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:39.674369 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff77c4-b4ac-40ad-82ed-1157d99b0eff None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:39.682492 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff77c4-b4ac-40ad-82ed-1157d99b0eff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:39.684518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff77c4-b4ac-40ad-82ed-1157d99b0eff None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-2dff77c4-b4ac-40ad-82ed-1157d99b0eff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:39.702343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:39.703469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:39.704545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:39.704545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:39.704545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:39.704545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:39.704545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:39.704545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:39.704545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:39.704545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:39.704545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 383/759] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:39.710401 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff77c4-b4ac-40ad-82ed-1157d99b0eff None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:39.739949 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e609c-75ed-4443-9770-4ac3474f022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:39.740770 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e609c-75ed-4443-9770-4ac3474f022c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:39.741057 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e609c-75ed-4443-9770-4ac3474f022c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:39.741338 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e609c-75ed-4443-9770-4ac3474f022c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:39.768731 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e609c-75ed-4443-9770-4ac3474f022c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:39.770201 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e609c-75ed-4443-9770-4ac3474f022c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-168e609c-75ed-4443-9770-4ac3474f022c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:39.811294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:39.812415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:39.813610 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:39.813610 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:39.813610 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:39.813610 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:39.816943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 377/760] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:39.823417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e609c-75ed-4443-9770-4ac3474f022c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:39.852360 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff77c4-b4ac-40ad-82ed-1157d99b0eff None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:39.855861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:39.924393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:39.950691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36f01f-6399-4e85-883f-666c48f5a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:39.954407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f01f-6399-4e85-883f-666c48f5a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:39.955884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f01f-6399-4e85-883f-666c48f5a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:39.955884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f01f-6399-4e85-883f-666c48f5a1c5 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:39.955884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36f01f-6399-4e85-883f-666c48f5a1c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:39.956491 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36f01f-6399-4e85-883f-666c48f5a1c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:39.961586 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36f01f-6399-4e85-883f-666c48f5a1c5 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:39.978567 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 384/761] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:39.983425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e609c-75ed-4443-9770-4ac3474f022c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:39.986115 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36f01f-6399-4e85-883f-666c48f5a1c5 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:40.099512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774abc6a-5d67-4b32-8fec-c8ef981e8c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:40.100208 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774abc6a-5d67-4b32-8fec-c8ef981e8c19 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:40.100421 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774abc6a-5d67-4b32-8fec-c8ef981e8c19 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:40.100678 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774abc6a-5d67-4b32-8fec-c8ef981e8c19 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:40.101433 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774abc6a-5d67-4b32-8fec-c8ef981e8c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:40.101748 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774abc6a-5d67-4b32-8fec-c8ef981e8c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:40.103210 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774abc6a-5d67-4b32-8fec-c8ef981e8c19 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:40.107204 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36f01f-6399-4e85-883f-666c48f5a1c5 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:40.121391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 378/762] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:40.128075 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774abc6a-5d67-4b32-8fec-c8ef981e8c19 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:40.150467 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bcbe2-39e8-42c7-bc45-a623f2f7ac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:40.151263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bcbe2-39e8-42c7-bc45-a623f2f7ac1f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:40.151451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bcbe2-39e8-42c7-bc45-a623f2f7ac1f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:40.151772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bcbe2-39e8-42c7-bc45-a623f2f7ac1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:40.152630 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bcbe2-39e8-42c7-bc45-a623f2f7ac1f None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=54a572dfba3e48498be80570d0f71369) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:40.152949 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bcbe2-39e8-42c7-bc45-a623f2f7ac1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:40.154430 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bcbe2-39e8-42c7-bc45-a623f2f7ac1f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:40.161098 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 385/763] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:39 2022] GET /identity/v3/role_assignments?user.id=54a572dfba3e48498be80570d0f71369&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:40.304242 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774abc6a-5d67-4b32-8fec-c8ef981e8c19 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:40.356516 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:40.362629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484839-32f8-4f36-b584-7d3dc8760cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:40.363517 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484839-32f8-4f36-b584-7d3dc8760cb4 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:40.363798 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484839-32f8-4f36-b584-7d3dc8760cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:40.364078 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484839-32f8-4f36-b584-7d3dc8760cb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:40.377339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87484839-32f8-4f36-b584-7d3dc8760cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:40.378864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87484839-32f8-4f36-b584-7d3dc8760cb4 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-87484839-32f8-4f36-b584-7d3dc8760cb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:40.398353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:40.399620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:40.400743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:40.400743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:40.400743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:40.400743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:40.400743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:40.400743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:40.400743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:40.400743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:40.404161 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 379/764] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:40.405469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bcbe2-39e8-42c7-bc45-a623f2f7ac1f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:40.467121 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:40.568490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bcbe2-39e8-42c7-bc45-a623f2f7ac1f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:40.569427 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c6d4d-30ee-44a5-93ed-37cb5252e4b1 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:40.569721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c6d4d-30ee-44a5-93ed-37cb5252e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:40.570005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c6d4d-30ee-44a5-93ed-37cb5252e4b1 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:40.574221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 380/765] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:40.578907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e0e6b-4de9-422d-97eb-6f997478a35d None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:40.579210 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e0e6b-4de9-422d-97eb-6f997478a35d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:40.579463 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e0e6b-4de9-422d-97eb-6f997478a35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:40.600131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-128e0e6b-4de9-422d-97eb-6f997478a35d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:40.601355 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-128e0e6b-4de9-422d-97eb-6f997478a35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:40.610454 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f444e39-77d1-40a5-bb62-cd3306f2bb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:40.611122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f444e39-77d1-40a5-bb62-cd3306f2bb9f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:40.611417 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f444e39-77d1-40a5-bb62-cd3306f2bb9f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:40.611694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f444e39-77d1-40a5-bb62-cd3306f2bb9f None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:40.612509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f444e39-77d1-40a5-bb62-cd3306f2bb9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:40.612817 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f444e39-77d1-40a5-bb62-cd3306f2bb9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:40.614275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f444e39-77d1-40a5-bb62-cd3306f2bb9f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:40.627637 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 386/766] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:40.633517 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f444e39-77d1-40a5-bb62-cd3306f2bb9f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:40.735563 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:40.747777 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f444e39-77d1-40a5-bb62-cd3306f2bb9f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:40.756608 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 381/767] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:46:40.774534 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285efc-5cfb-4f17-b18d-979b151b06c6 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:40.775199 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285efc-5cfb-4f17-b18d-979b151b06c6 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:40.775798 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285efc-5cfb-4f17-b18d-979b151b06c6 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:40.778350 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 382/768] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:40.784305 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2da18-ec7d-4045-ae43-901e1e8b9965 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:40.785092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2da18-ec7d-4045-ae43-901e1e8b9965 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:40.785693 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2da18-ec7d-4045-ae43-901e1e8b9965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:40.786197 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746e1cd-0414-4719-895e-bc82a6be8d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:40.787146 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746e1cd-0414-4719-895e-bc82a6be8d6c None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:40.787432 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746e1cd-0414-4719-895e-bc82a6be8d6c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:40.787713 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746e1cd-0414-4719-895e-bc82a6be8d6c None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/7a36f250f3d04faab08146d937ef840e/roles/480e35452fc547e0a2917bdd5b782f7d` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:40.789780 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746e1cd-0414-4719-895e-bc82a6be8d6c None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=7a36f250f3d04faab08146d937ef840e, role_id=480e35452fc547e0a2917bdd5b782f7d)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:40.791269 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746e1cd-0414-4719-895e-bc82a6be8d6c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:40.808509 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-35f2da18-ec7d-4045-ae43-901e1e8b9965 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:40.809822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-35f2da18-ec7d-4045-ae43-901e1e8b9965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:40.859199 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 387/769] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:46:40 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/7a36f250f3d04faab08146d937ef840e/roles/480e35452fc547e0a2917bdd5b782f7d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:46:40.867257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746e1cd-0414-4719-895e-bc82a6be8d6c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:40.921458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 383/770] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:40.998681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2da18-ec7d-4045-ae43-901e1e8b9965 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:41.082334 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746e1cd-0414-4719-895e-bc82a6be8d6c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:41.103084 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:41.147871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2da18-ec7d-4045-ae43-901e1e8b9965 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:41.149362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ac536-b4c7-443a-8bdd-99d3687aee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:41.150277 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ac536-b4c7-443a-8bdd-99d3687aee4f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:41.150697 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ac536-b4c7-443a-8bdd-99d3687aee4f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:41.151264 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ac536-b4c7-443a-8bdd-99d3687aee4f None admin] PATH_INFO: `/v3/services/network` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:41.153074 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ac536-b4c7-443a-8bdd-99d3687aee4f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:41.155237 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ac536-b4c7-443a-8bdd-99d3687aee4f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-8e9ac536-b4c7-443a-8bdd-99d3687aee4f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:41.169709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:41.171139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:46:41.172151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:41.173234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 388/771] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:40 2022] GET /identity/v3/services/network => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:41.179564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ac536-b4c7-443a-8bdd-99d3687aee4f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:41.196790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:41.200645 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794eb25-3616-4578-8e02-cd17539fc938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:41.202317 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794eb25-3616-4578-8e02-cd17539fc938 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:41.221136 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794eb25-3616-4578-8e02-cd17539fc938 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:41.221136 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794eb25-3616-4578-8e02-cd17539fc938 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:41.221136 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794eb25-3616-4578-8e02-cd17539fc938 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:41.221136 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794eb25-3616-4578-8e02-cd17539fc938 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-3794eb25-3616-4578-8e02-cd17539fc938 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:41.223688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:41.224979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:46:41.226252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:41.231628 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 384/772] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 20:46:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:41.240330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794eb25-3616-4578-8e02-cd17539fc938 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:41.353349 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ac536-b4c7-443a-8bdd-99d3687aee4f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:41.413040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c27e84-3cb0-4b0a-9994-0186252d8181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:41.414812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c27e84-3cb0-4b0a-9994-0186252d8181 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:41.416860 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c27e84-3cb0-4b0a-9994-0186252d8181 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:41.418212 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c27e84-3cb0-4b0a-9994-0186252d8181 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:41.419410 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c27e84-3cb0-4b0a-9994-0186252d8181 None admin] RBAC: Adding query filter params (name=network) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:41.420990 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c27e84-3cb0-4b0a-9994-0186252d8181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:41.422701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c27e84-3cb0-4b0a-9994-0186252d8181 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:41.430736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794eb25-3616-4578-8e02-cd17539fc938 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:41.437498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 389/773] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:46:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:41.443282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c27e84-3cb0-4b0a-9994-0186252d8181 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:41.475998 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:41.514621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f135-c4b0-4c34-849a-79896d3676fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:41.517842 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f135-c4b0-4c34-849a-79896d3676fc None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:41.518389 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f135-c4b0-4c34-849a-79896d3676fc None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:41.518931 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f135-c4b0-4c34-849a-79896d3676fc None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:41.520146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19f135-c4b0-4c34-849a-79896d3676fc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:41.521341 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19f135-c4b0-4c34-849a-79896d3676fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:41.523186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19f135-c4b0-4c34-849a-79896d3676fc None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:41.535418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 385/774] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:46:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:41.540428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f135-c4b0-4c34-849a-79896d3676fc None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:41.601521 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:41.672451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c27e84-3cb0-4b0a-9994-0186252d8181 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:41.731345 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f135-c4b0-4c34-849a-79896d3676fc None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:41.751594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95959d77-63ff-4669-843f-2576cdaeeddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:41.752803 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959d77-63ff-4669-843f-2576cdaeeddf None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:41.753318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959d77-63ff-4669-843f-2576cdaeeddf None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:41.753822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959d77-63ff-4669-843f-2576cdaeeddf None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:41.754821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95959d77-63ff-4669-843f-2576cdaeeddf None admin] RBAC: Adding query filter params (type=network) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:41.755372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95959d77-63ff-4669-843f-2576cdaeeddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:41.757020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95959d77-63ff-4669-843f-2576cdaeeddf None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:41.768659 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 390/775] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:46:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:41.774962 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95959d77-63ff-4669-843f-2576cdaeeddf None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:41.818150 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fbbe9-780d-4e6e-8c42-0dccafbd4cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:41.822417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fbbe9-780d-4e6e-8c42-0dccafbd4cc1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:41.823067 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fbbe9-780d-4e6e-8c42-0dccafbd4cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:41.823597 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fbbe9-780d-4e6e-8c42-0dccafbd4cc1 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:41.824556 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fbbe9-780d-4e6e-8c42-0dccafbd4cc1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:41.825083 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fbbe9-780d-4e6e-8c42-0dccafbd4cc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:41.826942 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fbbe9-780d-4e6e-8c42-0dccafbd4cc1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:41.841606 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 386/776] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:46:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:41.866789 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fbbe9-780d-4e6e-8c42-0dccafbd4cc1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:41.918805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:41.947555 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95959d77-63ff-4669-843f-2576cdaeeddf None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:41.995970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca5520-00e8-4398-b1fd-1d1f60d025e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:41.996667 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca5520-00e8-4398-b1fd-1d1f60d025e3 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:41.996974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca5520-00e8-4398-b1fd-1d1f60d025e3 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:41.997253 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca5520-00e8-4398-b1fd-1d1f60d025e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:41.998551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca5520-00e8-4398-b1fd-1d1f60d025e3 None admin] RBAC: Adding query filter params (interface=public, service_id=a4b899fd9c654bd0804bf43f0018edf4, region_id=RegionOne) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:41.998904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca5520-00e8-4398-b1fd-1d1f60d025e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:42.000660 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca5520-00e8-4398-b1fd-1d1f60d025e3 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:42.002306 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fbbe9-780d-4e6e-8c42-0dccafbd4cc1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:42.010843 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 391/777] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:46:41 2022] GET /identity/v3/endpoints?service_id=a4b899fd9c654bd0804bf43f0018edf4&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:42.012610 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0ca4-219a-479a-947f-89a092ce6ffc None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:42.013112 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0ca4-219a-479a-947f-89a092ce6ffc None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:42.013578 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0ca4-219a-479a-947f-89a092ce6ffc None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:42.015275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 392/778] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:42.019566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b0ca4-219a-479a-947f-89a092ce6ffc None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:42.024074 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:42.044308 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8105d3-459e-4152-9c00-a24a2a38dae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:42.046636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8105d3-459e-4152-9c00-a24a2a38dae8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:42.046636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8105d3-459e-4152-9c00-a24a2a38dae8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:42.046636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8105d3-459e-4152-9c00-a24a2a38dae8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:42.046923 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8105d3-459e-4152-9c00-a24a2a38dae8 None admin] RBAC: Adding query filter params (interface=public, service_id=fbec7f0fcb384422987628ca3dd1031d, region_id=RegionOne) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:42.048382 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8105d3-459e-4152-9c00-a24a2a38dae8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:42.051522 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8105d3-459e-4152-9c00-a24a2a38dae8 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:42.066749 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 387/779] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:46:41 2022] GET /identity/v3/endpoints?service_id=fbec7f0fcb384422987628ca3dd1031d&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:42.068628 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174d67-a9f7-44a2-bdda-51f0ac1c42c1 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:42.068918 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174d67-a9f7-44a2-bdda-51f0ac1c42c1 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:42.069197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174d67-a9f7-44a2-bdda-51f0ac1c42c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:42.086926 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-51174d67-a9f7-44a2-bdda-51f0ac1c42c1 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:42.088391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-51174d67-a9f7-44a2-bdda-51f0ac1c42c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:42.166954 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 388/780] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:42.168476 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51174d67-a9f7-44a2-bdda-51f0ac1c42c1 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:42.169732 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b0ca4-219a-479a-947f-89a092ce6ffc None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:42.212301 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc153274-671c-434e-b2eb-49edf2b23377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:42.213811 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153274-671c-434e-b2eb-49edf2b23377 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:42.215252 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153274-671c-434e-b2eb-49edf2b23377 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:42.215781 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153274-671c-434e-b2eb-49edf2b23377 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:42.217227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc153274-671c-434e-b2eb-49edf2b23377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:42.219259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc153274-671c-434e-b2eb-49edf2b23377 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:42.226717 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 393/781] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:46:42 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:42.226896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:42.228491 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc153274-671c-434e-b2eb-49edf2b23377 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:42.373463 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51174d67-a9f7-44a2-bdda-51f0ac1c42c1 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:42.404001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:42.422669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b912e6-8360-4f71-887c-45800f7beb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:42.423784 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b912e6-8360-4f71-887c-45800f7beb14 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:42.424295 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b912e6-8360-4f71-887c-45800f7beb14 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:42.424789 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b912e6-8360-4f71-887c-45800f7beb14 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:42.426404 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b912e6-8360-4f71-887c-45800f7beb14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:42.428157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b912e6-8360-4f71-887c-45800f7beb14 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:42.435657 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 389/782] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:46:42 2022] GET /identity/v3/services => generated 772 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:42.474414 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc153274-671c-434e-b2eb-49edf2b23377 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:42.521275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c94db-8205-4139-92f6-c54701162e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:42.522100 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c94db-8205-4139-92f6-c54701162e62 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:42.522383 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c94db-8205-4139-92f6-c54701162e62 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:42.522687 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c94db-8205-4139-92f6-c54701162e62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:42.543415 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c94db-8205-4139-92f6-c54701162e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-025c94db-8205-4139-92f6-c54701162e62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:42.552437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:42.553639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:42.554698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 394/783] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:42.560465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b912e6-8360-4f71-887c-45800f7beb14 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:42.687371 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b912e6-8360-4f71-887c-45800f7beb14 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:42.689613 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:42.728551 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bb9f7-f88b-4fee-bbc7-8b238a0aff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:42.729666 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bb9f7-f88b-4fee-bbc7-8b238a0aff6c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:42.734629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bb9f7-f88b-4fee-bbc7-8b238a0aff6c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:42.734629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bb9f7-f88b-4fee-bbc7-8b238a0aff6c None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:42.734629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bb9f7-f88b-4fee-bbc7-8b238a0aff6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:42.734629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bb9f7-f88b-4fee-bbc7-8b238a0aff6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:42.734629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bb9f7-f88b-4fee-bbc7-8b238a0aff6c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:42.746802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 390/784] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:42.752747 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c94db-8205-4139-92f6-c54701162e62 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:42.879530 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c94db-8205-4139-92f6-c54701162e62 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:42.909671 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:42.926459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420255-462f-4ce9-b0fe-d7c36d94c54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:42.927311 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420255-462f-4ce9-b0fe-d7c36d94c54d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:42.927599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420255-462f-4ce9-b0fe-d7c36d94c54d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:42.927880 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420255-462f-4ce9-b0fe-d7c36d94c54d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:42.940896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420255-462f-4ce9-b0fe-d7c36d94c54d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:42.942374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420255-462f-4ce9-b0fe-d7c36d94c54d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-82420255-462f-4ce9-b0fe-d7c36d94c54d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:42.970222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:42.971501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:42.972603 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:42.972603 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:42.972603 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:42.972603 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:42.972603 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 395/785] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:42.979884 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bb9f7-f88b-4fee-bbc7-8b238a0aff6c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:42.991538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ad539-21ed-4149-b9a6-9e621bef30ec None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:42.991871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ad539-21ed-4149-b9a6-9e621bef30ec None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:42.992106 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ad539-21ed-4149-b9a6-9e621bef30ec None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:42.993755 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 396/786] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:43.000003 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a628b8-47b7-4917-abb1-3cef605677cb None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:43.000205 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a628b8-47b7-4917-abb1-3cef605677cb None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:43.000477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a628b8-47b7-4917-abb1-3cef605677cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:43.024696 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-60a628b8-47b7-4917-abb1-3cef605677cb None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:43.025931 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-60a628b8-47b7-4917-abb1-3cef605677cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:43.175270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 397/787] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:46:43.189568 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bb9f7-f88b-4fee-bbc7-8b238a0aff6c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:43.238308 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03449d-1d4b-4bcb-a481-5d84049ac3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:43.239480 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03449d-1d4b-4bcb-a481-5d84049ac3f1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:43.240022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03449d-1d4b-4bcb-a481-5d84049ac3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:43.240533 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03449d-1d4b-4bcb-a481-5d84049ac3f1 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:43.240895 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a628b8-47b7-4917-abb1-3cef605677cb None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:43.241798 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03449d-1d4b-4bcb-a481-5d84049ac3f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:43.242372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03449d-1d4b-4bcb-a481-5d84049ac3f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:43.244225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03449d-1d4b-4bcb-a481-5d84049ac3f1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:43.265510 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 391/788] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:43.288096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03449d-1d4b-4bcb-a481-5d84049ac3f1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:43.328230 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:43.456257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a628b8-47b7-4917-abb1-3cef605677cb None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:43.469144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:43.475664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03449d-1d4b-4bcb-a481-5d84049ac3f1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:43.513983 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bccf69-b916-4fca-bb2c-a75b5b66bdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:43.514759 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bccf69-b916-4fca-bb2c-a75b5b66bdc2 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:43.515083 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bccf69-b916-4fca-bb2c-a75b5b66bdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:43.515367 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bccf69-b916-4fca-bb2c-a75b5b66bdc2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:43.524922 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bccf69-b916-4fca-bb2c-a75b5b66bdc2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:43.527620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bccf69-b916-4fca-bb2c-a75b5b66bdc2 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-99bccf69-b916-4fca-bb2c-a75b5b66bdc2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:43.546036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:43.547411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:43.548662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:43.548662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:43.548662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:43.548662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:43.548662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:43.548662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:43.548662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:43.548662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:43.548662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:43.548662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:43.549353 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ad18b-e134-4dfb-a02a-0dea7c070495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:43.549478 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 392/789] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:43.549577 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad18b-e134-4dfb-a02a-0dea7c070495 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:43.549577 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad18b-e134-4dfb-a02a-0dea7c070495 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:43.549577 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad18b-e134-4dfb-a02a-0dea7c070495 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:43.555951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bccf69-b916-4fca-bb2c-a75b5b66bdc2 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:43.568520 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ad18b-e134-4dfb-a02a-0dea7c070495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-282ad18b-e134-4dfb-a02a-0dea7c070495 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:43.584813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:43.587343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:43.589596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:43.595493 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 398/790] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:43.595493 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ad18b-e134-4dfb-a02a-0dea7c070495 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:43.670156 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bccf69-b916-4fca-bb2c-a75b5b66bdc2 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:43.673505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:43.714528 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48363325-b208-453f-949b-afe3ebb29273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:43.715319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363325-b208-453f-949b-afe3ebb29273 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:43.715605 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363325-b208-453f-949b-afe3ebb29273 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:43.715884 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363325-b208-453f-949b-afe3ebb29273 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:43.716869 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48363325-b208-453f-949b-afe3ebb29273 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:43.717440 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48363325-b208-453f-949b-afe3ebb29273 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:43.718945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48363325-b208-453f-949b-afe3ebb29273 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:43.723420 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ad18b-e134-4dfb-a02a-0dea7c070495 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:43.739848 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 393/791] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:46:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:43.741361 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce887e-3d83-4519-a40b-3d6ba437ce39 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:43.741658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce887e-3d83-4519-a40b-3d6ba437ce39 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:43.741971 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce887e-3d83-4519-a40b-3d6ba437ce39 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:43.749927 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 394/792] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:43.750871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce887e-3d83-4519-a40b-3d6ba437ce39 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:43.767379 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad91ec9-6cd9-4fd8-a1f9-3215e8c2ddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:43.768094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad91ec9-6cd9-4fd8-a1f9-3215e8c2ddff None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:43.768367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad91ec9-6cd9-4fd8-a1f9-3215e8c2ddff None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:43.768656 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad91ec9-6cd9-4fd8-a1f9-3215e8c2ddff None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:43.769552 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad91ec9-6cd9-4fd8-a1f9-3215e8c2ddff None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:43.769873 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad91ec9-6cd9-4fd8-a1f9-3215e8c2ddff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:43.771302 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad91ec9-6cd9-4fd8-a1f9-3215e8c2ddff None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:43.781565 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 399/793] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:43.783168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa699a53-5a31-4051-94b0-edca3ed66885 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:43.783566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa699a53-5a31-4051-94b0-edca3ed66885 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:43.783856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa699a53-5a31-4051-94b0-edca3ed66885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:43.802786 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-fa699a53-5a31-4051-94b0-edca3ed66885 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:43.804016 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-fa699a53-5a31-4051-94b0-edca3ed66885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:43.833538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:43.867299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce887e-3d83-4519-a40b-3d6ba437ce39 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:43.886751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 400/794] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:43.887833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa699a53-5a31-4051-94b0-edca3ed66885 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:43.909156 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40102fd-9f52-41cf-af52-182598f6a1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:43.910042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40102fd-9f52-41cf-af52-182598f6a1cd None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:43.910486 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40102fd-9f52-41cf-af52-182598f6a1cd None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:43.910849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40102fd-9f52-41cf-af52-182598f6a1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:43.924198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40102fd-9f52-41cf-af52-182598f6a1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:43.925757 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40102fd-9f52-41cf-af52-182598f6a1cd None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-f40102fd-9f52-41cf-af52-182598f6a1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:43.948993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:43.952068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:43.953360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:43.953360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:43.953360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:43.953360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:43.953360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:43.958635 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 395/795] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:43.958635 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40102fd-9f52-41cf-af52-182598f6a1cd None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:44.044043 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa699a53-5a31-4051-94b0-edca3ed66885 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:44.098665 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6763c11-db8f-46b9-8108-f23c5304d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:44.099517 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6763c11-db8f-46b9-8108-f23c5304d49b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:44.099798 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6763c11-db8f-46b9-8108-f23c5304d49b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:44.100079 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6763c11-db8f-46b9-8108-f23c5304d49b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:44.115660 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6763c11-db8f-46b9-8108-f23c5304d49b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:44.117627 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6763c11-db8f-46b9-8108-f23c5304d49b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:44.126284 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40102fd-9f52-41cf-af52-182598f6a1cd None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-b6763c11-db8f-46b9-8108-f23c5304d49b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:44.151701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:44.153456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:44.154711 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:44.154711 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:44.154711 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:44.154711 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:44.157702 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 401/796] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:44.159713 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6763c11-db8f-46b9-8108-f23c5304d49b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:44.179676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:44.182502 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d260-5e9b-4fe3-a3cb-f8215b5cd08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:44.184124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d260-5e9b-4fe3-a3cb-f8215b5cd08f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:44.184425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d260-5e9b-4fe3-a3cb-f8215b5cd08f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:44.184842 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d260-5e9b-4fe3-a3cb-f8215b5cd08f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:44.201001 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532d260-5e9b-4fe3-a3cb-f8215b5cd08f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-7532d260-5e9b-4fe3-a3cb-f8215b5cd08f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:44.212492 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:44.218857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 396/797] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:44.219912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d260-5e9b-4fe3-a3cb-f8215b5cd08f None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:44.302226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:44.318596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6763c11-db8f-46b9-8108-f23c5304d49b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:44.359471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65706-dca3-4728-a69d-6fa3859d4b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:44.360641 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65706-dca3-4728-a69d-6fa3859d4b23 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:44.361177 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65706-dca3-4728-a69d-6fa3859d4b23 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:44.361692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65706-dca3-4728-a69d-6fa3859d4b23 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:44.362726 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e65706-dca3-4728-a69d-6fa3859d4b23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:44.363263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e65706-dca3-4728-a69d-6fa3859d4b23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:44.364895 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e65706-dca3-4728-a69d-6fa3859d4b23 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:44.373446 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d260-5e9b-4fe3-a3cb-f8215b5cd08f None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:44.378430 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 402/798] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:44.379689 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65706-dca3-4728-a69d-6fa3859d4b23 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:44.411965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee24bd-5d09-430b-b4ae-a0068cc58e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:44.412590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee24bd-5d09-430b-b4ae-a0068cc58e1e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:44.412853 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee24bd-5d09-430b-b4ae-a0068cc58e1e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:44.413129 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee24bd-5d09-430b-b4ae-a0068cc58e1e None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:44.413871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee24bd-5d09-430b-b4ae-a0068cc58e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:44.414181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee24bd-5d09-430b-b4ae-a0068cc58e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:44.416043 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee24bd-5d09-430b-b4ae-a0068cc58e1e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:44.430331 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 397/799] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:44.431088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee24bd-5d09-430b-b4ae-a0068cc58e1e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:44.461402 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:44.494820 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65706-dca3-4728-a69d-6fa3859d4b23 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:44.532535 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c0999-e206-48e4-9df0-2bd76456dd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:44.533303 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c0999-e206-48e4-9df0-2bd76456dd16 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:44.533592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c0999-e206-48e4-9df0-2bd76456dd16 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:44.533888 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c0999-e206-48e4-9df0-2bd76456dd16 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:44.535082 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c0999-e206-48e4-9df0-2bd76456dd16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:44.535082 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c0999-e206-48e4-9df0-2bd76456dd16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:44.536483 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c0999-e206-48e4-9df0-2bd76456dd16 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:44.549644 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee24bd-5d09-430b-b4ae-a0068cc58e1e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:44.550838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 403/800] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:44.551881 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c0999-e206-48e4-9df0-2bd76456dd16 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:44.567219 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:44.590862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b56954-4174-4b60-8d77-57a5f83c4d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:44.592261 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56954-4174-4b60-8d77-57a5f83c4d00 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:44.592853 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56954-4174-4b60-8d77-57a5f83c4d00 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:44.593366 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56954-4174-4b60-8d77-57a5f83c4d00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:44.602499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b56954-4174-4b60-8d77-57a5f83c4d00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:44.604598 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b56954-4174-4b60-8d77-57a5f83c4d00 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-a3b56954-4174-4b60-8d77-57a5f83c4d00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:44.620945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:44.622097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:44.623209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:44.623209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:44.623209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:44.623209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:44.623209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:44.623209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:44.623209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:44.623209 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:44.625845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 398/801] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:44.627012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b56954-4174-4b60-8d77-57a5f83c4d00 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:44.664831 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c0999-e206-48e4-9df0-2bd76456dd16 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:44.706294 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d2ac7-ec3d-424c-a230-e05aa351a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:44.707257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2ac7-ec3d-424c-a230-e05aa351a157 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:44.707596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2ac7-ec3d-424c-a230-e05aa351a157 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:44.707877 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2ac7-ec3d-424c-a230-e05aa351a157 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:44.710478 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:44.718284 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d2ac7-ec3d-424c-a230-e05aa351a157 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:44.720080 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d2ac7-ec3d-424c-a230-e05aa351a157 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-4c3d2ac7-ec3d-424c-a230-e05aa351a157 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:44.736561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:44.738958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 404/802] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:46:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:44.741152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d2ac7-ec3d-424c-a230-e05aa351a157 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:44.784444 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b56954-4174-4b60-8d77-57a5f83c4d00 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:44.830494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140db332-49d6-4f9d-9289-3da9ce436d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:44.832083 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140db332-49d6-4f9d-9289-3da9ce436d7c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:44.832663 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140db332-49d6-4f9d-9289-3da9ce436d7c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:44.833287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140db332-49d6-4f9d-9289-3da9ce436d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:44.849612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140db332-49d6-4f9d-9289-3da9ce436d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:44.851778 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140db332-49d6-4f9d-9289-3da9ce436d7c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:44.852545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d2ac7-ec3d-424c-a230-e05aa351a157 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-140db332-49d6-4f9d-9289-3da9ce436d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:44.874914 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:44.876064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:44.877182 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:44.877182 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:44.877182 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:44.877182 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:44.879692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 399/803] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:44.880770 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140db332-49d6-4f9d-9289-3da9ce436d7c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:44.897041 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6b6ab-c14e-4a43-a7c8-5a42499bd514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:44.897732 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6b6ab-c14e-4a43-a7c8-5a42499bd514 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:44.898032 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6b6ab-c14e-4a43-a7c8-5a42499bd514 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:44.898302 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6b6ab-c14e-4a43-a7c8-5a42499bd514 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:44.899150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6b6ab-c14e-4a43-a7c8-5a42499bd514 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:44.899465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6b6ab-c14e-4a43-a7c8-5a42499bd514 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:44.900899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6b6ab-c14e-4a43-a7c8-5a42499bd514 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:44.918830 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 405/804] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:44.918830 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6b6ab-c14e-4a43-a7c8-5a42499bd514 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:44.925052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:44.978926 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:45.007728 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140db332-49d6-4f9d-9289-3da9ce436d7c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:45.033861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6b6ab-c14e-4a43-a7c8-5a42499bd514 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:45.050397 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c1835-f2db-487d-b901-96c034b08538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:45.051409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1835-f2db-487d-b901-96c034b08538 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.051699 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1835-f2db-487d-b901-96c034b08538 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.051981 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1835-f2db-487d-b901-96c034b08538 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.052845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c1835-f2db-487d-b901-96c034b08538 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:45.053502 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c1835-f2db-487d-b901-96c034b08538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:45.054628 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c1835-f2db-487d-b901-96c034b08538 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:45.077060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 400/805] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:46:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:45.079634 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa33b8-be8d-44c3-86c1-b14a34c3611c None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.079964 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa33b8-be8d-44c3-86c1-b14a34c3611c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.080212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa33b8-be8d-44c3-86c1-b14a34c3611c None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.081858 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 401/806] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:45.086268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca6e7a-9880-4ba0-a340-8a2a7c757f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:45.086705 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa33b8-be8d-44c3-86c1-b14a34c3611c None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:45.087126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca6e7a-9880-4ba0-a340-8a2a7c757f26 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.087523 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca6e7a-9880-4ba0-a340-8a2a7c757f26 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.087782 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca6e7a-9880-4ba0-a340-8a2a7c757f26 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.088687 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca6e7a-9880-4ba0-a340-8a2a7c757f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:45.089603 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca6e7a-9880-4ba0-a340-8a2a7c757f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:45.093136 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca6e7a-9880-4ba0-a340-8a2a7c757f26 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:45.112962 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 406/807] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:45.112962 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca6e7a-9880-4ba0-a340-8a2a7c757f26 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:45.193282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:45.212779 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa33b8-be8d-44c3-86c1-b14a34c3611c None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:45.225263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca6e7a-9880-4ba0-a340-8a2a7c757f26 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:45.241198 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:45.261767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d37d16-31a8-4873-84fe-c85d08050c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:45.262683 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d37d16-31a8-4873-84fe-c85d08050c4f None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.262967 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d37d16-31a8-4873-84fe-c85d08050c4f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.263269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d37d16-31a8-4873-84fe-c85d08050c4f None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/aab1ecd7a8074c288ac9b70065e6efa2/roles/480e35452fc547e0a2917bdd5b782f7d` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.263820 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94ca22-32c9-4fbd-8e47-2e5fc754314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:45.264633 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94ca22-32c9-4fbd-8e47-2e5fc754314a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.264918 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94ca22-32c9-4fbd-8e47-2e5fc754314a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.265197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d37d16-31a8-4873-84fe-c85d08050c4f None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=aab1ecd7a8074c288ac9b70065e6efa2, role_id=480e35452fc547e0a2917bdd5b782f7d)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:45.265359 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94ca22-32c9-4fbd-8e47-2e5fc754314a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.266675 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d37d16-31a8-4873-84fe-c85d08050c4f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:45.277380 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94ca22-32c9-4fbd-8e47-2e5fc754314a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:45.279459 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94ca22-32c9-4fbd-8e47-2e5fc754314a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-ab94ca22-32c9-4fbd-8e47-2e5fc754314a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:45.300973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:45.303026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:45.304372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:45.304372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:45.304372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:45.304372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:45.304372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 407/808] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:45.304372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da895-c579-45cf-85ca-9b7579cef4fa None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.304372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da895-c579-45cf-85ca-9b7579cef4fa None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.304372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da895-c579-45cf-85ca-9b7579cef4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.322198 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-d01da895-c579-45cf-85ca-9b7579cef4fa None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:45.324082 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-d01da895-c579-45cf-85ca-9b7579cef4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:45.351721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 402/809] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:46:45 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/aab1ecd7a8074c288ac9b70065e6efa2/roles/480e35452fc547e0a2917bdd5b782f7d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:46:45.352533 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d37d16-31a8-4873-84fe-c85d08050c4f None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:45.404719 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 408/810] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:45.406135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d655e-04ad-4968-acb5-e84ea19487fc None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.406427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d655e-04ad-4968-acb5-e84ea19487fc None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.406743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d655e-04ad-4968-acb5-e84ea19487fc None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.408397 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 409/811] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:45.413704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d655e-04ad-4968-acb5-e84ea19487fc None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:45.511290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d37d16-31a8-4873-84fe-c85d08050c4f None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:45.564904 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b922864-c15d-49b1-bed6-68fdabb46f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:45.565734 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b922864-c15d-49b1-bed6-68fdabb46f39 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.566012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b922864-c15d-49b1-bed6-68fdabb46f39 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.566288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b922864-c15d-49b1-bed6-68fdabb46f39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.579353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b922864-c15d-49b1-bed6-68fdabb46f39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:45.581090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b922864-c15d-49b1-bed6-68fdabb46f39 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:45.591776 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:45.596059 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d655e-04ad-4968-acb5-e84ea19487fc None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-6b922864-c15d-49b1-bed6-68fdabb46f39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:45.605818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:45.613237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 403/812] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:46:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda671f-45e3-4c0a-91b5-cae5aec0b6ae None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.615576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda671f-45e3-4c0a-91b5-cae5aec0b6ae None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.617329 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda671f-45e3-4c0a-91b5-cae5aec0b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.622862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:45.640711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-4cda671f-45e3-4c0a-91b5-cae5aec0b6ae None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:45.642228 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ea26a-df8b-4428-87d1-bcc2cd46892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:45.642793 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-4cda671f-45e3-4c0a-91b5-cae5aec0b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:45.643015 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea26a-df8b-4428-87d1-bcc2cd46892b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.643264 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea26a-df8b-4428-87d1-bcc2cd46892b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.643567 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea26a-df8b-4428-87d1-bcc2cd46892b None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.644275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ea26a-df8b-4428-87d1-bcc2cd46892b None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:45.644587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ea26a-df8b-4428-87d1-bcc2cd46892b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:45.645961 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ea26a-df8b-4428-87d1-bcc2cd46892b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:45.659229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 410/813] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:45.660477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ea26a-df8b-4428-87d1-bcc2cd46892b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:45.729975 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 404/814] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:45.730891 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda671f-45e3-4c0a-91b5-cae5aec0b6ae None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:45.791819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ea26a-df8b-4428-87d1-bcc2cd46892b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:45.842349 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20bf14-41fc-435c-a770-a81759abc947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:45.843317 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20bf14-41fc-435c-a770-a81759abc947 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.843613 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20bf14-41fc-435c-a770-a81759abc947 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.843893 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20bf14-41fc-435c-a770-a81759abc947 None admin] PATH_INFO: `/v3/services/network` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.844570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20bf14-41fc-435c-a770-a81759abc947 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:45.845990 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20bf14-41fc-435c-a770-a81759abc947 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:45.846124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda671f-45e3-4c0a-91b5-cae5aec0b6ae None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-5c20bf14-41fc-435c-a770-a81759abc947 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:45.859551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:45.860924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:45.861964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 411/815] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:45 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:45.862992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20bf14-41fc-435c-a770-a81759abc947 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:45.890282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:45.894182 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fddda-9798-49f9-96c3-7cc04c211d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:45.894907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fddda-9798-49f9-96c3-7cc04c211d26 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:45.895189 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fddda-9798-49f9-96c3-7cc04c211d26 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:45.895470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fddda-9798-49f9-96c3-7cc04c211d26 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:45.896375 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fddda-9798-49f9-96c3-7cc04c211d26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:45.896740 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fddda-9798-49f9-96c3-7cc04c211d26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:45.898230 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fddda-9798-49f9-96c3-7cc04c211d26 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:45.900215 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:45.920285 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 405/816] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:46:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:45.921472 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fddda-9798-49f9-96c3-7cc04c211d26 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:45.996249 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20bf14-41fc-435c-a770-a81759abc947 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:46.045076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fddda-9798-49f9-96c3-7cc04c211d26 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:46.056787 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78156b23-61a5-498b-9206-27391596b667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:46.060624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78156b23-61a5-498b-9206-27391596b667 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:46.061305 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78156b23-61a5-498b-9206-27391596b667 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:46.061599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78156b23-61a5-498b-9206-27391596b667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:46.076011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78156b23-61a5-498b-9206-27391596b667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:46.077569 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78156b23-61a5-498b-9206-27391596b667 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-78156b23-61a5-498b-9206-27391596b667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:46.094789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:46.096207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:46.097576 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:46.097576 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:46.097576 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:46.097576 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:46.097576 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:46.097576 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:46.097576 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:46.097576 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:46.100878 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 412/817] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:46.101812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78156b23-61a5-498b-9206-27391596b667 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:46.109039 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076a5b7-44e5-4d7a-8c37-7acf30d12339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:46.110251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076a5b7-44e5-4d7a-8c37-7acf30d12339 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:46.110729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076a5b7-44e5-4d7a-8c37-7acf30d12339 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:46.111521 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076a5b7-44e5-4d7a-8c37-7acf30d12339 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:46.112380 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076a5b7-44e5-4d7a-8c37-7acf30d12339 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:46.113941 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076a5b7-44e5-4d7a-8c37-7acf30d12339 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-0076a5b7-44e5-4d7a-8c37-7acf30d12339 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:46.130850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:46.132587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:46:46.133805 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:46.136744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 406/818] 10.222.0.89 () {56 vars in 1129 bytes} [Thu May 19 20:46:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:46.138171 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076a5b7-44e5-4d7a-8c37-7acf30d12339 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:46.200416 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:46.221874 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78156b23-61a5-498b-9206-27391596b667 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:46.224583 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:46.274010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85933b9-e443-4d80-819e-18b95fb64c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:46.274745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85933b9-e443-4d80-819e-18b95fb64c72 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:46.275042 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85933b9-e443-4d80-819e-18b95fb64c72 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:46.275326 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85933b9-e443-4d80-819e-18b95fb64c72 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:46.276062 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85933b9-e443-4d80-819e-18b95fb64c72 None admin] RBAC: Adding query filter params (name=network) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:46.276501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85933b9-e443-4d80-819e-18b95fb64c72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:46.277884 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85933b9-e443-4d80-819e-18b95fb64c72 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:46.283185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 413/819] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:46:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:46.284038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85933b9-e443-4d80-819e-18b95fb64c72 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:46.300018 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076a5b7-44e5-4d7a-8c37-7acf30d12339 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:46.350160 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19234a6-0639-4c15-bcc0-755c9f25160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:46.351859 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19234a6-0639-4c15-bcc0-755c9f25160a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:46.352444 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19234a6-0639-4c15-bcc0-755c9f25160a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:46.352898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19234a6-0639-4c15-bcc0-755c9f25160a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:46.400587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85933b9-e443-4d80-819e-18b95fb64c72 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:46.433421 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19234a6-0639-4c15-bcc0-755c9f25160a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:46.434945 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19234a6-0639-4c15-bcc0-755c9f25160a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:46.439087 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814692c-2400-4b23-857a-01b7bcc4667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:46.439745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814692c-2400-4b23-857a-01b7bcc4667a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:46.440034 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814692c-2400-4b23-857a-01b7bcc4667a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:46.440315 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814692c-2400-4b23-857a-01b7bcc4667a None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:46.441115 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814692c-2400-4b23-857a-01b7bcc4667a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:46.441431 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814692c-2400-4b23-857a-01b7bcc4667a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:46.442892 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814692c-2400-4b23-857a-01b7bcc4667a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:46.456558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 414/820] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:46.457407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814692c-2400-4b23-857a-01b7bcc4667a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:46.461007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:46.499172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:46.549434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 407/821] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:46:46.550726 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19234a6-0639-4c15-bcc0-755c9f25160a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:46.575541 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814692c-2400-4b23-857a-01b7bcc4667a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:46.613514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1859e-8b68-409c-baae-cc5e37da3c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:46.614200 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1859e-8b68-409c-baae-cc5e37da3c26 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:46.614485 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1859e-8b68-409c-baae-cc5e37da3c26 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:46.614862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1859e-8b68-409c-baae-cc5e37da3c26 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:46.615588 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1859e-8b68-409c-baae-cc5e37da3c26 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:46.615947 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1859e-8b68-409c-baae-cc5e37da3c26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:46.617335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1859e-8b68-409c-baae-cc5e37da3c26 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:46.626659 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 415/822] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:46:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:46.626659 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1859e-8b68-409c-baae-cc5e37da3c26 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:46.669738 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19234a6-0639-4c15-bcc0-755c9f25160a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:46.704410 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:46.708287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f130d-7c4c-48a9-b1b0-38db6040ef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:46.709061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f130d-7c4c-48a9-b1b0-38db6040ef06 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:46.709354 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f130d-7c4c-48a9-b1b0-38db6040ef06 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:46.722798 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f130d-7c4c-48a9-b1b0-38db6040ef06 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:46.722798 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f130d-7c4c-48a9-b1b0-38db6040ef06 None admin] RBAC: Adding query filter params (type=network) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:46.722798 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f130d-7c4c-48a9-b1b0-38db6040ef06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:46.722798 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f130d-7c4c-48a9-b1b0-38db6040ef06 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:46.723646 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 408/823] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:46:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:46.724801 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f130d-7c4c-48a9-b1b0-38db6040ef06 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:46.748446 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1859e-8b68-409c-baae-cc5e37da3c26 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:46.752478 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:46.786009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b72a6-2eb1-4da8-b6cc-327b1f8d5f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:46.787700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b72a6-2eb1-4da8-b6cc-327b1f8d5f21 None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:46.788045 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b72a6-2eb1-4da8-b6cc-327b1f8d5f21 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:46.788329 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b72a6-2eb1-4da8-b6cc-327b1f8d5f21 None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/54a572dfba3e48498be80570d0f71369/roles/df1609ea031d4414971c13ff878a13e2` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:46.805209 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b72a6-2eb1-4da8-b6cc-327b1f8d5f21 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=54a572dfba3e48498be80570d0f71369, role_id=df1609ea031d4414971c13ff878a13e2)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:46.806822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b72a6-2eb1-4da8-b6cc-327b1f8d5f21 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:46.844464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f130d-7c4c-48a9-b1b0-38db6040ef06 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:46.879880 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 416/824] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:46:46 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/54a572dfba3e48498be80570d0f71369/roles/df1609ea031d4414971c13ff878a13e2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:46:46.881230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b72a6-2eb1-4da8-b6cc-327b1f8d5f21 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:46.883631 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0ada7-54bb-4a6f-b61b-0f8f3845279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:46.884509 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0ada7-54bb-4a6f-b61b-0f8f3845279d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:46.884782 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0ada7-54bb-4a6f-b61b-0f8f3845279d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:46.885278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0ada7-54bb-4a6f-b61b-0f8f3845279d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:46.902810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0ada7-54bb-4a6f-b61b-0f8f3845279d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:46.904697 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0ada7-54bb-4a6f-b61b-0f8f3845279d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-c6f0ada7-54bb-4a6f-b61b-0f8f3845279d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:46.933845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:46.935106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:46.941593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:46.941593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:46.941593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:46.941593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:46.941593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 409/825] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:46.941593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0ada7-54bb-4a6f-b61b-0f8f3845279d None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:47.025870 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b72a6-2eb1-4da8-b6cc-327b1f8d5f21 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:47.030033 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:47.051621 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:47.071387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f033a50-1bdc-4cda-bf4c-18a576cd2961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:47.075236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f033a50-1bdc-4cda-bf4c-18a576cd2961 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:47.075236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f033a50-1bdc-4cda-bf4c-18a576cd2961 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:47.075236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f033a50-1bdc-4cda-bf4c-18a576cd2961 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:47.075236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f033a50-1bdc-4cda-bf4c-18a576cd2961 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:47.075236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f033a50-1bdc-4cda-bf4c-18a576cd2961 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:47.075940 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f033a50-1bdc-4cda-bf4c-18a576cd2961 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:47.081825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0ada7-54bb-4a6f-b61b-0f8f3845279d None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:47.086446 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 417/826] 10.222.0.89 () {56 vars in 1124 bytes} [Thu May 19 20:46:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:47.087552 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f033a50-1bdc-4cda-bf4c-18a576cd2961 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:47.129823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec034dd-7412-45cf-9cde-36e1c082ed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:47.130499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec034dd-7412-45cf-9cde-36e1c082ed9f None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:47.130855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec034dd-7412-45cf-9cde-36e1c082ed9f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:47.131137 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec034dd-7412-45cf-9cde-36e1c082ed9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:47.131904 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec034dd-7412-45cf-9cde-36e1c082ed9f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:47.133405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec034dd-7412-45cf-9cde-36e1c082ed9f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:47.218105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f033a50-1bdc-4cda-bf4c-18a576cd2961 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:47.235874 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 410/827] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:46:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:46:47.243990 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec034dd-7412-45cf-9cde-36e1c082ed9f None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:47.283846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92a31b-028a-4808-bf35-b058890dcba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:47.286394 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92a31b-028a-4808-bf35-b058890dcba6 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:47.287036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92a31b-028a-4808-bf35-b058890dcba6 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:47.288019 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92a31b-028a-4808-bf35-b058890dcba6 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:47.290130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92a31b-028a-4808-bf35-b058890dcba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:47.292080 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92a31b-028a-4808-bf35-b058890dcba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:47.296466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92a31b-028a-4808-bf35-b058890dcba6 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:47.331777 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 418/828] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:47.335108 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92a31b-028a-4808-bf35-b058890dcba6 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:47.415022 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:47.505768 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92a31b-028a-4808-bf35-b058890dcba6 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:47.514743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec034dd-7412-45cf-9cde-36e1c082ed9f None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:47.558292 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723dcba-4ccf-4476-8183-9b819f32563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:47.561352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723dcba-4ccf-4476-8183-9b819f32563c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:47.561689 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723dcba-4ccf-4476-8183-9b819f32563c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:47.561931 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723dcba-4ccf-4476-8183-9b819f32563c None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:47.569394 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:47.573634 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723dcba-4ccf-4476-8183-9b819f32563c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:47.578219 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723dcba-4ccf-4476-8183-9b819f32563c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:47.582797 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b84c9-12bb-4d5b-9592-55e4dbedea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:47.584162 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b84c9-12bb-4d5b-9592-55e4dbedea6e None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:47.584716 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b84c9-12bb-4d5b-9592-55e4dbedea6e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:47.585212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b84c9-12bb-4d5b-9592-55e4dbedea6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:47.586182 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b84c9-12bb-4d5b-9592-55e4dbedea6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:47.588055 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b84c9-12bb-4d5b-9592-55e4dbedea6e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-8723dcba-4ccf-4476-8183-9b819f32563c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:47.603078 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:47.605649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:47.607174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:47.607174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:47.607174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:47.607174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:47.607174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:47.607174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:47.607174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:47.607174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:47.607174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 419/829] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:47.614638 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723dcba-4ccf-4476-8183-9b819f32563c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:47.691346 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 411/830] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:46:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:46:47.745713 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18495-da28-4bd9-84a9-4872e4579257 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:47.746081 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18495-da28-4bd9-84a9-4872e4579257 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:47.746281 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18495-da28-4bd9-84a9-4872e4579257 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:47.747767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:47.752233 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 412/831] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:46:47.752904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723dcba-4ccf-4476-8183-9b819f32563c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:47.754151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8163c-0ed9-4584-977e-152e45650f6c None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:47.754444 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8163c-0ed9-4584-977e-152e45650f6c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:47.754758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8163c-0ed9-4584-977e-152e45650f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:47.778227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-75f8163c-0ed9-4584-977e-152e45650f6c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:47.780218 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-75f8163c-0ed9-4584-977e-152e45650f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:47.816611 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce69f0e-bd2f-49d5-a55e-a675d07cfbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:47.817260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce69f0e-bd2f-49d5-a55e-a675d07cfbbb None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:47.817601 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce69f0e-bd2f-49d5-a55e-a675d07cfbbb None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:47.817881 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce69f0e-bd2f-49d5-a55e-a675d07cfbbb None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:47.818749 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce69f0e-bd2f-49d5-a55e-a675d07cfbbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:47.819064 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce69f0e-bd2f-49d5-a55e-a675d07cfbbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:47.820550 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce69f0e-bd2f-49d5-a55e-a675d07cfbbb None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:47.835444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 420/832] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:47.842477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce69f0e-bd2f-49d5-a55e-a675d07cfbbb None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:47.873554 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 413/833] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:46:47.904654 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8163c-0ed9-4584-977e-152e45650f6c None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:47.997876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce69f0e-bd2f-49d5-a55e-a675d07cfbbb None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:48.038031 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fc484-b300-4a82-940f-61a515ae004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:48.038646 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fc484-b300-4a82-940f-61a515ae004a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:48.038939 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fc484-b300-4a82-940f-61a515ae004a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:48.039219 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fc484-b300-4a82-940f-61a515ae004a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:48.040080 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fc484-b300-4a82-940f-61a515ae004a None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=7a36f250f3d04faab08146d937ef840e) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:48.040397 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fc484-b300-4a82-940f-61a515ae004a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:48.041862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fc484-b300-4a82-940f-61a515ae004a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:48.045633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8163c-0ed9-4584-977e-152e45650f6c None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:48.050333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 421/834] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:47 2022] GET /identity/v3/role_assignments?user.id=7a36f250f3d04faab08146d937ef840e&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:48.067015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:48.093816 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83cdb-97f7-4242-b062-3a3dbcc89ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:48.095157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83cdb-97f7-4242-b062-3a3dbcc89ccc None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:48.095695 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83cdb-97f7-4242-b062-3a3dbcc89ccc None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:48.096197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83cdb-97f7-4242-b062-3a3dbcc89ccc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:48.110203 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d83cdb-97f7-4242-b062-3a3dbcc89ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-e8d83cdb-97f7-4242-b062-3a3dbcc89ccc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:48.118823 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:48.120050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:46:48.121116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:48.125524 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 414/835] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:48.127243 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fc484-b300-4a82-940f-61a515ae004a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:48.151003 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:48.259543 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fc484-b300-4a82-940f-61a515ae004a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:48.302140 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4f4e3-a3c0-4313-9e1f-6528a8053206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:48.302931 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4f4e3-a3c0-4313-9e1f-6528a8053206 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:48.303141 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4f4e3-a3c0-4313-9e1f-6528a8053206 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:48.303428 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4f4e3-a3c0-4313-9e1f-6528a8053206 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:48.304206 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4f4e3-a3c0-4313-9e1f-6528a8053206 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:48.304521 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4f4e3-a3c0-4313-9e1f-6528a8053206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:48.305952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4f4e3-a3c0-4313-9e1f-6528a8053206 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:48.316194 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 422/836] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:48.322375 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83cdb-97f7-4242-b062-3a3dbcc89ccc None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:48.442520 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83cdb-97f7-4242-b062-3a3dbcc89ccc None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:48.481813 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379a65a-df8d-4319-a9a8-17929d58b6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:48.482632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379a65a-df8d-4319-a9a8-17929d58b6d8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:48.482966 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379a65a-df8d-4319-a9a8-17929d58b6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:48.483252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379a65a-df8d-4319-a9a8-17929d58b6d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:48.495793 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379a65a-df8d-4319-a9a8-17929d58b6d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:48.497263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379a65a-df8d-4319-a9a8-17929d58b6d8 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-5379a65a-df8d-4319-a9a8-17929d58b6d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:48.515763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:48.518299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:48.519449 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:48.519449 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:48.519449 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:48.519449 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:48.519449 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 415/837] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:48.522678 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4f4e3-a3c0-4313-9e1f-6528a8053206 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:48.611093 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:48.631906 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4f4e3-a3c0-4313-9e1f-6528a8053206 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:48.669210 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da44732-779d-41f1-9605-d9d420d5dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:48.669890 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da44732-779d-41f1-9605-d9d420d5dc90 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:48.670176 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da44732-779d-41f1-9605-d9d420d5dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:48.670454 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da44732-779d-41f1-9605-d9d420d5dc90 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:48.671231 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da44732-779d-41f1-9605-d9d420d5dc90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:48.671545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da44732-779d-41f1-9605-d9d420d5dc90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:48.673017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da44732-779d-41f1-9605-d9d420d5dc90 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:48.687348 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 423/838] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:48.692994 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379a65a-df8d-4319-a9a8-17929d58b6d8 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:48.725251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:48.804099 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379a65a-df8d-4319-a9a8-17929d58b6d8 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:48.841485 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9aafd-6807-4110-b652-d65f1dbf5c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:48.842295 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9aafd-6807-4110-b652-d65f1dbf5c41 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:48.842649 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9aafd-6807-4110-b652-d65f1dbf5c41 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:48.842917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9aafd-6807-4110-b652-d65f1dbf5c41 None admin] PATH_INFO: `/v3/users/swift` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:48.850687 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9aafd-6807-4110-b652-d65f1dbf5c41 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:48.852151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9aafd-6807-4110-b652-d65f1dbf5c41 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-8aa9aafd-6807-4110-b652-d65f1dbf5c41 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:48.868035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:48.870866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:48.873045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:48.873045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:48.873045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:48.873045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:48.873045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:48.873045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:48.873045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:48.873045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:48.873045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:46:48.873045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:48.873045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 416/839] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:46:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:48.875381 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da44732-779d-41f1-9605-d9d420d5dc90 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:48.989327 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da44732-779d-41f1-9605-d9d420d5dc90 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:49.027857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f445d8-d818-4b9d-b0d0-f85d937b663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:49.028566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f445d8-d818-4b9d-b0d0-f85d937b663d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:49.028854 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f445d8-d818-4b9d-b0d0-f85d937b663d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:49.029131 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f445d8-d818-4b9d-b0d0-f85d937b663d None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:49.030003 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f445d8-d818-4b9d-b0d0-f85d937b663d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:49.030318 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f445d8-d818-4b9d-b0d0-f85d937b663d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:49.031837 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f445d8-d818-4b9d-b0d0-f85d937b663d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:49.043169 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:49.069886 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 424/840] 10.222.0.89 () {56 vars in 1135 bytes} [Thu May 19 20:46:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:49.070116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9aafd-6807-4110-b652-d65f1dbf5c41 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:49.156665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:49.173916 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9aafd-6807-4110-b652-d65f1dbf5c41 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:49.216499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb879211-94a7-411c-9029-b89e851ebdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:49.217167 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879211-94a7-411c-9029-b89e851ebdd1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:49.217986 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879211-94a7-411c-9029-b89e851ebdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:49.218264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879211-94a7-411c-9029-b89e851ebdd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:49.292949 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb879211-94a7-411c-9029-b89e851ebdd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:49.294426 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb879211-94a7-411c-9029-b89e851ebdd1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:49.382639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141219-0289-49af-8ef5-06293e57a4c1 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:49.383743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141219-0289-49af-8ef5-06293e57a4c1 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:49.384277 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141219-0289-49af-8ef5-06293e57a4c1 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:49.386888 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:49.387595 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 425/841] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:49.393721 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8548-bb32-46ee-a415-d17b259e599e None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:49.394287 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8548-bb32-46ee-a415-d17b259e599e None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:49.394826 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8548-bb32-46ee-a415-d17b259e599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:49.403524 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 417/842] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:46:49.414719 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-d1ec8548-bb32-46ee-a415-d17b259e599e None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:49.414900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb879211-94a7-411c-9029-b89e851ebdd1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:49.416309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-d1ec8548-bb32-46ee-a415-d17b259e599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:49.506880 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 426/843] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:46:49.520313 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb879211-94a7-411c-9029-b89e851ebdd1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:49.523997 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec8548-bb32-46ee-a415-d17b259e599e None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:49.558986 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983e938-1380-4c59-8630-ea252363fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:49.559801 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983e938-1380-4c59-8630-ea252363fea0 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:49.560085 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983e938-1380-4c59-8630-ea252363fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:49.560625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983e938-1380-4c59-8630-ea252363fea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:49.574410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983e938-1380-4c59-8630-ea252363fea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:49.576544 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983e938-1380-4c59-8630-ea252363fea0 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-9983e938-1380-4c59-8630-ea252363fea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:49.600526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:49.601677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:49.602776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:49.602776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:49.602776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:49.602776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:49.602776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 418/844] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:49.608420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983e938-1380-4c59-8630-ea252363fea0 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:49.645151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec8548-bb32-46ee-a415-d17b259e599e None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:49.671235 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:49.678056 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:49.689443 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb84c5-1c19-45ca-ab00-42d840c150d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:49.690261 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb84c5-1c19-45ca-ab00-42d840c150d0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:49.690546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb84c5-1c19-45ca-ab00-42d840c150d0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:49.690860 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb84c5-1c19-45ca-ab00-42d840c150d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:49.707255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb84c5-1c19-45ca-ab00-42d840c150d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-c9eb84c5-1c19-45ca-ab00-42d840c150d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:49.720168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:49.721823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:46:49.722897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:49.724498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 427/845] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:46:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:49.731092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983e938-1380-4c59-8630-ea252363fea0 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:49.733290 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb84c5-1c19-45ca-ab00-42d840c150d0 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:49.770582 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032b7dd-bc70-403a-b6ce-fb6ddd4de134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:49.771403 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032b7dd-bc70-403a-b6ce-fb6ddd4de134 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:49.771690 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032b7dd-bc70-403a-b6ce-fb6ddd4de134 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:49.771965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032b7dd-bc70-403a-b6ce-fb6ddd4de134 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:49.772703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032b7dd-bc70-403a-b6ce-fb6ddd4de134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:49.773032 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032b7dd-bc70-403a-b6ce-fb6ddd4de134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:49.774750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032b7dd-bc70-403a-b6ce-fb6ddd4de134 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:49.788862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 419/846] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:49.794346 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032b7dd-bc70-403a-b6ce-fb6ddd4de134 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:49.866310 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb84c5-1c19-45ca-ab00-42d840c150d0 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:49.903122 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c8106-6da0-4f40-8f13-fa217f2f98ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:49.903804 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c8106-6da0-4f40-8f13-fa217f2f98ae None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:49.904143 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c8106-6da0-4f40-8f13-fa217f2f98ae None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:49.904430 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c8106-6da0-4f40-8f13-fa217f2f98ae None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:49.905188 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c8106-6da0-4f40-8f13-fa217f2f98ae None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:49.905500 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c8106-6da0-4f40-8f13-fa217f2f98ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:49.906965 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c8106-6da0-4f40-8f13-fa217f2f98ae None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:49.915753 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 428/847] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:46:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:49.921403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c8106-6da0-4f40-8f13-fa217f2f98ae None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:49.925465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:49.930496 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032b7dd-bc70-403a-b6ce-fb6ddd4de134 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:49.973983 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85190e2e-6d5f-4644-800b-988253ecd406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:49.974817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85190e2e-6d5f-4644-800b-988253ecd406 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:49.975148 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85190e2e-6d5f-4644-800b-988253ecd406 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:49.975424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85190e2e-6d5f-4644-800b-988253ecd406 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:49.982691 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85190e2e-6d5f-4644-800b-988253ecd406 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:49.984138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85190e2e-6d5f-4644-800b-988253ecd406 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-85190e2e-6d5f-4644-800b-988253ecd406 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:49.998101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:49.999192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:50.000374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:50.000374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:50.000374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:50.000374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:50.000374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:50.000374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:50.000374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:50.000374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:50.000374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 420/848] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:50.002106 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:50.007041 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85190e2e-6d5f-4644-800b-988253ecd406 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:50.058172 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c8106-6da0-4f40-8f13-fa217f2f98ae None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:50.105499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6898b-30ac-4ea2-907f-14e13e6c69d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:50.106469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6898b-30ac-4ea2-907f-14e13e6c69d0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.107292 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6898b-30ac-4ea2-907f-14e13e6c69d0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.107292 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6898b-30ac-4ea2-907f-14e13e6c69d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.121226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6898b-30ac-4ea2-907f-14e13e6c69d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:50.122551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6898b-30ac-4ea2-907f-14e13e6c69d0 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-b5a6898b-30ac-4ea2-907f-14e13e6c69d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:50.141461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:50.142572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:50.143697 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:50.143697 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:50.143697 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:50.143697 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:50.143697 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 429/849] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:50.154669 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6898b-30ac-4ea2-907f-14e13e6c69d0 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:50.154909 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85190e2e-6d5f-4644-800b-988253ecd406 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:50.198897 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3c592-86d1-47d9-93f7-54bd9c5a0b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:50.200092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3c592-86d1-47d9-93f7-54bd9c5a0b60 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.200605 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3c592-86d1-47d9-93f7-54bd9c5a0b60 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.201067 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3c592-86d1-47d9-93f7-54bd9c5a0b60 None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.201952 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3c592-86d1-47d9-93f7-54bd9c5a0b60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:50.202473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3c592-86d1-47d9-93f7-54bd9c5a0b60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:50.204363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3c592-86d1-47d9-93f7-54bd9c5a0b60 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:50.221214 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 421/850] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:50.227250 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3c592-86d1-47d9-93f7-54bd9c5a0b60 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:50.253398 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:50.263372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6898b-30ac-4ea2-907f-14e13e6c69d0 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:50.265509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:50.301287 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1ff7f-2380-4785-9cfa-ada10be1a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:50.301961 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ff7f-2380-4785-9cfa-ada10be1a23a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.302242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ff7f-2380-4785-9cfa-ada10be1a23a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.302518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ff7f-2380-4785-9cfa-ada10be1a23a None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.303283 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1ff7f-2380-4785-9cfa-ada10be1a23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:50.303671 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1ff7f-2380-4785-9cfa-ada10be1a23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:50.305129 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1ff7f-2380-4785-9cfa-ada10be1a23a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:50.324598 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 430/851] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:50.324598 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c869d-84b6-4d2e-9131-298471481b72 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.324598 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c869d-84b6-4d2e-9131-298471481b72 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.324598 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c869d-84b6-4d2e-9131-298471481b72 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.324598 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 431/852] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:50.328184 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c869d-84b6-4d2e-9131-298471481b72 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:50.346908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3c592-86d1-47d9-93f7-54bd9c5a0b60 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:50.387100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68c11-9e42-4e96-933f-cc515eddbb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:50.387780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68c11-9e42-4e96-933f-cc515eddbb97 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.388032 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68c11-9e42-4e96-933f-cc515eddbb97 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.388308 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68c11-9e42-4e96-933f-cc515eddbb97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.389141 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb68c11-9e42-4e96-933f-cc515eddbb97 None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=aab1ecd7a8074c288ac9b70065e6efa2) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:50.389452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb68c11-9e42-4e96-933f-cc515eddbb97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:50.390910 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb68c11-9e42-4e96-933f-cc515eddbb97 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:50.406632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 422/853] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:50 2022] GET /identity/v3/role_assignments?user.id=aab1ecd7a8074c288ac9b70065e6efa2&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:50.406632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb106c-e540-43ed-9756-19ad7cf8f2e0 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.406632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb106c-e540-43ed-9756-19ad7cf8f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.406632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb106c-e540-43ed-9756-19ad7cf8f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.426813 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-d8cb106c-e540-43ed-9756-19ad7cf8f2e0 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:50.428266 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-d8cb106c-e540-43ed-9756-19ad7cf8f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:50.450571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c869d-84b6-4d2e-9131-298471481b72 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:50.502694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e468ad-b07c-4842-b8ff-8ac5eea70669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:50.503532 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e468ad-b07c-4842-b8ff-8ac5eea70669 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.503811 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e468ad-b07c-4842-b8ff-8ac5eea70669 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.504082 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e468ad-b07c-4842-b8ff-8ac5eea70669 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.513033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e468ad-b07c-4842-b8ff-8ac5eea70669 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:50.514564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e468ad-b07c-4842-b8ff-8ac5eea70669 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-11e468ad-b07c-4842-b8ff-8ac5eea70669 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:50.532773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:50.533971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:50.535144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:50.535144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:50.535144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:50.535144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:50.535144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:50.535144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:50.535144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:50.535144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:50.535144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:46:50.535144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:50.535144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 432/854] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:46:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:50.540073 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e468ad-b07c-4842-b8ff-8ac5eea70669 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:50.541744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 423/855] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:50.564199 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb106c-e540-43ed-9756-19ad7cf8f2e0 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:50.587673 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:50.595047 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:50.668523 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e468ad-b07c-4842-b8ff-8ac5eea70669 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:50.711564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29563d-75dd-48c2-b010-feeab8a66b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:50.712159 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29563d-75dd-48c2-b010-feeab8a66b32 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.712440 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29563d-75dd-48c2-b010-feeab8a66b32 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.712714 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29563d-75dd-48c2-b010-feeab8a66b32 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.713560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29563d-75dd-48c2-b010-feeab8a66b32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:50.714463 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29563d-75dd-48c2-b010-feeab8a66b32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:50.714585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb106c-e540-43ed-9756-19ad7cf8f2e0 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:50.715929 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29563d-75dd-48c2-b010-feeab8a66b32 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:50.742775 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 433/856] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:46:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:50.747990 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29563d-75dd-48c2-b010-feeab8a66b32 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:50.762630 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40ebad-7f9f-4e2e-9027-eea78ab66d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:50.762630 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ebad-7f9f-4e2e-9027-eea78ab66d2f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.762630 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ebad-7f9f-4e2e-9027-eea78ab66d2f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.762630 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ebad-7f9f-4e2e-9027-eea78ab66d2f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.763118 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40ebad-7f9f-4e2e-9027-eea78ab66d2f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:50.764163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40ebad-7f9f-4e2e-9027-eea78ab66d2f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-1f40ebad-7f9f-4e2e-9027-eea78ab66d2f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:50.781409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:50.782711 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:46:50.783727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:50.786709 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 424/857] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:46:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:50.789353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d22a6-6131-4ef3-80cb-593036650bec None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.789716 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d22a6-6131-4ef3-80cb-593036650bec None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.790068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d22a6-6131-4ef3-80cb-593036650bec None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.791545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 425/858] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:50.792301 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d22a6-6131-4ef3-80cb-593036650bec None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:50.850889 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:50.870793 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29563d-75dd-48c2-b010-feeab8a66b32 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:50.882342 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:50.909878 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d22a6-6131-4ef3-80cb-593036650bec None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:50.910509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8540a1-4260-41bd-9fb3-fca6d2dbccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:50.911201 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8540a1-4260-41bd-9fb3-fca6d2dbccf2 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.911491 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8540a1-4260-41bd-9fb3-fca6d2dbccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.911765 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8540a1-4260-41bd-9fb3-fca6d2dbccf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.946290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa0194-88b6-451a-a060-cc7c1a7a1f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:50.947000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa0194-88b6-451a-a060-cc7c1a7a1f9a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.947286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa0194-88b6-451a-a060-cc7c1a7a1f9a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.947564 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa0194-88b6-451a-a060-cc7c1a7a1f9a None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.948893 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa0194-88b6-451a-a060-cc7c1a7a1f9a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:50.949205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa0194-88b6-451a-a060-cc7c1a7a1f9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:50.950637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa0194-88b6-451a-a060-cc7c1a7a1f9a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:50.955924 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 426/859] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:46:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:50.960636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bcd70-f454-4ef8-896a-c0f1c9b2d3ec None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:50.960923 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bcd70-f454-4ef8-896a-c0f1c9b2d3ec None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:50.961199 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bcd70-f454-4ef8-896a-c0f1c9b2d3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:50.978880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-973bcd70-f454-4ef8-896a-c0f1c9b2d3ec None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:50.980133 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-973bcd70-f454-4ef8-896a-c0f1c9b2d3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:50.989625 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8540a1-4260-41bd-9fb3-fca6d2dbccf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:50.991161 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8540a1-4260-41bd-9fb3-fca6d2dbccf2 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:51.057965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 427/860] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:51.058881 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bcd70-f454-4ef8-896a-c0f1c9b2d3ec None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:51.096445 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:51.116764 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 434/861] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:46:51.117627 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8540a1-4260-41bd-9fb3-fca6d2dbccf2 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:51.141875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:51.174437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bcd70-f454-4ef8-896a-c0f1c9b2d3ec None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:51.214451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6aad8f-04b4-4f92-88b4-87d92f332433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:51.215167 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aad8f-04b4-4f92-88b4-87d92f332433 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:51.215450 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aad8f-04b4-4f92-88b4-87d92f332433 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:51.215721 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aad8f-04b4-4f92-88b4-87d92f332433 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:51.216439 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6aad8f-04b4-4f92-88b4-87d92f332433 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:51.216748 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6aad8f-04b4-4f92-88b4-87d92f332433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:51.218115 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6aad8f-04b4-4f92-88b4-87d92f332433 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:51.234735 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 428/862] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:46:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:51.234735 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6aad8f-04b4-4f92-88b4-87d92f332433 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:51.245484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8540a1-4260-41bd-9fb3-fca6d2dbccf2 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:51.289423 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfa44f-37af-4dad-a2db-4331aa6e5279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:51.290445 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfa44f-37af-4dad-a2db-4331aa6e5279 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:51.290830 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfa44f-37af-4dad-a2db-4331aa6e5279 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:51.291192 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfa44f-37af-4dad-a2db-4331aa6e5279 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:51.292000 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfa44f-37af-4dad-a2db-4331aa6e5279 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:51.293767 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfa44f-37af-4dad-a2db-4331aa6e5279 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-97bfa44f-37af-4dad-a2db-4331aa6e5279 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:51.309119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:51.310670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:51.312089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 435/863] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 20:46:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:51.316571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfa44f-37af-4dad-a2db-4331aa6e5279 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:51.373578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6aad8f-04b4-4f92-88b4-87d92f332433 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:51.378903 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:51.423690 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f873f5e-912b-47ff-a3f9-ea043ca5cb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:51.424960 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f873f5e-912b-47ff-a3f9-ea043ca5cb5a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:51.425406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f873f5e-912b-47ff-a3f9-ea043ca5cb5a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:51.425932 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f873f5e-912b-47ff-a3f9-ea043ca5cb5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:51.429925 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:51.447753 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f873f5e-912b-47ff-a3f9-ea043ca5cb5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:51.450556 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f873f5e-912b-47ff-a3f9-ea043ca5cb5a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:51.459678 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfa44f-37af-4dad-a2db-4331aa6e5279 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-1f873f5e-912b-47ff-a3f9-ea043ca5cb5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:51.472549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:51.473692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:51.475395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:51.475395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:51.475395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:51.475395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:51.475395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 429/864] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:51.479629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f873f5e-912b-47ff-a3f9-ea043ca5cb5a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:51.505250 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03578fb-9931-4ca2-9a17-4c2d13751308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:51.506206 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03578fb-9931-4ca2-9a17-4c2d13751308 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:51.506560 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03578fb-9931-4ca2-9a17-4c2d13751308 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:51.507116 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03578fb-9931-4ca2-9a17-4c2d13751308 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:51.508316 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03578fb-9931-4ca2-9a17-4c2d13751308 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:51.508777 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03578fb-9931-4ca2-9a17-4c2d13751308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:51.511130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03578fb-9931-4ca2-9a17-4c2d13751308 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:51.517919 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 436/865] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:46:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:51.524264 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03578fb-9931-4ca2-9a17-4c2d13751308 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:51.620404 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f873f5e-912b-47ff-a3f9-ea043ca5cb5a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:51.637999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03578fb-9931-4ca2-9a17-4c2d13751308 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:51.648925 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:51.671368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e94d0-3f57-45e1-bb20-3363a0f8d413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:51.672079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e94d0-3f57-45e1-bb20-3363a0f8d413 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:51.672561 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e94d0-3f57-45e1-bb20-3363a0f8d413 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:51.672846 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e94d0-3f57-45e1-bb20-3363a0f8d413 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:51.674282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e94d0-3f57-45e1-bb20-3363a0f8d413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:51.674595 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e94d0-3f57-45e1-bb20-3363a0f8d413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:51.676689 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e94d0-3f57-45e1-bb20-3363a0f8d413 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:51.679301 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5ddd7-39e4-42a0-afbe-5da427b50047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:51.680131 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5ddd7-39e4-42a0-afbe-5da427b50047 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:51.680513 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5ddd7-39e4-42a0-afbe-5da427b50047 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:51.680889 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5ddd7-39e4-42a0-afbe-5da427b50047 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:51.681734 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5ddd7-39e4-42a0-afbe-5da427b50047 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:51.682145 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5ddd7-39e4-42a0-afbe-5da427b50047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:51.684110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5ddd7-39e4-42a0-afbe-5da427b50047 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:51.693406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 430/866] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:51.695406 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 437/867] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:46:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:51.699555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e94d0-3f57-45e1-bb20-3363a0f8d413 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:51.757121 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:51.827567 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e94d0-3f57-45e1-bb20-3363a0f8d413 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:51.869135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ebe06-7c99-4fdc-99b0-a34b1c3bc7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:51.870657 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ebe06-7c99-4fdc-99b0-a34b1c3bc7f9 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:51.870957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ebe06-7c99-4fdc-99b0-a34b1c3bc7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:51.871236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ebe06-7c99-4fdc-99b0-a34b1c3bc7f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:51.879702 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ebe06-7c99-4fdc-99b0-a34b1c3bc7f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:51.881195 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ebe06-7c99-4fdc-99b0-a34b1c3bc7f9 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-9c2ebe06-7c99-4fdc-99b0-a34b1c3bc7f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:51.897650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:51.900072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:51.902470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:51.902470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:51.902470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:51.902470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:51.902470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:51.902470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:51.902470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:51.902470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:51.902470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 431/868] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:51.908232 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5ddd7-39e4-42a0-afbe-5da427b50047 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:52.019570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5ddd7-39e4-42a0-afbe-5da427b50047 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:52.054963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a005e4-5a7b-4e8d-8c57-418a486e264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:52.055943 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a005e4-5a7b-4e8d-8c57-418a486e264b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:52.056418 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a005e4-5a7b-4e8d-8c57-418a486e264b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:52.056872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a005e4-5a7b-4e8d-8c57-418a486e264b None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:52.058418 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a005e4-5a7b-4e8d-8c57-418a486e264b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:52.058932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a005e4-5a7b-4e8d-8c57-418a486e264b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:52.060834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a005e4-5a7b-4e8d-8c57-418a486e264b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:52.075494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 438/869] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:52.081697 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ebe06-7c99-4fdc-99b0-a34b1c3bc7f9 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:52.193345 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ebe06-7c99-4fdc-99b0-a34b1c3bc7f9 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:52.201610 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:52.231298 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056c67c-bc97-4d53-ace6-6b089e8a37cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:52.232409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c67c-bc97-4d53-ace6-6b089e8a37cf None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:52.232913 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c67c-bc97-4d53-ace6-6b089e8a37cf None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:52.233401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c67c-bc97-4d53-ace6-6b089e8a37cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:52.234439 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056c67c-bc97-4d53-ace6-6b089e8a37cf None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=54a572dfba3e48498be80570d0f71369) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:52.234993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056c67c-bc97-4d53-ace6-6b089e8a37cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:52.236651 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056c67c-bc97-4d53-ace6-6b089e8a37cf None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:52.243723 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 432/870] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:52 2022] GET /identity/v3/role_assignments?user.id=54a572dfba3e48498be80570d0f71369&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:52.818492 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da544f18-3b6d-4a5d-8a00-45b752daa7d1 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:52.819095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da544f18-3b6d-4a5d-8a00-45b752daa7d1 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:52.819095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da544f18-3b6d-4a5d-8a00-45b752daa7d1 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:52.820774 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 439/871] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:52.827217 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ec877-2e53-4d69-ada7-784138350b63 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:52.827754 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ec877-2e53-4d69-ada7-784138350b63 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:52.827754 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ec877-2e53-4d69-ada7-784138350b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:52.845915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-a06ec877-2e53-4d69-ada7-784138350b63 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:52.847162 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-a06ec877-2e53-4d69-ada7-784138350b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:52.922806 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 433/872] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:52.945144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da544f18-3b6d-4a5d-8a00-45b752daa7d1 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:52.979799 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:53.058790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da544f18-3b6d-4a5d-8a00-45b752daa7d1 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:53.097802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45843525-f976-431d-8bec-38dc54a0a264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:53.098512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45843525-f976-431d-8bec-38dc54a0a264 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:53.098833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45843525-f976-431d-8bec-38dc54a0a264 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:53.099102 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45843525-f976-431d-8bec-38dc54a0a264 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:53.099771 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45843525-f976-431d-8bec-38dc54a0a264 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:53.101160 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45843525-f976-431d-8bec-38dc54a0a264 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-45843525-f976-431d-8bec-38dc54a0a264 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:53.114597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:53.115936 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:53.116952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 440/873] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:46:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:53.122038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ec877-2e53-4d69-ada7-784138350b63 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:53.230540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:53.233691 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ec877-2e53-4d69-ada7-784138350b63 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:53.269532 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8e318-622c-4b28-8c62-de112a9be4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:53.270220 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8e318-622c-4b28-8c62-de112a9be4fc None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:53.270504 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8e318-622c-4b28-8c62-de112a9be4fc None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:53.270815 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8e318-622c-4b28-8c62-de112a9be4fc None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:53.271540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8e318-622c-4b28-8c62-de112a9be4fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:53.271855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8e318-622c-4b28-8c62-de112a9be4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:53.273244 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8e318-622c-4b28-8c62-de112a9be4fc None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:53.279124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 434/874] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:46:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:53.286627 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45843525-f976-431d-8bec-38dc54a0a264 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:53.386431 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:53.393196 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45843525-f976-431d-8bec-38dc54a0a264 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:53.433672 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67980e06-7628-4e5b-a6e6-06cedd2d0aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:53.434347 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980e06-7628-4e5b-a6e6-06cedd2d0aba None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:53.434654 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980e06-7628-4e5b-a6e6-06cedd2d0aba None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:53.434937 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980e06-7628-4e5b-a6e6-06cedd2d0aba None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:53.435925 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67980e06-7628-4e5b-a6e6-06cedd2d0aba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:53.436234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67980e06-7628-4e5b-a6e6-06cedd2d0aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:53.437647 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67980e06-7628-4e5b-a6e6-06cedd2d0aba None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:53.443323 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 441/875] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:46:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:53.672692 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f0c0-94e3-480e-b961-1a1b8585df16 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:53.672885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f0c0-94e3-480e-b961-1a1b8585df16 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:53.673387 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f0c0-94e3-480e-b961-1a1b8585df16 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:53.675111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 435/876] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:53.680564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75ffb-8c1f-4c23-92f6-31e790f5322b None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:53.680837 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75ffb-8c1f-4c23-92f6-31e790f5322b None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:53.681121 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75ffb-8c1f-4c23-92f6-31e790f5322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:53.699839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-78c75ffb-8c1f-4c23-92f6-31e790f5322b None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:53.701043 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-78c75ffb-8c1f-4c23-92f6-31e790f5322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:53.779376 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 442/877] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:53.802158 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864f0c0-94e3-480e-b961-1a1b8585df16 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:53.917919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864f0c0-94e3-480e-b961-1a1b8585df16 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:53.954474 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3d1c1-4d51-4bfb-b137-d6cab0a05661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:53.955094 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3d1c1-4d51-4bfb-b137-d6cab0a05661 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:53.955375 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3d1c1-4d51-4bfb-b137-d6cab0a05661 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:53.955648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3d1c1-4d51-4bfb-b137-d6cab0a05661 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:53.956392 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3d1c1-4d51-4bfb-b137-d6cab0a05661 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:53.957766 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3d1c1-4d51-4bfb-b137-d6cab0a05661 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:54.040580 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 436/878] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:46:53 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:46:54.178391 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f9fb9-2fa1-47e8-9373-f98293e08c0d None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:54.179001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f9fb9-2fa1-47e8-9373-f98293e08c0d None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:54.179001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f9fb9-2fa1-47e8-9373-f98293e08c0d None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:54.180735 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 443/879] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:54.187555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eafc8-6bca-4694-9eb9-8fec8ac55caf None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:54.187902 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eafc8-6bca-4694-9eb9-8fec8ac55caf None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:54.188125 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eafc8-6bca-4694-9eb9-8fec8ac55caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:54.207915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-ed5eafc8-6bca-4694-9eb9-8fec8ac55caf None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:54.209078 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-ed5eafc8-6bca-4694-9eb9-8fec8ac55caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:54.234198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:54.315168 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 437/880] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:54.339276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f9fb9-2fa1-47e8-9373-f98293e08c0d None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:54.439619 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:54.451132 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f9fb9-2fa1-47e8-9373-f98293e08c0d None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:54.488515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c738ac4-c7d6-406d-bd45-acb1c7cc31c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:54.489124 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c738ac4-c7d6-406d-bd45-acb1c7cc31c8 None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:54.489410 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c738ac4-c7d6-406d-bd45-acb1c7cc31c8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:54.489691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c738ac4-c7d6-406d-bd45-acb1c7cc31c8 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:54.490443 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c738ac4-c7d6-406d-bd45-acb1c7cc31c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:54.491865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c738ac4-c7d6-406d-bd45-acb1c7cc31c8 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:54.583398 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 444/881] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:46:54 2022] POST /identity/v3/services => generated 269 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:46:54.751031 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ca63e-5fb6-42ae-a2ba-48bc2caa5280 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:54.751706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ca63e-5fb6-42ae-a2ba-48bc2caa5280 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:54.752211 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ca63e-5fb6-42ae-a2ba-48bc2caa5280 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:54.754186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 438/882] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:54.760374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc77129-687a-4c76-988b-ff40c8b75907 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:54.761096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc77129-687a-4c76-988b-ff40c8b75907 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:54.761619 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc77129-687a-4c76-988b-ff40c8b75907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:54.781364 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-dcc77129-687a-4c76-988b-ff40c8b75907 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:54.783009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-dcc77129-687a-4c76-988b-ff40c8b75907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:54.866707 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 445/883] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:54.885099 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ca63e-5fb6-42ae-a2ba-48bc2caa5280 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:54.993523 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ca63e-5fb6-42ae-a2ba-48bc2caa5280 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:55.030131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7dbe0-e087-4c5e-97f3-8da69d4d88db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:55.031358 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7dbe0-e087-4c5e-97f3-8da69d4d88db None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:55.031947 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7dbe0-e087-4c5e-97f3-8da69d4d88db None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:55.032484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7dbe0-e087-4c5e-97f3-8da69d4d88db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:55.056176 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7dbe0-e087-4c5e-97f3-8da69d4d88db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-b7b7dbe0-e087-4c5e-97f3-8da69d4d88db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:46:55.065052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:55.066227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:46:55.067292 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:55.074899 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 439/884] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:46:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:55.076865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc77129-687a-4c76-988b-ff40c8b75907 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:55.159950 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:55.185963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc77129-687a-4c76-988b-ff40c8b75907 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:55.231128 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4af67-a4b6-43b1-ad8d-ba1ad91bd9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:55.231817 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4af67-a4b6-43b1-ad8d-ba1ad91bd9a2 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:55.232310 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4af67-a4b6-43b1-ad8d-ba1ad91bd9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:55.232600 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4af67-a4b6-43b1-ad8d-ba1ad91bd9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:55.233377 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4af67-a4b6-43b1-ad8d-ba1ad91bd9a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:55.233690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4af67-a4b6-43b1-ad8d-ba1ad91bd9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:55.235190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4af67-a4b6-43b1-ad8d-ba1ad91bd9a2 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:55.250487 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 446/885] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:46:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:55.255286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7dbe0-e087-4c5e-97f3-8da69d4d88db None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:55.274980 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:55.376862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7dbe0-e087-4c5e-97f3-8da69d4d88db None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:55.416291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d20b95-4e2a-437a-9e48-33f73afc1d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:55.417152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d20b95-4e2a-437a-9e48-33f73afc1d9a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:55.417434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d20b95-4e2a-437a-9e48-33f73afc1d9a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:55.417708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d20b95-4e2a-437a-9e48-33f73afc1d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:55.428478 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d20b95-4e2a-437a-9e48-33f73afc1d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:55.429935 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d20b95-4e2a-437a-9e48-33f73afc1d9a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-67d20b95-4e2a-437a-9e48-33f73afc1d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:55.456538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:55.457682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:55.459345 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:55.459345 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:55.459345 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:55.459345 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:55.459345 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 440/886] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:55.464447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4af67-a4b6-43b1-ad8d-ba1ad91bd9a2 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:55.578046 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4af67-a4b6-43b1-ad8d-ba1ad91bd9a2 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:55.618363 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa576da-304d-4042-8665-1e6b69640e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:55.619241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa576da-304d-4042-8665-1e6b69640e4b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:55.619533 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa576da-304d-4042-8665-1e6b69640e4b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:55.620338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa576da-304d-4042-8665-1e6b69640e4b None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:55.621089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa576da-304d-4042-8665-1e6b69640e4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:55.621404 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa576da-304d-4042-8665-1e6b69640e4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:55.622895 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa576da-304d-4042-8665-1e6b69640e4b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:55.633863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:55.636558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 447/887] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:55.641756 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d20b95-4e2a-437a-9e48-33f73afc1d9a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:55.710053 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:55.750752 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d20b95-4e2a-437a-9e48-33f73afc1d9a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:55.775499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd26f-ee26-41e2-b0c8-d4e844f0e185 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:55.775834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd26f-ee26-41e2-b0c8-d4e844f0e185 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:55.776094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd26f-ee26-41e2-b0c8-d4e844f0e185 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:55.777933 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 448/888] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:46:55.783442 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1a8d3-2e16-42b5-b0fc-1a43b86624b3 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:55.783740 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1a8d3-2e16-42b5-b0fc-1a43b86624b3 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:55.784109 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1a8d3-2e16-42b5-b0fc-1a43b86624b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:55.788933 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66102a-2ff3-46d9-ac96-ed6921a24ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:55.789867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66102a-2ff3-46d9-ac96-ed6921a24ab6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:55.790150 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66102a-2ff3-46d9-ac96-ed6921a24ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:55.790422 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66102a-2ff3-46d9-ac96-ed6921a24ab6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:55.799601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66102a-2ff3-46d9-ac96-ed6921a24ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:55.801326 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66102a-2ff3-46d9-ac96-ed6921a24ab6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:55.803395 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-acf1a8d3-2e16-42b5-b0fc-1a43b86624b3 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:55.804720 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-acf1a8d3-2e16-42b5-b0fc-1a43b86624b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-2f66102a-2ff3-46d9-ac96-ed6921a24ab6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:46:55.818307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:55.820744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:55.822255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:55.822255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:55.822255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:46:55.822255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:46:55.822255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:46:55.822255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:46:55.822255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:46:55.822255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:46:55.822255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:46:55.822255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:55.822255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 441/889] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:46:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:55.829783 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66102a-2ff3-46d9-ac96-ed6921a24ab6 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:55.890965 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 449/890] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:55.910209 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1a8d3-2e16-42b5-b0fc-1a43b86624b3 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:55.941482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66102a-2ff3-46d9-ac96-ed6921a24ab6 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:55.966682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:55.980105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c55a5d-2001-4a59-a8f6-d54d7d2d4a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:55.980764 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c55a5d-2001-4a59-a8f6-d54d7d2d4a6c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:55.982908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c55a5d-2001-4a59-a8f6-d54d7d2d4a6c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:55.982908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c55a5d-2001-4a59-a8f6-d54d7d2d4a6c None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:55.982908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c55a5d-2001-4a59-a8f6-d54d7d2d4a6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:55.982908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c55a5d-2001-4a59-a8f6-d54d7d2d4a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:55.984444 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c55a5d-2001-4a59-a8f6-d54d7d2d4a6c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:56.005170 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 442/891] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:46:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:56.010200 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c55a5d-2001-4a59-a8f6-d54d7d2d4a6c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:56.027308 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1a8d3-2e16-42b5-b0fc-1a43b86624b3 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:56.066997 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:56.076912 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976877a-77c7-4df0-b03e-569c084fc05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:56.080499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976877a-77c7-4df0-b03e-569c084fc05f None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:56.080499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976877a-77c7-4df0-b03e-569c084fc05f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:56.080499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976877a-77c7-4df0-b03e-569c084fc05f None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:56.080499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976877a-77c7-4df0-b03e-569c084fc05f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:56.082083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976877a-77c7-4df0-b03e-569c084fc05f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:56.141621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c55a5d-2001-4a59-a8f6-d54d7d2d4a6c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:56.151019 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 450/892] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:46:55 2022] POST /identity/v3/services => generated 241 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:46:56.190584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed1b6c-c147-4f41-ad11-c6ce52cbc443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:56.191332 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1b6c-c147-4f41-ad11-c6ce52cbc443 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:56.191620 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1b6c-c147-4f41-ad11-c6ce52cbc443 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:56.191895 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1b6c-c147-4f41-ad11-c6ce52cbc443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:56.250931 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:56.284862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed1b6c-c147-4f41-ad11-c6ce52cbc443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:56.286867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed1b6c-c147-4f41-ad11-c6ce52cbc443 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:56.408576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 443/893] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:46:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:46:56.414287 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976877a-77c7-4df0-b03e-569c084fc05f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:56.447480 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d06f-242a-41e9-9800-395816f671c4 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:56.447824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d06f-242a-41e9-9800-395816f671c4 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:56.448274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d06f-242a-41e9-9800-395816f671c4 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:56.449824 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 444/894] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:56.456828 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300a11-dc04-4389-80ef-13703084f2c2 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:56.457170 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300a11-dc04-4389-80ef-13703084f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:56.457428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300a11-dc04-4389-80ef-13703084f2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:56.480405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-dd300a11-dc04-4389-80ef-13703084f2c2 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:56.482190 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-dd300a11-dc04-4389-80ef-13703084f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:56.532946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976877a-77c7-4df0-b03e-569c084fc05f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:56.572509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5481c8-c121-4f74-b2b8-9ecbb58947d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:56.573739 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5481c8-c121-4f74-b2b8-9ecbb58947d6 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:56.574258 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5481c8-c121-4f74-b2b8-9ecbb58947d6 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:56.574860 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5481c8-c121-4f74-b2b8-9ecbb58947d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:56.577323 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 445/895] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:46:56.587498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5481c8-c121-4f74-b2b8-9ecbb58947d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:56.589846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5481c8-c121-4f74-b2b8-9ecbb58947d6 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:56.598122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd300a11-dc04-4389-80ef-13703084f2c2 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-2b5481c8-c121-4f74-b2b8-9ecbb58947d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:46:56.609904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:56.611256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:56.612455 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:46:56.612455 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:46:56.612455 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:46:56.612455 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:56.612720 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:56.615022 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 451/896] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:56.620815 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5481c8-c121-4f74-b2b8-9ecbb58947d6 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:56.680721 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:56.731774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd300a11-dc04-4389-80ef-13703084f2c2 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:56.744393 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5481c8-c121-4f74-b2b8-9ecbb58947d6 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:56.771612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68443b49-0f0e-43fc-9af4-95a524334201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:56.772918 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68443b49-0f0e-43fc-9af4-95a524334201 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:56.773460 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68443b49-0f0e-43fc-9af4-95a524334201 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:56.773970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68443b49-0f0e-43fc-9af4-95a524334201 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:56.775010 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68443b49-0f0e-43fc-9af4-95a524334201 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:56.777296 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68443b49-0f0e-43fc-9af4-95a524334201 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:56.781204 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad656-63fa-49d2-8869-a8dada5b6da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:56.781865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad656-63fa-49d2-8869-a8dada5b6da4 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:56.782158 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad656-63fa-49d2-8869-a8dada5b6da4 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:56.782402 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad656-63fa-49d2-8869-a8dada5b6da4 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:56.783182 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ad656-63fa-49d2-8869-a8dada5b6da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:56.783490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ad656-63fa-49d2-8869-a8dada5b6da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:56.784857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ad656-63fa-49d2-8869-a8dada5b6da4 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-68443b49-0f0e-43fc-9af4-95a524334201 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:56.792198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:56.793406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:46:56.794419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:46:56.795887 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 446/897] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:46:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:56.800981 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 452/898] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:56.805352 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68443b49-0f0e-43fc-9af4-95a524334201 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:56.805800 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad656-63fa-49d2-8869-a8dada5b6da4 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:56.908321 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:56.928088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:56.932683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad656-63fa-49d2-8869-a8dada5b6da4 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:56.943115 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68443b49-0f0e-43fc-9af4-95a524334201 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:56.984502 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5458b-c718-4d51-bf03-aa01c5d2b0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:56.985598 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5458b-c718-4d51-bf03-aa01c5d2b0b1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:56.986072 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5458b-c718-4d51-bf03-aa01c5d2b0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:56.986645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5458b-c718-4d51-bf03-aa01c5d2b0b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:56.988444 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ddab7-8e31-4508-a17a-a6a97edef1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:56.989290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ddab7-8e31-4508-a17a-a6a97edef1cd None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:56.989659 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ddab7-8e31-4508-a17a-a6a97edef1cd None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:56.990021 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ddab7-8e31-4508-a17a-a6a97edef1cd None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:56.990955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ddab7-8e31-4508-a17a-a6a97edef1cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:56.991335 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ddab7-8e31-4508-a17a-a6a97edef1cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:56.993184 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ddab7-8e31-4508-a17a-a6a97edef1cd None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:56.996602 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5458b-c718-4d51-bf03-aa01c5d2b0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:56.998553 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5458b-c718-4d51-bf03-aa01c5d2b0b1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:57.004068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 447/899] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:46:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:57.006103 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ddab7-8e31-4508-a17a-a6a97edef1cd None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-8bd5458b-c718-4d51-bf03-aa01c5d2b0b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:46:57.021838 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:57.023155 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:57.024240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:46:57.024240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:46:57.024240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:46:57.024240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:46:57.024240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:46:57.024240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:46:57.024240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:46:57.024240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:57.024240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 453/900] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:46:57.025816 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8a38d-599e-44d8-b584-5c928c30e9d2 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:57.026695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8a38d-599e-44d8-b584-5c928c30e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:57.026984 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8a38d-599e-44d8-b584-5c928c30e9d2 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:57.032345 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 454/901] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:57.032345 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8a38d-599e-44d8-b584-5c928c30e9d2 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:57.131706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ddab7-8e31-4508-a17a-a6a97edef1cd None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:57.159833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8a38d-599e-44d8-b584-5c928c30e9d2 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:57.171857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e8198-d9e3-4639-bc0e-1795981bddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:57.172534 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8198-d9e3-4639-bc0e-1795981bddfe None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:57.172825 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8198-d9e3-4639-bc0e-1795981bddfe None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:57.173108 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8198-d9e3-4639-bc0e-1795981bddfe None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:57.173834 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e8198-d9e3-4639-bc0e-1795981bddfe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:57.174145 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e8198-d9e3-4639-bc0e-1795981bddfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:57.175570 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e8198-d9e3-4639-bc0e-1795981bddfe None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:57.176918 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:57.180879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 448/902] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:46:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:57.182184 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6b496-2774-48cd-983a-654468fbb055 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:57.190087 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6b496-2774-48cd-983a-654468fbb055 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:57.190087 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6b496-2774-48cd-983a-654468fbb055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:57.202652 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-83c6b496-2774-48cd-983a-654468fbb055 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:57.203951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-83c6b496-2774-48cd-983a-654468fbb055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:57.205227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd3664-3159-497d-97e9-a47f4d53538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:57.206138 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd3664-3159-497d-97e9-a47f4d53538b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:57.206692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd3664-3159-497d-97e9-a47f4d53538b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:57.207041 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd3664-3159-497d-97e9-a47f4d53538b None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:57.207915 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd3664-3159-497d-97e9-a47f4d53538b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:57.208234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd3664-3159-497d-97e9-a47f4d53538b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:57.209709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd3664-3159-497d-97e9-a47f4d53538b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:57.224140 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 455/903] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:57.224786 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd3664-3159-497d-97e9-a47f4d53538b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:57.249949 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:57.286917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 449/904] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:57.286917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6b496-2774-48cd-983a-654468fbb055 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:57.352135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd3664-3159-497d-97e9-a47f4d53538b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:57.390991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f264753-fe30-400e-ab0f-799a5cf6bb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:57.391661 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264753-fe30-400e-ab0f-799a5cf6bb76 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:57.391943 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264753-fe30-400e-ab0f-799a5cf6bb76 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:57.392221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264753-fe30-400e-ab0f-799a5cf6bb76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:57.393243 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f264753-fe30-400e-ab0f-799a5cf6bb76 None admin] RBAC: Adding query filter params (interface=public, service_id=0ad2a3c1e520420caeacb3ab37c2155e, region_id=RegionOne) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:57.393568 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f264753-fe30-400e-ab0f-799a5cf6bb76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:57.394970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f264753-fe30-400e-ab0f-799a5cf6bb76 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:57.399175 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6b496-2774-48cd-983a-654468fbb055 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:57.405096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 456/905] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:46:57 2022] GET /identity/v3/endpoints?service_id=0ad2a3c1e520420caeacb3ab37c2155e&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:57.405096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f264753-fe30-400e-ab0f-799a5cf6bb76 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:57.434488 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:57.443025 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01264fde-e1cd-4a70-bbcc-1d6403a7da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:57.443619 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01264fde-e1cd-4a70-bbcc-1d6403a7da2f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:57.443898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01264fde-e1cd-4a70-bbcc-1d6403a7da2f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:57.444175 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01264fde-e1cd-4a70-bbcc-1d6403a7da2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:57.445048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01264fde-e1cd-4a70-bbcc-1d6403a7da2f None admin] RBAC: Adding query filter params (role.id=9e62b6dc2ae14408a6a05295caeb4054, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=54a572dfba3e48498be80570d0f71369) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:57.445366 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01264fde-e1cd-4a70-bbcc-1d6403a7da2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:57.446816 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01264fde-e1cd-4a70-bbcc-1d6403a7da2f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:57.462917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 450/906] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:46:57 2022] GET /identity/v3/role_assignments?user.id=54a572dfba3e48498be80570d0f71369&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=9e62b6dc2ae14408a6a05295caeb4054 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:57.462917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01264fde-e1cd-4a70-bbcc-1d6403a7da2f None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:57.526329 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:57.548104 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f264753-fe30-400e-ab0f-799a5cf6bb76 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:57.599998 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01264fde-e1cd-4a70-bbcc-1d6403a7da2f None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:57.601879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3ace-3f80-4575-94e6-aa55bd48c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:57.603053 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3ace-3f80-4575-94e6-aa55bd48c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:57.603336 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3ace-3f80-4575-94e6-aa55bd48c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:57.603614 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3ace-3f80-4575-94e6-aa55bd48c0a7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:57.605883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d3ace-3f80-4575-94e6-aa55bd48c0a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:57.607362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d3ace-3f80-4575-94e6-aa55bd48c0a7 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-986d3ace-3f80-4575-94e6-aa55bd48c0a7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:57.621538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:57.622778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:57.623871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 457/907] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 20:46:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:57.629656 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3ace-3f80-4575-94e6-aa55bd48c0a7 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:57.650376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8aa5-adf9-46a3-aa53-fd2e17fd68f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:57.651524 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8aa5-adf9-46a3-aa53-fd2e17fd68f2 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:57.652033 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8aa5-adf9-46a3-aa53-fd2e17fd68f2 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:57.652530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8aa5-adf9-46a3-aa53-fd2e17fd68f2 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:57.653465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d8aa5-adf9-46a3-aa53-fd2e17fd68f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:57.655161 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d8aa5-adf9-46a3-aa53-fd2e17fd68f2 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:57.662352 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 451/908] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:46:57 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:46:57.792471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3ace-3f80-4575-94e6-aa55bd48c0a7 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:57.833374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0585d-3433-4f9f-9eda-c07b22b02259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:57.834053 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0585d-3433-4f9f-9eda-c07b22b02259 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:57.834333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0585d-3433-4f9f-9eda-c07b22b02259 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:57.834625 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0585d-3433-4f9f-9eda-c07b22b02259 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:57.835503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0585d-3433-4f9f-9eda-c07b22b02259 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:57.835817 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0585d-3433-4f9f-9eda-c07b22b02259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:57.837227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0585d-3433-4f9f-9eda-c07b22b02259 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:57.843868 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 458/909] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:46:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:57.849655 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8aa5-adf9-46a3-aa53-fd2e17fd68f2 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:57.933371 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:58.005563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8aa5-adf9-46a3-aa53-fd2e17fd68f2 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:58.046186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39366ca-79a9-4a46-a35b-31dd35f78bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:58.046186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39366ca-79a9-4a46-a35b-31dd35f78bf6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:58.046186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39366ca-79a9-4a46-a35b-31dd35f78bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:58.046186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39366ca-79a9-4a46-a35b-31dd35f78bf6 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:58.047080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39366ca-79a9-4a46-a35b-31dd35f78bf6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:58.047080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39366ca-79a9-4a46-a35b-31dd35f78bf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:58.050541 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39366ca-79a9-4a46-a35b-31dd35f78bf6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:58.054447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 452/910] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:46:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:58.061001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0585d-3433-4f9f-9eda-c07b22b02259 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:58.086500 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:58.191143 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0585d-3433-4f9f-9eda-c07b22b02259 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:58.227586 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9625d3-a147-415a-999c-d5a77af32e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:58.228258 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9625d3-a147-415a-999c-d5a77af32e40 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:58.228542 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9625d3-a147-415a-999c-d5a77af32e40 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:58.228816 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9625d3-a147-415a-999c-d5a77af32e40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:58.229656 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9625d3-a147-415a-999c-d5a77af32e40 None admin] RBAC: Adding query filter params (interface=public, service_id=9e695862343045cb8d4f446302e8150e, region_id=RegionOne) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:58.229970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9625d3-a147-415a-999c-d5a77af32e40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:58.231374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9625d3-a147-415a-999c-d5a77af32e40 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:58.237286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 459/911] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:46:58 2022] GET /identity/v3/endpoints?service_id=9e695862343045cb8d4f446302e8150e&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:46:58.242522 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39366ca-79a9-4a46-a35b-31dd35f78bf6 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:58.353205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39366ca-79a9-4a46-a35b-31dd35f78bf6 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:58.375228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:58.390336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f272d6-1892-4cce-8b26-4d53d7ff28b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:58.394912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f272d6-1892-4cce-8b26-4d53d7ff28b1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:58.394912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f272d6-1892-4cce-8b26-4d53d7ff28b1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:58.394912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f272d6-1892-4cce-8b26-4d53d7ff28b1 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:58.394912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f272d6-1892-4cce-8b26-4d53d7ff28b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:58.394912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f272d6-1892-4cce-8b26-4d53d7ff28b1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:58.400605 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 453/912] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:46:58 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:46:58.679935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79251e7-099c-4e96-b937-d2b704c3f4a6 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:58.680490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79251e7-099c-4e96-b937-d2b704c3f4a6 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:58.680490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79251e7-099c-4e96-b937-d2b704c3f4a6 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:58.682084 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 460/913] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:58.688635 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954bed-f2a3-4c78-9f79-5e4ce1a6786d None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:58.688934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954bed-f2a3-4c78-9f79-5e4ce1a6786d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:58.689217 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954bed-f2a3-4c78-9f79-5e4ce1a6786d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:58.707391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-20954bed-f2a3-4c78-9f79-5e4ce1a6786d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:58.708603 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-20954bed-f2a3-4c78-9f79-5e4ce1a6786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:58.781319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 454/914] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:58.803430 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79251e7-099c-4e96-b937-d2b704c3f4a6 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:58.890654 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:58.914999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79251e7-099c-4e96-b937-d2b704c3f4a6 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:58.954045 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dc607-b914-427a-a93f-7ed874f9804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:58.954812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dc607-b914-427a-a93f-7ed874f9804c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:58.955095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dc607-b914-427a-a93f-7ed874f9804c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:58.955370 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dc607-b914-427a-a93f-7ed874f9804c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:58.956033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dc607-b914-427a-a93f-7ed874f9804c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:58.957465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dc607-b914-427a-a93f-7ed874f9804c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-474dc607-b914-427a-a93f-7ed874f9804c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:46:58.970352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:46:58.971624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:46:58.973270 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 461/915] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:46:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:46:58.978089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954bed-f2a3-4c78-9f79-5e4ce1a6786d None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:59.085681 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954bed-f2a3-4c78-9f79-5e4ce1a6786d None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:59.113802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:59.123573 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4659b5-7dd4-44e1-b422-b56a5728ca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:59.125997 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4659b5-7dd4-44e1-b422-b56a5728ca5c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:59.125997 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4659b5-7dd4-44e1-b422-b56a5728ca5c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:59.125997 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4659b5-7dd4-44e1-b422-b56a5728ca5c None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:59.125997 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4659b5-7dd4-44e1-b422-b56a5728ca5c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:59.125997 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4659b5-7dd4-44e1-b422-b56a5728ca5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:59.127224 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4659b5-7dd4-44e1-b422-b56a5728ca5c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:59.132913 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 455/916] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:46:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:59.138289 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dc607-b914-427a-a93f-7ed874f9804c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:59.249534 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dc607-b914-427a-a93f-7ed874f9804c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:59.286856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c97d-6143-4ddc-aadf-3a5c0295a7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:59.287537 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c97d-6143-4ddc-aadf-3a5c0295a7a4 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:59.287819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c97d-6143-4ddc-aadf-3a5c0295a7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:59.288159 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c97d-6143-4ddc-aadf-3a5c0295a7a4 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:59.288883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45c97d-6143-4ddc-aadf-3a5c0295a7a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:59.289240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45c97d-6143-4ddc-aadf-3a5c0295a7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:59.290654 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45c97d-6143-4ddc-aadf-3a5c0295a7a4 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:59.296719 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 462/917] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:46:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:59.302719 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4659b5-7dd4-44e1-b422-b56a5728ca5c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:59.411468 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4659b5-7dd4-44e1-b422-b56a5728ca5c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:59.449016 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600d775-1ff3-48db-9679-03b1500d1d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:59.449693 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600d775-1ff3-48db-9679-03b1500d1d9b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:59.449980 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600d775-1ff3-48db-9679-03b1500d1d9b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:59.450262 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600d775-1ff3-48db-9679-03b1500d1d9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:59.451102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600d775-1ff3-48db-9679-03b1500d1d9b None admin] RBAC: Adding query filter params (interface=public, service_id=bb233e5e3bdc4af8b1b49b1cd69f5f45, region_id=RegionOne) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:46:59.451419 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600d775-1ff3-48db-9679-03b1500d1d9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:59.452806 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600d775-1ff3-48db-9679-03b1500d1d9b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:59.458848 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 456/918] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:46:59 2022] GET /identity/v3/endpoints?service_id=bb233e5e3bdc4af8b1b49b1cd69f5f45&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:46:59.464592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c97d-6143-4ddc-aadf-3a5c0295a7a4 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:46:59.468664 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:59.599599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c97d-6143-4ddc-aadf-3a5c0295a7a4 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:46:59.636759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ebcba-6193-4827-9898-afd947a57641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:46:59.637454 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ebcba-6193-4827-9898-afd947a57641 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:59.637736 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ebcba-6193-4827-9898-afd947a57641 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:59.638011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ebcba-6193-4827-9898-afd947a57641 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:59.638763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ebcba-6193-4827-9898-afd947a57641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:46:59.640194 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ebcba-6193-4827-9898-afd947a57641 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:46:59.647807 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 463/919] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:46:59 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:46:59.843267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2866c-6ab2-481b-93f1-bcfa2a9eb305 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:59.843936 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2866c-6ab2-481b-93f1-bcfa2a9eb305 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:59.844423 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2866c-6ab2-481b-93f1-bcfa2a9eb305 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:59.845981 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 457/920] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:46:59.851676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac91e2-2279-416f-acdc-c8be753237a0 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:46:59.852597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac91e2-2279-416f-acdc-c8be753237a0 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:46:59.853088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac91e2-2279-416f-acdc-c8be753237a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:46:59.877734 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-19ac91e2-2279-416f-acdc-c8be753237a0 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:46:59.879025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-19ac91e2-2279-416f-acdc-c8be753237a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:46:59.952865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:46:59.959998 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 464/921] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:46:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:46:59.983962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2866c-6ab2-481b-93f1-bcfa2a9eb305 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:00.038176 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:00.105569 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2866c-6ab2-481b-93f1-bcfa2a9eb305 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:00.143097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0615fd-b98f-4d8a-8fd8-37d57e54a590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:00.143932 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0615fd-b98f-4d8a-8fd8-37d57e54a590 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.144220 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0615fd-b98f-4d8a-8fd8-37d57e54a590 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.144517 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0615fd-b98f-4d8a-8fd8-37d57e54a590 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.156085 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0615fd-b98f-4d8a-8fd8-37d57e54a590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-af0615fd-b98f-4d8a-8fd8-37d57e54a590 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:47:00.164539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:00.165703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:00.166880 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 458/922] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:46:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:00.171865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac91e2-2279-416f-acdc-c8be753237a0 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:00.175907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4288e58-c858-4c3e-bdbe-3ecc72c612c8 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.175907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4288e58-c858-4c3e-bdbe-3ecc72c612c8 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.175907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4288e58-c858-4c3e-bdbe-3ecc72c612c8 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.177385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 459/923] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:00.183357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecc454-98fc-4223-a2a6-ede3d507f2f3 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.183523 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecc454-98fc-4223-a2a6-ede3d507f2f3 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.183811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecc454-98fc-4223-a2a6-ede3d507f2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.206122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-cbecc454-98fc-4223-a2a6-ede3d507f2f3 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:00.207997 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-cbecc454-98fc-4223-a2a6-ede3d507f2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:00.291252 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac91e2-2279-416f-acdc-c8be753237a0 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:00.306754 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 460/924] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:47:00.334249 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecc454-98fc-4223-a2a6-ede3d507f2f3 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:00.336042 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cd68d-da73-4e37-a2bf-6dd296d1d976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:00.336972 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cd68d-da73-4e37-a2bf-6dd296d1d976 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.337476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cd68d-da73-4e37-a2bf-6dd296d1d976 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.337950 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cd68d-da73-4e37-a2bf-6dd296d1d976 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.339627 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cd68d-da73-4e37-a2bf-6dd296d1d976 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:00.340158 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cd68d-da73-4e37-a2bf-6dd296d1d976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:00.341740 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cd68d-da73-4e37-a2bf-6dd296d1d976 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:00.351272 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 465/925] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:47:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:00.360004 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cd68d-da73-4e37-a2bf-6dd296d1d976 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:00.370698 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:00.441661 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:00.452278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecc454-98fc-4223-a2a6-ede3d507f2f3 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:00.492938 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cd68d-da73-4e37-a2bf-6dd296d1d976 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:00.505095 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b344e9d-958d-40ef-84c1-b332c3bd9526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:00.506656 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b344e9d-958d-40ef-84c1-b332c3bd9526 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.507411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b344e9d-958d-40ef-84c1-b332c3bd9526 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.507862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b344e9d-958d-40ef-84c1-b332c3bd9526 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.508699 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b344e9d-958d-40ef-84c1-b332c3bd9526 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:00.511499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b344e9d-958d-40ef-84c1-b332c3bd9526 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-8b344e9d-958d-40ef-84c1-b332c3bd9526 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:00.529448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:00.530937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:47:00.532134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:00.534573 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 461/926] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:47:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:00.539844 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065987e6-1f5d-4165-b60b-f4fa7a276c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:00.539844 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065987e6-1f5d-4165-b60b-f4fa7a276c93 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.539844 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065987e6-1f5d-4165-b60b-f4fa7a276c93 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.539844 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065987e6-1f5d-4165-b60b-f4fa7a276c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.543687 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b344e9d-958d-40ef-84c1-b332c3bd9526 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:00.550995 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065987e6-1f5d-4165-b60b-f4fa7a276c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:00.552476 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065987e6-1f5d-4165-b60b-f4fa7a276c93 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-065987e6-1f5d-4165-b60b-f4fa7a276c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:00.573233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:00.574498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:00.576216 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:47:00.576216 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:00.576216 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:00.576216 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:00.576216 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 466/927] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:00.580589 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065987e6-1f5d-4165-b60b-f4fa7a276c93 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:00.683478 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:00.692445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b344e9d-958d-40ef-84c1-b332c3bd9526 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:00.722821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065987e6-1f5d-4165-b60b-f4fa7a276c93 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:00.735375 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5089-6673-4521-b97b-8ce8c133197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:00.736486 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5089-6673-4521-b97b-8ce8c133197e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.736996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5089-6673-4521-b97b-8ce8c133197e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.737537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5089-6673-4521-b97b-8ce8c133197e None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.738495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b5089-6673-4521-b97b-8ce8c133197e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:00.739155 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b5089-6673-4521-b97b-8ce8c133197e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:00.739741 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:00.741043 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b5089-6673-4521-b97b-8ce8c133197e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:00.747675 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 462/928] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:47:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:00.753844 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5089-6673-4521-b97b-8ce8c133197e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:00.770214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33b16-022d-4285-9486-014c38c090e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:00.770991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33b16-022d-4285-9486-014c38c090e0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.771591 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33b16-022d-4285-9486-014c38c090e0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.771878 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33b16-022d-4285-9486-014c38c090e0 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.772693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33b16-022d-4285-9486-014c38c090e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:00.773174 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33b16-022d-4285-9486-014c38c090e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:00.774683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33b16-022d-4285-9486-014c38c090e0 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:00.792731 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 467/929] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:00.794185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358732-21b1-4a1d-8d40-3762bf4d970f None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.794475 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358732-21b1-4a1d-8d40-3762bf4d970f None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.794819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358732-21b1-4a1d-8d40-3762bf4d970f None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.796112 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 468/930] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:00.798258 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28358732-21b1-4a1d-8d40-3762bf4d970f None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:00.877114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5089-6673-4521-b97b-8ce8c133197e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:00.914162 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd2dc1-191c-45ff-aa1e-5d2bf0db3256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:00.914878 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2dc1-191c-45ff-aa1e-5d2bf0db3256 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.915165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2dc1-191c-45ff-aa1e-5d2bf0db3256 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.915724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2dc1-191c-45ff-aa1e-5d2bf0db3256 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.916163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd2dc1-191c-45ff-aa1e-5d2bf0db3256 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:00.916478 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd2dc1-191c-45ff-aa1e-5d2bf0db3256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:00.918489 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd2dc1-191c-45ff-aa1e-5d2bf0db3256 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:00.920463 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28358732-21b1-4a1d-8d40-3762bf4d970f None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:00.924059 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 463/931] 10.222.0.89 () {56 vars in 1114 bytes} [Thu May 19 20:47:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:00.925110 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137841f-fd34-4a8d-a2dd-5c07082d8fc6 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.925403 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137841f-fd34-4a8d-a2dd-5c07082d8fc6 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.925683 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137841f-fd34-4a8d-a2dd-5c07082d8fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.943342 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-f137841f-fd34-4a8d-a2dd-5c07082d8fc6 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:00.944462 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-f137841f-fd34-4a8d-a2dd-5c07082d8fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:00.963058 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956863ce-d690-4535-9c18-4361485c4af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:00.964434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956863ce-d690-4535-9c18-4361485c4af5 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:00.964650 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:00.964782 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956863ce-d690-4535-9c18-4361485c4af5 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:00.964988 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956863ce-d690-4535-9c18-4361485c4af5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:00.973505 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956863ce-d690-4535-9c18-4361485c4af5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:00.974984 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956863ce-d690-4535-9c18-4361485c4af5 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-956863ce-d690-4535-9c18-4361485c4af5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:47:00.991759 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:00.993175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:00.994751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:00.994751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:00.994751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:47:00.994751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:47:00.994751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:47:00.994751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:47:00.994751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:47:00.994751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:47:00.994751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:47:00.994751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:00.997940 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 469/932] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:47:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:00.998833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956863ce-d690-4535-9c18-4361485c4af5 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:01.021995 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 464/933] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:01.022900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137841f-fd34-4a8d-a2dd-5c07082d8fc6 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:01.046141 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:01.129414 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956863ce-d690-4535-9c18-4361485c4af5 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:01.137337 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137841f-fd34-4a8d-a2dd-5c07082d8fc6 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:01.167249 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7e190-b015-4075-a5ce-2e7513e3f993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:01.167924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7e190-b015-4075-a5ce-2e7513e3f993 None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:01.168238 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7e190-b015-4075-a5ce-2e7513e3f993 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:01.168492 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7e190-b015-4075-a5ce-2e7513e3f993 None admin] PATH_INFO: `/v3/endpoints` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:01.169246 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7e190-b015-4075-a5ce-2e7513e3f993 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:01.170650 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7e190-b015-4075-a5ce-2e7513e3f993 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:01.173812 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894c403-7613-4ff9-8528-1f309ad8138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:01.174484 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894c403-7613-4ff9-8528-1f309ad8138c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:01.174796 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894c403-7613-4ff9-8528-1f309ad8138c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:01.175074 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894c403-7613-4ff9-8528-1f309ad8138c None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:01.175906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894c403-7613-4ff9-8528-1f309ad8138c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:01.176213 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894c403-7613-4ff9-8528-1f309ad8138c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:01.177656 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894c403-7613-4ff9-8528-1f309ad8138c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:01.196924 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 465/934] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:47:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:01.199206 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894c403-7613-4ff9-8528-1f309ad8138c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:01.215490 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:01.228684 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 470/935] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:47:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:47:01.230658 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7e190-b015-4075-a5ce-2e7513e3f993 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:01.349516 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894c403-7613-4ff9-8528-1f309ad8138c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:01.356049 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:01.377680 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7e190-b015-4075-a5ce-2e7513e3f993 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:01.392280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015495-9534-4e60-b462-08d6b10d5e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:01.393448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015495-9534-4e60-b462-08d6b10d5e24 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:01.393896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015495-9534-4e60-b462-08d6b10d5e24 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:01.394386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015495-9534-4e60-b462-08d6b10d5e24 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:01.395307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b015495-9534-4e60-b462-08d6b10d5e24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:01.397066 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b015495-9534-4e60-b462-08d6b10d5e24 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-7b015495-9534-4e60-b462-08d6b10d5e24 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:01.413104 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:01.427288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:01.428418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 466/936] 10.222.0.89 () {56 vars in 1132 bytes} [Thu May 19 20:47:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:01.429435 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbdedc-ba1e-4f60-8a55-450fbe581382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:01.429435 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbdedc-ba1e-4f60-8a55-450fbe581382 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:01.429435 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbdedc-ba1e-4f60-8a55-450fbe581382 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:01.429435 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbdedc-ba1e-4f60-8a55-450fbe581382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:01.429752 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015495-9534-4e60-b462-08d6b10d5e24 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:01.437149 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbdedc-ba1e-4f60-8a55-450fbe581382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:01.438816 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbdedc-ba1e-4f60-8a55-450fbe581382 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-decbdedc-ba1e-4f60-8a55-450fbe581382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:01.467700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:01.469066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:01.470437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:47:01.470437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:01.470437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:01.470437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:01.470437 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 471/937] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:01.476599 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbdedc-ba1e-4f60-8a55-450fbe581382 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:01.535148 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:01.563968 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015495-9534-4e60-b462-08d6b10d5e24 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:01.610811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f54464-2db8-4e67-89e5-473cb5fc1cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:01.611881 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f54464-2db8-4e67-89e5-473cb5fc1cf0 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:01.612032 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbdedc-ba1e-4f60-8a55-450fbe581382 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:01.612521 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f54464-2db8-4e67-89e5-473cb5fc1cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:01.613027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f54464-2db8-4e67-89e5-473cb5fc1cf0 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:01.614252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f54464-2db8-4e67-89e5-473cb5fc1cf0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:01.615718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f54464-2db8-4e67-89e5-473cb5fc1cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:01.617324 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f54464-2db8-4e67-89e5-473cb5fc1cf0 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:01.625022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 467/938] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:47:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:01.630331 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f54464-2db8-4e67-89e5-473cb5fc1cf0 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:01.654313 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645a2b0-9608-4990-95e8-7c2caf950d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:01.655664 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645a2b0-9608-4990-95e8-7c2caf950d08 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:01.656194 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645a2b0-9608-4990-95e8-7c2caf950d08 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:01.656793 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645a2b0-9608-4990-95e8-7c2caf950d08 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:01.657874 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645a2b0-9608-4990-95e8-7c2caf950d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:01.658406 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645a2b0-9608-4990-95e8-7c2caf950d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:01.660025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645a2b0-9608-4990-95e8-7c2caf950d08 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:01.663082 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:01.675221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 472/939] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:01.681272 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645a2b0-9608-4990-95e8-7c2caf950d08 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:01.757257 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f54464-2db8-4e67-89e5-473cb5fc1cf0 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:01.799353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a34ea-c193-43cd-a5b8-f27874a6c342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:01.800422 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a34ea-c193-43cd-a5b8-f27874a6c342 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:01.800975 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a34ea-c193-43cd-a5b8-f27874a6c342 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:01.801474 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a34ea-c193-43cd-a5b8-f27874a6c342 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:01.802386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a34ea-c193-43cd-a5b8-f27874a6c342 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:01.802920 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a34ea-c193-43cd-a5b8-f27874a6c342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:01.804592 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a34ea-c193-43cd-a5b8-f27874a6c342 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:01.814814 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645a2b0-9608-4990-95e8-7c2caf950d08 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:01.815167 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 468/940] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:47:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:01.817512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a34ea-c193-43cd-a5b8-f27874a6c342 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:01.821839 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:01.853707 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9230aa-7db8-4a5a-ad9f-04face3fa348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:01.854561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9230aa-7db8-4a5a-ad9f-04face3fa348 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:01.854896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9230aa-7db8-4a5a-ad9f-04face3fa348 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:01.855241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9230aa-7db8-4a5a-ad9f-04face3fa348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:01.863903 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9230aa-7db8-4a5a-ad9f-04face3fa348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:01.865056 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9230aa-7db8-4a5a-ad9f-04face3fa348 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-3b9230aa-7db8-4a5a-ad9f-04face3fa348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:47:01.881226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:01.882374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:01.883683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:47:01.883683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:47:01.883683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:47:01.883683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:47:01.883683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:47:01.883683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:47:01.883683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:01.883683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:01.887971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 473/941] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:47:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:01.889253 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9230aa-7db8-4a5a-ad9f-04face3fa348 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:01.944040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a34ea-c193-43cd-a5b8-f27874a6c342 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:01.975469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:01.983542 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953ce85-c8d0-4e5f-a6e2-9f3c143c23f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:01.992420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ce85-c8d0-4e5f-a6e2-9f3c143c23f1 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:01.992420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ce85-c8d0-4e5f-a6e2-9f3c143c23f1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:01.992420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ce85-c8d0-4e5f-a6e2-9f3c143c23f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:01.992420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953ce85-c8d0-4e5f-a6e2-9f3c143c23f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:01.992420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953ce85-c8d0-4e5f-a6e2-9f3c143c23f1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:02.027614 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9230aa-7db8-4a5a-ad9f-04face3fa348 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:02.072998 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435fe40-6687-4ec9-b772-72f881ebb33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:02.073982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fe40-6687-4ec9-b772-72f881ebb33e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:02.074296 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fe40-6687-4ec9-b772-72f881ebb33e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:02.074668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fe40-6687-4ec9-b772-72f881ebb33e None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:02.075683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435fe40-6687-4ec9-b772-72f881ebb33e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:02.076075 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435fe40-6687-4ec9-b772-72f881ebb33e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:02.077638 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435fe40-6687-4ec9-b772-72f881ebb33e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:02.087950 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 469/942] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:47:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:47:02.098844 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 474/943] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:47:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:02.101056 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953ce85-c8d0-4e5f-a6e2-9f3c143c23f1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:02.173366 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:02.237843 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953ce85-c8d0-4e5f-a6e2-9f3c143c23f1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:02.279732 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249e20-fa4c-4af9-a621-fc21c9389132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:02.280913 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249e20-fa4c-4af9-a621-fc21c9389132 None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:02.281432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249e20-fa4c-4af9-a621-fc21c9389132 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:02.281892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249e20-fa4c-4af9-a621-fc21c9389132 None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/54a572dfba3e48498be80570d0f71369/roles/9e62b6dc2ae14408a6a05295caeb4054` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:02.284586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19249e20-fa4c-4af9-a621-fc21c9389132 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=54a572dfba3e48498be80570d0f71369, role_id=9e62b6dc2ae14408a6a05295caeb4054)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:02.286277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19249e20-fa4c-4af9-a621-fc21c9389132 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:02.348284 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 470/944] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:47:02 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/54a572dfba3e48498be80570d0f71369/roles/9e62b6dc2ae14408a6a05295caeb4054 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:47:02.430161 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee20b9-e942-4e00-81a8-40859415151d None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:02.430454 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee20b9-e942-4e00-81a8-40859415151d None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:02.430771 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee20b9-e942-4e00-81a8-40859415151d None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:02.433390 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 475/945] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:02.439810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691805-6b74-4332-bb42-12a7146e3842 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:02.440102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691805-6b74-4332-bb42-12a7146e3842 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:02.440387 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691805-6b74-4332-bb42-12a7146e3842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:02.460610 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-65691805-6b74-4332-bb42-12a7146e3842 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:02.461845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-65691805-6b74-4332-bb42-12a7146e3842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:02.549126 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 471/946] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:02.572014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee20b9-e942-4e00-81a8-40859415151d None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:02.681227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee20b9-e942-4e00-81a8-40859415151d None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:02.699507 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:02.717990 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a6f54-c619-4c2f-9a41-ddb46092e583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:02.718892 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6f54-c619-4c2f-9a41-ddb46092e583 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:02.721120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6f54-c619-4c2f-9a41-ddb46092e583 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:02.721120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6f54-c619-4c2f-9a41-ddb46092e583 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:02.721120 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a6f54-c619-4c2f-9a41-ddb46092e583 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:02.721543 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a6f54-c619-4c2f-9a41-ddb46092e583 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-764a6f54-c619-4c2f-9a41-ddb46092e583 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:02.734276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:02.735547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:47:02.736606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:02.740719 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 476/947] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:47:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:02.742121 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65691805-6b74-4332-bb42-12a7146e3842 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:02.795078 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:02.852934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65691805-6b74-4332-bb42-12a7146e3842 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:02.890383 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353eac8-cf7f-408c-bc35-c48c859e436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:02.891086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353eac8-cf7f-408c-bc35-c48c859e436e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:02.891375 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353eac8-cf7f-408c-bc35-c48c859e436e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:02.891655 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353eac8-cf7f-408c-bc35-c48c859e436e None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:02.892381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353eac8-cf7f-408c-bc35-c48c859e436e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:02.892694 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353eac8-cf7f-408c-bc35-c48c859e436e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:02.894069 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353eac8-cf7f-408c-bc35-c48c859e436e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:02.899475 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 472/948] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:47:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:02.905706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a6f54-c619-4c2f-9a41-ddb46092e583 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:03.027618 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a6f54-c619-4c2f-9a41-ddb46092e583 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:03.066175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754ecdc-7b5f-4559-bab6-ea5e7e17aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:03.066889 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ecdc-7b5f-4559-bab6-ea5e7e17aca3 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:03.067178 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ecdc-7b5f-4559-bab6-ea5e7e17aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:03.067461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ecdc-7b5f-4559-bab6-ea5e7e17aca3 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:03.068187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754ecdc-7b5f-4559-bab6-ea5e7e17aca3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:03.068501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754ecdc-7b5f-4559-bab6-ea5e7e17aca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:03.069877 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754ecdc-7b5f-4559-bab6-ea5e7e17aca3 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:03.076372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 477/949] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:47:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:03.082048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353eac8-cf7f-408c-bc35-c48c859e436e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:03.189571 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353eac8-cf7f-408c-bc35-c48c859e436e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:03.211038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:03.225579 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22f734-8232-412c-99a7-c421420dfe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:03.236042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f734-8232-412c-99a7-c421420dfe98 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:03.236042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f734-8232-412c-99a7-c421420dfe98 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:03.236042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f734-8232-412c-99a7-c421420dfe98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:03.236042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22f734-8232-412c-99a7-c421420dfe98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:03.236042 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22f734-8232-412c-99a7-c421420dfe98 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:03.309388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 473/950] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:47:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:47:03.693396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a062df-a4c5-4925-8a01-d8b5486ab4ec None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:03.693783 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a062df-a4c5-4925-8a01-d8b5486ab4ec None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:03.693981 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a062df-a4c5-4925-8a01-d8b5486ab4ec None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:03.695544 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 478/951] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:03.701637 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d170-c901-467a-beda-633acc5d96c6 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:03.702228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d170-c901-467a-beda-633acc5d96c6 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:03.702775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d170-c901-467a-beda-633acc5d96c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:03.721384 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-4433d170-c901-467a-beda-633acc5d96c6 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:03.722938 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-4433d170-c901-467a-beda-633acc5d96c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:03.798943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 474/952] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:47:03.824264 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a062df-a4c5-4925-8a01-d8b5486ab4ec None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:03.882788 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:03.950637 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a062df-a4c5-4925-8a01-d8b5486ab4ec None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:03.995689 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2539e-cc2e-435c-b822-38ee53ce37ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:03.996369 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2539e-cc2e-435c-b822-38ee53ce37ea None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:03.996657 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2539e-cc2e-435c-b822-38ee53ce37ea None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:03.996938 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2539e-cc2e-435c-b822-38ee53ce37ea None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:03.997658 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2539e-cc2e-435c-b822-38ee53ce37ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:03.999132 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2539e-cc2e-435c-b822-38ee53ce37ea None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:04.000525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: WARNING keystone.server.flask.common [None req-c8d2539e-cc2e-435c-b822-38ee53ce37ea None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 20:47:04.049836 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.sql.core [None req-c8d2539e-cc2e-435c-b822-38ee53ce37ea None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:47:04.049836 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 20:47:04.049836 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [parameters: {'id': '25b63bb07acb494b9ff78fb3afccb63f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 20:47:04.049836 dv-cinder-841302-4-smb devstack@keystone.service[284561]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=284561) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-c8d2539e-cc2e-435c-b822-38ee53ce37ea None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 25b63bb07acb494b9ff78fb3afccb63f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 25b63bb07acb494b9ff78fb3afccb63f. May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application conn.query(q) May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:47:04.060207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application result.read() May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 20:47:04.061692 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application next(self.gen) May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application yield resource May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application next(self.gen) May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise self.value May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application session.commit() May 19 20:47:04.062974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self.session.flush() May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application compat.raise_( May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:47:04.064067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:47:04.066690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application conn.query(q) May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application result.read() May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:47:04.068852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [parameters: {'id': '25b63bb07acb494b9ff78fb3afccb63f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:04.071260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:04.073987 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:04.076387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:04.076387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 20:47:04.076387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 20:47:04.076387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:04.076387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:04.076387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 20:47:04.076387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 20:47:04.076387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 25b63bb07acb494b9ff78fb3afccb63f. May 19 20:47:04.076387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:04.076387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 479/953] 10.222.0.89 () {60 vars in 1140 bytes} [Thu May 19 20:47:03 2022] POST /identity/v3/projects => generated 262 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:04.077738 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433d170-c901-467a-beda-633acc5d96c6 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:04.172128 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:04.182294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433d170-c901-467a-beda-633acc5d96c6 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:04.223260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae3259-07f7-4fb3-831b-55ee8d7ec74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:04.224041 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3259-07f7-4fb3-831b-55ee8d7ec74d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:04.224331 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3259-07f7-4fb3-831b-55ee8d7ec74d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:04.224609 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3259-07f7-4fb3-831b-55ee8d7ec74d None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:04.232234 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae3259-07f7-4fb3-831b-55ee8d7ec74d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:04.233838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae3259-07f7-4fb3-831b-55ee8d7ec74d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-a3ae3259-07f7-4fb3-831b-55ee8d7ec74d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:47:04.249124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:04.251040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:04.252197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:47:04.252197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:47:04.252197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:47:04.252197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:47:04.252197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:47:04.252197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:47:04.252197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:04.252197 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:04.254289 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 475/954] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:04.257110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2539e-cc2e-435c-b822-38ee53ce37ea None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:04.367157 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:04.370295 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2539e-cc2e-435c-b822-38ee53ce37ea None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:04.407875 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde4d4c-7011-491e-af33-20dc3c4cdfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:04.408794 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4d4c-7011-491e-af33-20dc3c4cdfe1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:04.409087 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4d4c-7011-491e-af33-20dc3c4cdfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:04.409374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4d4c-7011-491e-af33-20dc3c4cdfe1 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:04.410179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde4d4c-7011-491e-af33-20dc3c4cdfe1 None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:04.410499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde4d4c-7011-491e-af33-20dc3c4cdfe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:04.412384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde4d4c-7011-491e-af33-20dc3c4cdfe1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:04.436598 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 480/955] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:47:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:04.615777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656cd30-9cc0-42c2-b80e-0783e862f97b None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:04.616121 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656cd30-9cc0-42c2-b80e-0783e862f97b None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:04.616337 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656cd30-9cc0-42c2-b80e-0783e862f97b None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:04.618285 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 476/956] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:04.625381 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99665734-0189-466d-8b69-6c61826cc9ca None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:04.625699 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99665734-0189-466d-8b69-6c61826cc9ca None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:04.625956 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99665734-0189-466d-8b69-6c61826cc9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:04.644950 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-99665734-0189-466d-8b69-6c61826cc9ca None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:04.646556 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-99665734-0189-466d-8b69-6c61826cc9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:04.721924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 481/957] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:04.744088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656cd30-9cc0-42c2-b80e-0783e862f97b None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:04.803021 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2972e-3487-4757-a565-bb1b1cab9b72 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:04.803388 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2972e-3487-4757-a565-bb1b1cab9b72 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:04.803559 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2972e-3487-4757-a565-bb1b1cab9b72 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:04.805229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 482/958] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:04.811438 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ebbb5-ebde-4ad8-ad16-46518dfd477a None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:04.811730 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ebbb5-ebde-4ad8-ad16-46518dfd477a None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:04.812020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ebbb5-ebde-4ad8-ad16-46518dfd477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:04.833316 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-688ebbb5-ebde-4ad8-ad16-46518dfd477a None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:04.835079 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-688ebbb5-ebde-4ad8-ad16-46518dfd477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:04.859311 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656cd30-9cc0-42c2-b80e-0783e862f97b None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:04.913564 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe892f-5831-44a4-a14b-38f3a6f4d823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:04.915030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe892f-5831-44a4-a14b-38f3a6f4d823 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:04.915764 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe892f-5831-44a4-a14b-38f3a6f4d823 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:04.917190 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe892f-5831-44a4-a14b-38f3a6f4d823 None admin] PATH_INFO: `/v3/services/compute` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:04.918369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe892f-5831-44a4-a14b-38f3a6f4d823 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:04.920816 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe892f-5831-44a4-a14b-38f3a6f4d823 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:04.928905 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 483/959] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-f4fe892f-5831-44a4-a14b-38f3a6f4d823 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:04.936505 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:04.937722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:47:04.939202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:04.941931 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 477/960] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:47:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:04.948112 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ebbb5-ebde-4ad8-ad16-46518dfd477a None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:04.953415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe892f-5831-44a4-a14b-38f3a6f4d823 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:04.977008 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:04.999030 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:05.072562 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe892f-5831-44a4-a14b-38f3a6f4d823 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:05.094012 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ebbb5-ebde-4ad8-ad16-46518dfd477a None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:05.117164 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f142338-5194-458b-9076-aa756dcb0b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:05.118733 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f142338-5194-458b-9076-aa756dcb0b56 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:05.119390 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f142338-5194-458b-9076-aa756dcb0b56 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:05.120001 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f142338-5194-458b-9076-aa756dcb0b56 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:05.133788 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218d198-ddcc-402c-a02b-2f7328156c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:05.134417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f142338-5194-458b-9076-aa756dcb0b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:47:05.134638 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218d198-ddcc-402c-a02b-2f7328156c05 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:05.135008 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218d198-ddcc-402c-a02b-2f7328156c05 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:05.135904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218d198-ddcc-402c-a02b-2f7328156c05 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:05.136709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218d198-ddcc-402c-a02b-2f7328156c05 None admin] RBAC: Adding query filter params (name=compute) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:05.137098 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218d198-ddcc-402c-a02b-2f7328156c05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:05.138553 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218d198-ddcc-402c-a02b-2f7328156c05 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:05.148605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 484/961] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:47:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-3f142338-5194-458b-9076-aa756dcb0b56 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:47:05.148885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:05.149959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:05.152205 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 478/962] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:47:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:05.153064 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218d198-ddcc-402c-a02b-2f7328156c05 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:05.159729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f142338-5194-458b-9076-aa756dcb0b56 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:05.247103 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:05.261188 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:05.284944 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218d198-ddcc-402c-a02b-2f7328156c05 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:05.288874 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f142338-5194-458b-9076-aa756dcb0b56 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:05.326234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed458af-1f45-4ded-89a0-4481e8598b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:05.326989 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed458af-1f45-4ded-89a0-4481e8598b90 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:05.327276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed458af-1f45-4ded-89a0-4481e8598b90 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:05.327558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed458af-1f45-4ded-89a0-4481e8598b90 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:05.328290 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed458af-1f45-4ded-89a0-4481e8598b90 None admin] RBAC: Adding query filter params (type=compute) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:05.328657 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed458af-1f45-4ded-89a0-4481e8598b90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:05.330165 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed458af-1f45-4ded-89a0-4481e8598b90 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:05.340152 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 485/963] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:47:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:05.340382 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84db069-3b52-4c55-8b88-ccc59b36ee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:05.342676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db069-3b52-4c55-8b88-ccc59b36ee1d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:05.342676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db069-3b52-4c55-8b88-ccc59b36ee1d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:05.342676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db069-3b52-4c55-8b88-ccc59b36ee1d None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:05.342676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84db069-3b52-4c55-8b88-ccc59b36ee1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:05.342676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84db069-3b52-4c55-8b88-ccc59b36ee1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:05.344085 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84db069-3b52-4c55-8b88-ccc59b36ee1d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:05.354686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 479/964] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:47:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:05.360824 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed458af-1f45-4ded-89a0-4481e8598b90 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:05.493886 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed458af-1f45-4ded-89a0-4481e8598b90 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:05.541310 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc7c56-3eed-4253-b518-372604400c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:05.543173 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc7c56-3eed-4253-b518-372604400c59 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:05.543707 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc7c56-3eed-4253-b518-372604400c59 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:05.544201 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc7c56-3eed-4253-b518-372604400c59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:05.556918 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc7c56-3eed-4253-b518-372604400c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:05.558798 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc7c56-3eed-4253-b518-372604400c59 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:05.569871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-16bc7c56-3eed-4253-b518-372604400c59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:05.580013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:05.582509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:05.583839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:47:05.583839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:05.583839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:05.583839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:05.583839 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 486/965] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:05.591310 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84db069-3b52-4c55-8b88-ccc59b36ee1d None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:05.679137 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f3f5-b55b-42e5-9652-534e55b05151 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:05.679493 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f3f5-b55b-42e5-9652-534e55b05151 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:05.679719 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f3f5-b55b-42e5-9652-534e55b05151 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:05.681479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 487/966] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:05.687821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a79f-6caa-4a9a-b8ed-66f9ac81cf8c None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:05.688105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a79f-6caa-4a9a-b8ed-66f9ac81cf8c None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:05.688385 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a79f-6caa-4a9a-b8ed-66f9ac81cf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:05.708579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-b102a79f-6caa-4a9a-b8ed-66f9ac81cf8c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:05.709836 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-b102a79f-6caa-4a9a-b8ed-66f9ac81cf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:05.721246 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84db069-3b52-4c55-8b88-ccc59b36ee1d None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:05.771949 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f94307-f245-408d-ac51-f50a4588a0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:05.773056 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94307-f245-408d-ac51-f50a4588a0b8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:05.773523 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94307-f245-408d-ac51-f50a4588a0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:05.774296 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94307-f245-408d-ac51-f50a4588a0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:05.775091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94307-f245-408d-ac51-f50a4588a0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:05.775417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94307-f245-408d-ac51-f50a4588a0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:05.777418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94307-f245-408d-ac51-f50a4588a0b8 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:05.791139 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 480/967] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:05.791579 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:05.792441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 488/968] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:47:05.796334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f94307-f245-408d-ac51-f50a4588a0b8 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:05.817845 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102a79f-6caa-4a9a-b8ed-66f9ac81cf8c None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:05.932566 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f94307-f245-408d-ac51-f50a4588a0b8 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:05.941742 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102a79f-6caa-4a9a-b8ed-66f9ac81cf8c None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:05.972001 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f93b0-f709-46aa-88ae-23857af02319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:05.973282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f93b0-f709-46aa-88ae-23857af02319 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:05.973787 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f93b0-f709-46aa-88ae-23857af02319 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:05.974001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:05.974887 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f93b0-f709-46aa-88ae-23857af02319 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:05.980197 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682dd04-4c26-40a7-bc4f-73e68a99c296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:05.981009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682dd04-4c26-40a7-bc4f-73e68a99c296 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:05.981290 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682dd04-4c26-40a7-bc4f-73e68a99c296 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:05.981564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682dd04-4c26-40a7-bc4f-73e68a99c296 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:05.982230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682dd04-4c26-40a7-bc4f-73e68a99c296 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:05.983791 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682dd04-4c26-40a7-bc4f-73e68a99c296 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:05.992766 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f93b0-f709-46aa-88ae-23857af02319 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:05.992766 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f93b0-f709-46aa-88ae-23857af02319 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-f682dd04-4c26-40a7-bc4f-73e68a99c296 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:05.997110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:05.998293 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:47:05.999346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:06.003076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 489/969] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:47:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:06.004801 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682dd04-4c26-40a7-bc4f-73e68a99c296 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-e17f93b0-f709-46aa-88ae-23857af02319 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:47:06.008232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:06.009330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:06.011225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:06.011225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:06.011225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:47:06.011225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:47:06.011225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:47:06.011225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:47:06.011225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:47:06.011225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:47:06.011225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:47:06.011225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:06.013297 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 481/970] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:47:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:06.017954 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f93b0-f709-46aa-88ae-23857af02319 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:06.083799 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:06.131189 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f93b0-f709-46aa-88ae-23857af02319 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:06.155068 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682dd04-4c26-40a7-bc4f-73e68a99c296 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:06.176499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d23ea-ec12-4233-bae5-264f39e5b0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:06.178235 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d23ea-ec12-4233-bae5-264f39e5b0bd None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:06.179089 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d23ea-ec12-4233-bae5-264f39e5b0bd None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:06.179593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d23ea-ec12-4233-bae5-264f39e5b0bd None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:06.181452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d23ea-ec12-4233-bae5-264f39e5b0bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:06.182829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d23ea-ec12-4233-bae5-264f39e5b0bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:06.185250 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d23ea-ec12-4233-bae5-264f39e5b0bd None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:06.200852 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b9603-c34a-457c-915d-85bd9f4b783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:06.201914 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9603-c34a-457c-915d-85bd9f4b783a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:06.202446 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9603-c34a-457c-915d-85bd9f4b783a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:06.202982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9603-c34a-457c-915d-85bd9f4b783a None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:06.203935 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b9603-c34a-457c-915d-85bd9f4b783a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:06.205064 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b9603-c34a-457c-915d-85bd9f4b783a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:06.207114 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b9603-c34a-457c-915d-85bd9f4b783a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:06.212897 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 482/971] 10.222.0.89 () {56 vars in 1149 bytes} [Thu May 19 20:47:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:06.213736 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 490/972] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:47:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:06.214714 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d23ea-ec12-4233-bae5-264f39e5b0bd None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:06.221041 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b9603-c34a-457c-915d-85bd9f4b783a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:06.304907 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:06.337519 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d23ea-ec12-4233-bae5-264f39e5b0bd None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:06.356103 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b9603-c34a-457c-915d-85bd9f4b783a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:06.361643 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:06.393550 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad39ca-2a7b-4a10-aabb-dca7acfbe6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:06.394595 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad39ca-2a7b-4a10-aabb-dca7acfbe6a0 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:06.395086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad39ca-2a7b-4a10-aabb-dca7acfbe6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:06.395674 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad39ca-2a7b-4a10-aabb-dca7acfbe6a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:06.398566 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de053103-a888-42d5-a0d7-3cfed2c0557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:06.399724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de053103-a888-42d5-a0d7-3cfed2c0557d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:06.400109 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de053103-a888-42d5-a0d7-3cfed2c0557d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:06.400487 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de053103-a888-42d5-a0d7-3cfed2c0557d None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:06.401718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de053103-a888-42d5-a0d7-3cfed2c0557d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:06.401867 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de053103-a888-42d5-a0d7-3cfed2c0557d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:06.403352 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de053103-a888-42d5-a0d7-3cfed2c0557d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:06.414197 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 491/973] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:47:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:06.415356 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de053103-a888-42d5-a0d7-3cfed2c0557d None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:06.496346 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad39ca-2a7b-4a10-aabb-dca7acfbe6a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:06.498188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad39ca-2a7b-4a10-aabb-dca7acfbe6a0 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:06.527940 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de053103-a888-42d5-a0d7-3cfed2c0557d None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:06.552824 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:06.566361 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adcc19-65ba-43b9-8aa4-621e2aa1d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:06.567040 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adcc19-65ba-43b9-8aa4-621e2aa1d92b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:06.567324 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adcc19-65ba-43b9-8aa4-621e2aa1d92b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:06.567602 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adcc19-65ba-43b9-8aa4-621e2aa1d92b None admin] PATH_INFO: `/v3/endpoints` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:06.568438 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adcc19-65ba-43b9-8aa4-621e2aa1d92b None admin] RBAC: Adding query filter params (interface=admin, service_id=bb233e5e3bdc4af8b1b49b1cd69f5f45, region_id=RegionOne) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:06.568757 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adcc19-65ba-43b9-8aa4-621e2aa1d92b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:06.570539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adcc19-65ba-43b9-8aa4-621e2aa1d92b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:06.581603 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 492/974] 10.222.0.89 () {56 vars in 1249 bytes} [Thu May 19 20:47:06 2022] GET /identity/v3/endpoints?service_id=bb233e5e3bdc4af8b1b49b1cd69f5f45&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:06.582848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adcc19-65ba-43b9-8aa4-621e2aa1d92b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:06.630530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 483/975] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:47:06 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:47:06.631881 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad39ca-2a7b-4a10-aabb-dca7acfbe6a0 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:06.651908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:06.694398 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adcc19-65ba-43b9-8aa4-621e2aa1d92b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:06.734355 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f81df-745f-46a7-8a2b-651cf2ad673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:06.735094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f81df-745f-46a7-8a2b-651cf2ad673e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:06.735378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f81df-745f-46a7-8a2b-651cf2ad673e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:06.735653 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f81df-745f-46a7-8a2b-651cf2ad673e None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:06.736369 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f81df-745f-46a7-8a2b-651cf2ad673e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:06.737812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f81df-745f-46a7-8a2b-651cf2ad673e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:06.752014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 493/976] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:47:06 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 20:47:06.756221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad39ca-2a7b-4a10-aabb-dca7acfbe6a0 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:06.805564 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbca1d-00ec-4a39-bfaf-8e08be469a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:06.806854 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbca1d-00ec-4a39-bfaf-8e08be469a44 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:06.807931 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbca1d-00ec-4a39-bfaf-8e08be469a44 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:06.808497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbca1d-00ec-4a39-bfaf-8e08be469a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:06.823079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbca1d-00ec-4a39-bfaf-8e08be469a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:06.825053 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbca1d-00ec-4a39-bfaf-8e08be469a44 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-43dbca1d-00ec-4a39-bfaf-8e08be469a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:06.847263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:06.848432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:06.849546 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:47:06.849546 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:06.849546 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:06.849546 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:06.851872 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 484/977] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:06.860091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f81df-745f-46a7-8a2b-651cf2ad673e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:06.930734 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:06.991239 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f81df-745f-46a7-8a2b-651cf2ad673e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:06.993688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f642d-0dfb-4d2e-ab8f-f8ee11db4467 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:06.994155 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f642d-0dfb-4d2e-ab8f-f8ee11db4467 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:06.994677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f642d-0dfb-4d2e-ab8f-f8ee11db4467 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:06.996997 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 485/978] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:07.005208 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442b166-fcb1-4c4b-9f69-33b2b58009de None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:07.005662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442b166-fcb1-4c4b-9f69-33b2b58009de None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:07.006100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442b166-fcb1-4c4b-9f69-33b2b58009de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:07.031248 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-8442b166-fcb1-4c4b-9f69-33b2b58009de None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:07.032464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-8442b166-fcb1-4c4b-9f69-33b2b58009de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:07.033238 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986ed72-038f-44e0-b03f-96f5353ed317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:07.034485 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986ed72-038f-44e0-b03f-96f5353ed317 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:07.035010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986ed72-038f-44e0-b03f-96f5353ed317 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:07.035499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986ed72-038f-44e0-b03f-96f5353ed317 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:07.036788 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986ed72-038f-44e0-b03f-96f5353ed317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:07.037375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986ed72-038f-44e0-b03f-96f5353ed317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:07.041248 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986ed72-038f-44e0-b03f-96f5353ed317 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:07.068707 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 494/979] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:07.075356 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986ed72-038f-44e0-b03f-96f5353ed317 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:07.118524 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:07.127232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 486/980] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:07.154114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442b166-fcb1-4c4b-9f69-33b2b58009de None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:07.199407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986ed72-038f-44e0-b03f-96f5353ed317 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:07.213606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:07.239332 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f31ba4-d29f-413f-b508-f2b4609d2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:07.240727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31ba4-d29f-413f-b508-f2b4609d2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:07.241224 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31ba4-d29f-413f-b508-f2b4609d2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:07.241679 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31ba4-d29f-413f-b508-f2b4609d2fc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:07.258434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f31ba4-d29f-413f-b508-f2b4609d2fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:07.258434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f31ba4-d29f-413f-b508-f2b4609d2fc8 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:07.262706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442b166-fcb1-4c4b-9f69-33b2b58009de None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-74f31ba4-d29f-413f-b508-f2b4609d2fc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:47:07.270338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:07.271499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:07.272570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:47:07.272570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:47:07.272570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:47:07.272570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:47:07.272570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:47:07.272570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:47:07.272570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:07.272570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:07.275465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 495/981] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:07.281283 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f31ba4-d29f-413f-b508-f2b4609d2fc8 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:07.303072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58266-49f0-479a-a79e-36c956dc8205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:07.303810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58266-49f0-479a-a79e-36c956dc8205 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:07.304092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58266-49f0-479a-a79e-36c956dc8205 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:07.304367 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58266-49f0-479a-a79e-36c956dc8205 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:07.305177 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58266-49f0-479a-a79e-36c956dc8205 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:07.306674 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58266-49f0-479a-a79e-36c956dc8205 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:07.309646 dv-cinder-841302-4-smb devstack@keystone.service[284560]: WARNING keystone.server.flask.common [None req-46b58266-49f0-479a-a79e-36c956dc8205 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 20:47:07.365015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.sql.core [None req-46b58266-49f0-479a-a79e-36c956dc8205 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:47:07.365015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 20:47:07.365015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [parameters: {'user_id': '7d394280830e4062887bd92024439195', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 20:47:07.365015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=284560) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-46b58266-49f0-479a-a79e-36c956dc8205 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application conn.query(q) May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application result.read() May 19 20:47:07.389181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:47:07.390506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application next(self.gen) May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application yield resource May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application next(self.gen) May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise self.value May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application session.commit() May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:47:07.392000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self.session.flush() May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application compat.raise_( May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:47:07.393236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:47:07.394512 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application conn.query(q) May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application result.read() May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:47:07.397090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [parameters: {'user_id': '7d394280830e4062887bd92024439195', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:07.400127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 20:47:07.402896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 20:47:07.405381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 20:47:07.405381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 20:47:07.405381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:47:07.405381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:47:07.405381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 20:47:07.405381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:07.405381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 487/982] 10.222.0.89 () {60 vars in 1131 bytes} [Thu May 19 20:47:07 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:07.405381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58266-49f0-479a-a79e-36c956dc8205 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:07.418747 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f31ba4-d29f-413f-b508-f2b4609d2fc8 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:07.467347 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc2889-562e-4cf1-b908-ed86849e00ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:07.468688 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2889-562e-4cf1-b908-ed86849e00ea None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:07.469762 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:07.471207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2889-562e-4cf1-b908-ed86849e00ea None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:07.471711 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2889-562e-4cf1-b908-ed86849e00ea None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:07.472916 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc2889-562e-4cf1-b908-ed86849e00ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:07.473780 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc2889-562e-4cf1-b908-ed86849e00ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:07.475857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc2889-562e-4cf1-b908-ed86849e00ea None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:07.493794 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 496/983] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:07.500140 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc2889-562e-4cf1-b908-ed86849e00ea None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:07.519363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58266-49f0-479a-a79e-36c956dc8205 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:07.533530 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:07.572160 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4acdeb-b566-4815-a099-396d1669ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:07.573306 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4acdeb-b566-4815-a099-396d1669ef0c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:07.573585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4acdeb-b566-4815-a099-396d1669ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:07.574388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4acdeb-b566-4815-a099-396d1669ef0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:07.587127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4acdeb-b566-4815-a099-396d1669ef0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:07.589335 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4acdeb-b566-4815-a099-396d1669ef0c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-ea4acdeb-b566-4815-a099-396d1669ef0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:47:07.615401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:07.617601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:07.619877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:07.619877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:07.619877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:47:07.619877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:47:07.619877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:47:07.619877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:47:07.619877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:47:07.619877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:47:07.619877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:47:07.619877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:07.619877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 488/984] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:47:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:07.623229 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4acdeb-b566-4815-a099-396d1669ef0c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:07.638346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc2889-562e-4cf1-b908-ed86849e00ea None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:07.690248 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdbf20-f30f-4739-9708-1a7f45cd1948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:07.691311 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdbf20-f30f-4739-9708-1a7f45cd1948 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:07.692089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdbf20-f30f-4739-9708-1a7f45cd1948 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:07.692549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdbf20-f30f-4739-9708-1a7f45cd1948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:07.694301 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdbf20-f30f-4739-9708-1a7f45cd1948 None admin] RBAC: Adding query filter params (role.id=9e62b6dc2ae14408a6a05295caeb4054, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=54a572dfba3e48498be80570d0f71369) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:07.694805 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdbf20-f30f-4739-9708-1a7f45cd1948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:07.696400 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdbf20-f30f-4739-9708-1a7f45cd1948 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:07.708941 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 497/985] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:47:07 2022] GET /identity/v3/role_assignments?user.id=54a572dfba3e48498be80570d0f71369&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=9e62b6dc2ae14408a6a05295caeb4054 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:07.740851 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4acdeb-b566-4815-a099-396d1669ef0c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:07.753426 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57fc1-a0f4-4a5a-9384-ca976e4c9d10 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:07.753772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57fc1-a0f4-4a5a-9384-ca976e4c9d10 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:07.754036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c57fc1-a0f4-4a5a-9384-ca976e4c9d10 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:07.756064 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 498/986] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:47:07.761515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedad650-8a04-42ff-876e-afcf0d007e67 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:07.761930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedad650-8a04-42ff-876e-afcf0d007e67 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:07.762305 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedad650-8a04-42ff-876e-afcf0d007e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:07.770023 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:07.782999 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-eedad650-8a04-42ff-876e-afcf0d007e67 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:07.784623 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-eedad650-8a04-42ff-876e-afcf0d007e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:07.786320 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fec69d-05fc-4cb7-b5eb-1ac21ecdb89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:07.787131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fec69d-05fc-4cb7-b5eb-1ac21ecdb89c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:07.787499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fec69d-05fc-4cb7-b5eb-1ac21ecdb89c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:07.787863 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fec69d-05fc-4cb7-b5eb-1ac21ecdb89c None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:07.788742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fec69d-05fc-4cb7-b5eb-1ac21ecdb89c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:07.789152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fec69d-05fc-4cb7-b5eb-1ac21ecdb89c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:07.790727 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fec69d-05fc-4cb7-b5eb-1ac21ecdb89c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:07.835005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 489/987] 10.222.0.89 () {56 vars in 1101 bytes} [Thu May 19 20:47:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:07.874875 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 499/988] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:07.899500 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fec69d-05fc-4cb7-b5eb-1ac21ecdb89c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:08.023875 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fec69d-05fc-4cb7-b5eb-1ac21ecdb89c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:08.068500 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c958a5-c5c7-4002-9f5d-55f4b0426dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:08.069330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c958a5-c5c7-4002-9f5d-55f4b0426dbd None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:08.069720 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c958a5-c5c7-4002-9f5d-55f4b0426dbd None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:08.070101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c958a5-c5c7-4002-9f5d-55f4b0426dbd None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:08.070996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c958a5-c5c7-4002-9f5d-55f4b0426dbd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:08.072482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c958a5-c5c7-4002-9f5d-55f4b0426dbd None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:08.150699 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 490/989] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:47:07 2022] POST /identity/v3/services => generated 242 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:47:09.181750 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def3217-3986-4018-adca-42c0362acce5 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:09.182857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def3217-3986-4018-adca-42c0362acce5 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:09.182857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def3217-3986-4018-adca-42c0362acce5 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:09.184392 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 500/990] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:09.190057 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafeae2-82bd-482b-bc8f-dc5587378f16 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:09.190529 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafeae2-82bd-482b-bc8f-dc5587378f16 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:09.190653 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafeae2-82bd-482b-bc8f-dc5587378f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:09.210290 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-3fafeae2-82bd-482b-bc8f-dc5587378f16 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:09.211850 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-3fafeae2-82bd-482b-bc8f-dc5587378f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:09.242560 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:09.289960 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 491/991] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:09.314294 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def3217-3986-4018-adca-42c0362acce5 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:09.340708 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:09.421184 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def3217-3986-4018-adca-42c0362acce5 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:09.456083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7609c-6317-4635-920f-7889e4c8b385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:09.456889 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7609c-6317-4635-920f-7889e4c8b385 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:09.457170 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7609c-6317-4635-920f-7889e4c8b385 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:09.457440 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7609c-6317-4635-920f-7889e4c8b385 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:09.458091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7609c-6317-4635-920f-7889e4c8b385 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:09.459488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7609c-6317-4635-920f-7889e4c8b385 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-7cd7609c-6317-4635-920f-7889e4c8b385 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:09.472255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:09.473469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:47:09.474549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:09.476453 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 501/992] 10.222.0.89 () {56 vars in 1126 bytes} [Thu May 19 20:47:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:09.480408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafeae2-82bd-482b-bc8f-dc5587378f16 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:09.582137 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafeae2-82bd-482b-bc8f-dc5587378f16 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:09.632684 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed857e-7c36-40d1-a3b5-844e99c4c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:09.633463 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed857e-7c36-40d1-a3b5-844e99c4c775 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:09.633742 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed857e-7c36-40d1-a3b5-844e99c4c775 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:09.634013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed857e-7c36-40d1-a3b5-844e99c4c775 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:09.634829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed857e-7c36-40d1-a3b5-844e99c4c775 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:09.635169 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed857e-7c36-40d1-a3b5-844e99c4c775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:09.636577 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed857e-7c36-40d1-a3b5-844e99c4c775 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:09.648145 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 492/993] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:47:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:09.649677 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7609c-6317-4635-920f-7889e4c8b385 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:09.745380 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:09.757777 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7609c-6317-4635-920f-7889e4c8b385 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:09.792922 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328932cf-b961-4a5f-a305-e704b06bcbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:09.793604 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328932cf-b961-4a5f-a305-e704b06bcbb9 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:09.793892 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328932cf-b961-4a5f-a305-e704b06bcbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:09.794170 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328932cf-b961-4a5f-a305-e704b06bcbb9 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:09.794929 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328932cf-b961-4a5f-a305-e704b06bcbb9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:09.795245 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328932cf-b961-4a5f-a305-e704b06bcbb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:09.796675 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328932cf-b961-4a5f-a305-e704b06bcbb9 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:09.806644 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 502/994] 10.222.0.89 () {56 vars in 1122 bytes} [Thu May 19 20:47:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:09.808398 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed857e-7c36-40d1-a3b5-844e99c4c775 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:09.839319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:09.921462 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed857e-7c36-40d1-a3b5-844e99c4c775 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:09.963173 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b83e0-5fd9-4e23-96cc-c13dba7c69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:09.964871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b83e0-5fd9-4e23-96cc-c13dba7c69db None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:09.965357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b83e0-5fd9-4e23-96cc-c13dba7c69db None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:09.965829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b83e0-5fd9-4e23-96cc-c13dba7c69db None admin] PATH_INFO: `/v3/endpoints` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:09.967276 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b83e0-5fd9-4e23-96cc-c13dba7c69db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:09.969863 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b83e0-5fd9-4e23-96cc-c13dba7c69db None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:10.058324 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 493/995] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:47:09 2022] POST /identity/v3/endpoints => generated 325 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:47:10.091893 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e66f38-f241-488b-8958-838d254e9ddd None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:10.092195 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e66f38-f241-488b-8958-838d254e9ddd None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:10.092466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e66f38-f241-488b-8958-838d254e9ddd None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:10.093983 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 503/996] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:10.099932 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b24a-c82a-49b3-87fb-9f334a2be723 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:10.100245 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b24a-c82a-49b3-87fb-9f334a2be723 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:10.100500 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b24a-c82a-49b3-87fb-9f334a2be723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:10.119878 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-8d73b24a-c82a-49b3-87fb-9f334a2be723 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:10.121138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-8d73b24a-c82a-49b3-87fb-9f334a2be723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:10.208330 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 494/997] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:10.231315 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e66f38-f241-488b-8958-838d254e9ddd None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:10.358098 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e66f38-f241-488b-8958-838d254e9ddd None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:10.393624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77ec3e-9bcc-4770-8215-4367eaa08d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:10.394427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77ec3e-9bcc-4770-8215-4367eaa08d7b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:10.394744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77ec3e-9bcc-4770-8215-4367eaa08d7b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:10.395025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77ec3e-9bcc-4770-8215-4367eaa08d7b None admin] PATH_INFO: `/v3/services/image` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:10.395687 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77ec3e-9bcc-4770-8215-4367eaa08d7b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:10.397068 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77ec3e-9bcc-4770-8215-4367eaa08d7b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-eb77ec3e-9bcc-4770-8215-4367eaa08d7b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:10.409718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:10.411268 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:47:10.412273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:10.414681 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 504/998] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 20:47:10 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:10.417386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73b24a-c82a-49b3-87fb-9f334a2be723 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:10.433225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:10.444971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc31472-10f1-4ee9-9f5a-d0470af87055 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:10.445335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc31472-10f1-4ee9-9f5a-d0470af87055 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:10.453050 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc31472-10f1-4ee9-9f5a-d0470af87055 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:10.453050 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 505/999] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:47:10.453379 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b867a14-051c-4b95-9a12-93b11a2bf2c4 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:10.453698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b867a14-051c-4b95-9a12-93b11a2bf2c4 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:10.454011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b867a14-051c-4b95-9a12-93b11a2bf2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:10.471766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-5b867a14-051c-4b95-9a12-93b11a2bf2c4 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:10.473186 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-5b867a14-051c-4b95-9a12-93b11a2bf2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:10.484927 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:10.534454 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73b24a-c82a-49b3-87fb-9f334a2be723 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:10.550851 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 506/1000] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:47:10.570373 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b867a14-051c-4b95-9a12-93b11a2bf2c4 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:10.576202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682447b-f8eb-417d-9638-cd678ba2ce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:10.576883 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682447b-f8eb-417d-9638-cd678ba2ce65 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:10.577173 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682447b-f8eb-417d-9638-cd678ba2ce65 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:10.577454 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682447b-f8eb-417d-9638-cd678ba2ce65 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:10.578172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682447b-f8eb-417d-9638-cd678ba2ce65 None admin] RBAC: Adding query filter params (name=image) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:10.578485 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682447b-f8eb-417d-9638-cd678ba2ce65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:10.579921 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682447b-f8eb-417d-9638-cd678ba2ce65 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:10.585186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 495/1001] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:10.590791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682447b-f8eb-417d-9638-cd678ba2ce65 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:10.678321 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:10.680881 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b867a14-051c-4b95-9a12-93b11a2bf2c4 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:10.702543 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682447b-f8eb-417d-9638-cd678ba2ce65 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:10.719434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd85dc-10e2-4441-82d3-12ff28ffb5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:10.720238 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd85dc-10e2-4441-82d3-12ff28ffb5ec None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:10.720525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd85dc-10e2-4441-82d3-12ff28ffb5ec None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:10.720805 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd85dc-10e2-4441-82d3-12ff28ffb5ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:10.721487 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd85dc-10e2-4441-82d3-12ff28ffb5ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:10.722907 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd85dc-10e2-4441-82d3-12ff28ffb5ec None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-0efd85dc-10e2-4441-82d3-12ff28ffb5ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:10.734963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:10.736171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:47:10.737180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:10.739456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 507/1002] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:47:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:10.739957 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf89c03-efb2-44bc-b52c-1e7b5e2c4329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:10.740701 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf89c03-efb2-44bc-b52c-1e7b5e2c4329 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:10.740989 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf89c03-efb2-44bc-b52c-1e7b5e2c4329 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:10.741262 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf89c03-efb2-44bc-b52c-1e7b5e2c4329 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:10.741974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf89c03-efb2-44bc-b52c-1e7b5e2c4329 None admin] RBAC: Adding query filter params (type=image) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:10.742285 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf89c03-efb2-44bc-b52c-1e7b5e2c4329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:10.743688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf89c03-efb2-44bc-b52c-1e7b5e2c4329 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:10.745907 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd85dc-10e2-4441-82d3-12ff28ffb5ec None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:10.755036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 496/1003] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:10.760819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:10.867070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd85dc-10e2-4441-82d3-12ff28ffb5ec None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:10.905823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b7d18-c501-4095-85e3-3654d3d322b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:10.906513 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7d18-c501-4095-85e3-3654d3d322b9 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:10.906831 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7d18-c501-4095-85e3-3654d3d322b9 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:10.907115 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7d18-c501-4095-85e3-3654d3d322b9 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:10.907858 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b7d18-c501-4095-85e3-3654d3d322b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:10.908175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b7d18-c501-4095-85e3-3654d3d322b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:10.909600 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b7d18-c501-4095-85e3-3654d3d322b9 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:10.920657 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 508/1004] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:47:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:10.921761 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf89c03-efb2-44bc-b52c-1e7b5e2c4329 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:11.032374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf89c03-efb2-44bc-b52c-1e7b5e2c4329 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:11.075752 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8ce7c-f4bb-4243-8efb-0140fb0278fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:11.076432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8ce7c-f4bb-4243-8efb-0140fb0278fd None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:11.076715 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8ce7c-f4bb-4243-8efb-0140fb0278fd None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:11.076992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8ce7c-f4bb-4243-8efb-0140fb0278fd None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:11.077702 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8ce7c-f4bb-4243-8efb-0140fb0278fd None admin] RBAC: Adding query filter params (type=compute) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:11.078012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8ce7c-f4bb-4243-8efb-0140fb0278fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:11.079465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8ce7c-f4bb-4243-8efb-0140fb0278fd None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:11.089376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 497/1005] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:47:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:11.091007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b7d18-c501-4095-85e3-3654d3d322b9 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:11.172698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:11.198310 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b7d18-c501-4095-85e3-3654d3d322b9 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:11.234216 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52acab7-0565-4579-b521-0345d9c40b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:11.235032 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acab7-0565-4579-b521-0345d9c40b1f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:11.235304 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acab7-0565-4579-b521-0345d9c40b1f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:11.235480 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acab7-0565-4579-b521-0345d9c40b1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:11.236306 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52acab7-0565-4579-b521-0345d9c40b1f None admin] RBAC: Adding query filter params (interface=public, service_id=c9cc6991a9e64b26b3ee0aced5195866, region_id=RegionOne) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:11.236619 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52acab7-0565-4579-b521-0345d9c40b1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:11.238044 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52acab7-0565-4579-b521-0345d9c40b1f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:11.249347 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 509/1006] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:47:11 2022] GET /identity/v3/endpoints?service_id=c9cc6991a9e64b26b3ee0aced5195866&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:11.250567 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8ce7c-f4bb-4243-8efb-0140fb0278fd None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:11.259867 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:11.360980 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8ce7c-f4bb-4243-8efb-0140fb0278fd None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:11.395452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8c24f-9e2c-4c26-aea5-314275c67f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:11.396129 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8c24f-9e2c-4c26-aea5-314275c67f19 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:11.396415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8c24f-9e2c-4c26-aea5-314275c67f19 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:11.396695 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8c24f-9e2c-4c26-aea5-314275c67f19 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:11.397386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8c24f-9e2c-4c26-aea5-314275c67f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:11.398852 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8c24f-9e2c-4c26-aea5-314275c67f19 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:11.414645 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 498/1007] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:47:11 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:47:12.364022 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357cee0-e1a3-4d6e-bbf5-2bbf8abdbab1 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:12.364556 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357cee0-e1a3-4d6e-bbf5-2bbf8abdbab1 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:12.364556 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357cee0-e1a3-4d6e-bbf5-2bbf8abdbab1 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:12.366102 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 510/1008] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:12.371958 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3824a44-0c5e-4e85-be2e-ae8f9dd1a82d None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:12.372402 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3824a44-0c5e-4e85-be2e-ae8f9dd1a82d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:12.372518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3824a44-0c5e-4e85-be2e-ae8f9dd1a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:12.390424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-d3824a44-0c5e-4e85-be2e-ae8f9dd1a82d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:12.391619 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-d3824a44-0c5e-4e85-be2e-ae8f9dd1a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:12.456564 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:12.462124 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 499/1009] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:12.485840 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357cee0-e1a3-4d6e-bbf5-2bbf8abdbab1 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:12.594801 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357cee0-e1a3-4d6e-bbf5-2bbf8abdbab1 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:12.630488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e118f-588b-445e-a9cc-47f9f53c8ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:12.631252 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e118f-588b-445e-a9cc-47f9f53c8ffe None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:12.631537 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e118f-588b-445e-a9cc-47f9f53c8ffe None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:12.631809 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e118f-588b-445e-a9cc-47f9f53c8ffe None admin] PATH_INFO: `/v3/domains/default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:12.633029 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e118f-588b-445e-a9cc-47f9f53c8ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:12.634461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e118f-588b-445e-a9cc-47f9f53c8ffe None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:12.641026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 511/1010] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:12.642281 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3824a44-0c5e-4e85-be2e-ae8f9dd1a82d None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:12.748646 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3824a44-0c5e-4e85-be2e-ae8f9dd1a82d None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:12.782645 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f132f-b098-4a72-b1dc-ff48fa57377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:12.783312 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f132f-b098-4a72-b1dc-ff48fa57377e None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:12.783593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f132f-b098-4a72-b1dc-ff48fa57377e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:12.783866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f132f-b098-4a72-b1dc-ff48fa57377e None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:12.784573 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f132f-b098-4a72-b1dc-ff48fa57377e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:12.785998 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f132f-b098-4a72-b1dc-ff48fa57377e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:12.903621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 500/1011] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:47:12 2022] POST /identity/v3/projects => generated 311 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:47:13.051424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768856b1-750f-4cf4-be54-d5c61fd1edc8 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:13.051909 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768856b1-750f-4cf4-be54-d5c61fd1edc8 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:13.052413 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768856b1-750f-4cf4-be54-d5c61fd1edc8 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:13.057933 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 512/1012] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:13.064592 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba1c10-1f00-43ca-9def-986a11adb5d7 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:13.064954 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba1c10-1f00-43ca-9def-986a11adb5d7 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:13.065159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba1c10-1f00-43ca-9def-986a11adb5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:13.085927 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-d1ba1c10-1f00-43ca-9def-986a11adb5d7 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:13.087255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-d1ba1c10-1f00-43ca-9def-986a11adb5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:13.143488 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:13.165101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 501/1013] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:13.189169 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768856b1-750f-4cf4-be54-d5c61fd1edc8 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:13.199557 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:13.300957 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768856b1-750f-4cf4-be54-d5c61fd1edc8 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:13.340433 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5532c96-e7cd-4879-849f-e96f23d29b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:13.341384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532c96-e7cd-4879-849f-e96f23d29b7f None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:13.341814 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532c96-e7cd-4879-849f-e96f23d29b7f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:13.342264 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532c96-e7cd-4879-849f-e96f23d29b7f None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:13.343439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5532c96-e7cd-4879-849f-e96f23d29b7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:13.345358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5532c96-e7cd-4879-849f-e96f23d29b7f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:13.455489 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 513/1014] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:47:13 2022] POST /identity/v3/services => generated 242 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:47:13.679960 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a46e0-5b5c-42a1-a99b-974d6fddc6bb None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:13.680520 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a46e0-5b5c-42a1-a99b-974d6fddc6bb None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:13.680520 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a46e0-5b5c-42a1-a99b-974d6fddc6bb None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:13.682434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 502/1015] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:13.688366 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbb9b-466d-4f2d-8818-7b4a97d2b388 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:13.688675 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbb9b-466d-4f2d-8818-7b4a97d2b388 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:13.688997 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbb9b-466d-4f2d-8818-7b4a97d2b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:13.707373 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-679bbb9b-466d-4f2d-8818-7b4a97d2b388 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:13.708545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-679bbb9b-466d-4f2d-8818-7b4a97d2b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:13.777320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:13.791963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 514/1016] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:13 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:13.819278 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a46e0-5b5c-42a1-a99b-974d6fddc6bb None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:13.931529 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a46e0-5b5c-42a1-a99b-974d6fddc6bb None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:13.970776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998476f-7edb-46d4-971e-589c0abfb1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:13.971584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998476f-7edb-46d4-971e-589c0abfb1dd None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:13.972010 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998476f-7edb-46d4-971e-589c0abfb1dd None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:13.972143 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998476f-7edb-46d4-971e-589c0abfb1dd None admin] PATH_INFO: `/v3/services/compute` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:13.972791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998476f-7edb-46d4-971e-589c0abfb1dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:13.974173 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998476f-7edb-46d4-971e-589c0abfb1dd None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-c998476f-7edb-46d4-971e-589c0abfb1dd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:13.987760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:13.989481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:47:13.991373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:13.992746 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 503/1017] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:47:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:13.995963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bbb9b-466d-4f2d-8818-7b4a97d2b388 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:14.111042 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bbb9b-466d-4f2d-8818-7b4a97d2b388 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:14.148066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf945a-e797-4b94-bbb5-4c31612edd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:14.148764 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf945a-e797-4b94-bbb5-4c31612edd6f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:14.149047 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf945a-e797-4b94-bbb5-4c31612edd6f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:14.149325 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf945a-e797-4b94-bbb5-4c31612edd6f None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:14.150072 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf945a-e797-4b94-bbb5-4c31612edd6f None admin] RBAC: Adding query filter params (name=compute) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:14.150386 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf945a-e797-4b94-bbb5-4c31612edd6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:14.152395 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf945a-e797-4b94-bbb5-4c31612edd6f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:14.162771 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 515/1018] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:47:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:14.164439 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998476f-7edb-46d4-971e-589c0abfb1dd None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:14.217324 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:14.274198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998476f-7edb-46d4-971e-589c0abfb1dd None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:14.311474 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286b679-047e-460a-95ff-30cd3fb40bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:14.312148 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286b679-047e-460a-95ff-30cd3fb40bc8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:14.312434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286b679-047e-460a-95ff-30cd3fb40bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:14.312714 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286b679-047e-460a-95ff-30cd3fb40bc8 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:14.313428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286b679-047e-460a-95ff-30cd3fb40bc8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:14.313744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286b679-047e-460a-95ff-30cd3fb40bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:14.315156 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286b679-047e-460a-95ff-30cd3fb40bc8 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:14.325138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 504/1019] 10.222.0.89 () {56 vars in 1112 bytes} [Thu May 19 20:47:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:14.326858 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf945a-e797-4b94-bbb5-4c31612edd6f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:14.386186 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:14.431639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf945a-e797-4b94-bbb5-4c31612edd6f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:14.466444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebc36b-0fc7-458e-a124-59980420a8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:14.467229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebc36b-0fc7-458e-a124-59980420a8dd None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:14.467479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebc36b-0fc7-458e-a124-59980420a8dd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:14.467726 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebc36b-0fc7-458e-a124-59980420a8dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:14.468470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebc36b-0fc7-458e-a124-59980420a8dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:14.469856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebc36b-0fc7-458e-a124-59980420a8dd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:14.574969 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 516/1020] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:47:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:47:15.284170 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceae6ec-965a-44b8-97c1-eede84ee6d4d None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:15.284786 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceae6ec-965a-44b8-97c1-eede84ee6d4d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:15.284786 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceae6ec-965a-44b8-97c1-eede84ee6d4d None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:15.286321 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 505/1021] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:15.292671 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6990f7-596b-4fa7-b09a-44ce6a6ea842 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:15.292955 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6990f7-596b-4fa7-b09a-44ce6a6ea842 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:15.293237 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6990f7-596b-4fa7-b09a-44ce6a6ea842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:15.315642 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-9d6990f7-596b-4fa7-b09a-44ce6a6ea842 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:15.315642 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-9d6990f7-596b-4fa7-b09a-44ce6a6ea842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:15.392686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 517/1022] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:15.418323 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceae6ec-965a-44b8-97c1-eede84ee6d4d None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:15.530144 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceae6ec-965a-44b8-97c1-eede84ee6d4d None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:15.543114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:15.568424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8d515-6931-455c-8915-fbd2ca423a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:15.569146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8d515-6931-455c-8915-fbd2ca423a36 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:15.569432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8d515-6931-455c-8915-fbd2ca423a36 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:15.569710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8d515-6931-455c-8915-fbd2ca423a36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:15.570966 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8d515-6931-455c-8915-fbd2ca423a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:15.572938 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8d515-6931-455c-8915-fbd2ca423a36 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:15.574844 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 506/1023] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:15.580460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6990f7-596b-4fa7-b09a-44ce6a6ea842 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:15.626103 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:15.691403 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6990f7-596b-4fa7-b09a-44ce6a6ea842 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:15.729652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019d5b1-765c-4e2a-b15f-6c448d25d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:15.730784 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019d5b1-765c-4e2a-b15f-6c448d25d909 None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:15.731304 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019d5b1-765c-4e2a-b15f-6c448d25d909 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:15.731805 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019d5b1-765c-4e2a-b15f-6c448d25d909 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:15.733163 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019d5b1-765c-4e2a-b15f-6c448d25d909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:15.734875 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019d5b1-765c-4e2a-b15f-6c448d25d909 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:15.793217 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a870-6650-4832-b71b-f31f41dae795 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:15.793507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a870-6650-4832-b71b-f31f41dae795 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:15.793791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a870-6650-4832-b71b-f31f41dae795 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:15.795216 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 507/1024] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:47:15.800336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f038a0b-e518-415d-b685-f4913026deb5 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:15.800619 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f038a0b-e518-415d-b685-f4913026deb5 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:15.800899 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f038a0b-e518-415d-b685-f4913026deb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:15.820076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-5f038a0b-e518-415d-b685-f4913026deb5 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:15.821248 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-5f038a0b-e518-415d-b685-f4913026deb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:15.850643 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 518/1025] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:47:15 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:47:15.930794 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 508/1026] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:47:15.952681 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019d5b1-765c-4e2a-b15f-6c448d25d909 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:16.076605 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:16.084887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019d5b1-765c-4e2a-b15f-6c448d25d909 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:16.121355 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe506547-11f5-4e79-8362-0aeebd9a7fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:16.122165 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506547-11f5-4e79-8362-0aeebd9a7fbf None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:16.122446 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506547-11f5-4e79-8362-0aeebd9a7fbf None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:16.122794 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506547-11f5-4e79-8362-0aeebd9a7fbf None admin] PATH_INFO: `/v3/services/image` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:16.123466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe506547-11f5-4e79-8362-0aeebd9a7fbf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:16.124847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe506547-11f5-4e79-8362-0aeebd9a7fbf None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-fe506547-11f5-4e79-8362-0aeebd9a7fbf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:16.137685 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:16.139180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:16.140213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 519/1027] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 20:47:15 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:16.146169 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f038a0b-e518-415d-b685-f4913026deb5 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:16.265546 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f038a0b-e518-415d-b685-f4913026deb5 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:16.275838 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:16.301689 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61e275-f922-44e2-b823-8d2b2ee19f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:16.302447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61e275-f922-44e2-b823-8d2b2ee19f3c None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:16.302765 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61e275-f922-44e2-b823-8d2b2ee19f3c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:16.302968 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61e275-f922-44e2-b823-8d2b2ee19f3c None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:16.303635 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61e275-f922-44e2-b823-8d2b2ee19f3c None admin] RBAC: Adding query filter params (name=image) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:16.304002 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61e275-f922-44e2-b823-8d2b2ee19f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:16.305385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61e275-f922-44e2-b823-8d2b2ee19f3c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:16.316570 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 509/1028] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:16.320336 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe506547-11f5-4e79-8362-0aeebd9a7fbf None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:16.424461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe506547-11f5-4e79-8362-0aeebd9a7fbf None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:16.460086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98620a-f6f9-476a-8e14-2b32d823f512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:16.460762 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98620a-f6f9-476a-8e14-2b32d823f512 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:16.461042 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98620a-f6f9-476a-8e14-2b32d823f512 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:16.461315 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98620a-f6f9-476a-8e14-2b32d823f512 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:16.462039 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98620a-f6f9-476a-8e14-2b32d823f512 None admin] RBAC: Adding query filter params (type=image) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:16.462347 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98620a-f6f9-476a-8e14-2b32d823f512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:16.463806 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98620a-f6f9-476a-8e14-2b32d823f512 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:16.469542 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 520/1029] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:16.475919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61e275-f922-44e2-b823-8d2b2ee19f3c None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:16.580536 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61e275-f922-44e2-b823-8d2b2ee19f3c None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:16.621143 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edc425-bbb8-43c7-adcf-91f271664677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:16.621814 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edc425-bbb8-43c7-adcf-91f271664677 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:16.622094 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edc425-bbb8-43c7-adcf-91f271664677 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:16.622376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edc425-bbb8-43c7-adcf-91f271664677 None admin] PATH_INFO: `/v3/endpoints` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:16.623243 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edc425-bbb8-43c7-adcf-91f271664677 None admin] RBAC: Adding query filter params (interface=public, service_id=529d76ed65064ba4a56b0f2cf8e92d3a, region_id=RegionOne) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:16.623569 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edc425-bbb8-43c7-adcf-91f271664677 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:16.624988 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edc425-bbb8-43c7-adcf-91f271664677 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:16.632295 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 510/1030] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:47:16 2022] GET /identity/v3/endpoints?service_id=529d76ed65064ba4a56b0f2cf8e92d3a&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:16.638529 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98620a-f6f9-476a-8e14-2b32d823f512 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:16.668726 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:16.753528 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98620a-f6f9-476a-8e14-2b32d823f512 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:16.792710 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a198993-ed63-4f86-823c-4ac21c05a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:16.793419 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a198993-ed63-4f86-823c-4ac21c05a41f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:16.793703 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a198993-ed63-4f86-823c-4ac21c05a41f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:16.793978 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a198993-ed63-4f86-823c-4ac21c05a41f None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:16.794736 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a198993-ed63-4f86-823c-4ac21c05a41f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:16.796188 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a198993-ed63-4f86-823c-4ac21c05a41f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:16.804226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 521/1031] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:47:16 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:47:16.978474 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63067b-d10f-40e6-9596-3a976feb3738 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:16.978912 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63067b-d10f-40e6-9596-3a976feb3738 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:16.979127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63067b-d10f-40e6-9596-3a976feb3738 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:16.980870 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 511/1032] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:16.986876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245675-90a2-4bb6-a818-13a84153749c None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:16.987255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245675-90a2-4bb6-a818-13a84153749c None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:16.987451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245675-90a2-4bb6-a818-13a84153749c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:17.006763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-34245675-90a2-4bb6-a818-13a84153749c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:17.007970 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-34245675-90a2-4bb6-a818-13a84153749c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:17.095977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 522/1033] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:17.119271 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63067b-d10f-40e6-9596-3a976feb3738 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:17.159842 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:17.230058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63067b-d10f-40e6-9596-3a976feb3738 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:17.269703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade8caf-d1c8-448b-b834-0b3b30966647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:17.269703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade8caf-d1c8-448b-b834-0b3b30966647 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:17.269703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade8caf-d1c8-448b-b834-0b3b30966647 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:17.269703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade8caf-d1c8-448b-b834-0b3b30966647 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:17.280273 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade8caf-d1c8-448b-b834-0b3b30966647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-1ade8caf-d1c8-448b-b834-0b3b30966647 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:47:17.288664 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:17.289845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:17.290900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 512/1034] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:47:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:17.297930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245675-90a2-4bb6-a818-13a84153749c None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:17.316910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:17.408168 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245675-90a2-4bb6-a818-13a84153749c None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:17.445090 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4edc6d-55d1-4c8b-9528-53b0f41cf1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:17.445779 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4edc6d-55d1-4c8b-9528-53b0f41cf1c7 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:17.446066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4edc6d-55d1-4c8b-9528-53b0f41cf1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:17.446342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4edc6d-55d1-4c8b-9528-53b0f41cf1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:17.447312 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4edc6d-55d1-4c8b-9528-53b0f41cf1c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:17.448196 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4edc6d-55d1-4c8b-9528-53b0f41cf1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:17.449584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4edc6d-55d1-4c8b-9528-53b0f41cf1c7 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:17.463709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 523/1035] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:47:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:17.464776 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade8caf-d1c8-448b-b834-0b3b30966647 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:17.570050 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:17.577536 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade8caf-d1c8-448b-b834-0b3b30966647 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:17.617102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1ff89-2945-4b54-8dc2-302997103a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:17.617908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1ff89-2945-4b54-8dc2-302997103a76 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:17.618193 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1ff89-2945-4b54-8dc2-302997103a76 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:17.618470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1ff89-2945-4b54-8dc2-302997103a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:17.629959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1ff89-2945-4b54-8dc2-302997103a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:17.631454 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1ff89-2945-4b54-8dc2-302997103a76 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-15b1ff89-2945-4b54-8dc2-302997103a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:17.650212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:17.651578 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:17.652663 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:47:17.652663 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:17.652663 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:17.652663 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:17.653450 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 513/1036] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:17.657621 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4edc6d-55d1-4c8b-9528-53b0f41cf1c7 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:17.746154 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:17.778964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4edc6d-55d1-4c8b-9528-53b0f41cf1c7 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:17.816161 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc73273-7f7c-4db3-8ea0-725c7ac2676d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:17.816842 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc73273-7f7c-4db3-8ea0-725c7ac2676d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:17.817126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc73273-7f7c-4db3-8ea0-725c7ac2676d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:17.817404 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc73273-7f7c-4db3-8ea0-725c7ac2676d None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:17.818146 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc73273-7f7c-4db3-8ea0-725c7ac2676d None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:17.818465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc73273-7f7c-4db3-8ea0-725c7ac2676d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:17.819897 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc73273-7f7c-4db3-8ea0-725c7ac2676d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:17.838511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 524/1037] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:17.839720 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1ff89-2945-4b54-8dc2-302997103a76 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:17.949351 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1ff89-2945-4b54-8dc2-302997103a76 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:17.986583 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddceaf-f935-43c3-a29d-49d35776ef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:17.987653 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddceaf-f935-43c3-a29d-49d35776ef71 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:17.987936 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddceaf-f935-43c3-a29d-49d35776ef71 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:17.988208 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddceaf-f935-43c3-a29d-49d35776ef71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:17.997421 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddceaf-f935-43c3-a29d-49d35776ef71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:17.998911 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddceaf-f935-43c3-a29d-49d35776ef71 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-d6ddceaf-f935-43c3-a29d-49d35776ef71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:47:18.013482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:18.019855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:18.021264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:18.021264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:18.021264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:47:18.021264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:47:18.021264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:47:18.021264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:47:18.021264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:47:18.021264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:47:18.021264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:47:18.021264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:18.021264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 514/1038] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:47:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:18.023330 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc73273-7f7c-4db3-8ea0-725c7ac2676d None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:18.142056 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc73273-7f7c-4db3-8ea0-725c7ac2676d None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:18.178573 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d6570-1007-415a-8092-26a501300df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:18.179265 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d6570-1007-415a-8092-26a501300df1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:18.179545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d6570-1007-415a-8092-26a501300df1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:18.179814 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d6570-1007-415a-8092-26a501300df1 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:18.180653 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d6570-1007-415a-8092-26a501300df1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:18.180961 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d6570-1007-415a-8092-26a501300df1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:18.182430 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d6570-1007-415a-8092-26a501300df1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:18.191381 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:18.206758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 525/1039] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:47:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:18.208702 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddceaf-f935-43c3-a29d-49d35776ef71 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:18.221722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:18.232256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb40bef-79af-4bd2-8738-844f194482a0 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:18.232601 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb40bef-79af-4bd2-8738-844f194482a0 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:18.232806 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb40bef-79af-4bd2-8738-844f194482a0 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:18.234341 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 526/1040] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:47:18.239628 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d129b5-e456-4b78-9ecd-561159599668 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:18.239924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d129b5-e456-4b78-9ecd-561159599668 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:18.240215 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d129b5-e456-4b78-9ecd-561159599668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:18.258449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-28d129b5-e456-4b78-9ecd-561159599668 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:18.259705 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-28d129b5-e456-4b78-9ecd-561159599668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:18.318704 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddceaf-f935-43c3-a29d-49d35776ef71 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:18.336494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 527/1041] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:18.360604 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d129b5-e456-4b78-9ecd-561159599668 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:18.361580 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ea602-4d52-4dad-ba22-010b6613c375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:18.362312 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ea602-4d52-4dad-ba22-010b6613c375 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:18.362929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ea602-4d52-4dad-ba22-010b6613c375 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:18.363211 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ea602-4d52-4dad-ba22-010b6613c375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:18.439078 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ea602-4d52-4dad-ba22-010b6613c375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:18.440454 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ea602-4d52-4dad-ba22-010b6613c375 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:18.453123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:18.471526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d129b5-e456-4b78-9ecd-561159599668 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:18.500370 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:18.511140 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca5c62-81b1-4990-b1f2-4636623c08ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:18.511943 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca5c62-81b1-4990-b1f2-4636623c08ee None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:18.512227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca5c62-81b1-4990-b1f2-4636623c08ee None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:18.512503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca5c62-81b1-4990-b1f2-4636623c08ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:18.523259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca5c62-81b1-4990-b1f2-4636623c08ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-2cca5c62-81b1-4990-b1f2-4636623c08ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:47:18.531698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:18.533083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:18.534490 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 528/1042] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:47:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:18.542227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca5c62-81b1-4990-b1f2-4636623c08ee None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:18.559250 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 515/1043] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:47:18 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:47:18.565157 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ea602-4d52-4dad-ba22-010b6613c375 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:18.659324 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca5c62-81b1-4990-b1f2-4636623c08ee None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:18.675134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ea602-4d52-4dad-ba22-010b6613c375 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:18.685885 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:18.697893 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe778-9e22-4ec7-97a0-4a54676dda69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:18.697893 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe778-9e22-4ec7-97a0-4a54676dda69 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:18.697893 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe778-9e22-4ec7-97a0-4a54676dda69 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:18.697893 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe778-9e22-4ec7-97a0-4a54676dda69 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:18.698387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fe778-9e22-4ec7-97a0-4a54676dda69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:18.698387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fe778-9e22-4ec7-97a0-4a54676dda69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:18.699104 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fe778-9e22-4ec7-97a0-4a54676dda69 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:18.713676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 529/1044] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:47:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:18.715373 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe778-9e22-4ec7-97a0-4a54676dda69 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:18.725503 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ddd4b-be84-4f4f-b6d9-0ea1117420b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:18.726309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ddd4b-be84-4f4f-b6d9-0ea1117420b8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:18.726591 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ddd4b-be84-4f4f-b6d9-0ea1117420b8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:18.726898 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ddd4b-be84-4f4f-b6d9-0ea1117420b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:18.737676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ddd4b-be84-4f4f-b6d9-0ea1117420b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:18.739202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ddd4b-be84-4f4f-b6d9-0ea1117420b8 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-534ddd4b-be84-4f4f-b6d9-0ea1117420b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:18.758153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:18.759365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:18.766494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:47:18.766494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:18.766494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:18.766494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:18.766494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 516/1045] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:18.766494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ddd4b-be84-4f4f-b6d9-0ea1117420b8 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:18.777163 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:18.836557 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe778-9e22-4ec7-97a0-4a54676dda69 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:18.873551 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ddd4b-be84-4f4f-b6d9-0ea1117420b8 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:18.875185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44c6e0-181e-4923-8cd5-f7062254bb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:18.876934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44c6e0-181e-4923-8cd5-f7062254bb2e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:18.877225 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44c6e0-181e-4923-8cd5-f7062254bb2e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:18.877505 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44c6e0-181e-4923-8cd5-f7062254bb2e None admin] PATH_INFO: `/v3/users/48009bb2555a42a580dc9cb3f4a9d938` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:18.896000 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44c6e0-181e-4923-8cd5-f7062254bb2e None admin] RBAC: Authorizing `identity:get_user(user_id=48009bb2555a42a580dc9cb3f4a9d938)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:18.897477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44c6e0-181e-4923-8cd5-f7062254bb2e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:18.899496 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 530/1046] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:18 2022] GET /identity/v3/users/48009bb2555a42a580dc9cb3f4a9d938 => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:18.905211 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44c6e0-181e-4923-8cd5-f7062254bb2e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:18.917940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f82a87-0105-4210-94c3-fc54a64a4da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:18.918696 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f82a87-0105-4210-94c3-fc54a64a4da8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:18.918989 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f82a87-0105-4210-94c3-fc54a64a4da8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:18.919270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f82a87-0105-4210-94c3-fc54a64a4da8 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:18.920013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f82a87-0105-4210-94c3-fc54a64a4da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:18.920323 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f82a87-0105-4210-94c3-fc54a64a4da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:18.921739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f82a87-0105-4210-94c3-fc54a64a4da8 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:18.935019 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 517/1047] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:18.941128 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f82a87-0105-4210-94c3-fc54a64a4da8 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:18.967663 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:19.028504 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44c6e0-181e-4923-8cd5-f7062254bb2e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:19.037018 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:19.061810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f82a87-0105-4210-94c3-fc54a64a4da8 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:19.077175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825ec0a-4573-4873-9483-21613a788d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:19.078588 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825ec0a-4573-4873-9483-21613a788d8f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:19.079089 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825ec0a-4573-4873-9483-21613a788d8f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:19.079536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825ec0a-4573-4873-9483-21613a788d8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:19.101356 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe1908-16b4-4c2c-92b8-b138c2d0ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:19.102573 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe1908-16b4-4c2c-92b8-b138c2d0ca0f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:19.102896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe1908-16b4-4c2c-92b8-b138c2d0ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:19.103175 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe1908-16b4-4c2c-92b8-b138c2d0ca0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:19.111348 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe1908-16b4-4c2c-92b8-b138c2d0ca0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:19.112873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe1908-16b4-4c2c-92b8-b138c2d0ca0f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-d9fe1908-16b4-4c2c-92b8-b138c2d0ca0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:47:19.128063 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:19.129408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:19.130507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:47:19.130507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:47:19.130507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:47:19.130507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:47:19.130507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:47:19.130507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:47:19.130507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:19.130507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:19.130507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 518/1048] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:47:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:19.135802 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe1908-16b4-4c2c-92b8-b138c2d0ca0f None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:19.164376 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825ec0a-4573-4873-9483-21613a788d8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:19.165845 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825ec0a-4573-4873-9483-21613a788d8f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:19.219533 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:19.238969 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe1908-16b4-4c2c-92b8-b138c2d0ca0f None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:19.271613 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 531/1049] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:47:18 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:47:19.273026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222e945-78ad-4c15-8369-bc890ac1cbf7 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:19.273328 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222e945-78ad-4c15-8369-bc890ac1cbf7 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:19.273606 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222e945-78ad-4c15-8369-bc890ac1cbf7 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:19.275091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 532/1050] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:19.277246 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222e945-78ad-4c15-8369-bc890ac1cbf7 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:19.279312 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61539b8-967f-4f7b-91d1-ae7f045a6b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:19.279987 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61539b8-967f-4f7b-91d1-ae7f045a6b27 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:19.280269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61539b8-967f-4f7b-91d1-ae7f045a6b27 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:19.280545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61539b8-967f-4f7b-91d1-ae7f045a6b27 None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:19.281471 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61539b8-967f-4f7b-91d1-ae7f045a6b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:19.281750 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61539b8-967f-4f7b-91d1-ae7f045a6b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:19.283222 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61539b8-967f-4f7b-91d1-ae7f045a6b27 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:19.285959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:19.296338 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 519/1051] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:19.297868 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062ecc0-3f4e-44e2-bf23-45cf60454d1d None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:19.298161 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062ecc0-3f4e-44e2-bf23-45cf60454d1d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:19.298438 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062ecc0-3f4e-44e2-bf23-45cf60454d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:19.317238 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-8062ecc0-3f4e-44e2-bf23-45cf60454d1d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:19.318476 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-8062ecc0-3f4e-44e2-bf23-45cf60454d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:19.384051 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222e945-78ad-4c15-8369-bc890ac1cbf7 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:19.390706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 520/1052] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:19.391585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062ecc0-3f4e-44e2-bf23-45cf60454d1d None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:19.422698 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac711382-9c88-453b-bb1d-6cff639e30ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:19.423576 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711382-9c88-453b-bb1d-6cff639e30ac None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:19.423864 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711382-9c88-453b-bb1d-6cff639e30ac None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:19.424147 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711382-9c88-453b-bb1d-6cff639e30ac None admin] PATH_INFO: `/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:19.425380 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac711382-9c88-453b-bb1d-6cff639e30ac None admin] RBAC: Authorizing `identity:get_project(project_id=5b6fc1ac73a24e2ab0688611b645a72e)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:19.426866 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac711382-9c88-453b-bb1d-6cff639e30ac None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:19.428644 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 533/1053] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:47:19 2022] GET /identity/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:19.429518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac711382-9c88-453b-bb1d-6cff639e30ac None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:19.467404 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:19.501421 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062ecc0-3f4e-44e2-bf23-45cf60454d1d None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:19.511788 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:19.536000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1d1e5-a928-4422-9d8a-4e5671762547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:19.536251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac711382-9c88-453b-bb1d-6cff639e30ac None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:19.536706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1d1e5-a928-4422-9d8a-4e5671762547 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:19.536992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1d1e5-a928-4422-9d8a-4e5671762547 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:19.537272 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1d1e5-a928-4422-9d8a-4e5671762547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:19.538111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1d1e5-a928-4422-9d8a-4e5671762547 None admin] RBAC: Adding query filter params (role.id=9e62b6dc2ae14408a6a05295caeb4054, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=7a36f250f3d04faab08146d937ef840e) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:19.538430 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1d1e5-a928-4422-9d8a-4e5671762547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:19.539910 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1d1e5-a928-4422-9d8a-4e5671762547 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:19.563593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 521/1054] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:47:19 2022] GET /identity/v3/role_assignments?user.id=7a36f250f3d04faab08146d937ef840e&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=9e62b6dc2ae14408a6a05295caeb4054 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:19.563593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1d1e5-a928-4422-9d8a-4e5671762547 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:19.578215 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343e673-17a9-47cd-a409-cf1f48289109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:19.579164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343e673-17a9-47cd-a409-cf1f48289109 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:19.579453 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343e673-17a9-47cd-a409-cf1f48289109 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:19.579756 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343e673-17a9-47cd-a409-cf1f48289109 None admin] PATH_INFO: `/v3/services/image` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:19.580398 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343e673-17a9-47cd-a409-cf1f48289109 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:19.581820 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343e673-17a9-47cd-a409-cf1f48289109 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-4343e673-17a9-47cd-a409-cf1f48289109 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:19.595282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:19.596727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:19.597745 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 534/1055] 10.222.0.89 () {56 vars in 1105 bytes} [Thu May 19 20:47:19 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:19.602963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343e673-17a9-47cd-a409-cf1f48289109 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:19.688038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1d1e5-a928-4422-9d8a-4e5671762547 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:19.725074 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343e673-17a9-47cd-a409-cf1f48289109 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:19.727990 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99399bb6-0519-4f38-b920-a7f64af0b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:19.729242 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99399bb6-0519-4f38-b920-a7f64af0b6ef None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:19.729625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99399bb6-0519-4f38-b920-a7f64af0b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:19.729903 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99399bb6-0519-4f38-b920-a7f64af0b6ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:19.730790 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99399bb6-0519-4f38-b920-a7f64af0b6ef None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=5b6fc1ac73a24e2ab0688611b645a72e, user.id=48009bb2555a42a580dc9cb3f4a9d938) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:19.731106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99399bb6-0519-4f38-b920-a7f64af0b6ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:19.732584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99399bb6-0519-4f38-b920-a7f64af0b6ef None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:19.734929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:19.741174 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 522/1056] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:47:19 2022] GET /identity/v3/role_assignments?user.id=48009bb2555a42a580dc9cb3f4a9d938&scope.project.id=5b6fc1ac73a24e2ab0688611b645a72e&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:19.773589 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185b7da-d158-44b8-9b42-eaf258305c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:19.774195 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b7da-d158-44b8-9b42-eaf258305c14 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:19.774485 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b7da-d158-44b8-9b42-eaf258305c14 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:19.774885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b7da-d158-44b8-9b42-eaf258305c14 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:19.776081 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185b7da-d158-44b8-9b42-eaf258305c14 None admin] RBAC: Adding query filter params (name=image) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:19.776399 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185b7da-d158-44b8-9b42-eaf258305c14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:19.777853 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185b7da-d158-44b8-9b42-eaf258305c14 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:19.784984 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 535/1057] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:19.790835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99399bb6-0519-4f38-b920-a7f64af0b6ef None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:19.915651 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99399bb6-0519-4f38-b920-a7f64af0b6ef None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:19.954531 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1395eb3-cfc9-4977-9446-51ee0187ff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:19.955306 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1395eb3-cfc9-4977-9446-51ee0187ff71 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:19.955558 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1395eb3-cfc9-4977-9446-51ee0187ff71 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:19.955782 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1395eb3-cfc9-4977-9446-51ee0187ff71 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:19.956497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1395eb3-cfc9-4977-9446-51ee0187ff71 None admin] RBAC: Adding query filter params (type=image) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:19.956804 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1395eb3-cfc9-4977-9446-51ee0187ff71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:19.958190 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1395eb3-cfc9-4977-9446-51ee0187ff71 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:19.966709 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 523/1058] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:19.969978 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185b7da-d158-44b8-9b42-eaf258305c14 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:19.972940 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:20.086276 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185b7da-d158-44b8-9b42-eaf258305c14 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:20.122510 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d795b0-e5b9-44d1-8e15-342633994822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:20.123211 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d795b0-e5b9-44d1-8e15-342633994822 None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:20.123501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d795b0-e5b9-44d1-8e15-342633994822 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:20.123781 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d795b0-e5b9-44d1-8e15-342633994822 None admin] PATH_INFO: `/v3/endpoints` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:20.124556 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d795b0-e5b9-44d1-8e15-342633994822 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:20.125939 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d795b0-e5b9-44d1-8e15-342633994822 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:20.240227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 536/1059] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:47:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:47:21.826351 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241abfb-4f75-4fc3-b00c-1e8ac2f205a6 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:21.826987 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241abfb-4f75-4fc3-b00c-1e8ac2f205a6 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:21.826987 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241abfb-4f75-4fc3-b00c-1e8ac2f205a6 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:21.828313 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 524/1060] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:21.834349 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9a3f-60b8-4ed5-94f4-2cb4f585529b None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:21.835006 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9a3f-60b8-4ed5-94f4-2cb4f585529b None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:21.835006 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9a3f-60b8-4ed5-94f4-2cb4f585529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:21.854062 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-597f9a3f-60b8-4ed5-94f4-2cb4f585529b None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:21.855347 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-597f9a3f-60b8-4ed5-94f4-2cb4f585529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:21.915079 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:21.936615 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 537/1061] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:21.959618 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241abfb-4f75-4fc3-b00c-1e8ac2f205a6 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:22.031614 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:22.037119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308116-8ecc-4138-ba13-65908a306b16 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.037414 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308116-8ecc-4138-ba13-65908a306b16 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.037697 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308116-8ecc-4138-ba13-65908a306b16 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.039907 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 538/1062] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:22.044819 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da180bd9-4328-4f02-a96b-355748e50c34 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.045032 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da180bd9-4328-4f02-a96b-355748e50c34 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.045323 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da180bd9-4328-4f02-a96b-355748e50c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.063940 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-da180bd9-4328-4f02-a96b-355748e50c34 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:22.065140 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-da180bd9-4328-4f02-a96b-355748e50c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:22.089762 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241abfb-4f75-4fc3-b00c-1e8ac2f205a6 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:22.129391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02898ab-e199-4312-bd27-4eb3359af115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:22.130207 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02898ab-e199-4312-bd27-4eb3359af115 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.130541 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02898ab-e199-4312-bd27-4eb3359af115 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.130871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02898ab-e199-4312-bd27-4eb3359af115 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.141833 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02898ab-e199-4312-bd27-4eb3359af115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:47:22.142899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 539/1063] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-e02898ab-e199-4312-bd27-4eb3359af115 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:47:22.149906 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:22.151135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:47:22.152159 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:22.154922 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 525/1064] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:47:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:22.157256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da180bd9-4328-4f02-a96b-355748e50c34 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:22.168200 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02898ab-e199-4312-bd27-4eb3359af115 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:22.263682 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da180bd9-4328-4f02-a96b-355748e50c34 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:22.281000 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:22.284138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02898ab-e199-4312-bd27-4eb3359af115 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:22.303000 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f518a70-0d8e-4200-a2a7-6e11b288679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:22.304028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f518a70-0d8e-4200-a2a7-6e11b288679c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.304310 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f518a70-0d8e-4200-a2a7-6e11b288679c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.304586 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f518a70-0d8e-4200-a2a7-6e11b288679c None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.305420 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f518a70-0d8e-4200-a2a7-6e11b288679c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:22.306027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f518a70-0d8e-4200-a2a7-6e11b288679c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:22.308833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f518a70-0d8e-4200-a2a7-6e11b288679c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:22.311206 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:22.321356 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 540/1065] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:47:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:22.325461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320bc7-6af0-4cdd-9c40-ab604a61e535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:22.326657 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320bc7-6af0-4cdd-9c40-ab604a61e535 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.326943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320bc7-6af0-4cdd-9c40-ab604a61e535 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.327226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320bc7-6af0-4cdd-9c40-ab604a61e535 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.327381 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f518a70-0d8e-4200-a2a7-6e11b288679c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:22.345749 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08320bc7-6af0-4cdd-9c40-ab604a61e535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-08320bc7-6af0-4cdd-9c40-ab604a61e535 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:47:22.352044 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:22.353365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:22.355070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 526/1066] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:47:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:22.360440 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320bc7-6af0-4cdd-9c40-ab604a61e535 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:22.459939 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f518a70-0d8e-4200-a2a7-6e11b288679c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:22.498835 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320bc7-6af0-4cdd-9c40-ab604a61e535 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:22.502827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0602c7-f96b-4bdb-8614-2945c676f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:22.503641 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0602c7-f96b-4bdb-8614-2945c676f027 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.503928 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0602c7-f96b-4bdb-8614-2945c676f027 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.504207 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0602c7-f96b-4bdb-8614-2945c676f027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.515979 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0602c7-f96b-4bdb-8614-2945c676f027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:22.517618 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0602c7-f96b-4bdb-8614-2945c676f027 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-2a0602c7-f96b-4bdb-8614-2945c676f027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:22.535693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:22.536910 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:22.538007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:47:22.538007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:22.538007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:22.538007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:22.542509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 541/1067] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:22.542849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95a928-08fc-4dd9-b3a7-4927853979bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:22.543532 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95a928-08fc-4dd9-b3a7-4927853979bd None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.543815 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95a928-08fc-4dd9-b3a7-4927853979bd None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.543930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417820d-8f90-4da9-9622-5653e8248cf0 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.544090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95a928-08fc-4dd9-b3a7-4927853979bd None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.544193 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417820d-8f90-4da9-9622-5653e8248cf0 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.544442 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417820d-8f90-4da9-9622-5653e8248cf0 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.544845 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95a928-08fc-4dd9-b3a7-4927853979bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:22.545152 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95a928-08fc-4dd9-b3a7-4927853979bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:22.545921 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 542/1068] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:22.546526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95a928-08fc-4dd9-b3a7-4927853979bd None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:22.546765 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417820d-8f90-4da9-9622-5653e8248cf0 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:22.556182 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 527/1069] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:47:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:22.558033 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39acd9-2592-4985-a83d-54b4422edd9c None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.558328 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39acd9-2592-4985-a83d-54b4422edd9c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.558594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39acd9-2592-4985-a83d-54b4422edd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.575371 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-2a39acd9-2592-4985-a83d-54b4422edd9c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:22.576593 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-2a39acd9-2592-4985-a83d-54b4422edd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:22.579503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:22.625208 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:22.656515 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 528/1070] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:22.657405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39acd9-2592-4985-a83d-54b4422edd9c None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:22.663354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417820d-8f90-4da9-9622-5653e8248cf0 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:22.708676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fea0c-ad50-488e-8619-fe48015ea2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:22.709375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fea0c-ad50-488e-8619-fe48015ea2ac None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.709663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fea0c-ad50-488e-8619-fe48015ea2ac None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.710049 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fea0c-ad50-488e-8619-fe48015ea2ac None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.710831 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fea0c-ad50-488e-8619-fe48015ea2ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:22.711161 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fea0c-ad50-488e-8619-fe48015ea2ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:22.712765 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fea0c-ad50-488e-8619-fe48015ea2ac None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:22.733113 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 543/1071] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:22.733113 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fea0c-ad50-488e-8619-fe48015ea2ac None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:22.773221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39acd9-2592-4985-a83d-54b4422edd9c None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:22.810540 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f3f35-88dc-4959-b198-57a0721e92b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:22.811724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f3f35-88dc-4959-b198-57a0721e92b8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.812011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f3f35-88dc-4959-b198-57a0721e92b8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.812283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f3f35-88dc-4959-b198-57a0721e92b8 None admin] PATH_INFO: `/v3/users/48009bb2555a42a580dc9cb3f4a9d938` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.813515 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f3f35-88dc-4959-b198-57a0721e92b8 None admin] RBAC: Authorizing `identity:get_user(user_id=48009bb2555a42a580dc9cb3f4a9d938)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:22.815080 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f3f35-88dc-4959-b198-57a0721e92b8 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:22.816770 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 529/1072] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:22 2022] GET /identity/v3/users/48009bb2555a42a580dc9cb3f4a9d938 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:22.817556 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f3f35-88dc-4959-b198-57a0721e92b8 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:22.832589 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:22.845949 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fea0c-ad50-488e-8619-fe48015ea2ac None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:22.867923 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:22.883033 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed6aeb-8a24-4efd-b840-fde3146e4946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:22.883622 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed6aeb-8a24-4efd-b840-fde3146e4946 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.883909 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed6aeb-8a24-4efd-b840-fde3146e4946 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.884189 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed6aeb-8a24-4efd-b840-fde3146e4946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.927132 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f3f35-88dc-4959-b198-57a0721e92b8 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:22.955920 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed6aeb-8a24-4efd-b840-fde3146e4946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:22.957386 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed6aeb-8a24-4efd-b840-fde3146e4946 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:22.961347 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74443f4d-a2ba-42dd-988a-6f52bf634592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:22.962147 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443f4d-a2ba-42dd-988a-6f52bf634592 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:22.962432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443f4d-a2ba-42dd-988a-6f52bf634592 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:22.962743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443f4d-a2ba-42dd-988a-6f52bf634592 None admin] PATH_INFO: `/v3/users/nova` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:22.971277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74443f4d-a2ba-42dd-988a-6f52bf634592 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:22.972746 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74443f4d-a2ba-42dd-988a-6f52bf634592 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-74443f4d-a2ba-42dd-988a-6f52bf634592 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:47:22.987105 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:22.988473 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 530/1073] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:47:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:22.989841 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74443f4d-a2ba-42dd-988a-6f52bf634592 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:23.055454 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:23.068613 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 544/1074] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:47:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:47:23.071809 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed6aeb-8a24-4efd-b840-fde3146e4946 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:23.101520 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74443f4d-a2ba-42dd-988a-6f52bf634592 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:23.103276 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:23.137326 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00087e73-230f-4ffb-a70e-190da475b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:23.138115 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087e73-230f-4ffb-a70e-190da475b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:23.138398 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087e73-230f-4ffb-a70e-190da475b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:23.138792 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087e73-230f-4ffb-a70e-190da475b4c2 None admin] PATH_INFO: `/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:23.140009 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00087e73-230f-4ffb-a70e-190da475b4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=5b6fc1ac73a24e2ab0688611b645a72e)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:23.141452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00087e73-230f-4ffb-a70e-190da475b4c2 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:23.143221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 531/1075] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:47:22 2022] GET /identity/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:23.143996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00087e73-230f-4ffb-a70e-190da475b4c2 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:23.175579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed6aeb-8a24-4efd-b840-fde3146e4946 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:23.211362 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb744ee-2a0d-41dd-b1eb-1450b482fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:23.212047 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb744ee-2a0d-41dd-b1eb-1450b482fe8e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:23.212334 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb744ee-2a0d-41dd-b1eb-1450b482fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:23.212616 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb744ee-2a0d-41dd-b1eb-1450b482fe8e None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:23.214047 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb744ee-2a0d-41dd-b1eb-1450b482fe8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:23.214358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb744ee-2a0d-41dd-b1eb-1450b482fe8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:23.215830 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb744ee-2a0d-41dd-b1eb-1450b482fe8e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:23.233772 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 545/1076] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:47:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:23.234562 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb744ee-2a0d-41dd-b1eb-1450b482fe8e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:23.255052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00087e73-230f-4ffb-a70e-190da475b4c2 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:23.283313 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:23.291606 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688d7c8-7f77-44c4-9829-a016a74b9a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:23.292415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688d7c8-7f77-44c4-9829-a016a74b9a7a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:23.292708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688d7c8-7f77-44c4-9829-a016a74b9a7a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:23.292983 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688d7c8-7f77-44c4-9829-a016a74b9a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:23.303837 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688d7c8-7f77-44c4-9829-a016a74b9a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:23.305444 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688d7c8-7f77-44c4-9829-a016a74b9a7a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-1688d7c8-7f77-44c4-9829-a016a74b9a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:23.324629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:23.325822 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:23.326955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:47:23.326955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:23.326955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:23.326955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:23.326955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 532/1077] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:23.327308 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688d7c8-7f77-44c4-9829-a016a74b9a7a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:23.343559 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb744ee-2a0d-41dd-b1eb-1450b482fe8e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:23.351739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:23.379639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e8b65-ecc2-4685-8415-e6659b9ea5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:23.380545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e8b65-ecc2-4685-8415-e6659b9ea5e9 None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:23.380832 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e8b65-ecc2-4685-8415-e6659b9ea5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:23.381111 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e8b65-ecc2-4685-8415-e6659b9ea5e9 None admin] PATH_INFO: `/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e/users/48009bb2555a42a580dc9cb3f4a9d938/roles/480e35452fc547e0a2917bdd5b782f7d` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:23.383185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e8b65-ecc2-4685-8415-e6659b9ea5e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b6fc1ac73a24e2ab0688611b645a72e, user_id=48009bb2555a42a580dc9cb3f4a9d938, role_id=480e35452fc547e0a2917bdd5b782f7d)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:23.384624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e8b65-ecc2-4685-8415-e6659b9ea5e9 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:23.426486 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688d7c8-7f77-44c4-9829-a016a74b9a7a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:23.455697 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 546/1078] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:47:23 2022] PUT /identity/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e/users/48009bb2555a42a580dc9cb3f4a9d938/roles/480e35452fc547e0a2917bdd5b782f7d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:47:23.456714 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e8b65-ecc2-4685-8415-e6659b9ea5e9 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:23.471250 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23a77d-1e11-401b-a6c7-12da84037343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:23.472090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a77d-1e11-401b-a6c7-12da84037343 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:23.472384 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a77d-1e11-401b-a6c7-12da84037343 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:23.472665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a77d-1e11-401b-a6c7-12da84037343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:23.485088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23a77d-1e11-401b-a6c7-12da84037343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:23.486630 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23a77d-1e11-401b-a6c7-12da84037343 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-cc23a77d-1e11-401b-a6c7-12da84037343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:23.507781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:23.508970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:23.510718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:47:23.510718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:23.510718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:23.510718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:23.510718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 533/1079] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:23.517452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23a77d-1e11-401b-a6c7-12da84037343 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:23.607052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:23.614527 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e8b65-ecc2-4685-8415-e6659b9ea5e9 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:23.628751 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:23.639410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23a77d-1e11-401b-a6c7-12da84037343 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:23.677025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b6f78-800d-43b4-adaa-6a998e16ef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:23.678429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b6f78-800d-43b4-adaa-6a998e16ef59 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:23.678565 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699561c-6c39-4213-8776-b63414626f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:23.678934 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b6f78-800d-43b4-adaa-6a998e16ef59 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:23.679135 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699561c-6c39-4213-8776-b63414626f59 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:23.679816 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b6f78-800d-43b4-adaa-6a998e16ef59 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:23.679947 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699561c-6c39-4213-8776-b63414626f59 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:23.679947 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699561c-6c39-4213-8776-b63414626f59 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:23.680418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699561c-6c39-4213-8776-b63414626f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:23.680734 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699561c-6c39-4213-8776-b63414626f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:23.681193 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b6f78-800d-43b4-adaa-6a998e16ef59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:23.681673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b6f78-800d-43b4-adaa-6a998e16ef59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:23.682763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699561c-6c39-4213-8776-b63414626f59 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:23.684562 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b6f78-800d-43b4-adaa-6a998e16ef59 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:23.696837 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 534/1080] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:23.704596 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 547/1081] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:23.706712 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699561c-6c39-4213-8776-b63414626f59 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:23.836212 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699561c-6c39-4213-8776-b63414626f59 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:23.876448 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22c18b-2b20-4a3a-9d6d-54ca83d77c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:23.877284 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22c18b-2b20-4a3a-9d6d-54ca83d77c08 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:23.877537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22c18b-2b20-4a3a-9d6d-54ca83d77c08 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:23.877808 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22c18b-2b20-4a3a-9d6d-54ca83d77c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:23.880040 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:23.887041 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22c18b-2b20-4a3a-9d6d-54ca83d77c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:23.888440 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22c18b-2b20-4a3a-9d6d-54ca83d77c08 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-6a22c18b-2b20-4a3a-9d6d-54ca83d77c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:47:23.903447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:23.904729 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:23.907138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:47:23.907138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:47:23.907138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:47:23.907138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:47:23.907138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:47:23.907138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:47:23.907138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:23.907138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:23.907138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 535/1082] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:47:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:23.910807 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b6f78-800d-43b4-adaa-6a998e16ef59 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:24.027238 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b6f78-800d-43b4-adaa-6a998e16ef59 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:24.073076 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfc8b2-f0ca-4ff7-a9b5-30966bfbd0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:24.073757 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc8b2-f0ca-4ff7-a9b5-30966bfbd0cd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:24.074043 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc8b2-f0ca-4ff7-a9b5-30966bfbd0cd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:24.074319 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc8b2-f0ca-4ff7-a9b5-30966bfbd0cd None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:24.075156 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfc8b2-f0ca-4ff7-a9b5-30966bfbd0cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:24.075474 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfc8b2-f0ca-4ff7-a9b5-30966bfbd0cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:24.077065 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfc8b2-f0ca-4ff7-a9b5-30966bfbd0cd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:24.090193 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 548/1083] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:47:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:24.096252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22c18b-2b20-4a3a-9d6d-54ca83d77c08 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:24.219958 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22c18b-2b20-4a3a-9d6d-54ca83d77c08 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:24.258844 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b6b04-8bf1-4384-a7af-09aa782df463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:24.259737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6b04-8bf1-4384-a7af-09aa782df463 None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:24.260018 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6b04-8bf1-4384-a7af-09aa782df463 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:24.260294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6b04-8bf1-4384-a7af-09aa782df463 None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/7a36f250f3d04faab08146d937ef840e/roles/9e62b6dc2ae14408a6a05295caeb4054` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:24.262534 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b6b04-8bf1-4384-a7af-09aa782df463 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=7a36f250f3d04faab08146d937ef840e, role_id=9e62b6dc2ae14408a6a05295caeb4054)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:24.263994 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b6b04-8bf1-4384-a7af-09aa782df463 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:24.381829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 536/1084] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:47:24 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/7a36f250f3d04faab08146d937ef840e/roles/9e62b6dc2ae14408a6a05295caeb4054 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:47:25.844747 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6a20-8994-4886-b164-6034f94f43de None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:25.845342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6a20-8994-4886-b164-6034f94f43de None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:25.845342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6a20-8994-4886-b164-6034f94f43de None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:25.846720 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 549/1085] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:25.852385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401d2dc-5d0c-45f6-8ee2-325d2c395129 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:25.852847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401d2dc-5d0c-45f6-8ee2-325d2c395129 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:25.852959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401d2dc-5d0c-45f6-8ee2-325d2c395129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:25.871149 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-7401d2dc-5d0c-45f6-8ee2-325d2c395129 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:25.872369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-7401d2dc-5d0c-45f6-8ee2-325d2c395129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:25.926455 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:25.944381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 537/1086] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:25.969972 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc6a20-8994-4886-b164-6034f94f43de None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:25.998412 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:26.101039 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc6a20-8994-4886-b164-6034f94f43de None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:26.162046 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc46122-3359-47e8-bf34-16b6fdc34dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:26.163471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc46122-3359-47e8-bf34-16b6fdc34dda None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:26.163977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc46122-3359-47e8-bf34-16b6fdc34dda None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:26.164488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc46122-3359-47e8-bf34-16b6fdc34dda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:26.183038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc46122-3359-47e8-bf34-16b6fdc34dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-5bc46122-3359-47e8-bf34-16b6fdc34dda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:47:26.199179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:26.200494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:26.201917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 550/1087] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:47:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:26.207641 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401d2dc-5d0c-45f6-8ee2-325d2c395129 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:26.310093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401d2dc-5d0c-45f6-8ee2-325d2c395129 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:26.346336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dabcbf-5e5c-43c2-92cc-fb1d4bc8926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:26.347045 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dabcbf-5e5c-43c2-92cc-fb1d4bc8926f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:26.347332 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dabcbf-5e5c-43c2-92cc-fb1d4bc8926f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:26.347612 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dabcbf-5e5c-43c2-92cc-fb1d4bc8926f None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:26.348372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dabcbf-5e5c-43c2-92cc-fb1d4bc8926f None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:26.348683 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dabcbf-5e5c-43c2-92cc-fb1d4bc8926f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:26.350058 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dabcbf-5e5c-43c2-92cc-fb1d4bc8926f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:26.358951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 538/1088] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:47:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:26.364824 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc46122-3359-47e8-bf34-16b6fdc34dda None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:26.502510 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:26.528920 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc46122-3359-47e8-bf34-16b6fdc34dda None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:26.584255 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c422ef-5a45-41f1-9f85-b0b815970b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:26.585390 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c422ef-5a45-41f1-9f85-b0b815970b6c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:26.585390 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c422ef-5a45-41f1-9f85-b0b815970b6c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:26.585736 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c422ef-5a45-41f1-9f85-b0b815970b6c None admin] PATH_INFO: `/v3/users/48009bb2555a42a580dc9cb3f4a9d938` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:26.586977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c422ef-5a45-41f1-9f85-b0b815970b6c None admin] RBAC: Authorizing `identity:get_user(user_id=48009bb2555a42a580dc9cb3f4a9d938)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:26.588631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c422ef-5a45-41f1-9f85-b0b815970b6c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:26.590334 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 551/1089] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:26 2022] GET /identity/v3/users/48009bb2555a42a580dc9cb3f4a9d938 => generated 285 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:26.596499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dabcbf-5e5c-43c2-92cc-fb1d4bc8926f None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:26.649555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:26.669997 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd606e4e-4954-42b2-8b1c-f72b66a27e15 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:26.670456 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd606e4e-4954-42b2-8b1c-f72b66a27e15 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:26.670947 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd606e4e-4954-42b2-8b1c-f72b66a27e15 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:26.672503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 552/1090] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:47:26.678663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab76a19-b071-4024-aae1-60ea1a8594ef None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:26.678959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab76a19-b071-4024-aae1-60ea1a8594ef None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:26.679240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab76a19-b071-4024-aae1-60ea1a8594ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:26.698511 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-eab76a19-b071-4024-aae1-60ea1a8594ef None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:26.699774 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-eab76a19-b071-4024-aae1-60ea1a8594ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:26.733999 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dabcbf-5e5c-43c2-92cc-fb1d4bc8926f None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:26.775087 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796a3d8-6384-41e9-a7bc-3e538d872547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:26.776333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796a3d8-6384-41e9-a7bc-3e538d872547 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:26.776613 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796a3d8-6384-41e9-a7bc-3e538d872547 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:26.776884 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796a3d8-6384-41e9-a7bc-3e538d872547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:26.783825 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 553/1091] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:47:26.808921 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab76a19-b071-4024-aae1-60ea1a8594ef None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:26.863743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796a3d8-6384-41e9-a7bc-3e538d872547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:26.865240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796a3d8-6384-41e9-a7bc-3e538d872547 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:26.916817 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:26.921943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:26.942063 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab76a19-b071-4024-aae1-60ea1a8594ef None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:26.977586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 539/1092] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:47:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:47:26.983629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796a3d8-6384-41e9-a7bc-3e538d872547 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:27.001310 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367ecbf-2ff0-430a-9d5e-6bd0b9e92259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:27.002197 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367ecbf-2ff0-430a-9d5e-6bd0b9e92259 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:27.002492 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367ecbf-2ff0-430a-9d5e-6bd0b9e92259 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:27.002804 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367ecbf-2ff0-430a-9d5e-6bd0b9e92259 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:27.014676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367ecbf-2ff0-430a-9d5e-6bd0b9e92259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-a367ecbf-2ff0-430a-9d5e-6bd0b9e92259 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:47:27.023069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:27.024526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:27.026126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 554/1093] 10.222.0.89 () {56 vars in 1120 bytes} [Thu May 19 20:47:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:27.031257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367ecbf-2ff0-430a-9d5e-6bd0b9e92259 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:27.120280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796a3d8-6384-41e9-a7bc-3e538d872547 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:27.153757 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367ecbf-2ff0-430a-9d5e-6bd0b9e92259 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:27.156184 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6042e85-e9dd-49ba-9fa6-981eb95e01ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:27.157067 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6042e85-e9dd-49ba-9fa6-981eb95e01ba None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:27.157343 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6042e85-e9dd-49ba-9fa6-981eb95e01ba None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:27.157614 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6042e85-e9dd-49ba-9fa6-981eb95e01ba None admin] PATH_INFO: `/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:27.158864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6042e85-e9dd-49ba-9fa6-981eb95e01ba None admin] RBAC: Authorizing `identity:get_project(project_id=5b6fc1ac73a24e2ab0688611b645a72e)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:27.160315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6042e85-e9dd-49ba-9fa6-981eb95e01ba None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:27.162043 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 540/1094] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:47:26 2022] GET /identity/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:27.168333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6042e85-e9dd-49ba-9fa6-981eb95e01ba None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:27.185408 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:27.196864 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238c521-3de6-4b96-ab5c-005ef12e296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:27.198163 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238c521-3de6-4b96-ab5c-005ef12e296b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:27.198478 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238c521-3de6-4b96-ab5c-005ef12e296b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:27.198822 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238c521-3de6-4b96-ab5c-005ef12e296b None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:27.199998 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238c521-3de6-4b96-ab5c-005ef12e296b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:27.200311 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238c521-3de6-4b96-ab5c-005ef12e296b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:27.202335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238c521-3de6-4b96-ab5c-005ef12e296b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:27.211659 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 555/1095] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:47:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:27.217695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238c521-3de6-4b96-ab5c-005ef12e296b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:27.227944 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:27.284404 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6042e85-e9dd-49ba-9fa6-981eb95e01ba None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:27.320348 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ef735-f124-4de4-a409-f3a2a4cc4757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:27.321008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ef735-f124-4de4-a409-f3a2a4cc4757 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:27.321294 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ef735-f124-4de4-a409-f3a2a4cc4757 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:27.321572 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ef735-f124-4de4-a409-f3a2a4cc4757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:27.323110 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ef735-f124-4de4-a409-f3a2a4cc4757 None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=5b6fc1ac73a24e2ab0688611b645a72e, user.id=48009bb2555a42a580dc9cb3f4a9d938) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:27.325213 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ef735-f124-4de4-a409-f3a2a4cc4757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:27.325213 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ef735-f124-4de4-a409-f3a2a4cc4757 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:27.331273 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 541/1096] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:47:27 2022] GET /identity/v3/role_assignments?user.id=48009bb2555a42a580dc9cb3f4a9d938&scope.project.id=5b6fc1ac73a24e2ab0688611b645a72e&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:27.344679 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238c521-3de6-4b96-ab5c-005ef12e296b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:27.402639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ebe2-8fcd-42d0-89a4-0e4e29498fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:27.403486 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ebe2-8fcd-42d0-89a4-0e4e29498fba None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:27.403775 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ebe2-8fcd-42d0-89a4-0e4e29498fba None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:27.404053 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ebe2-8fcd-42d0-89a4-0e4e29498fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:27.421355 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80ebe2-8fcd-42d0-89a4-0e4e29498fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:27.423141 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80ebe2-8fcd-42d0-89a4-0e4e29498fba None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-fd80ebe2-8fcd-42d0-89a4-0e4e29498fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:27.442704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:27.443977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:27.445086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:47:27.445086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:27.445086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:27.445086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:27.445086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 556/1097] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:47:27.450685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ef735-f124-4de4-a409-f3a2a4cc4757 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:27.536288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:27.558683 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ef735-f124-4de4-a409-f3a2a4cc4757 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:27.597874 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b56c4a-9001-46ca-a9c3-dcf557495d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:27.598548 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b56c4a-9001-46ca-a9c3-dcf557495d98 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:27.598938 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b56c4a-9001-46ca-a9c3-dcf557495d98 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:27.599216 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b56c4a-9001-46ca-a9c3-dcf557495d98 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:27.599944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b56c4a-9001-46ca-a9c3-dcf557495d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:27.600253 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b56c4a-9001-46ca-a9c3-dcf557495d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:27.601621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b56c4a-9001-46ca-a9c3-dcf557495d98 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:27.614143 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 542/1098] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:27.619965 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ebe2-8fcd-42d0-89a4-0e4e29498fba None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:27.681407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:27.734372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ebe2-8fcd-42d0-89a4-0e4e29498fba None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:27.771387 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29292c28-314c-444b-97fd-f20d698cdfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:27.772194 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292c28-314c-444b-97fd-f20d698cdfa4 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:27.772479 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292c28-314c-444b-97fd-f20d698cdfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:27.772760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292c28-314c-444b-97fd-f20d698cdfa4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:27.782005 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29292c28-314c-444b-97fd-f20d698cdfa4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:27.783523 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29292c28-314c-444b-97fd-f20d698cdfa4 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-29292c28-314c-444b-97fd-f20d698cdfa4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:47:27.798706 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:27.800164 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:27.801337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:27.801337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:27.801337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:47:27.801337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:47:27.801337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:47:27.801337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:47:27.801337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:47:27.801337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:47:27.801337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:47:27.801337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:27.801337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 557/1099] 10.222.0.89 () {56 vars in 1093 bytes} [Thu May 19 20:47:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:27.808347 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b56c4a-9001-46ca-a9c3-dcf557495d98 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:27.925420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b56c4a-9001-46ca-a9c3-dcf557495d98 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:27.962047 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f969e9-9195-42b1-94c9-918aef712181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:27.963213 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f969e9-9195-42b1-94c9-918aef712181 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:27.963539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f969e9-9195-42b1-94c9-918aef712181 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:27.963862 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f969e9-9195-42b1-94c9-918aef712181 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:27.964817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f969e9-9195-42b1-94c9-918aef712181 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:27.965132 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f969e9-9195-42b1-94c9-918aef712181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:27.966602 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f969e9-9195-42b1-94c9-918aef712181 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:27.975539 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:27.986034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 543/1100] 10.222.0.89 () {56 vars in 1133 bytes} [Thu May 19 20:47:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:27.992515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29292c28-314c-444b-97fd-f20d698cdfa4 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:28.126617 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29292c28-314c-444b-97fd-f20d698cdfa4 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:28.144183 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:28.162216 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad213-e18c-41cf-aeb3-b9ea2f361d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:28.164248 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad213-e18c-41cf-aeb3-b9ea2f361d3d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:28.164248 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad213-e18c-41cf-aeb3-b9ea2f361d3d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:28.164248 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad213-e18c-41cf-aeb3-b9ea2f361d3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:28.233818 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ad213-e18c-41cf-aeb3-b9ea2f361d3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:28.235233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ad213-e18c-41cf-aeb3-b9ea2f361d3d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:28.333648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 558/1101] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:47:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:47:28.340760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f969e9-9195-42b1-94c9-918aef712181 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:28.446274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f969e9-9195-42b1-94c9-918aef712181 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:28.482997 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7e85d-1321-42be-a591-04a0e1c0e717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:28.483931 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7e85d-1321-42be-a591-04a0e1c0e717 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:28.484232 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7e85d-1321-42be-a591-04a0e1c0e717 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:28.484568 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7e85d-1321-42be-a591-04a0e1c0e717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:28.495654 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7e85d-1321-42be-a591-04a0e1c0e717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:28.497131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7e85d-1321-42be-a591-04a0e1c0e717 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-64f7e85d-1321-42be-a591-04a0e1c0e717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:28.517530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:28.519584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:28.521379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:47:28.521379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:28.521379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:47:28.521379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:28.521379 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 544/1102] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:28.527554 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad213-e18c-41cf-aeb3-b9ea2f361d3d None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:28.548681 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:28.635660 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad213-e18c-41cf-aeb3-b9ea2f361d3d None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:28.671807 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20b28f-2c61-4b48-9085-cc8de967bcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:28.672487 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20b28f-2c61-4b48-9085-cc8de967bcd1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:28.672773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20b28f-2c61-4b48-9085-cc8de967bcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:28.673067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20b28f-2c61-4b48-9085-cc8de967bcd1 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:28.673792 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20b28f-2c61-4b48-9085-cc8de967bcd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:28.674109 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20b28f-2c61-4b48-9085-cc8de967bcd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:28.675532 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20b28f-2c61-4b48-9085-cc8de967bcd1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:28.687653 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 559/1103] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:28.693405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7e85d-1321-42be-a591-04a0e1c0e717 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:28.743011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:28.798977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7e85d-1321-42be-a591-04a0e1c0e717 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:28.832966 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd8af0-22d6-432b-865b-72aebd395c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:28.833760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8af0-22d6-432b-865b-72aebd395c32 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:28.834048 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8af0-22d6-432b-865b-72aebd395c32 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:28.834339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8af0-22d6-432b-865b-72aebd395c32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:28.841807 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd8af0-22d6-432b-865b-72aebd395c32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:28.843293 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd8af0-22d6-432b-865b-72aebd395c32 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-64bd8af0-22d6-432b-865b-72aebd395c32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:47:28.857724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:28.859461 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:28.861163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:47:28.861163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:47:28.861163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:47:28.861163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:47:28.861163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:47:28.861163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:47:28.861163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:47:28.861163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:28.861163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 545/1104] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:47:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:28.865286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20b28f-2c61-4b48-9085-cc8de967bcd1 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:28.973282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:28.995290 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20b28f-2c61-4b48-9085-cc8de967bcd1 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:29.036986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d49150-008a-4222-90fb-d5e5a6b7a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:29.037675 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d49150-008a-4222-90fb-d5e5a6b7a808 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:29.037963 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d49150-008a-4222-90fb-d5e5a6b7a808 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:29.038253 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d49150-008a-4222-90fb-d5e5a6b7a808 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:29.039105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d49150-008a-4222-90fb-d5e5a6b7a808 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:29.039424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d49150-008a-4222-90fb-d5e5a6b7a808 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:29.040883 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d49150-008a-4222-90fb-d5e5a6b7a808 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:29.056130 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 560/1105] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:29.062291 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd8af0-22d6-432b-865b-72aebd395c32 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:29.168984 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd8af0-22d6-432b-865b-72aebd395c32 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:29.178249 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:29.204613 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e51f77-1cc7-45d3-a428-87199607fd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:29.205269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51f77-1cc7-45d3-a428-87199607fd4d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:29.205553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51f77-1cc7-45d3-a428-87199607fd4d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:29.205833 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51f77-1cc7-45d3-a428-87199607fd4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:29.206748 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e51f77-1cc7-45d3-a428-87199607fd4d None admin] RBAC: Adding query filter params (role.id=9e62b6dc2ae14408a6a05295caeb4054, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=7a36f250f3d04faab08146d937ef840e) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:29.207066 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e51f77-1cc7-45d3-a428-87199607fd4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:29.208564 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e51f77-1cc7-45d3-a428-87199607fd4d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:29.215868 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 546/1106] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:47:29 2022] GET /identity/v3/role_assignments?user.id=7a36f250f3d04faab08146d937ef840e&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=9e62b6dc2ae14408a6a05295caeb4054 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:29.677903 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adde106-4377-4ca4-acbb-a0bf72f0bd8b None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:29.678192 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adde106-4377-4ca4-acbb-a0bf72f0bd8b None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:29.678477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adde106-4377-4ca4-acbb-a0bf72f0bd8b None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:29.680105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 561/1107] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:29.686490 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7f6a1-b3e7-43a4-a699-50d88e24fb03 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:29.686812 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7f6a1-b3e7-43a4-a699-50d88e24fb03 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:29.687095 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7f6a1-b3e7-43a4-a699-50d88e24fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:29.706180 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-27a7f6a1-b3e7-43a4-a699-50d88e24fb03 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:29.707440 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-27a7f6a1-b3e7-43a4-a699-50d88e24fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:29.782210 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 547/1108] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:29.810946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adde106-4377-4ca4-acbb-a0bf72f0bd8b None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:29.926530 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adde106-4377-4ca4-acbb-a0bf72f0bd8b None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:29.965925 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f448da-3576-4576-a133-60b9e7926fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:29.966733 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f448da-3576-4576-a133-60b9e7926fed None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:29.967022 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f448da-3576-4576-a133-60b9e7926fed None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:29.967304 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f448da-3576-4576-a133-60b9e7926fed None admin] PATH_INFO: `/v3/domains/default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:29.968600 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f448da-3576-4576-a133-60b9e7926fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:29.970146 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f448da-3576-4576-a133-60b9e7926fed None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:29.971898 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 562/1109] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:29.978034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7f6a1-b3e7-43a4-a699-50d88e24fb03 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:30.087639 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7f6a1-b3e7-43a4-a699-50d88e24fb03 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:30.090145 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:30.125601 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58e14d-e112-4c59-b791-d491bb00723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:30.126299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58e14d-e112-4c59-b791-d491bb00723c None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:30.126708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58e14d-e112-4c59-b791-d491bb00723c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:30.126988 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58e14d-e112-4c59-b791-d491bb00723c None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:30.127730 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58e14d-e112-4c59-b791-d491bb00723c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:30.129177 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58e14d-e112-4c59-b791-d491bb00723c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:30.210360 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 548/1110] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:47:29 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:47:32.529017 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70488f91-d91c-4c8b-9b5f-dd09e88f292d None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:32.529609 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70488f91-d91c-4c8b-9b5f-dd09e88f292d None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:32.529609 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70488f91-d91c-4c8b-9b5f-dd09e88f292d None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:32.530975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 563/1111] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:32.536387 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c656f0-2920-4f13-a953-8263011c9a9c None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:32.536820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c656f0-2920-4f13-a953-8263011c9a9c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:32.536966 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c656f0-2920-4f13-a953-8263011c9a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:32.553925 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-d8c656f0-2920-4f13-a953-8263011c9a9c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:32.555171 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-d8c656f0-2920-4f13-a953-8263011c9a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:32.624187 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 549/1112] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:32.648374 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70488f91-d91c-4c8b-9b5f-dd09e88f292d None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:32.657431 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:32.753515 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70488f91-d91c-4c8b-9b5f-dd09e88f292d None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:32.791663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a80a1-7c58-4e7f-887f-09b0206861b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:32.792460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a80a1-7c58-4e7f-887f-09b0206861b0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:32.792746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a80a1-7c58-4e7f-887f-09b0206861b0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:32.793026 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a80a1-7c58-4e7f-887f-09b0206861b0 None admin] PATH_INFO: `/v3/roles/715071b6b1244a559110be37cc8410ab` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:32.794549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a80a1-7c58-4e7f-887f-09b0206861b0 None admin] RBAC: Authorizing `identity:get_role(role_id=715071b6b1244a559110be37cc8410ab)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:32.795965 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a80a1-7c58-4e7f-887f-09b0206861b0 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:32.797532 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 564/1113] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:32 2022] GET /identity/v3/roles/715071b6b1244a559110be37cc8410ab => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:32.804809 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c656f0-2920-4f13-a953-8263011c9a9c None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:32.898538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:32.910441 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c656f0-2920-4f13-a953-8263011c9a9c None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:32.945086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb707c-523d-437c-b666-62fc6ec7ad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:32.945959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb707c-523d-437c-b666-62fc6ec7ad13 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:32.946241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb707c-523d-437c-b666-62fc6ec7ad13 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:32.946518 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb707c-523d-437c-b666-62fc6ec7ad13 None admin] PATH_INFO: `/v3/users/a92bd4fc89dc4c818a9494c029b7e8f3` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:32.960287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb707c-523d-437c-b666-62fc6ec7ad13 None admin] RBAC: Authorizing `identity:get_user(user_id=a92bd4fc89dc4c818a9494c029b7e8f3)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:32.961737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb707c-523d-437c-b666-62fc6ec7ad13 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:32.963465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 550/1114] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:32 2022] GET /identity/v3/users/a92bd4fc89dc4c818a9494c029b7e8f3 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:32.969347 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a80a1-7c58-4e7f-887f-09b0206861b0 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:33.050762 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:33.075980 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a80a1-7c58-4e7f-887f-09b0206861b0 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:33.110182 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53517b51-0dc4-42b6-94da-49b39c26357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:33.110848 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517b51-0dc4-42b6-94da-49b39c26357a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:33.111132 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517b51-0dc4-42b6-94da-49b39c26357a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:33.111405 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517b51-0dc4-42b6-94da-49b39c26357a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:33.182804 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53517b51-0dc4-42b6-94da-49b39c26357a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:33.184252 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53517b51-0dc4-42b6-94da-49b39c26357a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:33.262876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:33.289069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 565/1115] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:47:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:47:33.295192 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb707c-523d-437c-b666-62fc6ec7ad13 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:33.394451 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb707c-523d-437c-b666-62fc6ec7ad13 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:33.429148 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbae60-98c6-4474-a034-231b60414095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:33.430017 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbae60-98c6-4474-a034-231b60414095 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:33.430300 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbae60-98c6-4474-a034-231b60414095 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:33.430577 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbae60-98c6-4474-a034-231b60414095 None admin] PATH_INFO: `/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:33.431818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbae60-98c6-4474-a034-231b60414095 None admin] RBAC: Authorizing `identity:get_project(project_id=5b6fc1ac73a24e2ab0688611b645a72e)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:33.433242 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbae60-98c6-4474-a034-231b60414095 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:33.435007 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 551/1116] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:47:33 2022] GET /identity/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:33.441602 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53517b51-0dc4-42b6-94da-49b39c26357a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:33.544200 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53517b51-0dc4-42b6-94da-49b39c26357a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:33.582486 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ed4c4-928a-42b9-9c7e-032695fcb25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:33.583102 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed4c4-928a-42b9-9c7e-032695fcb25d None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:33.583390 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed4c4-928a-42b9-9c7e-032695fcb25d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:33.583670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed4c4-928a-42b9-9c7e-032695fcb25d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:33.584509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ed4c4-928a-42b9-9c7e-032695fcb25d None admin] RBAC: Adding query filter params (role.id=715071b6b1244a559110be37cc8410ab, scope.project.id=5b6fc1ac73a24e2ab0688611b645a72e, user.id=a92bd4fc89dc4c818a9494c029b7e8f3) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:33.584824 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ed4c4-928a-42b9-9c7e-032695fcb25d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:33.586292 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ed4c4-928a-42b9-9c7e-032695fcb25d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:33.592474 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 566/1117] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:47:33 2022] GET /identity/v3/role_assignments?user.id=a92bd4fc89dc4c818a9494c029b7e8f3&scope.project.id=5b6fc1ac73a24e2ab0688611b645a72e&role.id=715071b6b1244a559110be37cc8410ab => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:35.811079 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9e0e1-1f6f-4c8f-b4f1-53bdcb180475 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:35.811666 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9e0e1-1f6f-4c8f-b4f1-53bdcb180475 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:35.811666 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9e0e1-1f6f-4c8f-b4f1-53bdcb180475 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:35.813005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 552/1118] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:35.818321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c350d-0d3c-4425-b2b8-d72b8a9f21ea None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:35.818802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c350d-0d3c-4425-b2b8-d72b8a9f21ea None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:35.818907 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c350d-0d3c-4425-b2b8-d72b8a9f21ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:35.836370 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-804c350d-0d3c-4425-b2b8-d72b8a9f21ea None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:35.838200 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-804c350d-0d3c-4425-b2b8-d72b8a9f21ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:35.868269 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:35.906804 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 567/1119] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:35.930180 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9e0e1-1f6f-4c8f-b4f1-53bdcb180475 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:35.946682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:36.032624 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9e0e1-1f6f-4c8f-b4f1-53bdcb180475 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:36.068383 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2c722-6679-4734-bd23-0b1c8d0c1543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:36.069170 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2c722-6679-4734-bd23-0b1c8d0c1543 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:36.069457 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2c722-6679-4734-bd23-0b1c8d0c1543 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:36.069737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2c722-6679-4734-bd23-0b1c8d0c1543 None admin] PATH_INFO: `/v3/roles/715071b6b1244a559110be37cc8410ab` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:36.071273 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2c722-6679-4734-bd23-0b1c8d0c1543 None admin] RBAC: Authorizing `identity:get_role(role_id=715071b6b1244a559110be37cc8410ab)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:36.072644 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2c722-6679-4734-bd23-0b1c8d0c1543 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:36.074067 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 553/1120] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:35 2022] GET /identity/v3/roles/715071b6b1244a559110be37cc8410ab => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:36.080054 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c350d-0d3c-4425-b2b8-d72b8a9f21ea None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:36.180642 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c350d-0d3c-4425-b2b8-d72b8a9f21ea None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:36.215091 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59018bf3-d234-4055-832c-f74c47306115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:36.215962 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59018bf3-d234-4055-832c-f74c47306115 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:36.216242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59018bf3-d234-4055-832c-f74c47306115 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:36.216527 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59018bf3-d234-4055-832c-f74c47306115 None admin] PATH_INFO: `/v3/users/a92bd4fc89dc4c818a9494c029b7e8f3` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:36.217726 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59018bf3-d234-4055-832c-f74c47306115 None admin] RBAC: Authorizing `identity:get_user(user_id=a92bd4fc89dc4c818a9494c029b7e8f3)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:36.219195 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59018bf3-d234-4055-832c-f74c47306115 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:36.220833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 568/1121] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:36 2022] GET /identity/v3/users/a92bd4fc89dc4c818a9494c029b7e8f3 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:36.226674 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2c722-6679-4734-bd23-0b1c8d0c1543 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:36.307282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:36.324996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2c722-6679-4734-bd23-0b1c8d0c1543 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:36.359351 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27125d0b-4ca0-4f4e-871b-0a5961001c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:36.360202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27125d0b-4ca0-4f4e-871b-0a5961001c89 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:36.360483 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27125d0b-4ca0-4f4e-871b-0a5961001c89 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:36.360757 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27125d0b-4ca0-4f4e-871b-0a5961001c89 None admin] PATH_INFO: `/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:36.361927 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27125d0b-4ca0-4f4e-871b-0a5961001c89 None admin] RBAC: Authorizing `identity:get_project(project_id=5b6fc1ac73a24e2ab0688611b645a72e)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:36.363396 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27125d0b-4ca0-4f4e-871b-0a5961001c89 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:36.365083 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 554/1122] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:47:36 2022] GET /identity/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:36.371244 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59018bf3-d234-4055-832c-f74c47306115 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:36.406498 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:36.471757 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59018bf3-d234-4055-832c-f74c47306115 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:36.504626 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dd1ba-8184-4fd6-90b7-8b4ce4e29e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:36.505503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dd1ba-8184-4fd6-90b7-8b4ce4e29e6c None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:36.505783 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dd1ba-8184-4fd6-90b7-8b4ce4e29e6c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:36.506056 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dd1ba-8184-4fd6-90b7-8b4ce4e29e6c None admin] PATH_INFO: `/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e/users/a92bd4fc89dc4c818a9494c029b7e8f3/roles/715071b6b1244a559110be37cc8410ab` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:36.508257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dd1ba-8184-4fd6-90b7-8b4ce4e29e6c None admin] RBAC: Authorizing `identity:create_grant(project_id=5b6fc1ac73a24e2ab0688611b645a72e, user_id=a92bd4fc89dc4c818a9494c029b7e8f3, role_id=715071b6b1244a559110be37cc8410ab)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:36.510226 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dd1ba-8184-4fd6-90b7-8b4ce4e29e6c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:36.628842 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 569/1123] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:47:36 2022] PUT /identity/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e/users/a92bd4fc89dc4c818a9494c029b7e8f3/roles/715071b6b1244a559110be37cc8410ab => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:47:38.877351 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765e3b-6197-49fa-b139-bddd09be3e8b None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:38.877970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765e3b-6197-49fa-b139-bddd09be3e8b None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:38.877970 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765e3b-6197-49fa-b139-bddd09be3e8b None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:38.879437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 555/1124] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:38.886039 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceed8f5-fa28-4415-8615-755cd746b503 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:38.886663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceed8f5-fa28-4415-8615-755cd746b503 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:38.886663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceed8f5-fa28-4415-8615-755cd746b503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:38.905392 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-4ceed8f5-fa28-4415-8615-755cd746b503 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:38.906656 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-4ceed8f5-fa28-4415-8615-755cd746b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:38.981030 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 570/1125] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:39.004494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5765e3b-6197-49fa-b139-bddd09be3e8b None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:39.110930 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5765e3b-6197-49fa-b139-bddd09be3e8b None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:39.145949 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b085d6a-c34e-4016-abf9-2729e2e9badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:39.146758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b085d6a-c34e-4016-abf9-2729e2e9badb None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:39.147039 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b085d6a-c34e-4016-abf9-2729e2e9badb None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:39.147311 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b085d6a-c34e-4016-abf9-2729e2e9badb None admin] PATH_INFO: `/v3/roles/715071b6b1244a559110be37cc8410ab` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:39.148799 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b085d6a-c34e-4016-abf9-2729e2e9badb None admin] RBAC: Authorizing `identity:get_role(role_id=715071b6b1244a559110be37cc8410ab)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:39.150765 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b085d6a-c34e-4016-abf9-2729e2e9badb None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:39.152154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 556/1126] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:39 2022] GET /identity/v3/roles/715071b6b1244a559110be37cc8410ab => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:39.158185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceed8f5-fa28-4415-8615-755cd746b503 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:39.187110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:39.262059 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceed8f5-fa28-4415-8615-755cd746b503 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:39.297817 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58f452-89f2-41d0-966f-234da2c98207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:39.298729 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f452-89f2-41d0-966f-234da2c98207 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:39.299016 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f452-89f2-41d0-966f-234da2c98207 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:39.299295 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f452-89f2-41d0-966f-234da2c98207 None admin] PATH_INFO: `/v3/users/a92bd4fc89dc4c818a9494c029b7e8f3` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:39.300531 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58f452-89f2-41d0-966f-234da2c98207 None admin] RBAC: Authorizing `identity:get_user(user_id=a92bd4fc89dc4c818a9494c029b7e8f3)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:39.302056 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58f452-89f2-41d0-966f-234da2c98207 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:39.303750 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 571/1127] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:39 2022] GET /identity/v3/users/a92bd4fc89dc4c818a9494c029b7e8f3 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:39.310486 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b085d6a-c34e-4016-abf9-2729e2e9badb None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:39.332401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:39.416532 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b085d6a-c34e-4016-abf9-2729e2e9badb None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:39.451255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b43835-a7ff-4bc3-b729-d8bc7cdebf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:39.451910 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b43835-a7ff-4bc3-b729-d8bc7cdebf8e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:39.452195 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b43835-a7ff-4bc3-b729-d8bc7cdebf8e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:39.452469 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b43835-a7ff-4bc3-b729-d8bc7cdebf8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:39.520189 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b43835-a7ff-4bc3-b729-d8bc7cdebf8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:39.521640 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b43835-a7ff-4bc3-b729-d8bc7cdebf8e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:39.540617 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:39.624790 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 557/1128] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:47:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:47:39.631180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58f452-89f2-41d0-966f-234da2c98207 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:39.733012 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:39.740135 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58f452-89f2-41d0-966f-234da2c98207 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:39.777471 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59b951-b739-439c-a66f-cff7596ea6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:39.778349 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b951-b739-439c-a66f-cff7596ea6c6 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:39.778670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b951-b739-439c-a66f-cff7596ea6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:39.778953 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b951-b739-439c-a66f-cff7596ea6c6 None admin] PATH_INFO: `/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:39.780169 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59b951-b739-439c-a66f-cff7596ea6c6 None admin] RBAC: Authorizing `identity:get_project(project_id=5b6fc1ac73a24e2ab0688611b645a72e)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:39.781618 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59b951-b739-439c-a66f-cff7596ea6c6 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:39.783404 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 572/1129] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:47:39 2022] GET /identity/v3/projects/5b6fc1ac73a24e2ab0688611b645a72e => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:39.789641 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b43835-a7ff-4bc3-b729-d8bc7cdebf8e None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:39.893621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b43835-a7ff-4bc3-b729-d8bc7cdebf8e None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:39.912112 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:39.929991 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389ca58-c7be-4e1d-8dd3-6d684b2a6839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:39.930699 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389ca58-c7be-4e1d-8dd3-6d684b2a6839 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:39.930990 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389ca58-c7be-4e1d-8dd3-6d684b2a6839 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:39.931811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389ca58-c7be-4e1d-8dd3-6d684b2a6839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:39.932734 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389ca58-c7be-4e1d-8dd3-6d684b2a6839 None admin] RBAC: Adding query filter params (role.id=715071b6b1244a559110be37cc8410ab, scope.project.id=5b6fc1ac73a24e2ab0688611b645a72e, user.id=a92bd4fc89dc4c818a9494c029b7e8f3) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:39.933052 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389ca58-c7be-4e1d-8dd3-6d684b2a6839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:39.934517 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389ca58-c7be-4e1d-8dd3-6d684b2a6839 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:39.941266 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 558/1130] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:47:39 2022] GET /identity/v3/role_assignments?user.id=a92bd4fc89dc4c818a9494c029b7e8f3&scope.project.id=5b6fc1ac73a24e2ab0688611b645a72e&role.id=715071b6b1244a559110be37cc8410ab => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:42.223384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731ad0-371a-45b9-9496-5616c59fec21 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:42.223977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731ad0-371a-45b9-9496-5616c59fec21 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:42.223977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731ad0-371a-45b9-9496-5616c59fec21 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:42.225302 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 573/1131] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:42.231901 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999e0f-a1e8-4ee3-bb31-f605235fc68d None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:42.232447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999e0f-a1e8-4ee3-bb31-f605235fc68d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:42.232447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999e0f-a1e8-4ee3-bb31-f605235fc68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:42.250400 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-fe999e0f-a1e8-4ee3-bb31-f605235fc68d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:42.251671 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-fe999e0f-a1e8-4ee3-bb31-f605235fc68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:42.324384 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 559/1132] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:42.348631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77731ad0-371a-45b9-9496-5616c59fec21 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:42.460188 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77731ad0-371a-45b9-9496-5616c59fec21 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:42.494782 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d052d-70b7-4f0b-93a6-d34762ea5a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:42.495575 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d052d-70b7-4f0b-93a6-d34762ea5a04 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:42.495863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d052d-70b7-4f0b-93a6-d34762ea5a04 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:42.496142 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d052d-70b7-4f0b-93a6-d34762ea5a04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:42.497350 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d052d-70b7-4f0b-93a6-d34762ea5a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:42.498811 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d052d-70b7-4f0b-93a6-d34762ea5a04 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:42.500451 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 574/1133] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:42.506525 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe999e0f-a1e8-4ee3-bb31-f605235fc68d None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:42.606421 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe999e0f-a1e8-4ee3-bb31-f605235fc68d None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:42.619117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:42.640012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79722cea-de11-43b7-8f9b-ea4be5bec19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:42.640669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79722cea-de11-43b7-8f9b-ea4be5bec19f None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:42.640956 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79722cea-de11-43b7-8f9b-ea4be5bec19f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:42.641229 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79722cea-de11-43b7-8f9b-ea4be5bec19f None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:42.641951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79722cea-de11-43b7-8f9b-ea4be5bec19f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:42.643491 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79722cea-de11-43b7-8f9b-ea4be5bec19f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:42.720307 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 560/1134] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:47:42 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:47:44.997373 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0123ef-fbfe-4bc7-ac1b-48ad975befac None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:44.998071 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0123ef-fbfe-4bc7-ac1b-48ad975befac None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:44.998071 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0123ef-fbfe-4bc7-ac1b-48ad975befac None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:44.999338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 575/1135] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:45.005025 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202753-1238-452f-963f-626d871ecb5e None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:45.005520 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202753-1238-452f-963f-626d871ecb5e None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:45.005644 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202753-1238-452f-963f-626d871ecb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:45.025974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-4e202753-1238-452f-963f-626d871ecb5e None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:45.027231 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-4e202753-1238-452f-963f-626d871ecb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:45.096405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 561/1136] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:45.122225 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0123ef-fbfe-4bc7-ac1b-48ad975befac None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:45.152655 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:45.223964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0123ef-fbfe-4bc7-ac1b-48ad975befac None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:45.257514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea68175-ad47-44dd-a3a4-4a7a124925b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:45.258239 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea68175-ad47-44dd-a3a4-4a7a124925b8 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:45.258521 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea68175-ad47-44dd-a3a4-4a7a124925b8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:45.258824 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea68175-ad47-44dd-a3a4-4a7a124925b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:45.260027 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea68175-ad47-44dd-a3a4-4a7a124925b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:45.261486 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea68175-ad47-44dd-a3a4-4a7a124925b8 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:45.263140 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 576/1137] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:47:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:45.269049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202753-1238-452f-963f-626d871ecb5e None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:45.400747 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:45.407407 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202753-1238-452f-963f-626d871ecb5e None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:45.441097 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be50d7b-0b75-4285-8ec2-0e5fcd21f2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:45.441767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50d7b-0b75-4285-8ec2-0e5fcd21f2d0 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:45.442053 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50d7b-0b75-4285-8ec2-0e5fcd21f2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:45.442332 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50d7b-0b75-4285-8ec2-0e5fcd21f2d0 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:45.443076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be50d7b-0b75-4285-8ec2-0e5fcd21f2d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:45.444509 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be50d7b-0b75-4285-8ec2-0e5fcd21f2d0 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:45.568138 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 562/1138] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:47:45 2022] POST /identity/v3/users => generated 286 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:47:47.859224 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a239e48-d07e-4de8-a03b-ea318ab3cbad None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:47.859812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a239e48-d07e-4de8-a03b-ea318ab3cbad None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:47.859812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a239e48-d07e-4de8-a03b-ea318ab3cbad None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:47.861131 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 577/1139] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:47.866316 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd198c-1e39-4be4-9e20-6eaec843df71 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:47.866781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd198c-1e39-4be4-9e20-6eaec843df71 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:47.866916 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd198c-1e39-4be4-9e20-6eaec843df71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:47.883525 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-3dfd198c-1e39-4be4-9e20-6eaec843df71 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:47.885252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-3dfd198c-1e39-4be4-9e20-6eaec843df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:47.952864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 563/1140] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:47.976343 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a239e48-d07e-4de8-a03b-ea318ab3cbad None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:48.075377 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:48.080275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a239e48-d07e-4de8-a03b-ea318ab3cbad None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:48.114538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73d1c-9930-42f6-b45c-6168103ce281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:48.115367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73d1c-9930-42f6-b45c-6168103ce281 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:48.115650 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73d1c-9930-42f6-b45c-6168103ce281 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:48.115926 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73d1c-9930-42f6-b45c-6168103ce281 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:48.127245 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73d1c-9930-42f6-b45c-6168103ce281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-fcc73d1c-9930-42f6-b45c-6168103ce281 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:47:48.135631 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:48.137020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:48.138340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 578/1141] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:47:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:48.143001 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd198c-1e39-4be4-9e20-6eaec843df71 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:48.222406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:48.240865 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd198c-1e39-4be4-9e20-6eaec843df71 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:48.275390 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f497-9c1b-4928-a42d-3b219c32bbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:48.276061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f497-9c1b-4928-a42d-3b219c32bbe2 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:48.276347 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f497-9c1b-4928-a42d-3b219c32bbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:48.276652 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f497-9c1b-4928-a42d-3b219c32bbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:48.277414 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f497-9c1b-4928-a42d-3b219c32bbe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:48.277916 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f497-9c1b-4928-a42d-3b219c32bbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:48.279645 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f497-9c1b-4928-a42d-3b219c32bbe2 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:48.288513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 564/1142] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:47:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:48.294307 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73d1c-9930-42f6-b45c-6168103ce281 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:48.396225 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73d1c-9930-42f6-b45c-6168103ce281 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:48.429562 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26236b98-8251-42ba-b26e-a3d9947a0ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:48.430424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26236b98-8251-42ba-b26e-a3d9947a0ae8 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:48.430737 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26236b98-8251-42ba-b26e-a3d9947a0ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:48.431577 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26236b98-8251-42ba-b26e-a3d9947a0ae8 None admin] PATH_INFO: `/v3/users/1ea1c271208a4db0b68ad0c4a05a2885` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:48.445010 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26236b98-8251-42ba-b26e-a3d9947a0ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=1ea1c271208a4db0b68ad0c4a05a2885)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:48.446462 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26236b98-8251-42ba-b26e-a3d9947a0ae8 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:48.448187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 579/1143] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:48 2022] GET /identity/v3/users/1ea1c271208a4db0b68ad0c4a05a2885 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:48.454114 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f497-9c1b-4928-a42d-3b219c32bbe2 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:48.552251 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f497-9c1b-4928-a42d-3b219c32bbe2 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:48.585963 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d5fc1-c82a-4eec-b5ed-24d816378523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:48.586633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d5fc1-c82a-4eec-b5ed-24d816378523 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:48.586919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d5fc1-c82a-4eec-b5ed-24d816378523 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:48.587228 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d5fc1-c82a-4eec-b5ed-24d816378523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:48.599507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:48.654632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d5fc1-c82a-4eec-b5ed-24d816378523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:48.656010 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d5fc1-c82a-4eec-b5ed-24d816378523 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:48.752508 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 565/1144] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:47:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:47:48.758429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26236b98-8251-42ba-b26e-a3d9947a0ae8 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:48.777971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:48.860024 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26236b98-8251-42ba-b26e-a3d9947a0ae8 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:48.894463 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b6301-47c9-4f71-9206-9dba186509f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:48.895372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6301-47c9-4f71-9206-9dba186509f1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:48.895655 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6301-47c9-4f71-9206-9dba186509f1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:48.895933 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6301-47c9-4f71-9206-9dba186509f1 None admin] PATH_INFO: `/v3/projects/774d3fdb724d4413947071eeb2d746df` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:48.897144 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b6301-47c9-4f71-9206-9dba186509f1 None admin] RBAC: Authorizing `identity:get_project(project_id=774d3fdb724d4413947071eeb2d746df)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:48.898640 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b6301-47c9-4f71-9206-9dba186509f1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:48.900402 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 580/1145] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:47:48 2022] GET /identity/v3/projects/774d3fdb724d4413947071eeb2d746df => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:48.906687 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d5fc1-c82a-4eec-b5ed-24d816378523 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:48.949757 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:49.004144 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d5fc1-c82a-4eec-b5ed-24d816378523 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:49.037076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2674785-472e-4639-8e82-e75697f0e373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:49.037716 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2674785-472e-4639-8e82-e75697f0e373 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:49.037995 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2674785-472e-4639-8e82-e75697f0e373 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:49.038267 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2674785-472e-4639-8e82-e75697f0e373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:49.039123 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2674785-472e-4639-8e82-e75697f0e373 None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=774d3fdb724d4413947071eeb2d746df, user.id=1ea1c271208a4db0b68ad0c4a05a2885) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:49.039429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2674785-472e-4639-8e82-e75697f0e373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:49.040882 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2674785-472e-4639-8e82-e75697f0e373 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:49.046458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 566/1146] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:47:48 2022] GET /identity/v3/role_assignments?user.id=1ea1c271208a4db0b68ad0c4a05a2885&scope.project.id=774d3fdb724d4413947071eeb2d746df&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:47:51.268730 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d224-3d8c-43cf-a5ad-d378dd5ba01f None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:51.269305 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d224-3d8c-43cf-a5ad-d378dd5ba01f None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:51.269305 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d224-3d8c-43cf-a5ad-d378dd5ba01f None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:51.270718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 581/1147] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:51.275926 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23353612-0779-4353-ace9-e01f85fae195 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:51.276369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23353612-0779-4353-ace9-e01f85fae195 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:51.276586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23353612-0779-4353-ace9-e01f85fae195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:51.293146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-23353612-0779-4353-ace9-e01f85fae195 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:51.294412 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-23353612-0779-4353-ace9-e01f85fae195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:51.361820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 567/1148] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:51.386105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5d224-3d8c-43cf-a5ad-d378dd5ba01f None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:51.473695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:51.490397 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5d224-3d8c-43cf-a5ad-d378dd5ba01f None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:51.525618 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e15b3-daad-4079-8bf0-9425df5edd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:51.526411 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e15b3-daad-4079-8bf0-9425df5edd6a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:51.526734 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e15b3-daad-4079-8bf0-9425df5edd6a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:51.527012 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e15b3-daad-4079-8bf0-9425df5edd6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:51.537150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e15b3-daad-4079-8bf0-9425df5edd6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-673e15b3-daad-4079-8bf0-9425df5edd6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:47:51.545038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:51.546427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:51.547668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 582/1149] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:47:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:51.552354 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23353612-0779-4353-ace9-e01f85fae195 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:51.587059 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:51.654112 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23353612-0779-4353-ace9-e01f85fae195 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:51.687023 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89b4a-bb10-4ab4-870a-2cf1c66f1b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:51.687696 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89b4a-bb10-4ab4-870a-2cf1c66f1b37 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:51.688024 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89b4a-bb10-4ab4-870a-2cf1c66f1b37 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:51.688252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89b4a-bb10-4ab4-870a-2cf1c66f1b37 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:51.689004 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe89b4a-bb10-4ab4-870a-2cf1c66f1b37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:51.689310 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe89b4a-bb10-4ab4-870a-2cf1c66f1b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:51.690700 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe89b4a-bb10-4ab4-870a-2cf1c66f1b37 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:51.699856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 568/1150] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:47:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:51.705841 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e15b3-daad-4079-8bf0-9425df5edd6a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:51.805514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e15b3-daad-4079-8bf0-9425df5edd6a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:51.839905 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb07e5c-7eaf-42fb-a0ea-4ce31905a3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:51.840770 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb07e5c-7eaf-42fb-a0ea-4ce31905a3ab None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:51.841056 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb07e5c-7eaf-42fb-a0ea-4ce31905a3ab None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:51.841332 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb07e5c-7eaf-42fb-a0ea-4ce31905a3ab None admin] PATH_INFO: `/v3/users/1ea1c271208a4db0b68ad0c4a05a2885` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:51.842672 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb07e5c-7eaf-42fb-a0ea-4ce31905a3ab None admin] RBAC: Authorizing `identity:get_user(user_id=1ea1c271208a4db0b68ad0c4a05a2885)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:51.843991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb07e5c-7eaf-42fb-a0ea-4ce31905a3ab None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:51.845625 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 583/1151] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:51 2022] GET /identity/v3/users/1ea1c271208a4db0b68ad0c4a05a2885 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:51.851456 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89b4a-bb10-4ab4-870a-2cf1c66f1b37 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:51.950391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:51.954244 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89b4a-bb10-4ab4-870a-2cf1c66f1b37 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:51.991818 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb122d-7c6d-464b-a237-2b11dab92bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:51.992685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb122d-7c6d-464b-a237-2b11dab92bc2 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:51.992973 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb122d-7c6d-464b-a237-2b11dab92bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:51.993779 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb122d-7c6d-464b-a237-2b11dab92bc2 None admin] PATH_INFO: `/v3/projects/774d3fdb724d4413947071eeb2d746df` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:51.995010 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb122d-7c6d-464b-a237-2b11dab92bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=774d3fdb724d4413947071eeb2d746df)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:51.996480 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb122d-7c6d-464b-a237-2b11dab92bc2 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:51.998201 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 569/1152] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:47:51 2022] GET /identity/v3/projects/774d3fdb724d4413947071eeb2d746df => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:52.004296 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb07e5c-7eaf-42fb-a0ea-4ce31905a3ab None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:52.020431 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:52.105980 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb07e5c-7eaf-42fb-a0ea-4ce31905a3ab None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:52.139982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033eaee1-2345-4a5f-ab8c-9fce9ec8ea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:52.140869 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033eaee1-2345-4a5f-ab8c-9fce9ec8ea1e None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:52.141156 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033eaee1-2345-4a5f-ab8c-9fce9ec8ea1e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:52.141439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033eaee1-2345-4a5f-ab8c-9fce9ec8ea1e None admin] PATH_INFO: `/v3/projects/774d3fdb724d4413947071eeb2d746df/users/1ea1c271208a4db0b68ad0c4a05a2885/roles/480e35452fc547e0a2917bdd5b782f7d` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:52.143461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033eaee1-2345-4a5f-ab8c-9fce9ec8ea1e None admin] RBAC: Authorizing `identity:create_grant(project_id=774d3fdb724d4413947071eeb2d746df, user_id=1ea1c271208a4db0b68ad0c4a05a2885, role_id=480e35452fc547e0a2917bdd5b782f7d)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:52.144906 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033eaee1-2345-4a5f-ab8c-9fce9ec8ea1e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:52.244279 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 584/1153] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:47:52 2022] PUT /identity/v3/projects/774d3fdb724d4413947071eeb2d746df/users/1ea1c271208a4db0b68ad0c4a05a2885/roles/480e35452fc547e0a2917bdd5b782f7d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:47:54.451359 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac7da-4252-4fb4-b8c6-06a3986e309c None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:54.451985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac7da-4252-4fb4-b8c6-06a3986e309c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:54.451985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac7da-4252-4fb4-b8c6-06a3986e309c None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:54.453309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 570/1154] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:54.458724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd2c2-f733-4ec1-82b2-35e72ed5448e None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:54.459140 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd2c2-f733-4ec1-82b2-35e72ed5448e None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:54.459300 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd2c2-f733-4ec1-82b2-35e72ed5448e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:54.476837 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-5c6dd2c2-f733-4ec1-82b2-35e72ed5448e None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:54.478085 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-5c6dd2c2-f733-4ec1-82b2-35e72ed5448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:54.545206 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 585/1155] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:54.568576 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ac7da-4252-4fb4-b8c6-06a3986e309c None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:54.669863 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ac7da-4252-4fb4-b8c6-06a3986e309c None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:54.703514 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f779d5f-d762-49b5-8c03-b1be359fe6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:54.704233 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779d5f-d762-49b5-8c03-b1be359fe6c8 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:54.704519 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779d5f-d762-49b5-8c03-b1be359fe6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:54.704797 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779d5f-d762-49b5-8c03-b1be359fe6c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:54.715575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f779d5f-d762-49b5-8c03-b1be359fe6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-0f779d5f-d762-49b5-8c03-b1be359fe6c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:47:54.723111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:54.724466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:47:54.725625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 571/1156] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:47:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:54.730348 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd2c2-f733-4ec1-82b2-35e72ed5448e None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:54.732580 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:54.830959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd2c2-f733-4ec1-82b2-35e72ed5448e None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:54.866272 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3466a6-59c7-4ee4-a8ad-5fb47b6b352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:54.866972 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3466a6-59c7-4ee4-a8ad-5fb47b6b352a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:54.867260 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3466a6-59c7-4ee4-a8ad-5fb47b6b352a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:54.867538 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3466a6-59c7-4ee4-a8ad-5fb47b6b352a None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:54.868802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3466a6-59c7-4ee4-a8ad-5fb47b6b352a None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:54.869113 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3466a6-59c7-4ee4-a8ad-5fb47b6b352a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:54.870480 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3466a6-59c7-4ee4-a8ad-5fb47b6b352a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:54.878571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 586/1157] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:47:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:54.885072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f779d5f-d762-49b5-8c03-b1be359fe6c8 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:54.913374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:54.986996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f779d5f-d762-49b5-8c03-b1be359fe6c8 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:55.020353 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddfb22-94ae-4d42-ae8e-2bb489953557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:55.021204 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddfb22-94ae-4d42-ae8e-2bb489953557 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:55.021481 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddfb22-94ae-4d42-ae8e-2bb489953557 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:55.021754 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddfb22-94ae-4d42-ae8e-2bb489953557 None admin] PATH_INFO: `/v3/users/1ea1c271208a4db0b68ad0c4a05a2885` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:55.022960 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddfb22-94ae-4d42-ae8e-2bb489953557 None admin] RBAC: Authorizing `identity:get_user(user_id=1ea1c271208a4db0b68ad0c4a05a2885)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:55.024385 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddfb22-94ae-4d42-ae8e-2bb489953557 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:55.026036 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 572/1158] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:47:54 2022] GET /identity/v3/users/1ea1c271208a4db0b68ad0c4a05a2885 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:55.031937 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3466a6-59c7-4ee4-a8ad-5fb47b6b352a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:55.095348 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:55.133752 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3466a6-59c7-4ee4-a8ad-5fb47b6b352a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:55.167840 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847b8a-b6ed-4c10-904d-78c3b86b8131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:55.168488 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847b8a-b6ed-4c10-904d-78c3b86b8131 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:55.168773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847b8a-b6ed-4c10-904d-78c3b86b8131 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:55.169046 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847b8a-b6ed-4c10-904d-78c3b86b8131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:55.236741 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847b8a-b6ed-4c10-904d-78c3b86b8131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:55.238251 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847b8a-b6ed-4c10-904d-78c3b86b8131 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:55.297778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:55.335974 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 587/1159] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:47:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:47:55.341921 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddfb22-94ae-4d42-ae8e-2bb489953557 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:55.434537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:55.443102 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddfb22-94ae-4d42-ae8e-2bb489953557 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:55.478526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd501-aed3-4bc6-8215-751f6a76508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:55.479759 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd501-aed3-4bc6-8215-751f6a76508b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:55.480028 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd501-aed3-4bc6-8215-751f6a76508b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:55.480306 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd501-aed3-4bc6-8215-751f6a76508b None admin] PATH_INFO: `/v3/projects/774d3fdb724d4413947071eeb2d746df` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:55.481568 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edd501-aed3-4bc6-8215-751f6a76508b None admin] RBAC: Authorizing `identity:get_project(project_id=774d3fdb724d4413947071eeb2d746df)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:55.483056 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edd501-aed3-4bc6-8215-751f6a76508b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:55.484785 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 573/1160] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:47:55 2022] GET /identity/v3/projects/774d3fdb724d4413947071eeb2d746df => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:55.491142 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847b8a-b6ed-4c10-904d-78c3b86b8131 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:55.589639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847b8a-b6ed-4c10-904d-78c3b86b8131 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:55.623173 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698e1f-3ef0-44ab-b952-8537807e8a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:55.623824 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698e1f-3ef0-44ab-b952-8537807e8a52 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:55.624108 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698e1f-3ef0-44ab-b952-8537807e8a52 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:55.624383 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698e1f-3ef0-44ab-b952-8537807e8a52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:55.625221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698e1f-3ef0-44ab-b952-8537807e8a52 None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=774d3fdb724d4413947071eeb2d746df, user.id=1ea1c271208a4db0b68ad0c4a05a2885) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:55.625532 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698e1f-3ef0-44ab-b952-8537807e8a52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:55.626984 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698e1f-3ef0-44ab-b952-8537807e8a52 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:55.632760 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 588/1161] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:47:55 2022] GET /identity/v3/role_assignments?user.id=1ea1c271208a4db0b68ad0c4a05a2885&scope.project.id=774d3fdb724d4413947071eeb2d746df&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:47:57.902535 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a35df-40e6-47f4-857a-18f9578c645b None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:57.903146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a35df-40e6-47f4-857a-18f9578c645b None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:57.903146 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a35df-40e6-47f4-857a-18f9578c645b None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:57.904494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 574/1162] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:47:57.909726 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a459-874a-4e4e-9b04-a3f0220e098d None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:57.910149 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a459-874a-4e4e-9b04-a3f0220e098d None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:57.910292 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a459-874a-4e4e-9b04-a3f0220e098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:57.927861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-e8e1a459-874a-4e4e-9b04-a3f0220e098d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:47:57.929056 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-e8e1a459-874a-4e4e-9b04-a3f0220e098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:47:57.952157 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:57.996029 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 589/1163] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:47:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:47:58.018297 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a35df-40e6-47f4-857a-18f9578c645b None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:58.120172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a35df-40e6-47f4-857a-18f9578c645b None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:58.153768 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae9b12-21b0-4b68-838f-3075ad341a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:58.154342 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9b12-21b0-4b68-838f-3075ad341a01 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:58.154651 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9b12-21b0-4b68-838f-3075ad341a01 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:58.154942 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9b12-21b0-4b68-838f-3075ad341a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:58.184879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:58.226401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae9b12-21b0-4b68-838f-3075ad341a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:58.230100 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae9b12-21b0-4b68-838f-3075ad341a01 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:58.331626 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 575/1164] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:47:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:47:58.338041 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1a459-874a-4e4e-9b04-a3f0220e098d None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:58.437677 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1a459-874a-4e4e-9b04-a3f0220e098d None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:58.472009 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a76d0-725a-44a2-8c9d-66bb16cb1109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:58.472809 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a76d0-725a-44a2-8c9d-66bb16cb1109 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:58.473094 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a76d0-725a-44a2-8c9d-66bb16cb1109 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:58.473371 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a76d0-725a-44a2-8c9d-66bb16cb1109 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:58.480227 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a76d0-725a-44a2-8c9d-66bb16cb1109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:58.481690 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a76d0-725a-44a2-8c9d-66bb16cb1109 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-cf3a76d0-725a-44a2-8c9d-66bb16cb1109 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:47:58.495802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:47:58.497220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:47:58.498564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 590/1165] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:47:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:47:58.503118 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae9b12-21b0-4b68-838f-3075ad341a01 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:47:58.563051 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:47:58.599936 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae9b12-21b0-4b68-838f-3075ad341a01 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:47:58.633082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629bf1-4de3-43b2-8b2c-a209a874ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:47:58.634263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629bf1-4de3-43b2-8b2c-a209a874ca23 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:47:58.634553 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629bf1-4de3-43b2-8b2c-a209a874ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:47:58.634861 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629bf1-4de3-43b2-8b2c-a209a874ca23 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:47:58.635577 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629bf1-4de3-43b2-8b2c-a209a874ca23 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:47:58.635881 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629bf1-4de3-43b2-8b2c-a209a874ca23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:47:58.637250 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629bf1-4de3-43b2-8b2c-a209a874ca23 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:47:58.644336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 576/1166] 10.222.0.89 () {56 vars in 1115 bytes} [Thu May 19 20:47:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:00.880401 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1276f-f065-40b5-a2d3-a64e3093702f None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:00.880975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1276f-f065-40b5-a2d3-a64e3093702f None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:00.880975 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1276f-f065-40b5-a2d3-a64e3093702f None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:00.882345 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 591/1167] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:48:00.887882 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36598a8a-49fd-4476-b03e-7edd527c82d7 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:00.888386 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36598a8a-49fd-4476-b03e-7edd527c82d7 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:00.888600 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36598a8a-49fd-4476-b03e-7edd527c82d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:00.908856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-36598a8a-49fd-4476-b03e-7edd527c82d7 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:48:00.910051 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-36598a8a-49fd-4476-b03e-7edd527c82d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:48:00.978303 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 577/1168] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:48:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:48:01.001673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1276f-f065-40b5-a2d3-a64e3093702f None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:01.021973 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:01.108590 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1276f-f065-40b5-a2d3-a64e3093702f None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:01.143876 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39da413-c4a1-41d6-8733-5ee6e6689aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:01.144477 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39da413-c4a1-41d6-8733-5ee6e6689aaa None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:01.144764 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39da413-c4a1-41d6-8733-5ee6e6689aaa None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:01.145044 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39da413-c4a1-41d6-8733-5ee6e6689aaa None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:01.145813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39da413-c4a1-41d6-8733-5ee6e6689aaa None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:01.147254 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39da413-c4a1-41d6-8733-5ee6e6689aaa None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:01.262395 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 592/1169] 10.222.0.89 () {60 vars in 1138 bytes} [Thu May 19 20:48:01 2022] POST /identity/v3/domains => generated 267 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:48:03.519605 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0227c-c6ac-4c03-af2e-343bb5ad03f5 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:03.520185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0227c-c6ac-4c03-af2e-343bb5ad03f5 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:03.520185 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0227c-c6ac-4c03-af2e-343bb5ad03f5 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:03.521535 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 578/1170] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:48:03.527383 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d955-c202-4f83-a051-b61dbb37be5c None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:03.527844 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d955-c202-4f83-a051-b61dbb37be5c None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:03.527955 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d955-c202-4f83-a051-b61dbb37be5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:03.544904 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-a5a3d955-c202-4f83-a051-b61dbb37be5c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:48:03.546102 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-a5a3d955-c202-4f83-a051-b61dbb37be5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:48:03.614021 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 593/1171] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:48:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:48:03.637606 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0227c-c6ac-4c03-af2e-343bb5ad03f5 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:03.693607 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:03.738774 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0227c-c6ac-4c03-af2e-343bb5ad03f5 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:03.771849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0c251-bc11-4646-beb5-01584dba9d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:03.772627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0c251-bc11-4646-beb5-01584dba9d8a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:03.772910 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0c251-bc11-4646-beb5-01584dba9d8a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:03.773189 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0c251-bc11-4646-beb5-01584dba9d8a None admin] PATH_INFO: `/v3/domains/d9536c50c4644425a1af3177f5596970` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:03.784581 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0c251-bc11-4646-beb5-01584dba9d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=d9536c50c4644425a1af3177f5596970)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:03.786024 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0c251-bc11-4646-beb5-01584dba9d8a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:03.787697 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 579/1172] 10.222.0.89 () {56 vars in 1183 bytes} [Thu May 19 20:48:03 2022] GET /identity/v3/domains/d9536c50c4644425a1af3177f5596970 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:03.793537 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3d955-c202-4f83-a051-b61dbb37be5c None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:03.803813 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:03.894132 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3d955-c202-4f83-a051-b61dbb37be5c None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:03.929332 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932f5a8-ae29-4d96-8006-f40d9badfac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:03.930002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932f5a8-ae29-4d96-8006-f40d9badfac5 None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:03.930291 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932f5a8-ae29-4d96-8006-f40d9badfac5 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:03.930644 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932f5a8-ae29-4d96-8006-f40d9badfac5 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:03.931372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932f5a8-ae29-4d96-8006-f40d9badfac5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:03.932826 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932f5a8-ae29-4d96-8006-f40d9badfac5 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:04.073436 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 594/1173] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:48:03 2022] POST /identity/v3/projects => generated 361 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:48:06.336656 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a866b-89a5-48b2-9a12-12c815db9fef None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:06.337220 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a866b-89a5-48b2-9a12-12c815db9fef None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:06.337220 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a866b-89a5-48b2-9a12-12c815db9fef None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:06.338501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 580/1174] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:48:06.343957 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae528b1-b633-4f59-ac2c-628315a8bee4 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:06.344442 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae528b1-b633-4f59-ac2c-628315a8bee4 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:06.344556 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae528b1-b633-4f59-ac2c-628315a8bee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:06.361415 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-7ae528b1-b633-4f59-ac2c-628315a8bee4 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:48:06.362701 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-7ae528b1-b633-4f59-ac2c-628315a8bee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:48:06.420499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:06.431220 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 595/1175] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:48:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:48:06.456460 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a866b-89a5-48b2-9a12-12c815db9fef None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:06.561526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a866b-89a5-48b2-9a12-12c815db9fef None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:06.578086 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:06.631892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584e7b9-c091-489f-92e2-d4e15e5e9548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:06.631892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e7b9-c091-489f-92e2-d4e15e5e9548 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:06.631892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e7b9-c091-489f-92e2-d4e15e5e9548 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:06.631892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e7b9-c091-489f-92e2-d4e15e5e9548 None admin] PATH_INFO: `/v3/domains/d9536c50c4644425a1af3177f5596970` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:06.632415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584e7b9-c091-489f-92e2-d4e15e5e9548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d9536c50c4644425a1af3177f5596970)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:06.632415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584e7b9-c091-489f-92e2-d4e15e5e9548 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:06.632415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 581/1176] 10.222.0.89 () {56 vars in 1183 bytes} [Thu May 19 20:48:06 2022] GET /identity/v3/domains/d9536c50c4644425a1af3177f5596970 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:06.632695 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae528b1-b633-4f59-ac2c-628315a8bee4 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:06.705917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae528b1-b633-4f59-ac2c-628315a8bee4 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:06.739349 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed14ce-dbea-4e71-9bc3-a61b608ffd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:06.740013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed14ce-dbea-4e71-9bc3-a61b608ffd9a None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:06.740306 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed14ce-dbea-4e71-9bc3-a61b608ffd9a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:06.740565 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed14ce-dbea-4e71-9bc3-a61b608ffd9a None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:06.741289 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed14ce-dbea-4e71-9bc3-a61b608ffd9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:06.742747 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed14ce-dbea-4e71-9bc3-a61b608ffd9a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:06.826197 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 596/1177] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:48:06 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:48:09.161434 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23433835-8647-4e46-aa40-e0a4c6a8e821 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:09.162011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23433835-8647-4e46-aa40-e0a4c6a8e821 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:09.162011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23433835-8647-4e46-aa40-e0a4c6a8e821 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:09.163403 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 582/1178] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:48:09.169433 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45568-4451-4e00-8192-9b3f98ead85a None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:09.169870 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45568-4451-4e00-8192-9b3f98ead85a None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:09.169982 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45568-4451-4e00-8192-9b3f98ead85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:09.187468 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-c7b45568-4451-4e00-8192-9b3f98ead85a None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:48:09.188671 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-c7b45568-4451-4e00-8192-9b3f98ead85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:48:09.233060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:09.257247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 597/1179] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:48:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:48:09.281373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23433835-8647-4e46-aa40-e0a4c6a8e821 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:09.383814 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23433835-8647-4e46-aa40-e0a4c6a8e821 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:09.418724 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05507aba-0c03-4071-8644-dc948622ad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:09.419549 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507aba-0c03-4071-8644-dc948622ad26 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:09.419830 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507aba-0c03-4071-8644-dc948622ad26 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:09.420108 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507aba-0c03-4071-8644-dc948622ad26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:09.430688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05507aba-0c03-4071-8644-dc948622ad26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-05507aba-0c03-4071-8644-dc948622ad26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:48:09.438633 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:48:09.439879 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:48:09.441061 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 583/1180] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:48:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:48:09.446516 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b45568-4451-4e00-8192-9b3f98ead85a None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:09.545572 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b45568-4451-4e00-8192-9b3f98ead85a None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:09.579857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f44f6-019a-47c6-bfb8-3942e6b1dffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:09.580523 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f44f6-019a-47c6-bfb8-3942e6b1dffe None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:09.580808 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f44f6-019a-47c6-bfb8-3942e6b1dffe None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:09.581088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f44f6-019a-47c6-bfb8-3942e6b1dffe None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:09.581841 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f44f6-019a-47c6-bfb8-3942e6b1dffe None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:48:09.582150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f44f6-019a-47c6-bfb8-3942e6b1dffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:09.583553 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f44f6-019a-47c6-bfb8-3942e6b1dffe None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:09.592404 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 598/1181] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:48:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:09.598211 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05507aba-0c03-4071-8644-dc948622ad26 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:09.643602 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:09.698632 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05507aba-0c03-4071-8644-dc948622ad26 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:09.732996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bc027-5c7e-4ca1-bdb6-6b7e29b23063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:09.733871 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc027-5c7e-4ca1-bdb6-6b7e29b23063 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:09.734163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc027-5c7e-4ca1-bdb6-6b7e29b23063 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:09.734443 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc027-5c7e-4ca1-bdb6-6b7e29b23063 None admin] PATH_INFO: `/v3/users/0c61c36689484d838e7c97ce79d71105` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:09.747751 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bc027-5c7e-4ca1-bdb6-6b7e29b23063 None admin] RBAC: Authorizing `identity:get_user(user_id=0c61c36689484d838e7c97ce79d71105)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:09.749195 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bc027-5c7e-4ca1-bdb6-6b7e29b23063 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:09.750893 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 584/1182] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:48:09 2022] GET /identity/v3/users/0c61c36689484d838e7c97ce79d71105 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:09.756660 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f44f6-019a-47c6-bfb8-3942e6b1dffe None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:09.798584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:09.858909 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f44f6-019a-47c6-bfb8-3942e6b1dffe None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:09.892841 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fdd7f-c6c3-48dd-9674-beb59b3401e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:09.893532 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fdd7f-c6c3-48dd-9674-beb59b3401e4 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:09.893871 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fdd7f-c6c3-48dd-9674-beb59b3401e4 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:09.894090 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fdd7f-c6c3-48dd-9674-beb59b3401e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:09.960887 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fdd7f-c6c3-48dd-9674-beb59b3401e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:09.962380 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fdd7f-c6c3-48dd-9674-beb59b3401e4 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:09.999629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:10.060586 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 599/1183] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:48:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:48:10.066697 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bc027-5c7e-4ca1-bdb6-6b7e29b23063 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:10.167371 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bc027-5c7e-4ca1-bdb6-6b7e29b23063 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:10.168799 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:10.202525 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0659b2-cf94-4c4b-a351-c2f79d501f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:10.203405 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0659b2-cf94-4c4b-a351-c2f79d501f0d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:10.203688 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0659b2-cf94-4c4b-a351-c2f79d501f0d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:10.203968 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0659b2-cf94-4c4b-a351-c2f79d501f0d None admin] PATH_INFO: `/v3/projects/0c9aa4a56670445da5f6e4c7792a32de` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:10.205208 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0659b2-cf94-4c4b-a351-c2f79d501f0d None admin] RBAC: Authorizing `identity:get_project(project_id=0c9aa4a56670445da5f6e4c7792a32de)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:10.206686 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0659b2-cf94-4c4b-a351-c2f79d501f0d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:10.208450 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 585/1184] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:48:10 2022] GET /identity/v3/projects/0c9aa4a56670445da5f6e4c7792a32de => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:10.215221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fdd7f-c6c3-48dd-9674-beb59b3401e4 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:10.313245 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fdd7f-c6c3-48dd-9674-beb59b3401e4 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:10.347393 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657f0f4-ddcd-4514-8a8c-9e935230539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:10.348047 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657f0f4-ddcd-4514-8a8c-9e935230539e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:10.348335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657f0f4-ddcd-4514-8a8c-9e935230539e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:10.348614 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657f0f4-ddcd-4514-8a8c-9e935230539e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:10.349448 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657f0f4-ddcd-4514-8a8c-9e935230539e None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=0c9aa4a56670445da5f6e4c7792a32de, user.id=0c61c36689484d838e7c97ce79d71105) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:48:10.349763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657f0f4-ddcd-4514-8a8c-9e935230539e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:10.351236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657f0f4-ddcd-4514-8a8c-9e935230539e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:10.356693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 600/1185] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:48:10 2022] GET /identity/v3/role_assignments?user.id=0c61c36689484d838e7c97ce79d71105&scope.project.id=0c9aa4a56670445da5f6e4c7792a32de&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:12.597744 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bde57-53e2-4365-959e-f3d9586f8876 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:12.598334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bde57-53e2-4365-959e-f3d9586f8876 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:12.598334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bde57-53e2-4365-959e-f3d9586f8876 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:12.599708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 586/1186] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:48:12.605088 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da661955-6c2e-47c8-b3b0-afd8f4726248 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:12.605552 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da661955-6c2e-47c8-b3b0-afd8f4726248 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:12.605666 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da661955-6c2e-47c8-b3b0-afd8f4726248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:12.610857 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:12.623084 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-da661955-6c2e-47c8-b3b0-afd8f4726248 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:48:12.624288 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-da661955-6c2e-47c8-b3b0-afd8f4726248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:48:12.693440 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 601/1187] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:48:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:48:12.717009 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bde57-53e2-4365-959e-f3d9586f8876 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:12.816171 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bde57-53e2-4365-959e-f3d9586f8876 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:12.849967 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846a31b-3cd0-44b8-83a6-39fca45714c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:12.850712 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846a31b-3cd0-44b8-83a6-39fca45714c2 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:12.850996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846a31b-3cd0-44b8-83a6-39fca45714c2 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:12.851268 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846a31b-3cd0-44b8-83a6-39fca45714c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:12.867642 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846a31b-3cd0-44b8-83a6-39fca45714c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-8846a31b-3cd0-44b8-83a6-39fca45714c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:48:12.875319 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:48:12.876677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:48:12.877907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 587/1188] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:48:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:48:12.882550 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da661955-6c2e-47c8-b3b0-afd8f4726248 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:12.982140 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da661955-6c2e-47c8-b3b0-afd8f4726248 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:13.010746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:13.015552 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f208c7a-d48c-435c-84fb-70c4710d94cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:13.016215 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208c7a-d48c-435c-84fb-70c4710d94cd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:13.016497 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208c7a-d48c-435c-84fb-70c4710d94cd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:13.016773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208c7a-d48c-435c-84fb-70c4710d94cd None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:13.017520 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f208c7a-d48c-435c-84fb-70c4710d94cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:48:13.017827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f208c7a-d48c-435c-84fb-70c4710d94cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:13.019236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f208c7a-d48c-435c-84fb-70c4710d94cd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:13.028574 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 602/1189] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:48:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:13.034702 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846a31b-3cd0-44b8-83a6-39fca45714c2 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:13.066925 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:13.136113 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846a31b-3cd0-44b8-83a6-39fca45714c2 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:13.170658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f76b3-eb35-4231-bbdc-a6fdaef1b7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:13.171530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f76b3-eb35-4231-bbdc-a6fdaef1b7ad None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:13.171814 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f76b3-eb35-4231-bbdc-a6fdaef1b7ad None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:13.172092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f76b3-eb35-4231-bbdc-a6fdaef1b7ad None admin] PATH_INFO: `/v3/users/0c61c36689484d838e7c97ce79d71105` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:13.173283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f76b3-eb35-4231-bbdc-a6fdaef1b7ad None admin] RBAC: Authorizing `identity:get_user(user_id=0c61c36689484d838e7c97ce79d71105)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:13.174738 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f76b3-eb35-4231-bbdc-a6fdaef1b7ad None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:13.176490 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 588/1190] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:48:13 2022] GET /identity/v3/users/0c61c36689484d838e7c97ce79d71105 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:13.182242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f208c7a-d48c-435c-84fb-70c4710d94cd None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:13.283922 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f208c7a-d48c-435c-84fb-70c4710d94cd None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:13.317036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a95e6-e757-4655-af2e-d37995edf33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:13.317918 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a95e6-e757-4655-af2e-d37995edf33a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:13.318197 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a95e6-e757-4655-af2e-d37995edf33a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:13.318475 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a95e6-e757-4655-af2e-d37995edf33a None admin] PATH_INFO: `/v3/projects/0c9aa4a56670445da5f6e4c7792a32de` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:13.319774 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a95e6-e757-4655-af2e-d37995edf33a None admin] RBAC: Authorizing `identity:get_project(project_id=0c9aa4a56670445da5f6e4c7792a32de)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:13.321799 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a95e6-e757-4655-af2e-d37995edf33a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:13.323622 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 603/1191] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:48:13 2022] GET /identity/v3/projects/0c9aa4a56670445da5f6e4c7792a32de => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:13.329795 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f76b3-eb35-4231-bbdc-a6fdaef1b7ad None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:13.434245 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:13.438582 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f76b3-eb35-4231-bbdc-a6fdaef1b7ad None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:13.477718 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b6ccd-9154-43cc-80d1-41a2c5b2697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:13.478655 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b6ccd-9154-43cc-80d1-41a2c5b2697c None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:13.478942 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b6ccd-9154-43cc-80d1-41a2c5b2697c None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:13.479218 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b6ccd-9154-43cc-80d1-41a2c5b2697c None admin] PATH_INFO: `/v3/projects/0c9aa4a56670445da5f6e4c7792a32de/users/0c61c36689484d838e7c97ce79d71105/roles/480e35452fc547e0a2917bdd5b782f7d` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:13.481317 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b6ccd-9154-43cc-80d1-41a2c5b2697c None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9aa4a56670445da5f6e4c7792a32de, user_id=0c61c36689484d838e7c97ce79d71105, role_id=480e35452fc547e0a2917bdd5b782f7d)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:13.482829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b6ccd-9154-43cc-80d1-41a2c5b2697c None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:13.575955 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 589/1192] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:48:13 2022] PUT /identity/v3/projects/0c9aa4a56670445da5f6e4c7792a32de/users/0c61c36689484d838e7c97ce79d71105/roles/480e35452fc547e0a2917bdd5b782f7d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:48:15.809715 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dfe27-0241-4611-a3f5-053a73df9c62 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:15.810401 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dfe27-0241-4611-a3f5-053a73df9c62 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:15.810401 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dfe27-0241-4611-a3f5-053a73df9c62 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:15.813473 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 604/1193] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:48:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:48:15.818939 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2df8a-f9dd-4477-8cac-9771ed882009 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:15.819365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2df8a-f9dd-4477-8cac-9771ed882009 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:15.819478 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2df8a-f9dd-4477-8cac-9771ed882009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:15.836145 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-0af2df8a-f9dd-4477-8cac-9771ed882009 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:48:15.837860 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-0af2df8a-f9dd-4477-8cac-9771ed882009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:48:15.905760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 590/1194] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:48:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:48:15.929619 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dfe27-0241-4611-a3f5-053a73df9c62 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:15.997816 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:16.036915 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dfe27-0241-4611-a3f5-053a73df9c62 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:16.071933 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045517b-2a88-4176-b45d-92217845e3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:16.072650 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045517b-2a88-4176-b45d-92217845e3cf None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:16.072953 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045517b-2a88-4176-b45d-92217845e3cf None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:16.073234 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045517b-2a88-4176-b45d-92217845e3cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:16.083593 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045517b-2a88-4176-b45d-92217845e3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-9045517b-2a88-4176-b45d-92217845e3cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:48:16.091846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:48:16.093247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:48:16.094795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 605/1195] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:48:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:48:16.099243 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2df8a-f9dd-4477-8cac-9771ed882009 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:16.190787 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:16.203759 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2df8a-f9dd-4477-8cac-9771ed882009 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:16.240493 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce876aa-f341-48e8-8a5a-dacd3a7240ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:16.241265 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce876aa-f341-48e8-8a5a-dacd3a7240ba None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:16.241550 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce876aa-f341-48e8-8a5a-dacd3a7240ba None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:16.241900 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce876aa-f341-48e8-8a5a-dacd3a7240ba None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:16.242722 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce876aa-f341-48e8-8a5a-dacd3a7240ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:48:16.243038 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce876aa-f341-48e8-8a5a-dacd3a7240ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:16.244428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce876aa-f341-48e8-8a5a-dacd3a7240ba None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:16.254013 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 591/1196] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:48:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:16.260441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045517b-2a88-4176-b45d-92217845e3cf None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:16.366013 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045517b-2a88-4176-b45d-92217845e3cf None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:16.388493 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:16.400240 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fbabe-d3de-42ba-9883-51931d07528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:16.401161 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fbabe-d3de-42ba-9883-51931d07528e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:16.401384 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fbabe-d3de-42ba-9883-51931d07528e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:16.401662 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fbabe-d3de-42ba-9883-51931d07528e None admin] PATH_INFO: `/v3/users/0c61c36689484d838e7c97ce79d71105` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:16.402895 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fbabe-d3de-42ba-9883-51931d07528e None admin] RBAC: Authorizing `identity:get_user(user_id=0c61c36689484d838e7c97ce79d71105)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:16.404335 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fbabe-d3de-42ba-9883-51931d07528e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:16.405980 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 606/1197] 10.222.0.89 () {56 vars in 1177 bytes} [Thu May 19 20:48:16 2022] GET /identity/v3/users/0c61c36689484d838e7c97ce79d71105 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:16.411901 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce876aa-f341-48e8-8a5a-dacd3a7240ba None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:16.522188 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce876aa-f341-48e8-8a5a-dacd3a7240ba None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:16.554918 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622495b-a778-4360-8e91-5626ca9a86c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:16.556347 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622495b-a778-4360-8e91-5626ca9a86c7 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:16.556670 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622495b-a778-4360-8e91-5626ca9a86c7 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:16.556896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622495b-a778-4360-8e91-5626ca9a86c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:16.592503 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:16.642902 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622495b-a778-4360-8e91-5626ca9a86c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:16.644277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622495b-a778-4360-8e91-5626ca9a86c7 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:16.742577 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 592/1198] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:48:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:48:16.748818 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fbabe-d3de-42ba-9883-51931d07528e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:16.849049 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fbabe-d3de-42ba-9883-51931d07528e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:16.882860 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a8f48-3591-443a-89ec-a6459f114cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:16.883752 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8f48-3591-443a-89ec-a6459f114cf6 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:16.884041 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8f48-3591-443a-89ec-a6459f114cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:16.884323 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8f48-3591-443a-89ec-a6459f114cf6 None admin] PATH_INFO: `/v3/projects/0c9aa4a56670445da5f6e4c7792a32de` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:16.885521 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a8f48-3591-443a-89ec-a6459f114cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=0c9aa4a56670445da5f6e4c7792a32de)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:16.886988 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a8f48-3591-443a-89ec-a6459f114cf6 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:16.888709 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 607/1199] 10.222.0.89 () {56 vars in 1186 bytes} [Thu May 19 20:48:16 2022] GET /identity/v3/projects/0c9aa4a56670445da5f6e4c7792a32de => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:16.895186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622495b-a778-4360-8e91-5626ca9a86c7 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:48:16.947336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:16.999318 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622495b-a778-4360-8e91-5626ca9a86c7 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:48:17.033533 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ee29c-1ef8-407c-9b5e-7d2afcdd32cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:48:17.034184 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee29c-1ef8-407c-9b5e-7d2afcdd32cb None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:48:17.034466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee29c-1ef8-407c-9b5e-7d2afcdd32cb None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:48:17.034775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee29c-1ef8-407c-9b5e-7d2afcdd32cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:48:17.035604 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ee29c-1ef8-407c-9b5e-7d2afcdd32cb None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=0c9aa4a56670445da5f6e4c7792a32de, user.id=0c61c36689484d838e7c97ce79d71105) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:48:17.035917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ee29c-1ef8-407c-9b5e-7d2afcdd32cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:48:17.037343 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ee29c-1ef8-407c-9b5e-7d2afcdd32cb None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:48:17.043548 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 593/1200] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:48:16 2022] GET /identity/v3/role_assignments?user.id=0c61c36689484d838e7c97ce79d71105&scope.project.id=0c9aa4a56670445da5f6e4c7792a32de&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:48:26.878537 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=71 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:48:27.040594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=43 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:37.264863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fef53c-d375-4eac-b851-12f3ef576142 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:37.265818 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fef53c-d375-4eac-b851-12f3ef576142 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:37.265818 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fef53c-d375-4eac-b851-12f3ef576142 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:37.268859 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 608/1201] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:49:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:49:37.275206 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb45270-b5e5-4267-a651-9f196eaf2e87 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:37.276023 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb45270-b5e5-4267-a651-9f196eaf2e87 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:37.276023 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb45270-b5e5-4267-a651-9f196eaf2e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:37.295432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-3cb45270-b5e5-4267-a651-9f196eaf2e87 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:49:37.296866 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-3cb45270-b5e5-4267-a651-9f196eaf2e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:49:37.395252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 594/1202] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:49:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:49:37.435993 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fef53c-d375-4eac-b851-12f3ef576142 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:37.557704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fef53c-d375-4eac-b851-12f3ef576142 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:37.590885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20b37c-b6b2-4cd0-908e-ab182975f5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:37.591699 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b37c-b6b2-4cd0-908e-ab182975f5c0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:37.591976 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b37c-b6b2-4cd0-908e-ab182975f5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:37.592259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b37c-b6b2-4cd0-908e-ab182975f5c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:37.604257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20b37c-b6b2-4cd0-908e-ab182975f5c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:37.605794 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20b37c-b6b2-4cd0-908e-ab182975f5c0 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-1c20b37c-b6b2-4cd0-908e-ab182975f5c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:49:37.624407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:37.625766 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:37.627050 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:49:37.627050 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:49:37.627050 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:37.627050 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:49:37.627050 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 609/1203] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:49:37.632475 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb45270-b5e5-4267-a651-9f196eaf2e87 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:37.742043 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb45270-b5e5-4267-a651-9f196eaf2e87 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:37.776034 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:37.783497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ea5f2-51dc-42cc-862b-20d29ba45d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:37.788855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea5f2-51dc-42cc-862b-20d29ba45d63 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:37.788855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea5f2-51dc-42cc-862b-20d29ba45d63 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:37.788855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea5f2-51dc-42cc-862b-20d29ba45d63 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:37.788855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ea5f2-51dc-42cc-862b-20d29ba45d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:37.788855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ea5f2-51dc-42cc-862b-20d29ba45d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:37.788855 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ea5f2-51dc-42cc-862b-20d29ba45d63 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:37.800177 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 595/1204] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:37.808061 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20b37c-b6b2-4cd0-908e-ab182975f5c0 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:37.867764 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:37.919086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20b37c-b6b2-4cd0-908e-ab182975f5c0 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:37.957176 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba9f0e-b630-4d7b-adf5-81a5c691a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:37.957860 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba9f0e-b630-4d7b-adf5-81a5c691a2ae None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:37.958154 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba9f0e-b630-4d7b-adf5-81a5c691a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:37.958434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba9f0e-b630-4d7b-adf5-81a5c691a2ae None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:37.959829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba9f0e-b630-4d7b-adf5-81a5c691a2ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:37.961306 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba9f0e-b630-4d7b-adf5-81a5c691a2ae None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:38.049569 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 610/1205] 10.222.0.89 () {60 vars in 1132 bytes} [Thu May 19 20:49:37 2022] POST /identity/v3/users => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:49:40.413015 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145501-c9c0-44d1-8f8a-39c66cbd285e None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:40.413745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145501-c9c0-44d1-8f8a-39c66cbd285e None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:40.413745 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145501-c9c0-44d1-8f8a-39c66cbd285e None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:40.415318 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 596/1206] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:49:40.421879 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fd4b4-98d0-4b2c-ae35-1bccfda06cdc None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:40.429686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fd4b4-98d0-4b2c-ae35-1bccfda06cdc None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:40.429686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fd4b4-98d0-4b2c-ae35-1bccfda06cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:40.441151 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-955fd4b4-98d0-4b2c-ae35-1bccfda06cdc None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:49:40.442373 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-955fd4b4-98d0-4b2c-ae35-1bccfda06cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:49:40.526111 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 611/1207] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:49:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:49:40.556854 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6145501-c9c0-44d1-8f8a-39c66cbd285e None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:40.690311 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6145501-c9c0-44d1-8f8a-39c66cbd285e None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:40.728707 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39a59c-7fc7-4421-ab26-544283624f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:40.729515 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39a59c-7fc7-4421-ab26-544283624f93 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:40.729847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39a59c-7fc7-4421-ab26-544283624f93 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:40.730143 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39a59c-7fc7-4421-ab26-544283624f93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:40.741987 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39a59c-7fc7-4421-ab26-544283624f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-ae39a59c-7fc7-4421-ab26-544283624f93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:49:40.750011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:40.752309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:40.754708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 597/1208] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:49:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:40.760492 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fd4b4-98d0-4b2c-ae35-1bccfda06cdc None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:40.825920 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:40.889755 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fd4b4-98d0-4b2c-ae35-1bccfda06cdc None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:40.929522 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef98cc-4f66-4d66-86d6-d3dbcdc33a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:40.930321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef98cc-4f66-4d66-86d6-d3dbcdc33a91 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:40.930718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef98cc-4f66-4d66-86d6-d3dbcdc33a91 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:40.931070 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef98cc-4f66-4d66-86d6-d3dbcdc33a91 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:40.931890 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef98cc-4f66-4d66-86d6-d3dbcdc33a91 None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:40.932245 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef98cc-4f66-4d66-86d6-d3dbcdc33a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:40.933979 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef98cc-4f66-4d66-86d6-d3dbcdc33a91 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:40.944847 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 612/1209] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:49:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:40.950946 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39a59c-7fc7-4421-ab26-544283624f93 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:41.015775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:41.101755 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39a59c-7fc7-4421-ab26-544283624f93 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:41.161293 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05c189-3eaa-43a0-a1b9-9b5df879ec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:41.162621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c189-3eaa-43a0-a1b9-9b5df879ec14 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:41.163134 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c189-3eaa-43a0-a1b9-9b5df879ec14 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:41.163607 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c189-3eaa-43a0-a1b9-9b5df879ec14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:41.183033 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05c189-3eaa-43a0-a1b9-9b5df879ec14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:41.185868 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05c189-3eaa-43a0-a1b9-9b5df879ec14 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-3e05c189-3eaa-43a0-a1b9-9b5df879ec14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:49:41.219857 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:41.221008 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:41.222092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:49:41.222092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:49:41.222092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:41.222092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:41.222092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 598/1210] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:41.228530 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef98cc-4f66-4d66-86d6-d3dbcdc33a91 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:41.344795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:41.348273 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef98cc-4f66-4d66-86d6-d3dbcdc33a91 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:41.386791 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe445-8203-4583-93f5-f20da27c4c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:41.387547 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe445-8203-4583-93f5-f20da27c4c27 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:41.387829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe445-8203-4583-93f5-f20da27c4c27 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:41.388105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe445-8203-4583-93f5-f20da27c4c27 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:41.388850 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffe445-8203-4583-93f5-f20da27c4c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:41.389161 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffe445-8203-4583-93f5-f20da27c4c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:41.390544 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffe445-8203-4583-93f5-f20da27c4c27 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:41.404360 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 613/1211] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:49:41.413324 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05c189-3eaa-43a0-a1b9-9b5df879ec14 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:41.531891 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05c189-3eaa-43a0-a1b9-9b5df879ec14 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:41.533662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:41.572285 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2e632-dcd4-4882-90c1-edf26dbbe922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:41.573617 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2e632-dcd4-4882-90c1-edf26dbbe922 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:41.573972 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2e632-dcd4-4882-90c1-edf26dbbe922 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:41.574368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2e632-dcd4-4882-90c1-edf26dbbe922 None admin] PATH_INFO: `/v3/users/placement` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:41.583586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2e632-dcd4-4882-90c1-edf26dbbe922 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:41.585260 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2e632-dcd4-4882-90c1-edf26dbbe922 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-ebe2e632-dcd4-4882-90c1-edf26dbbe922 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:49:41.603435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:41.604771 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:41.606737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:41.606737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:41.606737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:49:41.606737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:49:41.606737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:49:41.606737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:49:41.606737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:49:41.606737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:49:41.606737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:49:41.606737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:41.606737 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 599/1212] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:41.611981 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe445-8203-4583-93f5-f20da27c4c27 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:41.745112 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe445-8203-4583-93f5-f20da27c4c27 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:41.783460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9e82a-3b3c-4a57-813b-fe792f75e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:41.784050 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9e82a-3b3c-4a57-813b-fe792f75e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:41.784336 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9e82a-3b3c-4a57-813b-fe792f75e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:41.784614 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9e82a-3b3c-4a57-813b-fe792f75e0e9 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:41.785469 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9e82a-3b3c-4a57-813b-fe792f75e0e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:41.785787 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9e82a-3b3c-4a57-813b-fe792f75e0e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:41.787844 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9e82a-3b3c-4a57-813b-fe792f75e0e9 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:41.807823 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 614/1213] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:49:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:41.814250 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2e632-dcd4-4882-90c1-edf26dbbe922 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:41.930968 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2e632-dcd4-4882-90c1-edf26dbbe922 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:41.975176 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c766-4d0e-4d99-99e1-f7fbe08004f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:41.975859 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c766-4d0e-4d99-99e1-f7fbe08004f5 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:41.976144 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c766-4d0e-4d99-99e1-f7fbe08004f5 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:41.976425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c766-4d0e-4d99-99e1-f7fbe08004f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:42.019919 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:42.072181 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c766-4d0e-4d99-99e1-f7fbe08004f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:42.073763 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c766-4d0e-4d99-99e1-f7fbe08004f5 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:42.210406 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 600/1214] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:49:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:49:42.216236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9e82a-3b3c-4a57-813b-fe792f75e0e9 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:42.238219 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:42.332724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9e82a-3b3c-4a57-813b-fe792f75e0e9 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:42.371341 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8205502-9e3e-43e8-83b3-4dc6f1f91064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:42.372154 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205502-9e3e-43e8-83b3-4dc6f1f91064 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:42.372441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205502-9e3e-43e8-83b3-4dc6f1f91064 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:42.372721 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205502-9e3e-43e8-83b3-4dc6f1f91064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:42.386778 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8205502-9e3e-43e8-83b3-4dc6f1f91064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:42.388333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8205502-9e3e-43e8-83b3-4dc6f1f91064 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-d8205502-9e3e-43e8-83b3-4dc6f1f91064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:49:42.409441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:42.411396 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:42.413577 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:49:42.413577 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:49:42.413577 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:42.413577 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:49:42.413577 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 615/1215] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:42.420479 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c766-4d0e-4d99-99e1-f7fbe08004f5 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:42.507859 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:42.556115 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c766-4d0e-4d99-99e1-f7fbe08004f5 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:42.607122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b321-e77b-4e7d-8e0b-e6754ecac424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:42.607122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b321-e77b-4e7d-8e0b-e6754ecac424 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:42.607122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b321-e77b-4e7d-8e0b-e6754ecac424 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:42.607122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b321-e77b-4e7d-8e0b-e6754ecac424 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:42.607854 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814b321-e77b-4e7d-8e0b-e6754ecac424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:42.607854 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814b321-e77b-4e7d-8e0b-e6754ecac424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:42.607854 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814b321-e77b-4e7d-8e0b-e6754ecac424 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:42.613510 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 601/1216] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:42.620815 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8205502-9e3e-43e8-83b3-4dc6f1f91064 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:42.718305 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:42.757763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8205502-9e3e-43e8-83b3-4dc6f1f91064 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:42.821704 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78402-4dcc-4c7c-bd30-407ceee1451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:42.823181 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78402-4dcc-4c7c-bd30-407ceee1451e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:42.823705 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78402-4dcc-4c7c-bd30-407ceee1451e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:42.824377 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78402-4dcc-4c7c-bd30-407ceee1451e None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:42.839294 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78402-4dcc-4c7c-bd30-407ceee1451e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:42.842180 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78402-4dcc-4c7c-bd30-407ceee1451e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-25d78402-4dcc-4c7c-bd30-407ceee1451e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:49:42.870694 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:42.872648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:42.875014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:49:42.875014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:49:42.875014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:49:42.875014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:49:42.875014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:49:42.875014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:49:42.875014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:49:42.875014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:49:42.875014 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 616/1217] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:49:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:42.880340 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b321-e77b-4e7d-8e0b-e6754ecac424 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:43.026107 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b321-e77b-4e7d-8e0b-e6754ecac424 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:43.059566 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:43.073117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ac7b4-3512-4146-94f3-f9ae071f6da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:43.075672 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ac7b4-3512-4146-94f3-f9ae071f6da3 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:43.075672 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ac7b4-3512-4146-94f3-f9ae071f6da3 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:43.075672 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ac7b4-3512-4146-94f3-f9ae071f6da3 None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:43.075672 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ac7b4-3512-4146-94f3-f9ae071f6da3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:43.075672 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ac7b4-3512-4146-94f3-f9ae071f6da3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:43.076993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ac7b4-3512-4146-94f3-f9ae071f6da3 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:43.092395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 602/1218] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:49:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:43.100752 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78402-4dcc-4c7c-bd30-407ceee1451e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:43.251983 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78402-4dcc-4c7c-bd30-407ceee1451e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:43.288218 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:43.294991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25811a55-3e98-4a72-aa5b-d5bd66e30ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:43.295671 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25811a55-3e98-4a72-aa5b-d5bd66e30ea5 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:43.295966 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25811a55-3e98-4a72-aa5b-d5bd66e30ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:43.296247 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25811a55-3e98-4a72-aa5b-d5bd66e30ea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:43.297108 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25811a55-3e98-4a72-aa5b-d5bd66e30ea5 None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=c082fa1f58db43e391d4da9fc32a767d) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:43.297429 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25811a55-3e98-4a72-aa5b-d5bd66e30ea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:43.298965 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25811a55-3e98-4a72-aa5b-d5bd66e30ea5 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:43.306143 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 617/1219] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:49:43 2022] GET /identity/v3/role_assignments?user.id=c082fa1f58db43e391d4da9fc32a767d&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:49:45.722060 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f096a-ff49-4936-b5e8-8fe6ea96b1e4 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:45.722726 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f096a-ff49-4936-b5e8-8fe6ea96b1e4 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:45.723215 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f096a-ff49-4936-b5e8-8fe6ea96b1e4 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:45.725971 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 603/1220] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:49:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:49:45.735856 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee26fcc-af3f-4e76-b2e4-32d3cebaf950 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:45.736639 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee26fcc-af3f-4e76-b2e4-32d3cebaf950 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:45.736804 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee26fcc-af3f-4e76-b2e4-32d3cebaf950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:45.758035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-cee26fcc-af3f-4e76-b2e4-32d3cebaf950 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:49:45.761651 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-cee26fcc-af3f-4e76-b2e4-32d3cebaf950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:49:45.861001 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 618/1221] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:49:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:49:45.885820 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f096a-ff49-4936-b5e8-8fe6ea96b1e4 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:46.023627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f096a-ff49-4936-b5e8-8fe6ea96b1e4 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:46.090426 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61b4fe-ecec-4b71-a1da-4a8f19ab02ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:46.091954 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61b4fe-ecec-4b71-a1da-4a8f19ab02ed None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:46.092465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61b4fe-ecec-4b71-a1da-4a8f19ab02ed None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:46.092974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61b4fe-ecec-4b71-a1da-4a8f19ab02ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:46.113106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61b4fe-ecec-4b71-a1da-4a8f19ab02ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-9d61b4fe-ecec-4b71-a1da-4a8f19ab02ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:49:46.129240 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:46.137391 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:46.139452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 604/1222] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:49:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:49:46.141103 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee26fcc-af3f-4e76-b2e4-32d3cebaf950 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:46.272559 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee26fcc-af3f-4e76-b2e4-32d3cebaf950 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:46.306389 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:46.319110 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdbc3a-cd8f-41a0-8ccf-d0ddad87b919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:46.320185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdbc3a-cd8f-41a0-8ccf-d0ddad87b919 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:46.320475 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdbc3a-cd8f-41a0-8ccf-d0ddad87b919 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:46.320755 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdbc3a-cd8f-41a0-8ccf-d0ddad87b919 None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:46.321546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdbc3a-cd8f-41a0-8ccf-d0ddad87b919 None admin] RBAC: Adding query filter params (name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:46.321862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdbc3a-cd8f-41a0-8ccf-d0ddad87b919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:46.323365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdbc3a-cd8f-41a0-8ccf-d0ddad87b919 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:46.334248 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 619/1223] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:49:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:46.340710 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61b4fe-ecec-4b71-a1da-4a8f19ab02ed None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:46.397987 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:46.477963 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61b4fe-ecec-4b71-a1da-4a8f19ab02ed None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:46.546698 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c885d-7100-426a-9b5a-fb4c5d00b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:46.548072 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c885d-7100-426a-9b5a-fb4c5d00b99d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:46.548545 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c885d-7100-426a-9b5a-fb4c5d00b99d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:46.549024 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c885d-7100-426a-9b5a-fb4c5d00b99d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:46.572682 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c885d-7100-426a-9b5a-fb4c5d00b99d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:46.575442 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c885d-7100-426a-9b5a-fb4c5d00b99d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-4b4c885d-7100-426a-9b5a-fb4c5d00b99d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:49:46.602458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:46.604221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:46.605544 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:49:46.605544 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:49:46.605544 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:46.605544 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:46.605544 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 605/1224] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:49:46.613721 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdbc3a-cd8f-41a0-8ccf-d0ddad87b919 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:46.799257 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdbc3a-cd8f-41a0-8ccf-d0ddad87b919 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:46.863752 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7c8ce-331c-4f86-8068-b2052c17adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:46.864945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c8ce-331c-4f86-8068-b2052c17adc4 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:46.865472 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c8ce-331c-4f86-8068-b2052c17adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:46.865969 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c8ce-331c-4f86-8068-b2052c17adc4 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:46.867418 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7c8ce-331c-4f86-8068-b2052c17adc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:46.867980 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7c8ce-331c-4f86-8068-b2052c17adc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:46.870637 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7c8ce-331c-4f86-8068-b2052c17adc4 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:46.894728 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 620/1225] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:46.904555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c885d-7100-426a-9b5a-fb4c5d00b99d None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:47.051112 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:47.062154 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c885d-7100-426a-9b5a-fb4c5d00b99d None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:47.132873 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978b01f-ca35-45f7-a99a-e1c7e994dfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:47.134130 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978b01f-ca35-45f7-a99a-e1c7e994dfe6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:47.134629 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978b01f-ca35-45f7-a99a-e1c7e994dfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:47.135111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978b01f-ca35-45f7-a99a-e1c7e994dfe6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:47.150277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978b01f-ca35-45f7-a99a-e1c7e994dfe6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:47.153230 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978b01f-ca35-45f7-a99a-e1c7e994dfe6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-e978b01f-ca35-45f7-a99a-e1c7e994dfe6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:49:47.184280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:47.186575 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:47.189625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:47.189625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:47.189625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:49:47.189625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:49:47.189625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:49:47.189625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:49:47.189625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:49:47.189625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:49:47.189625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:49:47.189625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:47.189625 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 606/1226] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:47.196166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7c8ce-331c-4f86-8068-b2052c17adc4 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:47.296173 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:47.367473 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7c8ce-331c-4f86-8068-b2052c17adc4 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:47.408154 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c00bd-3f28-45c0-833b-a78760fa72b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:47.408782 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c00bd-3f28-45c0-833b-a78760fa72b1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:47.409071 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c00bd-3f28-45c0-833b-a78760fa72b1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:47.409350 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c00bd-3f28-45c0-833b-a78760fa72b1 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:47.410222 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c00bd-3f28-45c0-833b-a78760fa72b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:47.410540 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c00bd-3f28-45c0-833b-a78760fa72b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:47.412768 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c00bd-3f28-45c0-833b-a78760fa72b1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:47.447125 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 621/1227] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:49:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:47.452395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978b01f-ca35-45f7-a99a-e1c7e994dfe6 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:47.580494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978b01f-ca35-45f7-a99a-e1c7e994dfe6 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:47.626502 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09948120-3b78-4c58-8939-683a7ffebf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:47.627363 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09948120-3b78-4c58-8939-683a7ffebf10 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:47.627648 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09948120-3b78-4c58-8939-683a7ffebf10 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:47.627926 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09948120-3b78-4c58-8939-683a7ffebf10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:47.640263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09948120-3b78-4c58-8939-683a7ffebf10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:47.642854 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09948120-3b78-4c58-8939-683a7ffebf10 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-09948120-3b78-4c58-8939-683a7ffebf10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:49:47.666241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:47.668495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:47.670778 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:49:47.670778 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:49:47.670778 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:47.670778 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:47.670778 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 607/1228] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:49:47.671407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c00bd-3f28-45c0-833b-a78760fa72b1 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:47.822919 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c00bd-3f28-45c0-833b-a78760fa72b1 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:47.825810 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:47.861419 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5ae5e-3aa0-4096-8213-d61e23c6e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:47.862099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5ae5e-3aa0-4096-8213-d61e23c6e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:47.862386 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5ae5e-3aa0-4096-8213-d61e23c6e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:47.862687 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5ae5e-3aa0-4096-8213-d61e23c6e9c7 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:47.863428 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5ae5e-3aa0-4096-8213-d61e23c6e9c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:47.863738 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5ae5e-3aa0-4096-8213-d61e23c6e9c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:47.865703 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5ae5e-3aa0-4096-8213-d61e23c6e9c7 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:47.879166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 622/1229] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:47.885258 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09948120-3b78-4c58-8939-683a7ffebf10 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:47.895091 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:48.003990 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09948120-3b78-4c58-8939-683a7ffebf10 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:48.055666 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f49cf2-8eda-4a9c-9823-67e9c1df3d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:48.056590 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49cf2-8eda-4a9c-9823-67e9c1df3d83 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:48.056934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49cf2-8eda-4a9c-9823-67e9c1df3d83 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:48.057269 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f49cf2-8eda-4a9c-9823-67e9c1df3d83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:48.066420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f49cf2-8eda-4a9c-9823-67e9c1df3d83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:48.068148 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f49cf2-8eda-4a9c-9823-67e9c1df3d83 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-a1f49cf2-8eda-4a9c-9823-67e9c1df3d83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:49:48.085395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:48.087974 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:48.090376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:49:48.090376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:49:48.090376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:49:48.090376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:49:48.090376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:49:48.090376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:49:48.090376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:49:48.090376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:48.090376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 608/1230] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:49:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:48.093644 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5ae5e-3aa0-4096-8213-d61e23c6e9c7 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:48.238210 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5ae5e-3aa0-4096-8213-d61e23c6e9c7 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:48.283821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841c4b5-c5b4-46cc-86aa-232a3b9120e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:48.284917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841c4b5-c5b4-46cc-86aa-232a3b9120e7 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:48.285422 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841c4b5-c5b4-46cc-86aa-232a3b9120e7 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:48.285917 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841c4b5-c5b4-46cc-86aa-232a3b9120e7 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:48.288133 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841c4b5-c5b4-46cc-86aa-232a3b9120e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:48.288720 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841c4b5-c5b4-46cc-86aa-232a3b9120e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:48.291542 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841c4b5-c5b4-46cc-86aa-232a3b9120e7 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:48.321275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 623/1231] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:49:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:48.322895 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f49cf2-8eda-4a9c-9823-67e9c1df3d83 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:48.410441 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:48.452795 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f49cf2-8eda-4a9c-9823-67e9c1df3d83 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:48.489106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527f5fc-c080-434c-9e04-ec456f11459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:48.490082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f5fc-c080-434c-9e04-ec456f11459b None admin] REQUEST_METHOD: `PUT` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:48.490362 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f5fc-c080-434c-9e04-ec456f11459b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:48.490670 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f5fc-c080-434c-9e04-ec456f11459b None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/c082fa1f58db43e391d4da9fc32a767d/roles/df1609ea031d4414971c13ff878a13e2` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:48.507580 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527f5fc-c080-434c-9e04-ec456f11459b None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=c082fa1f58db43e391d4da9fc32a767d, role_id=df1609ea031d4414971c13ff878a13e2)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:48.509074 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527f5fc-c080-434c-9e04-ec456f11459b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:48.585065 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 609/1232] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:49:48 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/c082fa1f58db43e391d4da9fc32a767d/roles/df1609ea031d4414971c13ff878a13e2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:49:50.906736 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e850b-eeca-48af-aff8-f073c08b64b5 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:50.907542 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e850b-eeca-48af-aff8-f073c08b64b5 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:50.907542 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e850b-eeca-48af-aff8-f073c08b64b5 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:50.908721 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 624/1233] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:49:50.917741 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66123c72-df5f-4fcb-bab9-a449a22977c4 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:50.919337 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66123c72-df5f-4fcb-bab9-a449a22977c4 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:50.919337 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66123c72-df5f-4fcb-bab9-a449a22977c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:50.948299 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-66123c72-df5f-4fcb-bab9-a449a22977c4 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:49:50.950435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-66123c72-df5f-4fcb-bab9-a449a22977c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:49:51.051270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 610/1234] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:49:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:49:51.076036 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e850b-eeca-48af-aff8-f073c08b64b5 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:51.104364 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:51.193082 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e850b-eeca-48af-aff8-f073c08b64b5 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:51.240224 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e5cff-6247-4049-a399-50c4641100f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:51.241057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e5cff-6247-4049-a399-50c4641100f2 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:51.241347 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e5cff-6247-4049-a399-50c4641100f2 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:51.241629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e5cff-6247-4049-a399-50c4641100f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:51.255224 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e5cff-6247-4049-a399-50c4641100f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-bb5e5cff-6247-4049-a399-50c4641100f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:49:51.264932 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:51.267564 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:49:51.269829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 625/1235] 10.222.0.89 () {56 vars in 1102 bytes} [Thu May 19 20:49:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:51.275929 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66123c72-df5f-4fcb-bab9-a449a22977c4 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:51.372167 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:51.450219 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66123c72-df5f-4fcb-bab9-a449a22977c4 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:51.491280 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075cfef-2efc-47f3-a9ac-69db62bae2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:51.492049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075cfef-2efc-47f3-a9ac-69db62bae2c5 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:51.492361 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075cfef-2efc-47f3-a9ac-69db62bae2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:51.492636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075cfef-2efc-47f3-a9ac-69db62bae2c5 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:51.493400 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075cfef-2efc-47f3-a9ac-69db62bae2c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:51.493705 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075cfef-2efc-47f3-a9ac-69db62bae2c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:51.495122 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075cfef-2efc-47f3-a9ac-69db62bae2c5 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:51.504000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 611/1236] 10.222.0.89 () {56 vars in 1103 bytes} [Thu May 19 20:49:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:51.510834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e5cff-6247-4049-a399-50c4641100f2 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:51.624365 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:51.653900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e5cff-6247-4049-a399-50c4641100f2 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:51.702007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69d9ad-8d1f-487a-8029-2b273abce1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:51.703358 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69d9ad-8d1f-487a-8029-2b273abce1cc None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:51.703831 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69d9ad-8d1f-487a-8029-2b273abce1cc None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:51.704118 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69d9ad-8d1f-487a-8029-2b273abce1cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:51.724894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69d9ad-8d1f-487a-8029-2b273abce1cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:51.727951 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69d9ad-8d1f-487a-8029-2b273abce1cc None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-3a69d9ad-8d1f-487a-8029-2b273abce1cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:49:51.748763 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:51.751095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:51.753571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:49:51.753571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:49:51.753571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:51.753571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:49:51.753571 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 626/1237] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:49:51.759084 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075cfef-2efc-47f3-a9ac-69db62bae2c5 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:51.876843 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075cfef-2efc-47f3-a9ac-69db62bae2c5 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:51.887645 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:51.916665 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e6bcc-0b96-42a3-9e0b-04e59d7adc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:51.917348 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6bcc-0b96-42a3-9e0b-04e59d7adc79 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:51.917635 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6bcc-0b96-42a3-9e0b-04e59d7adc79 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:51.917915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6bcc-0b96-42a3-9e0b-04e59d7adc79 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:51.918757 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e6bcc-0b96-42a3-9e0b-04e59d7adc79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:51.919243 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e6bcc-0b96-42a3-9e0b-04e59d7adc79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:51.920660 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e6bcc-0b96-42a3-9e0b-04e59d7adc79 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:51.934143 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 612/1238] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:51.942753 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69d9ad-8d1f-487a-8029-2b273abce1cc None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:52.059652 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69d9ad-8d1f-487a-8029-2b273abce1cc None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:52.102111 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f507e-34c9-4097-baa2-bb1ae0001a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:52.102972 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f507e-34c9-4097-baa2-bb1ae0001a2f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:52.103256 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f507e-34c9-4097-baa2-bb1ae0001a2f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:52.103532 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f507e-34c9-4097-baa2-bb1ae0001a2f None admin] PATH_INFO: `/v3/users/placement` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:52.106992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:52.113012 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f507e-34c9-4097-baa2-bb1ae0001a2f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:52.124487 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f507e-34c9-4097-baa2-bb1ae0001a2f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-ff7f507e-34c9-4097-baa2-bb1ae0001a2f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:49:52.130700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:52.133190 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:52.135465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:52.135465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:52.135465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:49:52.135465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:49:52.135465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:49:52.135465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:49:52.135465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:49:52.135465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:49:52.135465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:49:52.135465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:49:52.135465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 627/1239] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:52.139174 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e6bcc-0b96-42a3-9e0b-04e59d7adc79 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:52.262131 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e6bcc-0b96-42a3-9e0b-04e59d7adc79 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:52.305095 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324792c-20b8-40cf-a743-8eacfdf059ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:52.305678 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324792c-20b8-40cf-a743-8eacfdf059ac None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:52.305959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324792c-20b8-40cf-a743-8eacfdf059ac None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:52.306235 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324792c-20b8-40cf-a743-8eacfdf059ac None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:52.307129 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324792c-20b8-40cf-a743-8eacfdf059ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:52.307439 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324792c-20b8-40cf-a743-8eacfdf059ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:52.308897 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324792c-20b8-40cf-a743-8eacfdf059ac None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:52.329328 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 613/1240] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:49:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:49:52.339663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f507e-34c9-4097-baa2-bb1ae0001a2f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:52.484997 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f507e-34c9-4097-baa2-bb1ae0001a2f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:52.548972 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819483c-4abb-4839-9f07-b2185469e74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:52.550053 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819483c-4abb-4839-9f07-b2185469e74a None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:52.550526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819483c-4abb-4839-9f07-b2185469e74a None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:52.551043 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819483c-4abb-4839-9f07-b2185469e74a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:52.668346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:52.681312 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819483c-4abb-4839-9f07-b2185469e74a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:52.684206 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819483c-4abb-4839-9f07-b2185469e74a None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:52.863282 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 628/1241] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:49:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:49:52.869669 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324792c-20b8-40cf-a743-8eacfdf059ac None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:52.900652 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:52.982990 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324792c-20b8-40cf-a743-8eacfdf059ac None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:53.026226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc3c1-ae9e-4ff4-8d58-a06e9bd30930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:53.027690 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc3c1-ae9e-4ff4-8d58-a06e9bd30930 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:53.028183 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc3c1-ae9e-4ff4-8d58-a06e9bd30930 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:53.028658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc3c1-ae9e-4ff4-8d58-a06e9bd30930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:53.049082 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc3c1-ae9e-4ff4-8d58-a06e9bd30930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:53.051989 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc3c1-ae9e-4ff4-8d58-a06e9bd30930 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-dbffc3c1-ae9e-4ff4-8d58-a06e9bd30930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:49:53.086288 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:53.088274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:53.090092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:49:53.090092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:49:53.090092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:53.090092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:53.090092 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 614/1242] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:53.095338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819483c-4abb-4839-9f07-b2185469e74a None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:53.210841 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:53.217370 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819483c-4abb-4839-9f07-b2185469e74a None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:53.254474 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749d6f6-9cb6-4c44-9e6f-695733a329c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:53.255099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d6f6-9cb6-4c44-9e6f-695733a329c8 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:53.255928 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d6f6-9cb6-4c44-9e6f-695733a329c8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:53.256209 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d6f6-9cb6-4c44-9e6f-695733a329c8 None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:53.256950 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749d6f6-9cb6-4c44-9e6f-695733a329c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:53.257263 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749d6f6-9cb6-4c44-9e6f-695733a329c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:53.258781 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749d6f6-9cb6-4c44-9e6f-695733a329c8 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:53.272595 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 629/1243] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:53.279208 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc3c1-ae9e-4ff4-8d58-a06e9bd30930 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:53.368338 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:53.394856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc3c1-ae9e-4ff4-8d58-a06e9bd30930 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:53.435592 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2aa7-1d1b-4ce9-8f4f-ebbd64c45e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:53.436417 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2aa7-1d1b-4ce9-8f4f-ebbd64c45e1d None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:53.436707 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2aa7-1d1b-4ce9-8f4f-ebbd64c45e1d None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:53.437250 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2aa7-1d1b-4ce9-8f4f-ebbd64c45e1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:53.445520 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b2aa7-1d1b-4ce9-8f4f-ebbd64c45e1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:53.447550 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b2aa7-1d1b-4ce9-8f4f-ebbd64c45e1d None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-4b2b2aa7-1d1b-4ce9-8f4f-ebbd64c45e1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:49:53.462101 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:53.464005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:53.466068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:49:53.466068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:49:53.466068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:49:53.466068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:49:53.466068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:49:53.466068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:49:53.466068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:49:53.466068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:53.466068 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 615/1244] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:49:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:49:53.471166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749d6f6-9cb6-4c44-9e6f-695733a329c8 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:53.587542 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749d6f6-9cb6-4c44-9e6f-695733a329c8 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:53.629624 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec98d58-b590-49a2-9967-ae3acf425c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:53.631046 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec98d58-b590-49a2-9967-ae3acf425c27 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:53.631445 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec98d58-b590-49a2-9967-ae3acf425c27 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:53.631825 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec98d58-b590-49a2-9967-ae3acf425c27 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:53.632741 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec98d58-b590-49a2-9967-ae3acf425c27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:53.633165 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec98d58-b590-49a2-9967-ae3acf425c27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:53.634774 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec98d58-b590-49a2-9967-ae3acf425c27 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:53.649928 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 630/1245] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:49:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:53.660670 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2aa7-1d1b-4ce9-8f4f-ebbd64c45e1d None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:53.844021 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2aa7-1d1b-4ce9-8f4f-ebbd64c45e1d None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:53.898088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad3c83-47ca-406c-be12-54cf8f0f45b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:53.898877 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad3c83-47ca-406c-be12-54cf8f0f45b6 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:53.899215 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad3c83-47ca-406c-be12-54cf8f0f45b6 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:53.899538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad3c83-47ca-406c-be12-54cf8f0f45b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:53.900470 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad3c83-47ca-406c-be12-54cf8f0f45b6 None admin] RBAC: Adding query filter params (role.id=df1609ea031d4414971c13ff878a13e2, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=c082fa1f58db43e391d4da9fc32a767d) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:53.900830 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad3c83-47ca-406c-be12-54cf8f0f45b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:53.902413 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad3c83-47ca-406c-be12-54cf8f0f45b6 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:53.909934 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 616/1246] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:49:53 2022] GET /identity/v3/role_assignments?user.id=c082fa1f58db43e391d4da9fc32a767d&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=df1609ea031d4414971c13ff878a13e2 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:49:56.289592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eccd8-74f9-4d72-afdd-b7347e9b36ee None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:56.290179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eccd8-74f9-4d72-afdd-b7347e9b36ee None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:56.290295 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eccd8-74f9-4d72-afdd-b7347e9b36ee None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:56.291844 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 631/1247] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:49:56.297864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2498f1d-aaa5-449a-8f39-373fa806ddd8 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:56.298389 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2498f1d-aaa5-449a-8f39-373fa806ddd8 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:56.298500 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2498f1d-aaa5-449a-8f39-373fa806ddd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:56.304318 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:56.317596 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-c2498f1d-aaa5-449a-8f39-373fa806ddd8 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:49:56.319485 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-c2498f1d-aaa5-449a-8f39-373fa806ddd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:49:56.391117 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 617/1248] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:49:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:49:56.434378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eccd8-74f9-4d72-afdd-b7347e9b36ee None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:56.458991 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:56.556949 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eccd8-74f9-4d72-afdd-b7347e9b36ee None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:56.596367 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c6959-5bad-4735-b926-53a336f82155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:56.597201 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c6959-5bad-4735-b926-53a336f82155 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:56.597486 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c6959-5bad-4735-b926-53a336f82155 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:56.597758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c6959-5bad-4735-b926-53a336f82155 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:56.609913 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c6959-5bad-4735-b926-53a336f82155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-400c6959-5bad-4735-b926-53a336f82155 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:49:56.619959 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:56.621865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:49:56.623514 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 632/1249] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:49:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:56.628703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2498f1d-aaa5-449a-8f39-373fa806ddd8 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:56.737453 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2498f1d-aaa5-449a-8f39-373fa806ddd8 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:56.771174 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:56.776442 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48346b69-4927-4745-a842-e895ffaf7d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:56.780471 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48346b69-4927-4745-a842-e895ffaf7d03 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:56.780471 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48346b69-4927-4745-a842-e895ffaf7d03 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:56.780471 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48346b69-4927-4745-a842-e895ffaf7d03 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:56.780471 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48346b69-4927-4745-a842-e895ffaf7d03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:56.780471 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48346b69-4927-4745-a842-e895ffaf7d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:56.780471 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48346b69-4927-4745-a842-e895ffaf7d03 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:56.789777 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 618/1250] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:49:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:56.795831 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c6959-5bad-4735-b926-53a336f82155 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:56.890790 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:56.917375 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c6959-5bad-4735-b926-53a336f82155 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:56.956654 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4847e-647f-4f1c-b4d5-010162d83531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:56.957461 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4847e-647f-4f1c-b4d5-010162d83531 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:56.957746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4847e-647f-4f1c-b4d5-010162d83531 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:56.958025 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4847e-647f-4f1c-b4d5-010162d83531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:56.969971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4847e-647f-4f1c-b4d5-010162d83531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:56.971499 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4847e-647f-4f1c-b4d5-010162d83531 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-3ec4847e-647f-4f1c-b4d5-010162d83531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:49:56.991351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:56.994354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:56.995795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:49:56.995795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:49:56.995795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:56.995795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:49:56.995795 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 633/1251] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:56.998677 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48346b69-4927-4745-a842-e895ffaf7d03 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:57.104594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48346b69-4927-4745-a842-e895ffaf7d03 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:57.139638 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a826-6f9b-460b-ac18-2645d9c71fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:57.140309 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a826-6f9b-460b-ac18-2645d9c71fb0 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:57.140608 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a826-6f9b-460b-ac18-2645d9c71fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:57.140937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a826-6f9b-460b-ac18-2645d9c71fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:57.141608 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a826-6f9b-460b-ac18-2645d9c71fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:57.141910 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a826-6f9b-460b-ac18-2645d9c71fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:57.143310 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a826-6f9b-460b-ac18-2645d9c71fb0 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:57.156194 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 619/1252] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:57.163421 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4847e-647f-4f1c-b4d5-010162d83531 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:57.270310 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4847e-647f-4f1c-b4d5-010162d83531 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:57.300221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:57.308780 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba871-5d30-4d4f-9b27-06aa456f46ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:57.309662 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba871-5d30-4d4f-9b27-06aa456f46ac None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:57.309945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba871-5d30-4d4f-9b27-06aa456f46ac None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:57.310225 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba871-5d30-4d4f-9b27-06aa456f46ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:57.318863 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fba871-5d30-4d4f-9b27-06aa456f46ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:57.320338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fba871-5d30-4d4f-9b27-06aa456f46ac None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-e7fba871-5d30-4d4f-9b27-06aa456f46ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:49:57.336150 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:57.337452 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:57.338592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:57.338592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:57.338592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:49:57.338592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:49:57.338592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:49:57.338592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:49:57.338592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:49:57.338592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:49:57.338592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:49:57.338592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:49:57.338592 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 634/1253] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:57.343502 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a826-6f9b-460b-ac18-2645d9c71fb0 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:57.412769 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:57.461469 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a826-6f9b-460b-ac18-2645d9c71fb0 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:57.499312 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e1d4a-1f0f-405f-9969-3f6c7e53606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:57.500056 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1d4a-1f0f-405f-9969-3f6c7e53606b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:57.500411 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1d4a-1f0f-405f-9969-3f6c7e53606b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:57.500736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1d4a-1f0f-405f-9969-3f6c7e53606b None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:57.501636 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e1d4a-1f0f-405f-9969-3f6c7e53606b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:57.501994 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e1d4a-1f0f-405f-9969-3f6c7e53606b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:57.503506 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e1d4a-1f0f-405f-9969-3f6c7e53606b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:57.523302 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 620/1254] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:49:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:49:57.529525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba871-5d30-4d4f-9b27-06aa456f46ac None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:57.645629 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba871-5d30-4d4f-9b27-06aa456f46ac None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:57.684738 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b3fd0-14e1-4cc2-83f2-b639ad123ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:57.685275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b3fd0-14e1-4cc2-83f2-b639ad123ff8 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:57.685556 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b3fd0-14e1-4cc2-83f2-b639ad123ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:57.685833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b3fd0-14e1-4cc2-83f2-b639ad123ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:57.751674 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:57.765764 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b3fd0-14e1-4cc2-83f2-b639ad123ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:57.767361 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b3fd0-14e1-4cc2-83f2-b639ad123ff8 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:57.883649 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 635/1255] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:49:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:49:57.890264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e1d4a-1f0f-405f-9969-3f6c7e53606b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:58.004401 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e1d4a-1f0f-405f-9969-3f6c7e53606b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:58.018728 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:58.043339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a17559-e6d7-48a5-895a-e8043a43d9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:58.044694 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a17559-e6d7-48a5-895a-e8043a43d9ca None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:58.044694 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a17559-e6d7-48a5-895a-e8043a43d9ca None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:58.044694 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a17559-e6d7-48a5-895a-e8043a43d9ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:58.056116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a17559-e6d7-48a5-895a-e8043a43d9ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:58.057579 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a17559-e6d7-48a5-895a-e8043a43d9ca None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-c8a17559-e6d7-48a5-895a-e8043a43d9ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:49:58.076425 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:58.081336 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:58.083924 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:49:58.083924 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:49:58.083924 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:49:58.083924 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:58.083924 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 621/1256] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:49:58.085463 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b3fd0-14e1-4cc2-83f2-b639ad123ff8 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:58.183940 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:58.197424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b3fd0-14e1-4cc2-83f2-b639ad123ff8 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:58.237554 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626c9ee-6a4b-4d7a-8ded-f454e28076de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:58.238376 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626c9ee-6a4b-4d7a-8ded-f454e28076de None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:58.238748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626c9ee-6a4b-4d7a-8ded-f454e28076de None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:58.239067 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626c9ee-6a4b-4d7a-8ded-f454e28076de None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:58.239888 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626c9ee-6a4b-4d7a-8ded-f454e28076de None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:58.240245 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626c9ee-6a4b-4d7a-8ded-f454e28076de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:58.241733 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626c9ee-6a4b-4d7a-8ded-f454e28076de None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:58.255670 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 636/1257] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:49:58.262274 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a17559-e6d7-48a5-895a-e8043a43d9ca None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:58.370896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a17559-e6d7-48a5-895a-e8043a43d9ca None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:58.411973 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4b32c-e8d5-40b3-bac7-4c400c99ae1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:58.412905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b32c-e8d5-40b3-bac7-4c400c99ae1a None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:58.413227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b32c-e8d5-40b3-bac7-4c400c99ae1a None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:58.413548 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b32c-e8d5-40b3-bac7-4c400c99ae1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:58.421668 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4b32c-e8d5-40b3-bac7-4c400c99ae1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:58.423482 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4b32c-e8d5-40b3-bac7-4c400c99ae1a None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-1db4b32c-e8d5-40b3-bac7-4c400c99ae1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:49:58.438962 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:49:58.441339 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:49:58.444096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:49:58.444096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:49:58.444096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:49:58.444096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:49:58.444096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:49:58.444096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:49:58.444096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:49:58.444096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:49:58.444096 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 622/1258] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:49:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:49:58.447508 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626c9ee-6a4b-4d7a-8ded-f454e28076de None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:58.557558 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626c9ee-6a4b-4d7a-8ded-f454e28076de None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:58.595250 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a014f-01f4-44db-b042-477c8b25f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:58.595938 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a014f-01f4-44db-b042-477c8b25f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:58.596221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a014f-01f4-44db-b042-477c8b25f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:58.596549 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a014f-01f4-44db-b042-477c8b25f6e1 None admin] PATH_INFO: `/v3/projects` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:58.597370 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a014f-01f4-44db-b042-477c8b25f6e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:58.597681 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a014f-01f4-44db-b042-477c8b25f6e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:58.599223 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a014f-01f4-44db-b042-477c8b25f6e1 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:58.613512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 637/1259] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:49:58.620369 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4b32c-e8d5-40b3-bac7-4c400c99ae1a None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:49:58.648767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:49:58.730410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4b32c-e8d5-40b3-bac7-4c400c99ae1a None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:49:58.766381 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c318f-ac8b-4a26-99b5-5799b74f4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:49:58.767476 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c318f-ac8b-4a26-99b5-5799b74f4754 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:49:58.767963 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c318f-ac8b-4a26-99b5-5799b74f4754 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:49:58.768428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c318f-ac8b-4a26-99b5-5799b74f4754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:49:58.769895 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c318f-ac8b-4a26-99b5-5799b74f4754 None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=c082fa1f58db43e391d4da9fc32a767d) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:49:58.770441 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c318f-ac8b-4a26-99b5-5799b74f4754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:49:58.773847 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c318f-ac8b-4a26-99b5-5799b74f4754 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:49:58.782533 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 623/1260] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:49:58 2022] GET /identity/v3/role_assignments?user.id=c082fa1f58db43e391d4da9fc32a767d&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:50:01.119007 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0adb-1e7d-468c-b747-88518566e165 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:01.119674 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0adb-1e7d-468c-b747-88518566e165 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:01.119674 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0adb-1e7d-468c-b747-88518566e165 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:01.121484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 638/1261] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:50:01.128394 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6860d5-319a-4026-9d78-3711ad79395d None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:01.129186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6860d5-319a-4026-9d78-3711ad79395d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:01.129186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6860d5-319a-4026-9d78-3711ad79395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:01.148940 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-4f6860d5-319a-4026-9d78-3711ad79395d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:50:01.150198 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-4f6860d5-319a-4026-9d78-3711ad79395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:50:01.234954 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 624/1262] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:50:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:50:01.259960 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd0adb-1e7d-468c-b747-88518566e165 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:01.273286 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:01.389161 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd0adb-1e7d-468c-b747-88518566e165 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:01.428154 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11de666-f824-4958-abe4-8d7550f83693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:01.428964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11de666-f824-4958-abe4-8d7550f83693 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:01.429242 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11de666-f824-4958-abe4-8d7550f83693 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:01.429531 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11de666-f824-4958-abe4-8d7550f83693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:01.442092 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11de666-f824-4958-abe4-8d7550f83693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-c11de666-f824-4958-abe4-8d7550f83693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:50:01.451187 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:01.452945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:50:01.454872 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 639/1263] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:50:01.459368 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6860d5-319a-4026-9d78-3711ad79395d None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:01.480136 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:01.580526 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6860d5-319a-4026-9d78-3711ad79395d None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:01.618064 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c8f98-a17f-4867-a4e9-98f062de4273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:01.618781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c8f98-a17f-4867-a4e9-98f062de4273 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:01.619070 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c8f98-a17f-4867-a4e9-98f062de4273 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:01.619347 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c8f98-a17f-4867-a4e9-98f062de4273 None admin] PATH_INFO: `/v3/roles` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:01.620115 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c8f98-a17f-4867-a4e9-98f062de4273 None admin] RBAC: Adding query filter params (name=admin) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:01.620426 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c8f98-a17f-4867-a4e9-98f062de4273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:01.621829 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c8f98-a17f-4867-a4e9-98f062de4273 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:01.631747 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 625/1264] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:50:01.638743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11de666-f824-4958-abe4-8d7550f83693 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:01.711635 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:01.748773 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11de666-f824-4958-abe4-8d7550f83693 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:01.786543 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a9587-df66-4a1e-a989-a948271a585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:01.787434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a9587-df66-4a1e-a989-a948271a585c None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:01.787770 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a9587-df66-4a1e-a989-a948271a585c None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:01.788104 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a9587-df66-4a1e-a989-a948271a585c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:01.800390 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a9587-df66-4a1e-a989-a948271a585c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:01.802464 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a9587-df66-4a1e-a989-a948271a585c None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-2e8a9587-df66-4a1e-a989-a948271a585c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:50:01.823579 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:01.826828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:01.828958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:50:01.828958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:50:01.828958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:50:01.828958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:50:01.828958 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 640/1265] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:50:01.831819 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c8f98-a17f-4867-a4e9-98f062de4273 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:01.931494 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:01.953953 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c8f98-a17f-4867-a4e9-98f062de4273 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:01.994177 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ea6b2-7d4b-4499-aeb0-d8fd1360d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:01.994810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ea6b2-7d4b-4499-aeb0-d8fd1360d8d1 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:01.995088 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ea6b2-7d4b-4499-aeb0-d8fd1360d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:01.995373 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ea6b2-7d4b-4499-aeb0-d8fd1360d8d1 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:01.996120 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ea6b2-7d4b-4499-aeb0-d8fd1360d8d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:01.996437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ea6b2-7d4b-4499-aeb0-d8fd1360d8d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:01.997843 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ea6b2-7d4b-4499-aeb0-d8fd1360d8d1 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:02.012521 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 626/1266] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:50:02.019493 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a9587-df66-4a1e-a989-a948271a585c None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:02.195370 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a9587-df66-4a1e-a989-a948271a585c None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:02.217693 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:02.235271 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd40d4-10f2-42e8-bc32-2ff812a0f906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:02.236175 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd40d4-10f2-42e8-bc32-2ff812a0f906 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:02.236500 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd40d4-10f2-42e8-bc32-2ff812a0f906 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:02.236821 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd40d4-10f2-42e8-bc32-2ff812a0f906 None admin] PATH_INFO: `/v3/users/placement` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:02.246510 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd40d4-10f2-42e8-bc32-2ff812a0f906 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:02.248053 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd40d4-10f2-42e8-bc32-2ff812a0f906 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-50dd40d4-10f2-42e8-bc32-2ff812a0f906 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:50:02.265166 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:02.267342 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:02.269424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:02.269424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:02.269424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:50:02.269424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:50:02.269424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:50:02.269424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:50:02.269424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:50:02.269424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:50:02.269424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:50:02.269424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:50:02.269424 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 641/1267] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:50:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:50:02.275247 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ea6b2-7d4b-4499-aeb0-d8fd1360d8d1 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:02.411856 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ea6b2-7d4b-4499-aeb0-d8fd1360d8d1 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:02.450265 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb94e9-d8b3-450d-ba77-1a0fdbae2b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:02.450552 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb94e9-d8b3-450d-ba77-1a0fdbae2b16 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:02.451390 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb94e9-d8b3-450d-ba77-1a0fdbae2b16 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:02.451390 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb94e9-d8b3-450d-ba77-1a0fdbae2b16 None admin] PATH_INFO: `/v3/users` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:02.452174 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb94e9-d8b3-450d-ba77-1a0fdbae2b16 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:02.452493 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb94e9-d8b3-450d-ba77-1a0fdbae2b16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:02.453975 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb94e9-d8b3-450d-ba77-1a0fdbae2b16 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:02.466111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:02.476249 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 627/1268] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:50:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:50:02.484964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd40d4-10f2-42e8-bc32-2ff812a0f906 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:02.663453 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd40d4-10f2-42e8-bc32-2ff812a0f906 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:02.719319 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222aee4-b204-4680-b17c-e4b01ae1cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:02.720297 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222aee4-b204-4680-b17c-e4b01ae1cd6e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:02.720587 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222aee4-b204-4680-b17c-e4b01ae1cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:02.720868 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222aee4-b204-4680-b17c-e4b01ae1cd6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:02.732944 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222aee4-b204-4680-b17c-e4b01ae1cd6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:02.740082 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222aee4-b204-4680-b17c-e4b01ae1cd6e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-1222aee4-b204-4680-b17c-e4b01ae1cd6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:50:02.753096 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:02.755594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:02.757439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:50:02.757439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:50:02.757439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:50:02.757439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:50:02.757439 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 642/1269] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:50:02.761022 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb94e9-d8b3-450d-ba77-1a0fdbae2b16 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:02.868592 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb94e9-d8b3-450d-ba77-1a0fdbae2b16 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:02.910196 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ab56-86dd-465e-ad80-a3828654d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:02.910897 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ab56-86dd-465e-ad80-a3828654d88b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:02.911210 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ab56-86dd-465e-ad80-a3828654d88b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:02.911495 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ab56-86dd-465e-ad80-a3828654d88b None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:02.912233 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9ab56-86dd-465e-ad80-a3828654d88b None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:02.912542 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9ab56-86dd-465e-ad80-a3828654d88b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:02.913979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9ab56-86dd-465e-ad80-a3828654d88b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:02.926298 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 628/1270] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:50:02.932519 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222aee4-b204-4680-b17c-e4b01ae1cd6e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:02.967691 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:03.047354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222aee4-b204-4680-b17c-e4b01ae1cd6e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:03.088494 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f2ac-70be-4736-b4fb-f457c824b3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:03.089355 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f2ac-70be-4736-b4fb-f457c824b3b0 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:03.089683 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f2ac-70be-4736-b4fb-f457c824b3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:03.090004 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f2ac-70be-4736-b4fb-f457c824b3b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:03.097921 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81f2ac-70be-4736-b4fb-f457c824b3b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:03.099604 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81f2ac-70be-4736-b4fb-f457c824b3b0 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-9c81f2ac-70be-4736-b4fb-f457c824b3b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:50:03.116259 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:03.125748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:03.128191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:50:03.128191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:50:03.128191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:50:03.128191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:50:03.128191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:50:03.128191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:50:03.128191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:50:03.128191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:50:03.128191 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 643/1271] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:50:03.129437 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ab56-86dd-465e-ad80-a3828654d88b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:03.189603 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:03.234770 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ab56-86dd-465e-ad80-a3828654d88b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:03.273418 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9c6ce-b360-412f-81b5-73af399575cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:03.274170 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c6ce-b360-412f-81b5-73af399575cf None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:03.274520 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c6ce-b360-412f-81b5-73af399575cf None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:03.275139 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c6ce-b360-412f-81b5-73af399575cf None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:03.275746 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9c6ce-b360-412f-81b5-73af399575cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:03.276338 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9c6ce-b360-412f-81b5-73af399575cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:03.277610 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9c6ce-b360-412f-81b5-73af399575cf None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:03.291342 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 629/1272] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:50:03.297900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f2ac-70be-4736-b4fb-f457c824b3b0 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:03.415060 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:03.424700 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f2ac-70be-4736-b4fb-f457c824b3b0 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:03.462729 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667b12e-5395-4db3-aecd-8adf94483702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:03.463544 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b12e-5395-4db3-aecd-8adf94483702 None admin] REQUEST_METHOD: `PUT` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:03.463833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b12e-5395-4db3-aecd-8adf94483702 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:03.464116 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b12e-5395-4db3-aecd-8adf94483702 None admin] PATH_INFO: `/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/c082fa1f58db43e391d4da9fc32a767d/roles/480e35452fc547e0a2917bdd5b782f7d` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:03.466149 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667b12e-5395-4db3-aecd-8adf94483702 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf2a8497104277b32b7b1f688ccde8, user_id=c082fa1f58db43e391d4da9fc32a767d, role_id=480e35452fc547e0a2917bdd5b782f7d)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:03.467663 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667b12e-5395-4db3-aecd-8adf94483702 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:03.551407 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 644/1273] 10.222.0.89 () {58 vars in 1439 bytes} [Thu May 19 20:50:03 2022] PUT /identity/v3/projects/f3bf2a8497104277b32b7b1f688ccde8/users/c082fa1f58db43e391d4da9fc32a767d/roles/480e35452fc547e0a2917bdd5b782f7d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:50:06.177697 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3145b-63cd-4791-852f-a33c5772a895 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:06.178333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3145b-63cd-4791-852f-a33c5772a895 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:06.178333 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3145b-63cd-4791-852f-a33c5772a895 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:06.179676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 630/1274] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:50:06.185395 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b195f-4926-452e-a868-36f6fddfaa1d None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:06.185941 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b195f-4926-452e-a868-36f6fddfaa1d None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:06.186047 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b195f-4926-452e-a868-36f6fddfaa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:06.203221 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-d76b195f-4926-452e-a868-36f6fddfaa1d None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:50:06.204474 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-d76b195f-4926-452e-a868-36f6fddfaa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:50:06.276368 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 645/1275] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:50:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:50:06.301153 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3145b-63cd-4791-852f-a33c5772a895 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:06.414271 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3145b-63cd-4791-852f-a33c5772a895 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:06.433076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:06.450965 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821b8ff-6232-4f61-a313-6d3017f7edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:06.451770 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821b8ff-6232-4f61-a313-6d3017f7edd5 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:06.452069 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821b8ff-6232-4f61-a313-6d3017f7edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:06.452342 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821b8ff-6232-4f61-a313-6d3017f7edd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:06.464233 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821b8ff-6232-4f61-a313-6d3017f7edd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-9821b8ff-6232-4f61-a313-6d3017f7edd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:50:06.473327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:06.475283 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:06.476334 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 631/1276] 10.222.0.89 () {56 vars in 1096 bytes} [Thu May 19 20:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:50:06.499294 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b195f-4926-452e-a868-36f6fddfaa1d None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:06.611143 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:06.629351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b195f-4926-452e-a868-36f6fddfaa1d None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:06.668046 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff68f1f-157c-4b3d-8d63-ffbaad49153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:06.668725 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff68f1f-157c-4b3d-8d63-ffbaad49153b None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:06.669011 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff68f1f-157c-4b3d-8d63-ffbaad49153b None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:06.669292 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff68f1f-157c-4b3d-8d63-ffbaad49153b None admin] PATH_INFO: `/v3/roles` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:06.670069 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff68f1f-157c-4b3d-8d63-ffbaad49153b None admin] RBAC: Adding query filter params (name=admin) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:06.670648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff68f1f-157c-4b3d-8d63-ffbaad49153b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:06.672215 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff68f1f-157c-4b3d-8d63-ffbaad49153b None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:06.681349 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 646/1277] 10.222.0.89 () {56 vars in 1099 bytes} [Thu May 19 20:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:50:06.687754 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821b8ff-6232-4f61-a313-6d3017f7edd5 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:06.841538 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821b8ff-6232-4f61-a313-6d3017f7edd5 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:06.879459 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fdc5e-02fe-464b-b042-0e9c641ed04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:06.880817 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fdc5e-02fe-464b-b042-0e9c641ed04f None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:06.881093 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fdc5e-02fe-464b-b042-0e9c641ed04f None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:06.881374 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fdc5e-02fe-464b-b042-0e9c641ed04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:06.893327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fdc5e-02fe-464b-b042-0e9c641ed04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:06.900270 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fdc5e-02fe-464b-b042-0e9c641ed04f None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-e92fdc5e-02fe-464b-b042-0e9c641ed04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:50:06.912896 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:06.914499 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:06.915944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:50:06.915944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:50:06.915944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:50:06.915944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:06.915944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 632/1278] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:50:06.920673 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff68f1f-157c-4b3d-8d63-ffbaad49153b None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:07.031765 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff68f1f-157c-4b3d-8d63-ffbaad49153b None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:07.070509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4592f5-3d0d-4629-b146-1bf477df5f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:07.071228 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4592f5-3d0d-4629-b146-1bf477df5f3e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:07.071512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4592f5-3d0d-4629-b146-1bf477df5f3e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:07.071794 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4592f5-3d0d-4629-b146-1bf477df5f3e None admin] PATH_INFO: `/v3/domains` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:07.072536 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4592f5-3d0d-4629-b146-1bf477df5f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:07.072850 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4592f5-3d0d-4629-b146-1bf477df5f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:07.074230 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4592f5-3d0d-4629-b146-1bf477df5f3e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:07.086992 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 647/1279] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:50:07.092781 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fdc5e-02fe-464b-b042-0e9c641ed04f None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:07.126028 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:07.202691 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fdc5e-02fe-464b-b042-0e9c641ed04f None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:07.238508 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b07268-419c-49ab-ba0c-402674851569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:07.240020 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07268-419c-49ab-ba0c-402674851569 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:07.240308 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07268-419c-49ab-ba0c-402674851569 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:07.240585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07268-419c-49ab-ba0c-402674851569 None admin] PATH_INFO: `/v3/users/placement` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:07.248695 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b07268-419c-49ab-ba0c-402674851569 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:07.250225 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b07268-419c-49ab-ba0c-402674851569 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-05b07268-419c-49ab-ba0c-402674851569 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:50:07.267775 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:07.272621 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:07.274685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:07.274685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:07.274685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:50:07.274685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:50:07.274685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:50:07.274685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:50:07.274685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:50:07.274685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:50:07.274685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:50:07.274685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:07.274685 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 633/1280] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:50:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:50:07.277185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4592f5-3d0d-4629-b146-1bf477df5f3e None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:07.281517 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:07.398931 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4592f5-3d0d-4629-b146-1bf477df5f3e None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:07.441774 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abf53c-8f0b-4420-967e-cacb773defa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:07.442504 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abf53c-8f0b-4420-967e-cacb773defa4 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:07.442826 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abf53c-8f0b-4420-967e-cacb773defa4 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:07.443114 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abf53c-8f0b-4420-967e-cacb773defa4 None admin] PATH_INFO: `/v3/users` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:07.443980 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abf53c-8f0b-4420-967e-cacb773defa4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:07.444338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abf53c-8f0b-4420-967e-cacb773defa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:07.445804 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abf53c-8f0b-4420-967e-cacb773defa4 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:07.465753 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 648/1281] 10.222.0.89 () {56 vars in 1143 bytes} [Thu May 19 20:50:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:50:07.475587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b07268-419c-49ab-ba0c-402674851569 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:07.606347 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:07.616005 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b07268-419c-49ab-ba0c-402674851569 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:07.653125 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b5c6a-4b4d-46e1-bdf2-c7a2d16e66e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:07.653787 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b5c6a-4b4d-46e1-bdf2-c7a2d16e66e9 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:07.654075 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b5c6a-4b4d-46e1-bdf2-c7a2d16e66e9 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:07.654356 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b5c6a-4b4d-46e1-bdf2-c7a2d16e66e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:07.730204 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b5c6a-4b4d-46e1-bdf2-c7a2d16e66e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:07.731627 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b5c6a-4b4d-46e1-bdf2-c7a2d16e66e9 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:07.856541 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:07.868119 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 634/1282] 10.222.0.89 () {58 vars in 1282 bytes} [Thu May 19 20:50:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:50:07.874500 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abf53c-8f0b-4420-967e-cacb773defa4 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:07.943672 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:07.985886 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abf53c-8f0b-4420-967e-cacb773defa4 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:08.023501 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb14c66-fb4a-417b-acc8-5d387a1d0670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:08.024319 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb14c66-fb4a-417b-acc8-5d387a1d0670 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:08.024593 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb14c66-fb4a-417b-acc8-5d387a1d0670 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:08.024864 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb14c66-fb4a-417b-acc8-5d387a1d0670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:08.036506 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb14c66-fb4a-417b-acc8-5d387a1d0670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:08.037985 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb14c66-fb4a-417b-acc8-5d387a1d0670 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-6fb14c66-fb4a-417b-acc8-5d387a1d0670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:50:08.057525 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:08.059686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:08.062351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:50:08.062351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:50:08.062351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:50:08.062351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:50:08.062351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 649/1283] 10.222.0.89 () {56 vars in 1108 bytes} [Thu May 19 20:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:50:08.068720 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b5c6a-4b4d-46e1-bdf2-c7a2d16e66e9 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:08.203714 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b5c6a-4b4d-46e1-bdf2-c7a2d16e66e9 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:08.245985 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d5d44-65b8-40f9-a8ae-bb905b7bdd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:08.246586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d5d44-65b8-40f9-a8ae-bb905b7bdd17 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:08.246902 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d5d44-65b8-40f9-a8ae-bb905b7bdd17 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:08.247180 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d5d44-65b8-40f9-a8ae-bb905b7bdd17 None admin] PATH_INFO: `/v3/domains` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:08.247915 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d5d44-65b8-40f9-a8ae-bb905b7bdd17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:08.248227 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d5d44-65b8-40f9-a8ae-bb905b7bdd17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:08.249617 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d5d44-65b8-40f9-a8ae-bb905b7bdd17 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:08.262707 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 635/1284] 10.222.0.89 () {56 vars in 1109 bytes} [Thu May 19 20:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:50:08.268806 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb14c66-fb4a-417b-acc8-5d387a1d0670 None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:08.389441 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb14c66-fb4a-417b-acc8-5d387a1d0670 None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:08.406229 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:08.437528 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f7a7f-8478-4b80-bdf2-8b1db45d21bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:08.438340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7a7f-8478-4b80-bdf2-8b1db45d21bb None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:08.438647 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7a7f-8478-4b80-bdf2-8b1db45d21bb None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:08.438926 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7a7f-8478-4b80-bdf2-8b1db45d21bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:08.446746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f7a7f-8478-4b80-bdf2-8b1db45d21bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:08.448219 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f7a7f-8478-4b80-bdf2-8b1db45d21bb None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application [None req-342f7a7f-8478-4b80-bdf2-8b1db45d21bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:50:08.463977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application with Lock( May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:08.466057 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:08.468509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:50:08.468509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:50:08.468509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:50:08.468509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:50:08.468509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:50:08.468509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:50:08.468509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:50:08.468509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: ERROR keystone.server.flask.application May 19 20:50:08.468509 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 650/1285] 10.222.0.89 () {56 vars in 1111 bytes} [Thu May 19 20:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:50:08.473224 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d5d44-65b8-40f9-a8ae-bb905b7bdd17 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:08.537753 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:08.594442 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d5d44-65b8-40f9-a8ae-bb905b7bdd17 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:08.632222 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e6354-0190-41f6-ad0b-067fdde74bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:08.632903 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e6354-0190-41f6-ad0b-067fdde74bcd None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:08.633187 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e6354-0190-41f6-ad0b-067fdde74bcd None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:08.633464 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e6354-0190-41f6-ad0b-067fdde74bcd None admin] PATH_INFO: `/v3/projects` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:08.634263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e6354-0190-41f6-ad0b-067fdde74bcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:08.634574 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e6354-0190-41f6-ad0b-067fdde74bcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:08.636161 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e6354-0190-41f6-ad0b-067fdde74bcd None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:08.651456 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 636/1286] 10.222.0.89 () {56 vars in 1148 bytes} [Thu May 19 20:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:50:08.662048 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f7a7f-8478-4b80-bdf2-8b1db45d21bb None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:08.823593 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f7a7f-8478-4b80-bdf2-8b1db45d21bb None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:08.862347 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1d5d5-3e74-489e-b50e-652610c7e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:08.863080 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1d5d5-3e74-489e-b50e-652610c7e9f3 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:08.863366 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1d5d5-3e74-489e-b50e-652610c7e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:08.863645 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1d5d5-3e74-489e-b50e-652610c7e9f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:08.864526 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1d5d5-3e74-489e-b50e-652610c7e9f3 None admin] RBAC: Adding query filter params (role.id=480e35452fc547e0a2917bdd5b782f7d, scope.project.id=f3bf2a8497104277b32b7b1f688ccde8, user.id=c082fa1f58db43e391d4da9fc32a767d) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:08.864846 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1d5d5-3e74-489e-b50e-652610c7e9f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:08.866380 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1d5d5-3e74-489e-b50e-652610c7e9f3 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:08.873865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 651/1287] 10.222.0.89 () {56 vars in 1374 bytes} [Thu May 19 20:50:08 2022] GET /identity/v3/role_assignments?user.id=c082fa1f58db43e391d4da9fc32a767d&scope.project.id=f3bf2a8497104277b32b7b1f688ccde8&role.id=480e35452fc547e0a2917bdd5b782f7d => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:50:11.292207 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6859-fbad-4960-a408-e7dbb244252f None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:11.292790 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6859-fbad-4960-a408-e7dbb244252f None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:11.292960 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6859-fbad-4960-a408-e7dbb244252f None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:11.294376 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 637/1288] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:50:11.300313 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba79d1-5b94-40a9-af35-3b761e1bafca None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:11.300899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba79d1-5b94-40a9-af35-3b761e1bafca None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:11.300899 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba79d1-5b94-40a9-af35-3b761e1bafca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:11.320613 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-dcba79d1-5b94-40a9-af35-3b761e1bafca None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:50:11.321858 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-dcba79d1-5b94-40a9-af35-3b761e1bafca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:50:11.356952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:11.396812 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 652/1289] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:50:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:50:11.419887 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6859-fbad-4960-a408-e7dbb244252f None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:11.539717 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6859-fbad-4960-a408-e7dbb244252f None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:11.551570 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:11.577951 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdfc43-6cd4-4dff-86b1-c07683c669d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:11.578959 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdfc43-6cd4-4dff-86b1-c07683c669d9 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:11.579293 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdfc43-6cd4-4dff-86b1-c07683c669d9 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:11.579618 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdfc43-6cd4-4dff-86b1-c07683c669d9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:11.580337 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdfc43-6cd4-4dff-86b1-c07683c669d9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:11.581783 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdfc43-6cd4-4dff-86b1-c07683c669d9 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-c2fdfc43-6cd4-4dff-86b1-c07683c669d9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:11.597917 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:11.600743 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:11.602286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 638/1290] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:50:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:50:11.607337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba79d1-5b94-40a9-af35-3b761e1bafca None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:11.716035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba79d1-5b94-40a9-af35-3b761e1bafca None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:11.756491 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171410e8-fcc1-4505-9c5c-31acc38d8149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:11.757181 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171410e8-fcc1-4505-9c5c-31acc38d8149 None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:11.757470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171410e8-fcc1-4505-9c5c-31acc38d8149 None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:11.757747 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171410e8-fcc1-4505-9c5c-31acc38d8149 None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:11.758480 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171410e8-fcc1-4505-9c5c-31acc38d8149 None admin] RBAC: Adding query filter params (name=placement) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:11.758825 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171410e8-fcc1-4505-9c5c-31acc38d8149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:11.760215 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171410e8-fcc1-4505-9c5c-31acc38d8149 None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:11.766041 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 653/1291] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:50:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:50:11.772826 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdfc43-6cd4-4dff-86b1-c07683c669d9 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:11.918687 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdfc43-6cd4-4dff-86b1-c07683c669d9 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:11.979694 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242eb8b-8e82-4942-a3c7-a268cb3838e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:11.980863 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242eb8b-8e82-4942-a3c7-a268cb3838e0 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:11.981390 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242eb8b-8e82-4942-a3c7-a268cb3838e0 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:11.981920 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242eb8b-8e82-4942-a3c7-a268cb3838e0 None admin] PATH_INFO: `/v3/services` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:11.983276 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242eb8b-8e82-4942-a3c7-a268cb3838e0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:11.983864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242eb8b-8e82-4942-a3c7-a268cb3838e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:11.986467 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242eb8b-8e82-4942-a3c7-a268cb3838e0 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:11.995241 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 639/1292] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:50:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:50:14.329309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb6846-74da-408d-8545-548357b759dd None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:14.329859 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb6846-74da-408d-8545-548357b759dd None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:14.329859 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb6846-74da-408d-8545-548357b759dd None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:14.331209 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 654/1293] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:50:14.337662 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532627e6-ca8c-4c5b-a709-b4ba5de93a2c None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:14.338252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532627e6-ca8c-4c5b-a709-b4ba5de93a2c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:14.338252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532627e6-ca8c-4c5b-a709-b4ba5de93a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:14.356672 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-532627e6-ca8c-4c5b-a709-b4ba5de93a2c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:50:14.357886 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-532627e6-ca8c-4c5b-a709-b4ba5de93a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:50:14.389643 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:14.437317 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 640/1294] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:50:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:50:14.461269 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb6846-74da-408d-8545-548357b759dd None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:14.495038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:14.571748 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb6846-74da-408d-8545-548357b759dd None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:14.609924 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fa9bb-ae5d-44fd-9eb9-7856b674ee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:14.610484 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fa9bb-ae5d-44fd-9eb9-7856b674ee9d None admin] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:14.610801 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fa9bb-ae5d-44fd-9eb9-7856b674ee9d None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:14.611086 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fa9bb-ae5d-44fd-9eb9-7856b674ee9d None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:14.611831 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fa9bb-ae5d-44fd-9eb9-7856b674ee9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:14.613236 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fa9bb-ae5d-44fd-9eb9-7856b674ee9d None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:14.683686 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 655/1295] 10.222.0.89 () {60 vars in 1141 bytes} [Thu May 19 20:50:14 2022] POST /identity/v3/services => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:50:17.014467 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caef74b-0a06-4adb-9b42-f837a1cc57c3 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:17.015111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caef74b-0a06-4adb-9b42-f837a1cc57c3 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:17.015111 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caef74b-0a06-4adb-9b42-f837a1cc57c3 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:17.016458 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 641/1296] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:50:17.023321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eef0d-215e-45fa-80d0-53eeb5725f76 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:17.024095 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eef0d-215e-45fa-80d0-53eeb5725f76 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:17.025858 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eef0d-215e-45fa-80d0-53eeb5725f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:17.042005 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-8d2eef0d-215e-45fa-80d0-53eeb5725f76 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:50:17.043245 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-8d2eef0d-215e-45fa-80d0-53eeb5725f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:50:17.129296 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 656/1297] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:50:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:50:17.154586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caef74b-0a06-4adb-9b42-f837a1cc57c3 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:17.315889 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caef74b-0a06-4adb-9b42-f837a1cc57c3 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:17.352619 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3cfa6-2e53-4e47-a298-c171c53f443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:17.353429 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3cfa6-2e53-4e47-a298-c171c53f443b None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:17.353739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3cfa6-2e53-4e47-a298-c171c53f443b None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:17.354012 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3cfa6-2e53-4e47-a298-c171c53f443b None admin] PATH_INFO: `/v3/services/placement` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:17.354701 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3cfa6-2e53-4e47-a298-c171c53f443b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:17.356222 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3cfa6-2e53-4e47-a298-c171c53f443b None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-9df3cfa6-2e53-4e47-a298-c171c53f443b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:17.369420 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:17.370979 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:17.372849 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 642/1298] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:50:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:50:17.378212 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2eef0d-215e-45fa-80d0-53eeb5725f76 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:17.399493 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:17.494542 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2eef0d-215e-45fa-80d0-53eeb5725f76 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:17.534041 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4003d45-23d8-43b8-a76b-38415c3eb86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:17.534827 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4003d45-23d8-43b8-a76b-38415c3eb86f None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:17.535215 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4003d45-23d8-43b8-a76b-38415c3eb86f None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:17.535580 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4003d45-23d8-43b8-a76b-38415c3eb86f None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:17.537012 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4003d45-23d8-43b8-a76b-38415c3eb86f None admin] RBAC: Adding query filter params (name=placement) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:17.537369 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4003d45-23d8-43b8-a76b-38415c3eb86f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:17.538885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4003d45-23d8-43b8-a76b-38415c3eb86f None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:17.547225 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 657/1299] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:50:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:50:17.554127 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3cfa6-2e53-4e47-a298-c171c53f443b None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:17.596892 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:17.679987 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3cfa6-2e53-4e47-a298-c171c53f443b None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:17.721245 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669503b6-4556-4d24-bd26-917c0af0263e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:17.722054 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669503b6-4556-4d24-bd26-917c0af0263e None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:17.722341 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669503b6-4556-4d24-bd26-917c0af0263e None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:17.722646 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669503b6-4556-4d24-bd26-917c0af0263e None admin] PATH_INFO: `/v3/endpoints` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:17.723479 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669503b6-4556-4d24-bd26-917c0af0263e None admin] RBAC: Adding query filter params (interface=public, service_id=2eb697ffe11a43408de8b9ae3def3581, region_id=RegionOne) {{(pid=284560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:17.723791 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669503b6-4556-4d24-bd26-917c0af0263e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:17.725184 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669503b6-4556-4d24-bd26-917c0af0263e None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:17.731182 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 643/1300] 10.222.0.89 () {56 vars in 1251 bytes} [Thu May 19 20:50:17 2022] GET /identity/v3/endpoints?service_id=2eb697ffe11a43408de8b9ae3def3581&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:50:17.737323 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4003d45-23d8-43b8-a76b-38415c3eb86f None admin] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:17.832444 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:17.852539 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4003d45-23d8-43b8-a76b-38415c3eb86f None admin] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:17.891295 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc72b3-7986-478e-8f75-4c5692dab11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:17.892066 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc72b3-7986-478e-8f75-4c5692dab11e None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:17.892346 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc72b3-7986-478e-8f75-4c5692dab11e None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:17.892627 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc72b3-7986-478e-8f75-4c5692dab11e None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:17.893327 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc72b3-7986-478e-8f75-4c5692dab11e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:17.894806 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc72b3-7986-478e-8f75-4c5692dab11e None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:17.902946 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 658/1301] 10.222.0.89 () {56 vars in 1087 bytes} [Thu May 19 20:50:17 2022] GET /identity/v3/services => generated 2191 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:50:20.298076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2fca-cd9f-483e-9a76-e840657e5c60 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:20.298741 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2fca-cd9f-483e-9a76-e840657e5c60 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:20.298741 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2fca-cd9f-483e-9a76-e840657e5c60 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:20.300000 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 644/1302] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:50:20.306675 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165f967-f232-43ec-851d-0c24232595e8 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:20.307563 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165f967-f232-43ec-851d-0c24232595e8 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:20.307563 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165f967-f232-43ec-851d-0c24232595e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:20.328662 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-5165f967-f232-43ec-851d-0c24232595e8 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:50:20.329898 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-5165f967-f232-43ec-851d-0c24232595e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:50:20.405947 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 659/1303] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:50:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:50:20.430180 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d2fca-cd9f-483e-9a76-e840657e5c60 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:20.574927 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:20.583237 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d2fca-cd9f-483e-9a76-e840657e5c60 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:20.627430 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f00b26-6c11-4f8f-8ee1-c0a09bdbadd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:20.628811 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00b26-6c11-4f8f-8ee1-c0a09bdbadd9 None admin] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:20.629452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00b26-6c11-4f8f-8ee1-c0a09bdbadd9 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:20.630106 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00b26-6c11-4f8f-8ee1-c0a09bdbadd9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:20.631327 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f00b26-6c11-4f8f-8ee1-c0a09bdbadd9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:20.634010 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f00b26-6c11-4f8f-8ee1-c0a09bdbadd9 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application [None req-88f00b26-6c11-4f8f-8ee1-c0a09bdbadd9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:50:20.648256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:50:20.650513 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application with Lock( May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self._enter() May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application return self.creator() May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application created_value = creator( May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: ERROR keystone.server.flask.application May 19 20:50:20.652497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 645/1304] 10.222.0.89 () {56 vars in 1117 bytes} [Thu May 19 20:50:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:50:20.659896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165f967-f232-43ec-851d-0c24232595e8 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:20.803311 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:20.830817 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165f967-f232-43ec-851d-0c24232595e8 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:20.875638 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9c22b-fd41-4d5b-ac4e-09351dff24fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:20.876321 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9c22b-fd41-4d5b-ac4e-09351dff24fd None admin] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:20.876609 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9c22b-fd41-4d5b-ac4e-09351dff24fd None admin] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:20.876900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9c22b-fd41-4d5b-ac4e-09351dff24fd None admin] PATH_INFO: `/v3/services` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:20.877626 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9c22b-fd41-4d5b-ac4e-09351dff24fd None admin] RBAC: Adding query filter params (name=placement) {{(pid=284561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:50:20.877937 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9c22b-fd41-4d5b-ac4e-09351dff24fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:20.879434 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9c22b-fd41-4d5b-ac4e-09351dff24fd None admin] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:20.885458 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 660/1305] 10.222.0.89 () {56 vars in 1116 bytes} [Thu May 19 20:50:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:50:20.894586 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f00b26-6c11-4f8f-8ee1-c0a09bdbadd9 None admin] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:50:21.003616 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f00b26-6c11-4f8f-8ee1-c0a09bdbadd9 None admin] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:50:21.040594 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bce513-b63c-4443-acd0-4fab47cf9762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7348bece61b448488b3b2cc1f96ba25d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:50:21.041393 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bce513-b63c-4443-acd0-4fab47cf9762 None admin] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:50:21.041748 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bce513-b63c-4443-acd0-4fab47cf9762 None admin] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:50:21.042133 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bce513-b63c-4443-acd0-4fab47cf9762 None admin] PATH_INFO: `/v3/endpoints` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:50:21.043027 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bce513-b63c-4443-acd0-4fab47cf9762 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:50:21.044605 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bce513-b63c-4443-acd0-4fab47cf9762 None admin] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:50:21.147535 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 646/1306] 10.222.0.89 () {60 vars in 1144 bytes} [Thu May 19 20:50:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:50:30.881814 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=30 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:50:31.141359 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:57:45.418117 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d98b-c286-4a18-90e4-64df9c26ed68 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:45.418117 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d98b-c286-4a18-90e4-64df9c26ed68 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:45.418117 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d98b-c286-4a18-90e4-64df9c26ed68 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:45.419530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1bd1-bc92-4e00-80c8-7a2797673de1 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:45.419530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1bd1-bc92-4e00-80c8-7a2797673de1 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:45.419530 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1bd1-bc92-4e00-80c8-7a2797673de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:45.420828 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 661/1307] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:57:45 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:57:45.498676 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-324e1bd1-bc92-4e00-80c8-7a2797673de1 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:57:45.499993 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-324e1bd1-bc92-4e00-80c8-7a2797673de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:45.618564 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 647/1308] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:57:45.691546 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab820b7-f9d1-45fa-ac6c-e438286d3d80 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:45.692228 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab820b7-f9d1-45fa-ac6c-e438286d3d80 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:45.692718 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab820b7-f9d1-45fa-ac6c-e438286d3d80 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:45.694630 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 662/1309] 10.222.0.89 () {54 vars in 964 bytes} [Thu May 19 20:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:57:45.704186 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b50d7-fe81-4e5e-81ad-00bbf7a21164 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:45.704497 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b50d7-fe81-4e5e-81ad-00bbf7a21164 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:45.704754 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b50d7-fe81-4e5e-81ad-00bbf7a21164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:45.809272 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-013b50d7-fe81-4e5e-81ad-00bbf7a21164 None None] MFA Rules not processed for user `68547d17dd4546469230112f91a48764`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:57:45.810585 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-013b50d7-fe81-4e5e-81ad-00bbf7a21164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:45.843810 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:57:45.932287 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 648/1310] 10.222.0.89 () {58 vars in 1061 bytes} [Thu May 19 20:57:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:57:45.941351 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab820b7-f9d1-45fa-ac6c-e438286d3d80 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:57:45.943431 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-6ab820b7-f9d1-45fa-ac6c-e438286d3d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:46.191912 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab820b7-f9d1-45fa-ac6c-e438286d3d80 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:57:46.292146 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502a7cf-4dc2-4916-913f-ca15f1bba8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:57:46.294829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502a7cf-4dc2-4916-913f-ca15f1bba8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:46.294829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502a7cf-4dc2-4916-913f-ca15f1bba8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:46.294829 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502a7cf-4dc2-4916-913f-ca15f1bba8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:46.295850 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-0502a7cf-4dc2-4916-913f-ca15f1bba8e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:46.409518 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:57:46.546185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502a7cf-4dc2-4916-913f-ca15f1bba8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:57:46.547595 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502a7cf-4dc2-4916-913f-ca15f1bba8e8 service neutron] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:57:46.583894 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 663/1311] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:57:49.418928 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a307-5d04-42be-85ff-9d681883995d None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:49.419786 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a307-5d04-42be-85ff-9d681883995d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:49.419786 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a307-5d04-42be-85ff-9d681883995d None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:49.420864 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 649/1312] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:57:49.426664 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b0c47-5349-4bb6-baa9-57ab52aa9d13 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:49.427195 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b0c47-5349-4bb6-baa9-57ab52aa9d13 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:49.427289 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b0c47-5349-4bb6-baa9-57ab52aa9d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:49.534020 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-703b0c47-5349-4bb6-baa9-57ab52aa9d13 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:57:49.535581 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-703b0c47-5349-4bb6-baa9-57ab52aa9d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:49.714789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 664/1313] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:57:49.756911 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362a307-5d04-42be-85ff-9d681883995d None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:57:49.759236 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-8362a307-5d04-42be-85ff-9d681883995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:49.896462 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362a307-5d04-42be-85ff-9d681883995d None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:57:49.979894 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:57:49.982382 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67248e63-2d4e-44c1-a711-675c565e716d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:57:49.983365 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67248e63-2d4e-44c1-a711-675c565e716d service neutron] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:49.983652 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67248e63-2d4e-44c1-a711-675c565e716d service neutron] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:49.983926 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67248e63-2d4e-44c1-a711-675c565e716d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:49.985598 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-67248e63-2d4e-44c1-a711-675c565e716d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:50.117220 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67248e63-2d4e-44c1-a711-675c565e716d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:57:50.118733 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67248e63-2d4e-44c1-a711-675c565e716d service neutron] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:57:50.140616 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 650/1314] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:57:53.070969 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7c1ca-5a19-49e8-9b24-554fbf6b785b None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:53.071493 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7c1ca-5a19-49e8-9b24-554fbf6b785b None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:53.071597 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7c1ca-5a19-49e8-9b24-554fbf6b785b None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:53.072930 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 665/1315] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:57:53.078165 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54260b-3256-42f8-a0a0-a403ee4b1caf None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:53.078595 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54260b-3256-42f8-a0a0-a403ee4b1caf None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:53.078780 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54260b-3256-42f8-a0a0-a403ee4b1caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:53.143133 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-ea54260b-3256-42f8-a0a0-a403ee4b1caf None None] MFA Rules not processed for user `3ed428cb56e14e89a5927b411a660345`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:57:53.144364 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-ea54260b-3256-42f8-a0a0-a403ee4b1caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:53.197837 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:57:53.243315 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 651/1316] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:57:53.283139 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7c1ca-5a19-49e8-9b24-554fbf6b785b None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:57:53.284802 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-f1b7c1ca-5a19-49e8-9b24-554fbf6b785b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:53.295493 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:57:53.395035 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7c1ca-5a19-49e8-9b24-554fbf6b785b None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:57:53.472625 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f4d55-cd55-4bf9-80ae-40442b7342cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:57:53.473474 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f4d55-cd55-4bf9-80ae-40442b7342cb service neutron] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:53.473758 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f4d55-cd55-4bf9-80ae-40442b7342cb service neutron] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:53.474032 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f4d55-cd55-4bf9-80ae-40442b7342cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:53.475875 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-f22f4d55-cd55-4bf9-80ae-40442b7342cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:53.539320 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:57:53.589309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f4d55-cd55-4bf9-80ae-40442b7342cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:57:53.590817 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f4d55-cd55-4bf9-80ae-40442b7342cb service neutron] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:57:53.609134 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 666/1317] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:57:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:57:56.876024 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd248c-3280-49b7-aa1a-459b563cf83e None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:56.876584 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd248c-3280-49b7-aa1a-459b563cf83e None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:56.876708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd248c-3280-49b7-aa1a-459b563cf83e None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:56.877996 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 652/1318] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:57:56.883294 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02c87-9f48-4126-8a40-89f7d125c397 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:56.883736 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02c87-9f48-4126-8a40-89f7d125c397 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:56.883861 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02c87-9f48-4126-8a40-89f7d125c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:56.950600 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-1ef02c87-9f48-4126-8a40-89f7d125c397 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:57:56.951845 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-1ef02c87-9f48-4126-8a40-89f7d125c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:57.048002 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 667/1319] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:57:57.086890 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd248c-3280-49b7-aa1a-459b563cf83e None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:57:57.088432 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-70dd248c-3280-49b7-aa1a-459b563cf83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:57.190943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd248c-3280-49b7-aa1a-459b563cf83e None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:57:57.265057 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed6a6-af38-498f-98ba-f73916977f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:57:57.265703 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed6a6-af38-498f-98ba-f73916977f7f service neutron] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:57:57.265983 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed6a6-af38-498f-98ba-f73916977f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:57:57.266256 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed6a6-af38-498f-98ba-f73916977f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:57:57.267943 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-caaed6a6-af38-498f-98ba-f73916977f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:57:57.276009 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:57:57.376474 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaed6a6-af38-498f-98ba-f73916977f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:57:57.377904 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaed6a6-af38-498f-98ba-f73916977f7f service neutron] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:57:57.396790 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 653/1320] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:57:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:01.052552 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b4a6a-b623-4a28-8cc4-a4b9523db4fc None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:01.053042 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b4a6a-b623-4a28-8cc4-a4b9523db4fc None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:01.053185 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b4a6a-b623-4a28-8cc4-a4b9523db4fc None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:01.054481 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 668/1321] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:01.059980 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bc4bd-b048-4446-8383-61d95c8804ab None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:01.060395 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bc4bd-b048-4446-8383-61d95c8804ab None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:01.060563 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bc4bd-b048-4446-8383-61d95c8804ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:01.126388 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-b42bc4bd-b048-4446-8383-61d95c8804ab None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:01.127643 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-b42bc4bd-b048-4446-8383-61d95c8804ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:01.186208 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:01.225998 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 654/1322] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:01.262472 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b4a6a-b623-4a28-8cc4-a4b9523db4fc None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:01.264213 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-a92b4a6a-b623-4a28-8cc4-a4b9523db4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:01.284519 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:01.373083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b4a6a-b623-4a28-8cc4-a4b9523db4fc None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:01.449584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb47fda-e978-4d1f-917a-06c29b744b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:01.450333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb47fda-e978-4d1f-917a-06c29b744b22 service neutron] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:01.450634 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb47fda-e978-4d1f-917a-06c29b744b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:01.450961 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb47fda-e978-4d1f-917a-06c29b744b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:01.452662 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-9fb47fda-e978-4d1f-917a-06c29b744b22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:01.527825 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:01.568870 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb47fda-e978-4d1f-917a-06c29b744b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:01.570372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb47fda-e978-4d1f-917a-06c29b744b22 service neutron] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:01.589874 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 669/1323] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:03.920537 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249827c-fdc7-46d3-b1df-fcb9b2e9575d None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:03.921151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249827c-fdc7-46d3-b1df-fcb9b2e9575d None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:03.921151 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249827c-fdc7-46d3-b1df-fcb9b2e9575d None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:03.922517 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 655/1324] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:58:03.928099 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11ee57-c07e-48e9-bc31-b35e1d484af1 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:03.928559 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11ee57-c07e-48e9-bc31-b35e1d484af1 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:03.928743 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11ee57-c07e-48e9-bc31-b35e1d484af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:03.997176 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-bd11ee57-c07e-48e9-bc31-b35e1d484af1 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:03.998313 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-bd11ee57-c07e-48e9-bc31-b35e1d484af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:04.099727 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 670/1325] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:04.135944 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249827c-fdc7-46d3-b1df-fcb9b2e9575d None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:04.137541 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-b249827c-fdc7-46d3-b1df-fcb9b2e9575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:04.242897 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249827c-fdc7-46d3-b1df-fcb9b2e9575d None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:04.325952 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344ff9-1d7e-424b-aec9-a7d683fae518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:04.328137 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344ff9-1d7e-424b-aec9-a7d683fae518 service neutron] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:04.328424 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344ff9-1d7e-424b-aec9-a7d683fae518 service neutron] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:04.328706 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344ff9-1d7e-424b-aec9-a7d683fae518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:04.330582 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-a0344ff9-1d7e-424b-aec9-a7d683fae518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:04.349679 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:04.460172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344ff9-1d7e-424b-aec9-a7d683fae518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:04.495826 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344ff9-1d7e-424b-aec9-a7d683fae518 service neutron] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:04.495826 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 656/1326] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:06.810090 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261241e-4a46-4d6c-986a-1ec7747a5b8b None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:06.810723 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261241e-4a46-4d6c-986a-1ec7747a5b8b None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:06.810723 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261241e-4a46-4d6c-986a-1ec7747a5b8b None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:06.812064 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 671/1327] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:06.817583 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7847a1-86e4-4350-838b-72d9f44b7766 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:06.818049 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7847a1-86e4-4350-838b-72d9f44b7766 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:06.818168 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7847a1-86e4-4350-838b-72d9f44b7766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:06.883794 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-0d7847a1-86e4-4350-838b-72d9f44b7766 None None] MFA Rules not processed for user `3ed428cb56e14e89a5927b411a660345`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:06.885011 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-0d7847a1-86e4-4350-838b-72d9f44b7766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:06.950736 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:06.982946 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 657/1328] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:07.034103 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445beca1-f41a-4be8-94eb-4198b5d0848f None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:07.034394 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445beca1-f41a-4be8-94eb-4198b5d0848f None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:07.034842 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445beca1-f41a-4be8-94eb-4198b5d0848f None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:07.036235 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 672/1329] 10.222.0.89 () {54 vars in 964 bytes} [Thu May 19 20:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:07.042190 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc061110-ab3f-4ef0-86e0-fb4a2d04cba8 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:07.042580 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc061110-ab3f-4ef0-86e0-fb4a2d04cba8 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:07.043001 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc061110-ab3f-4ef0-86e0-fb4a2d04cba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:07.118187 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-dc061110-ab3f-4ef0-86e0-fb4a2d04cba8 None None] MFA Rules not processed for user `68547d17dd4546469230112f91a48764`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:07.119430 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-dc061110-ab3f-4ef0-86e0-fb4a2d04cba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:07.195204 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 658/1330] 10.222.0.89 () {58 vars in 1061 bytes} [Thu May 19 20:58:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:07.204345 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445beca1-f41a-4be8-94eb-4198b5d0848f None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:07.205889 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-445beca1-f41a-4be8-94eb-4198b5d0848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:07.236212 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:07.312233 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445beca1-f41a-4be8-94eb-4198b5d0848f None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:07.388765 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521c011-7b1d-499d-9d94-9eb513c76116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:07.389325 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521c011-7b1d-499d-9d94-9eb513c76116 service neutron] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:07.389612 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521c011-7b1d-499d-9d94-9eb513c76116 service neutron] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:07.389893 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521c011-7b1d-499d-9d94-9eb513c76116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:07.391622 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-6521c011-7b1d-499d-9d94-9eb513c76116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:07.470971 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:07.502744 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521c011-7b1d-499d-9d94-9eb513c76116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:07.504195 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521c011-7b1d-499d-9d94-9eb513c76116 service neutron] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:07.523981 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 673/1331] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:10.723459 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa237fd0-627a-43b0-bc85-5259b48acf8f None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:10.724076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa237fd0-627a-43b0-bc85-5259b48acf8f None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:10.724076 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa237fd0-627a-43b0-bc85-5259b48acf8f None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:10.725433 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 659/1332] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:10.731355 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f098b-3f24-40b8-b8ad-7f0bfdfa732c None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:10.731775 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f098b-3f24-40b8-b8ad-7f0bfdfa732c None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:10.731914 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f098b-3f24-40b8-b8ad-7f0bfdfa732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:10.797495 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-a20f098b-3f24-40b8-b8ad-7f0bfdfa732c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:10.798779 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-a20f098b-3f24-40b8-b8ad-7f0bfdfa732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:10.897503 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 674/1333] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:10.933779 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa237fd0-627a-43b0-bc85-5259b48acf8f None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:10.935428 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-aa237fd0-627a-43b0-bc85-5259b48acf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:11.005372 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:11.040207 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa237fd0-627a-43b0-bc85-5259b48acf8f None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:11.116311 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344351c1-60c8-4d40-877d-e387ec20db80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:11.116968 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344351c1-60c8-4d40-877d-e387ec20db80 service neutron] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:11.117767 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344351c1-60c8-4d40-877d-e387ec20db80 service neutron] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:11.118055 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344351c1-60c8-4d40-877d-e387ec20db80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:11.119764 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-344351c1-60c8-4d40-877d-e387ec20db80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:11.229760 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344351c1-60c8-4d40-877d-e387ec20db80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:11.231252 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344351c1-60c8-4d40-877d-e387ec20db80 service neutron] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:11.241409 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:11.250533 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 660/1334] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:13.508647 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479474-363a-4aa0-9005-d2d22f5cfbf6 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:13.509238 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479474-363a-4aa0-9005-d2d22f5cfbf6 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:13.509238 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479474-363a-4aa0-9005-d2d22f5cfbf6 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:13.510738 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 675/1335] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:13.515992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fd2cd-939b-466b-ad24-fff91c9b2d61 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:13.516452 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fd2cd-939b-466b-ad24-fff91c9b2d61 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:13.516566 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fd2cd-939b-466b-ad24-fff91c9b2d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:13.581264 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-705fd2cd-939b-466b-ad24-fff91c9b2d61 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:13.582466 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-705fd2cd-939b-466b-ad24-fff91c9b2d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:13.677658 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 661/1336] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:13.718354 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479474-363a-4aa0-9005-d2d22f5cfbf6 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:13.719952 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-bb479474-363a-4aa0-9005-d2d22f5cfbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:13.764627 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:13.831312 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479474-363a-4aa0-9005-d2d22f5cfbf6 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:13.905463 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cf93e-1370-4dc2-87db-97049065588b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:13.906126 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cf93e-1370-4dc2-87db-97049065588b service neutron] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:13.906414 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cf93e-1370-4dc2-87db-97049065588b service neutron] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:13.906725 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cf93e-1370-4dc2-87db-97049065588b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:13.908410 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-809cf93e-1370-4dc2-87db-97049065588b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:13.994044 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:14.021199 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cf93e-1370-4dc2-87db-97049065588b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:14.022561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cf93e-1370-4dc2-87db-97049065588b service neutron] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:14.041545 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 676/1337] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:17.112035 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebaa2f-57f1-412d-b4bd-89ffaf36516a None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:17.112608 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebaa2f-57f1-412d-b4bd-89ffaf36516a None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:17.112608 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebaa2f-57f1-412d-b4bd-89ffaf36516a None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:17.113998 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 662/1338] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:17.119895 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9a688-1a1f-4616-80b0-a104d4d9cda0 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:17.120338 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9a688-1a1f-4616-80b0-a104d4d9cda0 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:17.120512 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9a688-1a1f-4616-80b0-a104d4d9cda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:17.190427 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-16d9a688-1a1f-4616-80b0-a104d4d9cda0 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:17.191668 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-16d9a688-1a1f-4616-80b0-a104d4d9cda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:17.296325 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 677/1339] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:17.333202 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebaa2f-57f1-412d-b4bd-89ffaf36516a None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:17.335465 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-80ebaa2f-57f1-412d-b4bd-89ffaf36516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:17.417908 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=100 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:17.433610 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebaa2f-57f1-412d-b4bd-89ffaf36516a None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:17.437306 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73fcea-c3d7-4ed2-b458-803afffeb554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:17.438210 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73fcea-c3d7-4ed2-b458-803afffeb554 service neutron] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:17.438491 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73fcea-c3d7-4ed2-b458-803afffeb554 service neutron] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:17.438839 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73fcea-c3d7-4ed2-b458-803afffeb554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:17.448739 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73fcea-c3d7-4ed2-b458-803afffeb554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:17.450163 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73fcea-c3d7-4ed2-b458-803afffeb554 service neutron] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:17.459478 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 663/1340] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:22.453393 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b86b98-5f04-4806-ad7e-f63b35e68bb1 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:22.453938 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b86b98-5f04-4806-ad7e-f63b35e68bb1 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:22.453938 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b86b98-5f04-4806-ad7e-f63b35e68bb1 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:22.455534 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 678/1341] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:22.461478 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d73e8-9acc-4054-a325-081db33cf295 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:22.461983 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d73e8-9acc-4054-a325-081db33cf295 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:22.462109 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d73e8-9acc-4054-a325-081db33cf295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:22.493116 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-c10d73e8-9acc-4054-a325-081db33cf295 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:22.494277 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-c10d73e8-9acc-4054-a325-081db33cf295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:22.574507 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 664/1342] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:22.613789 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b86b98-5f04-4806-ad7e-f63b35e68bb1 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:22.624752 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b86b98-5f04-4806-ad7e-f63b35e68bb1 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:22.628454 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f674e-47e5-458a-b124-328a8c2b6386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:22.629083 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f674e-47e5-458a-b124-328a8c2b6386 service neutron] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:22.629371 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f674e-47e5-458a-b124-328a8c2b6386 service neutron] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:22.629648 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f674e-47e5-458a-b124-328a8c2b6386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:22.639378 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f674e-47e5-458a-b124-328a8c2b6386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:22.640817 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f674e-47e5-458a-b124-328a8c2b6386 service neutron] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:22.651676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 679/1343] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:26.010447 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a29e35-c8e7-4e4b-bc90-e03424d6b510 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:26.011037 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a29e35-c8e7-4e4b-bc90-e03424d6b510 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:26.011037 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a29e35-c8e7-4e4b-bc90-e03424d6b510 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:26.012445 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 665/1344] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:26.017994 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612d852-33fe-4952-b413-3fa3c28c6b6c None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:26.018447 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612d852-33fe-4952-b413-3fa3c28c6b6c None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:26.018551 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612d852-33fe-4952-b413-3fa3c28c6b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:26.036602 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-5612d852-33fe-4952-b413-3fa3c28c6b6c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:26.037824 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-5612d852-33fe-4952-b413-3fa3c28c6b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:26.046105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 680/1345] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:26.084255 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a29e35-c8e7-4e4b-bc90-e03424d6b510 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:26.095113 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a29e35-c8e7-4e4b-bc90-e03424d6b510 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:26.098708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59242054-4f16-4403-9965-59d281efb681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:26.099344 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242054-4f16-4403-9965-59d281efb681 service neutron] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:26.099628 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242054-4f16-4403-9965-59d281efb681 service neutron] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:26.099907 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242054-4f16-4403-9965-59d281efb681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:26.108990 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59242054-4f16-4403-9965-59d281efb681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:26.110415 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59242054-4f16-4403-9965-59d281efb681 service neutron] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:26.120397 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 666/1346] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:30.799340 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fb026-a9cb-43f5-9922-631552fd7fa8 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:30.799907 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fb026-a9cb-43f5-9922-631552fd7fa8 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:30.799907 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fb026-a9cb-43f5-9922-631552fd7fa8 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:30.801290 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 681/1347] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:30.806758 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4a58f-091a-4deb-bbb4-8ea743cc947e None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:30.807221 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4a58f-091a-4deb-bbb4-8ea743cc947e None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:30.807389 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4a58f-091a-4deb-bbb4-8ea743cc947e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:30.826263 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-53f4a58f-091a-4deb-bbb4-8ea743cc947e None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:30.827509 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-53f4a58f-091a-4deb-bbb4-8ea743cc947e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:30.835412 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 667/1348] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:30.873496 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fb026-a9cb-43f5-9922-631552fd7fa8 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:30.875333 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-286fb026-a9cb-43f5-9922-631552fd7fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:30.890682 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fb026-a9cb-43f5-9922-631552fd7fa8 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:30.894833 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892dd04-d399-4433-bd3c-e5ab3f8d7769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68547d17dd4546469230112f91a48764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:30.895584 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892dd04-d399-4433-bd3c-e5ab3f8d7769 service neutron] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:30.895870 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892dd04-d399-4433-bd3c-e5ab3f8d7769 service neutron] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:30.896171 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892dd04-d399-4433-bd3c-e5ab3f8d7769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:30.907460 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892dd04-d399-4433-bd3c-e5ab3f8d7769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:30.908965 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892dd04-d399-4433-bd3c-e5ab3f8d7769 service neutron] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:30.919961 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 682/1349] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:36.656286 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd64fa-03d8-4171-b697-6f178d49b31c None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:36.656789 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd64fa-03d8-4171-b697-6f178d49b31c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:36.656983 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd64fa-03d8-4171-b697-6f178d49b31c None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:36.658508 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 668/1350] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 20:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:36.663918 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013014-d36c-4217-a442-ccd9ac28dd64 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:36.665199 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013014-d36c-4217-a442-ccd9ac28dd64 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:36.665372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013014-d36c-4217-a442-ccd9ac28dd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:36.682926 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:36.749885 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-28013014-d36c-4217-a442-ccd9ac28dd64 None None] MFA Rules not processed for user `c082fa1f58db43e391d4da9fc32a767d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:36.751623 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-28013014-d36c-4217-a442-ccd9ac28dd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:36.861594 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 683/1351] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:40.821577 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=57 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:41.689913 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010f54a-3968-4150-9151-11516a70c98b None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:41.690501 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010f54a-3968-4150-9151-11516a70c98b None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:41.690854 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010f54a-3968-4150-9151-11516a70c98b None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:41.692201 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 669/1352] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 20:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:41.698495 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96748951-a4aa-4460-9e4a-3af13d406038 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:41.699392 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96748951-a4aa-4460-9e4a-3af13d406038 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:41.699896 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96748951-a4aa-4460-9e4a-3af13d406038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:41.719801 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-96748951-a4aa-4460-9e4a-3af13d406038 None None] MFA Rules not processed for user `c082fa1f58db43e391d4da9fc32a767d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:41.721383 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-96748951-a4aa-4460-9e4a-3af13d406038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:41.747746 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 684/1353] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:43.076937 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f670e-f69c-4a27-870e-bacee3ae4b45 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:43.077552 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f670e-f69c-4a27-870e-bacee3ae4b45 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:43.077552 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f670e-f69c-4a27-870e-bacee3ae4b45 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:43.079150 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 670/1354] 10.222.0.89 () {54 vars in 921 bytes} [Thu May 19 20:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:43.084412 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0726e8f-5a18-4ea2-970c-4aa1918bedee None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:43.084945 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0726e8f-5a18-4ea2-970c-4aa1918bedee None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:43.085101 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0726e8f-5a18-4ea2-970c-4aa1918bedee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:43.105241 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-c0726e8f-5a18-4ea2-970c-4aa1918bedee None None] MFA Rules not processed for user `c082fa1f58db43e391d4da9fc32a767d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:43.106465 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-c0726e8f-5a18-4ea2-970c-4aa1918bedee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:43.116336 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 685/1355] 10.222.0.89 () {58 vars in 1018 bytes} [Thu May 19 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:47.063738 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e73ff-366a-4bbc-8365-688814666d16 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:47.064271 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e73ff-366a-4bbc-8365-688814666d16 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:47.064271 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e73ff-366a-4bbc-8365-688814666d16 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:47.065821 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 671/1356] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:47.072062 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3d62b-da11-4f81-9e7f-f8adb0de7fff None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:47.072969 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3d62b-da11-4f81-9e7f-f8adb0de7fff None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:47.073553 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3d62b-da11-4f81-9e7f-f8adb0de7fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:47.093038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-d2d3d62b-da11-4f81-9e7f-f8adb0de7fff None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:47.094625 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-d2d3d62b-da11-4f81-9e7f-f8adb0de7fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:47.105165 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 686/1357] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:47.165678 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4888b88-ca68-4dfa-b02b-eea618719c59 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:47.165992 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4888b88-ca68-4dfa-b02b-eea618719c59 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:47.166282 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4888b88-ca68-4dfa-b02b-eea618719c59 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:47.168410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 672/1358] 10.222.0.89 () {54 vars in 961 bytes} [Thu May 19 20:58:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:47.181287 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023432f-eced-4474-a0bd-ad8e9d8ed57a None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:47.181807 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023432f-eced-4474-a0bd-ad8e9d8ed57a None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:47.182449 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023432f-eced-4474-a0bd-ad8e9d8ed57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:47.239855 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-a023432f-eced-4474-a0bd-ad8e9d8ed57a None None] MFA Rules not processed for user `7a36f250f3d04faab08146d937ef840e`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:47.241075 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-a023432f-eced-4474-a0bd-ad8e9d8ed57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:47.311682 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=100 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:58:47.336275 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 687/1359] 10.222.0.89 () {58 vars in 1058 bytes} [Thu May 19 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:47.344382 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4888b88-ca68-4dfa-b02b-eea618719c59 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:47.360647 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4888b88-ca68-4dfa-b02b-eea618719c59 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:47.368699 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0bf0a-cc55-449d-b0dc-a9b832d5a221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a36f250f3d04faab08146d937ef840e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:47.369673 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0bf0a-cc55-449d-b0dc-a9b832d5a221 service nova] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:47.370172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0bf0a-cc55-449d-b0dc-a9b832d5a221 service nova] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:47.370834 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0bf0a-cc55-449d-b0dc-a9b832d5a221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:47.382734 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0bf0a-cc55-449d-b0dc-a9b832d5a221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:47.384735 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0bf0a-cc55-449d-b0dc-a9b832d5a221 service nova] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:47.396248 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 673/1360] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:49.879466 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aac4ea-fe03-49d2-ad81-d3ee4f751785 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:49.880085 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aac4ea-fe03-49d2-ad81-d3ee4f751785 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:49.880085 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aac4ea-fe03-49d2-ad81-d3ee4f751785 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:49.881470 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 688/1361] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:49.888051 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76f47d-d8df-42ad-ab1e-6123b5f3ce14 None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:49.888587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76f47d-d8df-42ad-ab1e-6123b5f3ce14 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:49.888587 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76f47d-d8df-42ad-ab1e-6123b5f3ce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:49.909454 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-6c76f47d-d8df-42ad-ab1e-6123b5f3ce14 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:49.910708 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-6c76f47d-d8df-42ad-ab1e-6123b5f3ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:49.918839 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 674/1362] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:49.965676 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aac4ea-fe03-49d2-ad81-d3ee4f751785 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:49.983724 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aac4ea-fe03-49d2-ad81-d3ee4f751785 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:49.989893 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5d8da-1852-4cae-823b-46a551a91096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a36f250f3d04faab08146d937ef840e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:49.990513 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d8da-1852-4cae-823b-46a551a91096 service nova] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:49.990834 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d8da-1852-4cae-823b-46a551a91096 service nova] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:49.991119 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d8da-1852-4cae-823b-46a551a91096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:50.001108 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5d8da-1852-4cae-823b-46a551a91096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:50.002862 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5d8da-1852-4cae-823b-46a551a91096 service nova] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:50.015211 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 689/1363] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:52.945571 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87bb70-bcb6-4897-84a0-5cde460eb21c None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:52.946525 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87bb70-bcb6-4897-84a0-5cde460eb21c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:52.947132 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87bb70-bcb6-4897-84a0-5cde460eb21c None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:52.948550 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 675/1364] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:58:52.955295 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d3ab8-58b6-4730-bb36-bf95821ac779 None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:52.956106 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d3ab8-58b6-4730-bb36-bf95821ac779 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:52.956106 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d3ab8-58b6-4730-bb36-bf95821ac779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:52.978669 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-f89d3ab8-58b6-4730-bb36-bf95821ac779 None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:52.980391 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-f89d3ab8-58b6-4730-bb36-bf95821ac779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:52.989309 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 690/1365] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:58:53.048158 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b6f2-869b-4992-9347-da11a37b1496 None None] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:53.049398 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b6f2-869b-4992-9347-da11a37b1496 None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:53.050963 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b6f2-869b-4992-9347-da11a37b1496 None None] PATH_INFO: `/` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:53.052485 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 676/1366] 10.222.0.89 () {54 vars in 961 bytes} [Thu May 19 20:58:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:53.059324 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527cdb-2411-420b-9e46-d6cae09894cb None None] REQUEST_METHOD: `POST` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:53.061105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527cdb-2411-420b-9e46-d6cae09894cb None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:53.061105 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527cdb-2411-420b-9e46-d6cae09894cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:53.080996 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.auth.core [None req-c5527cdb-2411-420b-9e46-d6cae09894cb None None] MFA Rules not processed for user `7a36f250f3d04faab08146d937ef840e`. Rule list: `[]` (Enabled: `True`). {{(pid=284561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:53.082214 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.fernet_utils [None req-c5527cdb-2411-420b-9e46-d6cae09894cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:53.094986 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 691/1367] 10.222.0.89 () {58 vars in 1058 bytes} [Thu May 19 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:53.102735 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309b6f2-869b-4992-9347-da11a37b1496 None None] Authenticating user token {{(pid=284560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:53.119132 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309b6f2-869b-4992-9347-da11a37b1496 None None] Validating token access rules against request {{(pid=284560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:53.125357 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7c053-7502-4422-ae9c-b061698b1434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a36f250f3d04faab08146d937ef840e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:53.126166 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7c053-7502-4422-ae9c-b061698b1434 service nova] REQUEST_METHOD: `GET` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:53.126555 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7c053-7502-4422-ae9c-b061698b1434 service nova] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:53.126958 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7c053-7502-4422-ae9c-b061698b1434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:53.137043 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7c053-7502-4422-ae9c-b061698b1434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:53.138977 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7c053-7502-4422-ae9c-b061698b1434 service nova] RBAC: Authorization granted {{(pid=284560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:53.150340 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 677/1368] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:58:53.909900 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83ea9d-4fe6-4105-b851-420a79ed0150 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:53.910179 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83ea9d-4fe6-4105-b851-420a79ed0150 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:53.910463 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83ea9d-4fe6-4105-b851-420a79ed0150 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:53.912038 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 692/1369] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:53.917797 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebb5a5-18b5-4835-933f-9c6456fd1b8c None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:53.918090 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebb5a5-18b5-4835-933f-9c6456fd1b8c None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:53.918366 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebb5a5-18b5-4835-933f-9c6456fd1b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:53.936905 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-d2ebb5a5-18b5-4835-933f-9c6456fd1b8c None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:53.938367 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-d2ebb5a5-18b5-4835-933f-9c6456fd1b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:53.947349 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 678/1370] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:55.706372 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224acfe-bccd-4b39-b14a-2f5051431ec9 None None] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:55.706977 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224acfe-bccd-4b39-b14a-2f5051431ec9 None None] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:55.707117 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224acfe-bccd-4b39-b14a-2f5051431ec9 None None] PATH_INFO: `/` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:55.708408 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 693/1371] 10.222.0.89 () {54 vars in 926 bytes} [Thu May 19 20:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:58:55.714435 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa4ed-1671-4b7f-9b08-6309a05ffdec None None] REQUEST_METHOD: `POST` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:55.715016 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa4ed-1671-4b7f-9b08-6309a05ffdec None None] SCRIPT_NAME: `/identity` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:55.715016 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa4ed-1671-4b7f-9b08-6309a05ffdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=284560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:55.733410 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.auth.core [None req-f17fa4ed-1671-4b7f-9b08-6309a05ffdec None None] MFA Rules not processed for user `7348bece61b448488b3b2cc1f96ba25d`. Rule list: `[]` (Enabled: `True`). {{(pid=284560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:58:55.734624 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG keystone.common.fernet_utils [None req-f17fa4ed-1671-4b7f-9b08-6309a05ffdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=284560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:58:55.743226 dv-cinder-841302-4-smb devstack@keystone.service[284560]: [pid: 284560|app: 0|req: 679/1372] 10.222.0.89 () {58 vars in 1023 bytes} [Thu May 19 20:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:58:55.787561 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224acfe-bccd-4b39-b14a-2f5051431ec9 None None] Authenticating user token {{(pid=284561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:58:55.802337 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224acfe-bccd-4b39-b14a-2f5051431ec9 None None] Validating token access rules against request {{(pid=284561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:58:55.808028 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc5f3b-0dc1-4d93-959c-239911e467e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a36f250f3d04faab08146d937ef840e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3bf2a8497104277b32b7b1f688ccde8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=284561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:58:55.808684 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc5f3b-0dc1-4d93-959c-239911e467e0 service nova] REQUEST_METHOD: `GET` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:58:55.808964 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc5f3b-0dc1-4d93-959c-239911e467e0 service nova] SCRIPT_NAME: `/identity` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:58:55.809356 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc5f3b-0dc1-4d93-959c-239911e467e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=284561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:58:55.819570 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc5f3b-0dc1-4d93-959c-239911e467e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:58:55.821740 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc5f3b-0dc1-4d93-959c-239911e467e0 service nova] RBAC: Authorization granted {{(pid=284561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:58:55.832049 dv-cinder-841302-4-smb devstack@keystone.service[284561]: [pid: 284561|app: 0|req: 694/1373] 10.222.0.89 () {60 vars in 1365 bytes} [Thu May 19 20:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:59:05.728172 dv-cinder-841302-4-smb devstack@keystone.service[284560]: DEBUG dbcounter [-] [284560] Writing DB stats keystone:SELECT=21 {{(pid=284560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:59:05.827381 dv-cinder-841302-4-smb devstack@keystone.service[284561]: DEBUG dbcounter [-] [284561] Writing DB stats keystone:SELECT=23 {{(pid=284561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:59:25.495587 dv-cinder-841302-4-smb systemd[1]: Stopping Devstack devstack@keystone.service... May 19 20:59:25.495804 dv-cinder-841302-4-smb devstack@keystone.service[284547]: Thu May 19 20:59:25 2022 - graceful shutdown triggered... May 19 20:59:25.496402 dv-cinder-841302-4-smb devstack@keystone.service[284560]: Gracefully killing worker 1 (pid: 284560)... May 19 20:59:25.496865 dv-cinder-841302-4-smb devstack@keystone.service[284561]: Gracefully killing worker 2 (pid: 284561)... May 19 20:59:26.496906 dv-cinder-841302-4-smb devstack@keystone.service[284547]: worker 1 buried after 1 seconds May 19 20:59:26.496906 dv-cinder-841302-4-smb devstack@keystone.service[284547]: worker 2 buried after 1 seconds May 19 20:59:26.496906 dv-cinder-841302-4-smb devstack@keystone.service[284547]: goodbye to uWSGI. May 19 20:59:26.498501 dv-cinder-841302-4-smb systemd[1]: devstack@keystone.service: Succeeded. May 19 20:59:26.499581 dv-cinder-841302-4-smb systemd[1]: Stopped Devstack devstack@keystone.service.